TY  - JOUR
TI  - DifFRelight: Diffusion-Based Facial Performance Relighting
PY  - 2024
DA  - 2024/12//
JO  - Eyeline Studios (Netflix)
AB  - DifFRelight, presented at SIGGRAPH Asia 2024 by Netflix's Eyeline Studios, introduces a diffusion-based system for relighting facial performance captures from any viewpoint without on-set lighting rigs for each required condition. The approach combines a subject-specific diffusion model with dynamic 3D Gaussian splatting to reconstruct the subject, then applies learned relighting. The result reproduces physically accurate lighting phenomena -- eye reflections, subsurface scattering, self-shadowing -- that previously required manual VFX. This represents a paradigm shift in the digital-human capture pipeline that educators teaching facial performance and visual effects need to understand as it enters production practice.
KW  - generative-ai
KW  - vfx-production
KW  - character-animation
KW  - production-practice
UR  - https://www.eyelinestudios.com/research/diffrelight.html
LA  - en
ER  -