Physically Controllable Relighting of Photographs

Researchers have developed a new method for relighting photographs that combines traditional 3D rendering with neural rendering. This technique allows users to explicitly control light sources in real-world images with high physical accuracy.
Why it matters
This advancement bridges the gap between professional 3D graphics tools and everyday photography, enabling more sophisticated image editing.
We present a photograph relighting method that enables explicit control over light sources akin to CG pipelines. Users can insert different types of light sources, such as spot lights, point lights, or environmental illumination into the scene. We achieve this in a pipeline involving mid-level computer vision, physically-based rendering, and neural rendering. We introduce a self-supervised training methodology using differentiable rendering to train our neural renderer with real-world photograph collections for in-the-wild generalization.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in