1 / 30

Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs

This research paper explores the problem of recovering reflectance properties of real scenes from photographs, specifically focusing on the global illumination and geometry aspects. The paper presents a novel approach to recovering reflectance properties by varying viewpoint and lighting conditions, and discusses the application of this technique in rendering non-diffuse scenes.

bburgess
Download Presentation

Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Inverse Global Illumination:Recovering Reflectance Models of Real Scenes from Photographs Computer Science Division University of California at Berkeley Yizhou Yu, Paul Debevec, Jitendra Malik & Tim Hawkins

  2. Image-based Modeling and Rendering • 1st Generation---- vary viewpoint but not lighting • Recover geometry ( explicit or implicit ) • Acquire photographs • Facade, Plenoptic Modeling, View Morphing, Lumigraph, Layered Depth Images, (Light Field Rendering) etc.

  3. Image-based Modeling and Rendering • Photographs arenot Reflectance Maps ! • 2nd Generation---- vary viewpoint and lighting for non-diffuse scenes • Recover geometry • Recover reflectance properties • Render using light transport simulation Illumination Radiance Reflectance

  4. Previous Work • BRDF Measurement in the Laboratory • [ Ward 92 ], [Dana, Ginneken, Nayar & Koenderink 97] • Isolated Objects under Direct Illumination • [ Sato, Wheeler & Ikeuchi 97 ] • Isolated Objects under General Illumination • [ Yu & Malik 98], [ Debevec 98]

  5. The Problem • General case of multiple objects under mutual illumination has not been studied.

  6. Global Illumination Reflectance Properties Radiance Images Geometry Illumination

  7. Inverse Global Illumination Reflectance Properties Radiance Images Geometry Illumination

  8. Input Radiance Images [ Debevec & Malik 97] http://www.cs.berkeley.edu/~debevec/HDR

  9. In Detail ...

  10. Geometry and Camera Positions

  11. Light Sources

  12. Synthesized Images Original Lighting Novel Lighting

  13. Outline • Diffuse surfaces under mutual illumination • Non-diffuse surfaces under direct illumination • Non-diffuse surfaces under mutual illumination

  14. Source Target Lambertian Surfaces under Mutual Illumination • Bi, Bj, Ei measured • Form-factor Fij known • Solve for diffuse albedo

  15. Parametric BRDF Model [ Ward 92 ] N H Isotropic Kernel ( 3 parameters) Anisotropic Kernel ( 5 parameters)

  16. Non-diffuse Surfaces underDirect Illumination N P2 H P1 P2 P1

  17. Non-diffuse Surfaces under Mutual Illumination • LPiAj is not known. ( unlike diffuse case, where LPiAj = LCkAj ) Source Aj LPiAj LCkAj Pi Target LCvPi Ck Cv

  18. Solution: iteratively estimate specular component. • Initialize • Repeat • Estimate BRDF parameters for each surface • Update and

  19. Estimation of Specular Difference S • Estimate specular component of by Monte Carlo ray-tracing using current guess of reflectance parameters. • Similarly for • Difference gives S Aj LPiAj LPiAj Pi LCkAj Ck LCkAj LCvPi Cv

  20. Recovering Diffuse Albedo Maps • Specular properties assumed uniform across each surface, but diffuse albedo allowed to vary.

  21. Results • A simulated cubical room

  22. Results for the Simulated Case Diffuse Albedo Specular Roughness

  23. Results • A real conference room

  24. Real vs. Synthetic for Original Lighting Real Synthetic

  25. Diffuse Albedo Maps of Identical Posters in Different Positions Poster A Poster B Poster C

  26. Inverting Color Bleed Input Photograph Output Albedo Map

  27. Real vs. Synthetic for Novel Lighting Real Synthetic

  28. Video

  29. Acknowledgments • Thanks to David Culler and the Berkeley NOW project, Tal Garfinkel, Gregory Ward Larson, Carlo Sequin. • Supported by ONR BMDO, the California MICRO program, Philips Corporation, Interval Research Corporation and Microsoft Graduate Fellowship.

  30. Conclusions • A digital camera can undertake all the data acquisition tasks involved. • Both specular and high resolution diffuse reflectance properties can be recovered from photographs. • Reflectance recovery can re-render non-diffuse real scenes under novel illumination as well as from novel viewpoints.

More Related