Presentation

· Contributors · Organizations · Search Program

IntrinsicDiffusion: Joint Intrinsic Layers From Latent Diffusion Models

SessionLighting and Matting With Image Generation

DescriptionEstimating intrinsic images, such as albedo, shading, and normals, is challenging. We propose leveraging the implicit priors learned by the large-scale generation model. Our novel conditioning mechanism allows predicting multiple intrinsic modalities jointly and training with mixed datasets that only have partial annotations. It achieves state-of-the-art performance qualitatively and quantitatively.

Authors