NeRF & DreamFusion

Neural Radiance Fields

NeRF

From a diffusion model we can generate several images of a scene or object from different views -> NeRF -> 3D model

Getting Started with NVIDIA Instant NeRFs | NVIDIA Technical BlogNVIDIA Technical Blog

DreamFusion

DreamFusion uses StableDiffusion to generate several images of the same object/scene/person from different points of view. These pictures are passed to a NeRF model to generate a a 3D object

DreamFusion: Text-to-3D using 2D DiffusionDreamFusion: Text-to-3D using 2D Diffusion

Research paper explanation