Transcription of ffirstname.lastnameg@tue.mpg.de arXiv:2011.12100v2 [cs.CV ...
{{id}} {{{paragraph}}}
Example: air traffic controller
ffirstname.lastnameg@tue.mpg.de arXiv:2011.12100v2 [cs.CV ...
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature FieldsMichael Niemeyer1,2 Andreas Geiger1,21 Max Planck Institute for Intelligent Systems, T ubingen2 University of T generative models allow for photorealistic imagesynthesis at high resolutions. But for many applications,this is not enough: content creation also needs to be con-trollable. While several recent works investigate how to dis-entangle underlying factors of variation in the data, mostof them operate in 2D and hence ignore that our worldis three-dimensional. Further, only few works considerthe compositional nature of scenes. Our key hypothesis isthat incorporating a compositional 3D scene representationinto the generative model leads to more controllable imagesynthesis. Representing scenes as compositional genera-tive neural feature fields allows us to disentangle one ormultiple objects from the background as well as individualobjects shapes and appearances while learning from un-structured and unposed image collections without any ad-ditional supervision.
works [50,51,66,81,92] propose differentiable rendering techniques. Mildenhall et al. [61] propose Neural Radiance Fields (NeRFs) in which they combine an implicit neural model with volume rendering for novel view synthesis of complex scenes. Due to their expressiveness, we use a generative variant of NeRFs as our object-level represen-tation.
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: