Understanding The Limits Of Neural Rendering For 3D Reconstruction