🎉 Excited to introduce TRON, a relighting framework for 3D captures.
💡TRON pairs a neural renderer with 3D Gaussian reconstructions, achieving realistic quality, with 3D, material, & lighting control at interactive frame rates.
arxiv.org/abs/2606.11314
research.nvidia.com/labs/sil/proje…
Joined March 2018
- 1/9 Excited to share SpectralSplats! 📢 Given a 3DGS asset + target video, we deform it to match the video via differentiable rendering. Appearance-based tracking fails when the initial pose is even slightly off. Our spectral loss stays robust. 🔗 avigailco.github.io/SpectralSplats 🧵
- 🚗📡Radar is the unsung hero of AV perception: widespread in cars, yet overlooked in simulation. Introducing RadarGen: Realistic radar synthesis from cameras using diffusion. Massive kudos to my fantastic team at @TechnionLive and @NVIDIAAI radargen.github.io
- 📢 New paper: FlowBender. Conditional generators drift from their own conditioning. The usual fix: tune guidance & pray 🙏 💡We train them to self-correct from their own error +4.5 dB on 3D texturing, +4.9 dB on SR. Give it a spin and bend away👇 flow-bender.github.ioConditional diffusion/flow models often produce outputs inconsistent with the very signal conditioning them. The error is easily measurable, yet models are never trained to act on it. In FlowBender (now on arXiv), we train the model to correct its own errors. 🧵
- Excited to share our new paper: VideoMDM 📢 We propose a principled framework for training 3D motion diffusion models (e.g. MDM), using only 2D supervision from monocular videos -- no 3D ground truth required. Project: videomdm.github.io Paper: arxiv.org/abs/2606.13364 🧵



