Meta Reality Labs is looking for research interns! ✨
If you're excited about building world models for AR/VR and immersive experiences, come join us. 🙌
Roles available across Europe (I’m based in Zurich 🇨🇭) and the US.
You can DM me or find me at #ICCV to chat. 🙂
@AIatMeta
It’s online! 😁 We 3D reconstruct both humans and environments from TV shows in our #ECCV2022 paper with Georgios Pavlakos*, Matthew Tancik, and Prof. Angjoo Kanazawa @akanazawa. Such a fun project and incredible team to be part of. 🙂 ethanweber.me/sitcoms3D/
Why can humans perceive 3D from drawings yet SfM tools fail? We investigate this with Toon3D! toon3d.studio
Riley (@cardiacmangoes) and I led this project together with amazing co-authors Rohan Mathur, @FrederikWarburg, Alexei A. Efros, and @akanazawa! 🙂
We added some buttons on the top of the Toon3D Labeler labeler.toon3d.studio so you can explore the Toon3D Dataset toon3d.studio. Beyond 3D reconstruction of hand-drawn cartoons, I think this dataset might be useful as a benchmark for 2D correspondence methods.
Excited to share our #CoRL2025 paper: Eye, Robot: Learning to Look to Act 👀🤖
360° teleop data (Insta360) 🎥 → high-speed robotic eyeball 👁️
The robot learns where to look in order to act using a BC-RL perception-action loop. w/ @justkerrding + team 📎 eyerobot.net
Should robots have eyeballs? Human eyes move constantly and use variable resolution to actively gather visual details. In EyeRobot (eyerobot.net) we train a robot eyeball entirely with RL: eye movements emerge from experience driven by task-driven rewards.
For Toon3D (toon3d.studio), we made a labeler to make it easy to label points across many images. It visualizes depth and SAM masks too. The tool is online at labeler.toon3d.studio with docs at github.com/ethanweber/too…. Please reach out if you have any questions! 😄
After a long time in the making, it’s finally live! It’s been so fun building this with the @nerfstudioteam, and we can’t wait for what’s next. Reach out if you are curious for our future plans. 🥳
Releasing 🌟nerfstudio🌟, a plug-and-play python library to easily create your own NeRFs!
@nerfstudioteam is a contributor friendly open-source repo with a realtime web viewer that makes it easy to make cool videos 📽️
github.com/nerfstudio-pro…docs.nerf.studio#nerfstudio 1/
I'm looking forward to presenting NeRFiller at CVPR on Friday morning!
Also! 😁 I'll be looking for full-time opportunities starting next spring/summer, and I'll be around all week to connect with folks! Feel free to ping me if you want to chat. ethanweber.me 🙌
NeRFiller: Completing Scenes via Generative 3D Inpainting
paper page: huggingface.co/papers/2312.04…
propose NeRFiller, an approach that completes missing portions of a 3D capture via generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a captured
We ran DUSt3R on our cartoon reconstruction setting and found that it struggles (even with ground truth correspondences)! Our proposed work is designed to handle this challenging setting where input images are hand-drawn and non-geometrically consistent. toon3d.studio
Why can humans perceive 3D from drawings yet SfM tools fail? We investigate this with Toon3D! toon3d.studio
Riley (@cardiacmangoes) and I led this project together with amazing co-authors Rohan Mathur, @FrederikWarburg, Alexei A. Efros, and @akanazawa! 🙂
🎉 V1.0.0 officially released!
* New splatfacto model, nerfstudio's implementation of Gaussian splatting
* Complete rewrite of the viewer, now built entirely on viser
I’m especially excited about an interactive graph we’re building for the community. Our goal is to spark discussion and encourage works in the upper right — where we have abundant input views but still need to generate significant missing content. 🙂
scenecomp.github.io/tasks.html
