Kfir Aberman (@AbermanKfir) / X

Kfir Aberman

314 posts

Kfir Aberman

@AbermanKfir

Palo Alto, CA

kfiraberman.github.io

Joined August 2019

Pinned
Kfir Aberman
@AbermanKfir
Jun 10
1/ Today, we’re announcing Oasis 3: @DecartAI’s interactive world model for Physical AI. For the first time, teams can generate realistic, controllable, multi-view simulation environments in real time, and access them through an API. Thread + links 👇
00:00
1.6K
Kfir Aberman
@AbermanKfir
Feb 10, 2025
We discovered that imposing a spatio-temporal weight space via LoRAs on DIT-based video models unlocks powerful customization! It captures dynamic concepts with precision and even enables composition of multiple videos together!🎥✨
00:00
59K
Kfir Aberman
@AbermanKfir
Jul 17, 2025
🎉 Today at @DecartAI we're announcing Mirage. The first generative video model that runs in real-time, to infinity. Mirage is a Live Stream Diffusion (LSD), a breakthrough that transforms any video into anything you can imagine, as it plays. 🎮 Try it: mirage.decart.ai
00:00
00:31
Decart
@DecartAI
Jul 17, 2025
Introducing MirageLSD: The First Live-Stream Diffusion (LSD) AI Model Input any video stream, from a camera or video chat to a computer screen or game, and transform it into any world you desire, in real-time (<40ms latency). Here’s how it works (w/ demo you can use!):
38K
Kfir Aberman
@AbermanKfir
Nov 19, 2022
This amazing work takes our prompt-to-prompt, build together with a language model (GPT-3) a large dataset of triplets: (input images, instruction, output image), and use it to train a model that can edit images with instructions!!! 👑
AK
@_akhaliq
Nov 18, 2022
InstructPix2Pix: Learning to Follow Image Editing Instructions abs: arxiv.org/abs/2211.09800 project page: timothybrooks.com/instruct-pix2p… InstructPix2Pix, trained on generated data, and generalizes to real images and user-written instructions at inference time
Kfir Aberman
@AbermanKfir
Jul 14, 2023
We present HyperDreamBooth, our follow-up work to DreamBooth. With a new HyperNetwork architecture, you can now pass your image, count to 10.. 🧨 3.. 2.. 1.. and boom💥 You got your personalized model. Better, cheaper and faster. Play safe 😃 #HyperDreamBooth #DreamBooth
AK
@_akhaliq
Jul 14, 2023
HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models paper page: huggingface.co/papers/2307.06… Personalization has emerged as a prominent aspect within the field of generative AI, enabling the synthesis of individuals in diverse contexts and styles, while
46K
Kfir Aberman
@AbermanKfir
Jun 27, 2025
🚀 Career Update After years pushing the boundaries of Generative AI at some of the world’s top companies -> I’m going startup. I’ve joined @DecartAI as a founding team member, leading the charge to build our San Francisco office from the ground up.
Decart AI Lab | Real-Time World Models
From decart.ai
18K
Kfir Aberman
@AbermanKfir
Oct 16, 2022
Check out our Prompt-to-Prompt implementation with #stabledifussion ! You can now edit images by editing their captions. No more prompt engineering 🤩
AK
@_akhaliq
Oct 16, 2022
Prompt-to-Prompt: Latent Diffusion and Stable Diffusion implementation with @huggingface diffusers is out github: github.com/google/prompt-…
Kfir Aberman
@AbermanKfir
Aug 3, 2022
⭐️No more prompt engineering!⭐️ Excited to share our “Prompt-to-Prompt” work, an editing framework using text-2-image diffusion models, that enables users to edit images based only on textual edits of a prompt. Check the paper to see how powerful Cross-Attention layers are!
AK
@_akhaliq
Aug 3, 2022
Prompt-to-Prompt Image Editing with Cross Attention Control abs: arxiv.org/abs/2208.01626 analyze a text-conditioned model and observe that the cross-attention layers are the key to controlling the relation between the spatial layout of the image to each word in the prompt
Kfir Aberman
@AbermanKfir
Mar 1, 2025
Back in my PhD days, I really wanted to crack motion transfer between skeletons with totally different topologies. But the tools and data just weren’t there. Crazy to see how far it’s come - these motion transfer (and generation!) results are really exciting 🦖!
Andreas Aristidou
@andaristidou
Mar 1, 2025
🚀 New preprint! 🚀 Check out AnyTop 🤩 ✅ A diffusion model that generates motion for arbitrary skeletons 🦴 ✅ Using only a skeletal structure as input ✅ Learns semantic correspondences across diverse skeletons 🦅🐒🪲 🔗 Arxiv: arxiv.org/abs/2502.17327
00:00
9.5K
Kfir Aberman
@AbermanKfir
Jun 13, 2023
📣📣 Thrilled to announce that after 3 incredible years at Google, I'm joining Snap Research to build a world-leading Generative AI research team. More details below 👇🏼
32K
Kfir Aberman
@AbermanKfir
Aug 29, 2023
Thrilled to share that Break-A-Scene is accepted to #SIGGRAPH Asia 2023 , another amazing leap in Personalized Generative AI! 🍾 You can now take a single image: break it into pieces, re-render them, vary, and extract backgrounds like never before. Big shoutout to @OmriAvr and
AK
@_akhaliq
May 29, 2023
Break-A-Scene: Extracting Multiple Concepts from a Single Image introduce the task of textual scene decomposition: given a single image of a scene that may contain several concepts, we aim to extract a distinct text token for each concept, enabling fine-grained control over the
00:00
38K
Kfir Aberman
@AbermanKfir
May 5, 2023
Excited to share that it got accepted to #SIGGRAPH2023! 😍🎉 “Sketch-Guided Diffusion” enables text-to-image models to use spatial maps from other domains (like sketches) for inference guidance without any finetuning! 🙌🏼
AK
@_akhaliq
Nov 28, 2022
Sketch-Guided Text-to-Image Diffusion Models abs: arxiv.org/abs/2211.13752 project page: sketch-guided-diffusion.github.io
00:00
19K
Kfir Aberman
@AbermanKfir
Dec 13, 2022
⭐️Open internship position in @GoogleAI ⭐️ If you are: ✅ A last year Ph.D student ✅ Working on image/video synthesis ✅ Willing to spend the summer in the Bay Area and work with us on the next generation of Generative AI. Please ping me!
Kfir Aberman
@AbermanKfir
Feb 23, 2025
Proud to be part of this legacy. This small lab in Tel Aviv has shaped the landscape of Personalized GenAI - years of innovation behind us, and so much more ahead!
Daniel Cohen-Or
@DanielCohenOr1
Feb 22, 2025
Thrilled to see this plot in a recent survey on 'personalized image generation' (arxiv.org/abs/2502.13081) — highlighting the impact of our work! Huge congratulations to my fantastic students, whose creativity and dedication continue to drive exciting advances in the field!
5.8K