Log inSign up
Mostafa Dehghani
2,158 posts
user avatar
Mostafa Dehghani
@m__dehghani
/google_deepmind/gemini/.
San Francisco
Joined June 2014
706
Following
11.5K
Followers

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Feb 13, 2023
    1/ There is a huge headroom for improving capabilities of our vision models and given the lessons we've learned from LLMs, scaling is a promising bet. We are introducing ViT-22B, the largest vision backbone reported to date: arxiv.org/abs/2302.05442
    Image
    311K
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Jul 13, 2023
    1/ Excited to share "Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution". NaViT breaks away from the CNN-designed input and modeling pipeline, sets a new course for ViTs, and opens up exciting possibilities in their development. arxiv.org/abs/2307.06304
    Image
    144K
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Feb 22, 2023
    We're hiring student researchers who are passionate about large scale vision models. Know someone who fits the bill or interested yourself? Let me know, and I'll be happy to share more details! [Retweets are greatly appreciated.]
    164K
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Dec 11, 2024
    Gemini2 Flash on the challenge of what the internet has been asking for: breaking down "draw the rest of the owl" into actual steps with interleaved generation. not perfect yet, but it’s on the edge of something super cool...
    Image
    Image
    Image
    Image
    105K
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Nov 1, 2021
    A few weeks ago, we open-sourced SCENIC, a JAX library/codebase that we like it a lot and wanted to share our joy with the community. GitHub: github.com/google-researc… Paper: arxiv.org/abs/2110.11403
    Scenic: A Jax Library for Computer Vision Research and Beyond
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Dec 7, 2023
    Replying to @ysu_nlp and @emilymbender
    Thanks for releasing this benchmark! Great effort! Just for the record, I posted a link when the benchmark was released, and the great @ankesh_anand made it available for evaluating Gemini models literally within a few hours! Incredible display of agility for sure! :)
    Image
    77K
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Mar 13, 2025
    I've been having a lot of fun seeing all the examples from folks trying Gemini’s native image generation! So many impressive edits (yes, Gemini is the best at this), and people love the magical consistency & pixel-perfect tweaks.
    user avatar
    Jerrod Lew
    @jerrod_lew
    Mar 12, 2025
    Edit images directly in Google AI Studio. It's incredible how fast this is.
    Image
    00:00
    53K
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Jul 16, 2021
    1. Benchmarks are fundamental to track progress in empirical machine learning. In our new paper, we study how benchmarking may affect the long term research direction and pace of progress in ML and put forward the notion of a "benchmark lottery":
    arXiv logo
    arxiv.org
    The Benchmark Lottery
    The world of empirical machine learning (ML) strongly relies on benchmarks in order to determine the relative effectiveness of different algorithms and methods. This paper proposes the notion of...
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Nov 8, 2021
    We released the code for ViViT as well as the checkpoints of its different variants. If you are interested in transformers for video understanding, check it out: Code: github.com/google-researc… Paper: arxiv.org/abs/2103.15691
    Image
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Aug 30, 2022
    We have released the JAX implementation of Universal Transformers (arxiv.org/abs/1807.03819) with adaptive halting in #Scenic (along with a Vision Transformer with token/example level halting mechanism): github.com/google-researc… Thanks to @XueFz for his amazing contribution.
    Image
    00:00
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    May 8, 2019
    If you are at #ICLR2019, make sure that you learn about our work, "Universal Transformers", w/ @sgouws, @OriolVinyalsML, @kyosu, and @lukaszkaiser (Thursday 11am-1pm, poster session at Great Hall BC, #62). You can also check out this blog post about UT: mostafadehghani.com/2019/05/05/uni…
    Image
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    May 12, 2022
    "Whether to go with a decoder-only or encoder-decoder transformer?" It turned out that this question on the architecture of the model is not actually that important! You just need the right objective function and a simple prompting to switch mode during pretraining/finetuning.
    Image
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Mar 12, 2025
    Anyone who has been in this room knows that it’s never just another day in here! This space has seen the extremes of chaos and genius! ...and we ship! developers.googleblog.com/en/experiment-… Happy Wednesday everyone!
    Image
    30K
  • user avatar
    Mostafa Dehghani
    @m__dehghani
    Mar 20, 2025
    Gemini image generation usage is through the roof, giving us a ton of energy and motivation to roll out improvements and fixes fast! Use it, share cool use cases, send feedback (we love a good complaint!), and stay tuned... more upgrades are on the way!🔥
    user avatar
    Logan Kilpatrick
    Google AI Studio
    @OfficialLoganK
    Mar 20, 2025
    Updates on Gemini native image generation 🖼️: - significantly decreased block / filter rates - fixed some bugs with multi turn image quality - added a “re-run” button at the top level in chat to make iterating faster Lots more to come! Try it out: aistudio.google.com
    22K
Advertisement
Advertisement