Log inSign up
Image
user avatar
Robert Lange
@RobertTLange
Staff Research Scientist & Founding Member @SakanaAILabs 🎏 The AI Scientist, ShinkaEvolve, gymnax, evosax Prev: SR & Intern @GoogleDeepMind
BLN/TKY
roberttlange.com
Joined April 2017
696
Following
9,970
Followers
  • Pinned
    user avatar
    Robert Lange
    @RobertTLange
    Mar 25
    I am really excited to share that our work on The AI Scientist has been published in Nature Automated Scientific Discovery has been something I only dreamt about at the start of my PhD. Today, we are making big leaps into a world in which autonomous agents support human
    Image
    Image
    user avatar
    Sakana AI
    @SakanaAILabs
    Mar 25
    The AI Scientist: Towards Fully Automated AI Research, Now Published in Nature Nature: nature.com/articles/s4158… Blog: sakana.ai/ai-scientist-n… When we first introduced The AI Scientist, we shared an ambitious vision of an agent powered by foundation models capable of executing
    26K
  • user avatar
    Robert Lange
    @RobertTLange
    Dec 27, 2020
    🎄I am a big fan of @ylecun‘s & @alfcnz‘s Deep Learning course. The attention to detail is incredible and one feels the love and passion, which goes into every single course week (my favorites: 7+8 on EBMs)🤗#feelthelearn 📜: atcold.github.io/pytorch-Deep-L… 📽️: youtube.com/playlist?list=…
    Image
    Image
    Image
    Image
  • user avatar
    Robert Lange
    @RobertTLange
    May 1, 2021
    It's the beginning of a new month - so let's reflect on the core ideas of statistics in the last 50 years ⏳ Great weekend read by @StatModeling & @avehtari covering the core developments, their commonalities & future directions 🧑‍🚀 #mlcollage [17/52] 📜: arxiv.org/abs/2012.00174
    Image
  • user avatar
    Robert Lange
    @RobertTLange
    Jul 10, 2020
    Beautiful overview of Bayesian Methods in ML by @shakir_za at #MLSS2020. Left me pondering about many things beyond Bayesian Inference. Thank you Shakir🙏 Quote of the day: “The cyclist, not the cycle, steers.“🚴‍♀️ 🎤 P-I: youtu.be/x4Y90zPjbq0 🎤 P-II: youtu.be/DItJbz2OH5U
    Image
    Image
    Image
    Image
  • user avatar
    Robert Lange
    @RobertTLange
    May 3, 2020
    Really happy to share #visualmlnotes ✍️ a virtual gallery of sketchnotes taken at Machine Learning talks 🧠🤓🤖 which includes last weeks #ICLR2020. Explore, exploit & feel free to share: 💻 website: visual-ml-notes.github.io 📝 repository: github.com/visual-ml-note…
    Image
    00:00
  • user avatar
    Robert Lange
    @RobertTLange
    Apr 4, 2021
    how it started how its going
    Image
    Image
  • user avatar
    Robert Lange
    @RobertTLange
    Feb 6, 2021
    🤖JAX is more than just the 'next cool autodiff library'. The primitives allow us to flexibly leverage XLA and to speed-up + vectorize neuroevolution methods 🦎 with minimal engineering overhead. Find out more in my new blog post 📝: roberttlange.github.io/posts/2021/02/…
    Image
  • user avatar
    Robert Lange
    @RobertTLange
    Jul 7, 2020
    Great tutorial on Meta-Learning by @yeewhye covering optimisation-based, black-box & a probabilistic perspective on learning task invariances at #MLSS2020. Re-watch the videos here: 📺(Part I): youtu.be/A0a1M61gjgI 📺(Part II): youtu.be/WCREWkWGd6s
    Image
    Image
    Image
    Image
  • user avatar
    Robert Lange
    @RobertTLange
    Jun 25, 2022
    🚀 I am very excited to share gymnax 🏋️ — a JAX-based library of RL environments with >20 different classic environments 🌎, which are all easily parallelizable and run on CPU/GPU/TPU. 💻[repo]: github.com/RobertTLange/g…
 📜[colab]: colab.research.google.com/github/RobertT…
    Image
    00:00
  • user avatar
    Robert Lange
    @RobertTLange
    Jul 17, 2020
    There is a lot to wrap your head around in LSTMs🤯. One way of thinking that helped me a lot is the 'conveyor belt' metaphor of the cell state 🧑‍🏭 by @ch402. I put together a little animation 🖼️ Check out the amazing blog post by Chris Olah here✍️: colah.github.io/posts/2015-08-…
    Image
    GIF
  • user avatar
    Robert Lange
    @RobertTLange
    Dec 16, 2019
    What a week 🧠🤓💻! I loved meeting so many of you at #NeurIPS2019 - the ML community is truly wonderful. Checkout all my collected visual notes ✍️ & feel free to share: github.com/RobertTLange/c…
    Image
  • user avatar
    Robert Lange
    @RobertTLange
    Jun 27, 2020
    The lottery ticket hypothesis 🎲 states that sparse nets can be trained given the right initialisation 🧬. Since the original paper (@jefrankle & @mcarbin) a lot has happened. Checkout my blog post for an overview of recent developments & open Qs. ✍️: roberttlange.github.io/posts/2020/06/…
    Image
    GIF
  • user avatar
    Robert Lange
    @RobertTLange
    Mar 6, 2023
    🚀 How can meta-learning, self-attention & JAX power the next generation of Evolutionary Optimizers 🦎? Excited to share my @DeepMind internship project and our #ICLR2023 paper ‘Discovering Evolution Strategies via Meta-Black-Box Optimization’ 🎉 📜: openreview.net/forum?id=mFDU0…
    Image
    GIF
    57K
  • user avatar
    Robert Lange
    @RobertTLange
    Jun 12, 2025
    Text-to-LoRA: What if you no longer had to fine-tune your LLM for every single downstream task? 🚀 Stoked to share our work on instant LLM adaptation using meta-learned hypernetworks 📝 → 🔥 The idea is simple yet elegant: We text-condition a hypernetwork to output LoRA
    Image
    Image
    00:18
    user avatar
    Sakana AI
    @SakanaAILabs
    Jun 12, 2025
    We’re excited to introduce Text-to-LoRA: a Hypernetwork that generates task-specific LLM adapters (LoRAs) based on a text description of the task. Catch our presentation at #ICML2025! Paper: arxiv.org/abs/2506.06105 Code: github.com/SakanaAI/Text-… Biological systems are capable of
    40K