Anthropic is elf-coded, OpenAI is orc-coded, xAI is dwarf-coded, and Google DeepMind is human-coded. This leaves an opportunity for a hobbit-coded research lab.
Sergey Karayev
2,602 posts
Sergey Karayev
@sergeykarayev
The best way to build software with agents: @superconductor • Previously co-founded @gradescope • PhD @berkeley_ai
- Here's a brief glimpse of our INCREDIBLE near future. GPT-3 armed with a Python interpreter can · do exact math · make API requests · answer in unprecedented ways Thanks to @goodside and @amasad for the idea and repl! Play with it: replit.com/@SergeyKarayev…
- AI research is converging on a major finding: language models are a great substrate for all AI applications. This feels like a HUGE deal. Some examples:
- The future: · Write emails with bullet points, which an AI assistant automatically expands into beautiful long text. · Read emails by having an AI assistant summarize long-ass text into bullet points...
- Google has no moat. They don't have over 90% search traffic. They don't have everyone's emails and the most used email client. Their OS is not powering 70% of smartphones. They will never be able to deploy LLM features into these products -- instead, people will run OSS LLMs.
- Okay so OpenAI board is · Ilya, got it, makes sense · Helen Toner, DC policy person, fine · Adam D'Angelo, CEO of Quora, okay I guess but why though? · Tasha McCauley, "tech entrepreneur" and funny enough also wife of Joseph Gordon-Levitt, how did this board come together?
- I'm ready to pay much more than $20/month for a coding copilot that is 10x as good as GitHub Copilot or Cursor. I WANT to pay more. Load my entire repo into Gemini 1.5 context and cache it. Automatically review all my PRs. Charge me $200/month. Charge me $2000/month!
- Got nerd-sniped by the OpenAI Board of Directors. Here's everyone who's ever been on it, their claim to fame, and why they left.
- Did you know that Claude Code can use the browser to QA its own work? 1. Run `claude mcp add playwright -- npx -y @playwright/mcp@latest` 2. Tell Claude where your app is running, e.g localhost:8000 3. Now Claude can click and type to make sure its code is actually working!
00:00 - Now that our GPT-3 can execute code on @Replit, let's teach it to: · Google stuff · Read web pages · ✨Ask GPT-3 questions✨ That's right -- we're going RECURSIVE.
- GitHub Copilot was released three years ago. In these three years, GitHub still hasn't shipped automated PR description, review, multi-file editing, test gen, etc. Perhaps because Nat Friedman stopped being their CEO right after releasing Copilot? Who even is their CEO now?
- Conclusion after GPT-4 hacking weekend: Even if there is ZERO further progress in LLM models, software engineering will still be revolutionized in the next couple of years, just through UX and non-ML innovations. Absolutely massive overhang.
- What I admire about @karpathy is that he just keeps "doing things that don't scale". Label the entire ImageNet by yourself? Sure. Engineer petabyte-scale data engine for self-driving? Let's do it. Implement GPT from scratch? Easy. An inspiring attitude.
