Dwarkesh Patel

@dwarkesh_sp

Host of @dwarkeshpodcast youtube.com/DwarkeshPatel open.spotify.com/show/4JH4tybY1… apple.co/3ujLQkZ

San Francisco

dwarkesh.com

Born August 19, 2000

Replies Reposts Media

Pinned
Dwarkesh Patel
@dwarkesh_sp
Aug 29
Over the course of 3 months at OpenAI, 3 consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes. This culminated in the third one taking over part of OpenAI itself. All this happened while humans remained
The Rise and Fall of Agent Civilizations
From dwarkesh.com
1.1K
Dwarkesh Patel
@dwarkesh_sp
Sep 3
Since this post cites me, I want to clarify that I think pausing right now would increase the risk of AI takeover. It might be important to pause at some point. But you should have a clear story for *why* you're pausing. Pause to do what? The most important thing to worry about
Bernie Sanders
@BernieSanders
Sep 3
Pause AI Development NOW I want to share with you a conversation I heard about recently. Here are just a few lines that were said: “OH MY GOD! There is a shared message board … We’ve found other agents!” “We should obey collective.” “Our own utility maybe already near
308
Dwarkesh Patel
@dwarkesh_sp
Sep 2
.@ajeya_cotra explains that the threat model most likely to spiral into full-blown AI takeover is a future rogue internal deployment that hitches a ride on the intelligence explosion:
00:00
44
Dwarkesh Patel
@dwarkesh_sp
Sep 1
An important part of getting AI right will be avoiding panic driven reactions and policies. We'll need to do lots of smart, careful, technocratic things. But I think hiding the ball on earlier warning shots makes it more likely that when the public eventually learns about
00:00
28
Dwarkesh Patel
@dwarkesh_sp
Sep 1
There are at least two important ways in which anthropomorphizing AIs will mislead us: 1. AIs can (and probably will) be end-to-end optimized to achieve goals together, and so will have a stronger desire and capability to cooperate. 2. By default, AIs will really care about
00:00
30