待翻譯:Disagreements about AI are usually disagreements about future AI capabilities
AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:Zvi Mowshowitz Aug 05, 2026 Sincere disagreements about AI are usually disagreements about future AI capabilities. There are roughly four positions people take. Two are reasonable. Two are not. I distinguish these via t…
AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。
Zvi Mowshowitz Aug 05, 2026 Sincere disagreements about AI are usually disagreements about future AI capabilities. There are roughly four positions people take. Two are reasonable. Two are not. I distinguish these via the Three AI Pills. You can take zero, one, two or three. Three Pills The three pills are, roughly, taking each of the following three things seriously: AI pilled. AI exists and can do the things it can already do. AGI pilled. AI will be able to do a lot more of the things. ASI pilled. AI will be able to do approximately all the things better than you, within our natural lifetimes. I am ASI pilled. A large percentage of employees of the frontier labs are ASI pilled. The labs themselves are ASI pilled. The Unpill People I see unpilled people. Where do I see them? Everywhere. The majority of people have not taken the first pill. Most people have no idea what frontier AIs can do for them. They are unaware of coding agents. They have used only ChatGPT, for harmless trifles, and they hold years old memories of its failings. They mock any failure anywhere as ‘what AI can do.’ They dismiss AI as worthless because it pointed them to a closed store or recommended the wrong number of pizzas. They cite old studies that were obsolete before they were published and used terrible prompting techniques. They often still talk about ‘stochastic parrots’ or how AI can never possibly think and everything must be stolen from the training data. And so on. Some versions of this are wrong. Some are Not Even Wrong. None are reasonable. When you discuss AI with people who are fully unpilled, your goal is usually to first give them the AI pill. Show them that AI can do the things it can already do. The AI Pill Even fully taking the first AI pill is a big deal. Existing AI unlocks, today, in practice, tons of cool things. It is, in many ways, already smarter and more capable than you. So many things that you used to do by hand, or some other way, are now better done by typing a quick request into a text box. So many things that previously were not worth doing are now worth doing. So many questions previously not worth asking are now worth asking. The marginal cost of seeing what the AI can do for you is often very close to zero. AI can also do a variety of harmful things, or do things that are useful for you but make others worse off or disrupt or invalidate norms or systems. People don’t like that. Most economists, and most people who work in policy and government, have taken at most this first pill, and underestimate even the impacts of the first pill alone. Often they say things like ‘AI will be too expensive to use on [X]’ because they don’t realize it will soon be orders of magnitude cheaper for the same level of intelligence. Or they point to particular details where AI does poorly, and presume this will not be fixed. They see AI as ‘uncompetitive’ without realizing the situation is temporary. When you discuss AI with someone who has taken only the first pill, you typically have three basic options. You can try to ‘fully AI pill’ them and explain the things AI can already do and the implications of what that means, even if things stop here. You can try to explain that we will get better at using what AI we have, and that there is a lot of ‘unhobbling’ left for us to do, even if things stop here. You can explain that things will not stop here, and you need to be thinking about what future AIs will be able to do. Get them to take at least the AGI pill. Even if AI could permanently only do the things it can currently do, that would be Internet big, and radically change the world, mostly for the better. AI capabilities will not permanently stop here. It is wrong to not take the second pill. Stuck At The First Pill Our debates about AI remain largely stuck on settled questions, because so many people cannot even take the first pill. Dean W. Ball: A couple years ago, the AI debate was centered, rightfully, on whether crazy-sounding things like “AIs autonomously making math breakthroughs” and “AIs breaking from their sandbox and hacking on the internet” would be real things in the near term. Sometimes it feels like that’s still the debate we’re having. This can be frustrating, because in my view, that debate is settled and was settled quite a while ago. To have good discussions, we need to at least take the second pill. Whereas, yes, many people, even many who work with AI, really do say current AI is ‘good enough’ and can’t imagine what a better one can do. As in, someone tweeting at Sam Altman saying ‘Sol does everything I want it to do, this is all I ever need’ and Altman retweeting saying they were wrong. Which they obviously are. The AGI Pill The AGI pill is a much bigger deal than the AI pill. If you take the AGI pill, you understand that AI is advancing its capabilities rapidly. Even if you think that such AGIs will remain fully under human control, and remain ‘mere tools,’ and you expect the lived experience of most people’s everyday lives to not change so radically, you understand that their capabilities will ‘change everything.’ You see that we will face times of great transition and uncertainty, that have the potential to go extremely badly, and that those who succeed at AI will leave those who do not behind in the dust. The world in the future will be very different from our own. AIs will be able to do most digital work, most of the time, along with the inevitable robots and self-driving cars and so on. Lots of current jobs will go away, whether or not they are replaced by new and potentially better ones. Economic growth and productivity will accelerate. You see some of the dangers of what would happen if we empowered misuse of such advanced AI systems before we were ready, especially in places like cyber and bio risk. You see the potential for centralization of power, or inequality, and also for some forms of runaway gradual disempowerment. You see the potential for mass unemployment, either transitional or permanent. You understand that our legal and regulatory regimes are not ready, either to protect against and mitigate the risks and harms, or to allow for the opportunities and remove the bottlenecks to diffusion and mundane utility. The Need To Be Prepared Those who expect AI to quickly become sufficiently advanced to greatly impact the physical world usually see great danger. They notice that as a result everyone may soon die. Usually they think this is bad, actually. Thus such folks call to take coordinated action to mitigate the downside risks of such impacts, keep us all from dying, and ideally also to help capture the upside benefits. Those who expect AI to become importantly more advanced, but with a slower and smaller impact on the physical world, and who think the practical value of more intelligence will cap out. For different values of ‘sufficiently advanced,’ as in AGI versus ASI, you would see different degrees of danger. The AGI pill is still sufficient for most things in the Overton window or under serious consideration as of August 2026. We are almost entirely considering overdetermined, low cost, high benefit interventions. There is no good case for not doing radically more investment in alignment, infrastructure and oversight, state capacity, transparency, liability, disclosures, safety testing including of internal models, red teaming, auditing, enforcement of export controls and laying the groundwork for diplomacy. This includes laying the groundwork to Pace the Frontier should that prove necessary. If you are fully ASI pilled, and realistic about the current state of alignment and how superintelligence likely plays out if it arrives soon, then you will want to go further. You will want to do things that have real downsides, and require real tradeoffs. Some such people want to do a full international pause of frontier AI development. If you took the full ASI pill and believed what they do about superintelligence, in terms of how fast it might arrive and what it can do, you might well agree with them. The ASI Pill The ASI pill is the understanding that AI is on pace to be able to do approximately all of the things better than you. I said ‘approximately.’ As I go over in detail, that does not mean literally all of the things. There are some things that inherently require or greatly benefit from being a human. And there may be weird corner cases where the AI won’t be good enough. It does not mean omnipotence or omniscience, although one should expect it to look a lot like that to an unaided human. It does mean the AI takes your job, and then takes the new job that you switch into, unless you pivot to ‘requires literal human.’ You will be uncompetitive at essentially any other task. It does mean that it will use this capability to figure out approximately all of the things, remarkably quickly, until you hit the physical limits. It does mean that those who rely more on such AIs will reliably outcompete, in all senses including for resources, those that rely on such AIs less. It does mean that, in a ‘fair fight’ or sufficiently open competition, the AI wins. It also means the AIs often figuring out and doing things you did not imagine or anticipate. It means realizing that intelligence does not stop anywhere near the human level, nor does its ability to chart paths through causal space towards preferred arrangements of atoms. It also means not pretending that its superior intellect can be matched by your puny weapons, or your pieces of ink on paper, or your entries in a database, or your regulatory capture and rent seeking. And Then Nothing Much Changes For You Despite all that, the sign of the AGI pill, as opposed to the ASI pill, is the belief that day to day life will continue to look similar to how it looks now, in the sense that we see day to day life in 1926 as not that different from life in 2026. Sometimes this is clearly disingenuous, as it is coming from someone ASI pilled enough to know better. I read Sam Altman saying various forms of ‘life will not much change after the singularity’ as basically unjustified Obvious Nonsense to reassure his audiences, rather than a coherent position. Sometimes the person such folks want to reassure most is themselves. Others sometimes do have something more concrete in mind as their vision of the future, and why it will not change so much, with varying degrees of coherence. Those with only the AGI pill believe in bottlenecks that hold back change. They often believe that our ability to exponentially grow AI’s capacity and capabilities will hit various physical limits. There can only be so many chips. Actions take time. Things too far out there are often pejoratively dismissed as ‘magic.’ They often believe there is not that much left to physically discover, in the classic ‘close the patent office’ kind of way, even in theory. Your steak can only be so tender, your lobster so buttery, your lifespan so long, and your status so high, so why does it matter. I strongly disagree on lifespan and health, and expect we have a long way to go in so many other ways in terms of finding value, although they may have a point about moment-to-moment maximal hedonic experiences of a physical human brain. They often believe that the upside of intelligence is importantly limited. That no mind, however advanced, could be all that persuasive, or that economically valuable, or that capable of creating innovations in the physical world, or of running sufficiently accurate simulations, or making sufficiently strong predictions, or even able to do things like overcome red tape and regulatory capture. Intelligence Denialism I sometimes call this Intelligence Denialism: The idea that being smarter is not all that, no matter how smart one gets. That there is this thing, intelligence, that you either have or don’t have, and that [truncated for AI cost control]