Is the AI industry really ready to slow down?
Weâre seeing a big debate over AI safety and a potential slowdown, as Anthropic CEO Dario Amodei recentlypublished a plan to âpace the frontier,âwhile Nvidia CEO Jensen Huang haspublicly echoed President Donald Trumpâs claimsthatthe AI backlash is a hoaxand regulation is unnecessary. On the latest episode ofTechCrunchâs Equity podcast, Kirsten Korosec, Sean OâKane, and I discussed whether executives like Amodei and OpenAI CEO Sam Altman are serious about wanting to slow down. While I was surprised at how many industry leaders seemed to throw their support behind Amodeiâs plan, Sean noted that the plan seemed short on details. And when Kristen asked whether a combination of existing regulation and the workings of the free market could provide enough safeguards on their own, Sean replied, âWe have a federal government at the moment that certainly does not seem eager to enforce regulations broadly speaking, let alone specifically speaking here.â Plus, he argued, âThere does not seem like there is a ton of consumer choice driving this market, in the sense of, okay, if one of these companies does something really bad, then they will see an impact in how many cancellations there are or whatever.â Keep reading for a preview ofour conversation, edited for length and clarity. Anthony Ha:Sean, what do you think? Are we actually going toââpace the frontierâ? Sean OâKane:That sounds, for some reason, like something from âPoint Break.â Itâs just a very California statement, like, âWeâre gonna pace the frontier, bruh.â I donât know.I said on this show last week, I didnât think we were headed for a slowdown of any kind, in large part because I donât think these companies are structured in a way where that works. So this was a pretty immediate flip of what I said a week ago, to hear this from Dario at Anthropic and Sam at OpenAI and even Elon Musk to a certain degree â and we can get into whether we believe that or not. I will say, I donât think I was completely wrong, because even with these loose plans that Dario laid out in a blog post and and some of the other leaders have talked about, I feel like weâre still missing a lot of specifics here, not only on some of the claims about why these people think there are dangers and risks, but also specifics on what they mean by slowing down. Anthony, I know you read this stuff pretty closely last weekend as it was all popping off, so Iâm curious if youâre maybe more generous than I am, as far as understanding what it is theyâre trying to say here. Anthony:I mean, I also have questions. What really stood out to me is the fact that so many people in the industry seemed to coalesce around this fairly quickly. Even before Amodei published his blog post, I was seeing other people post some version of this [plan,] just in the days leading up to it. My understanding is, these suggestions that have come out of the AI safety community; these are things that have been percolating for a while. Theyâre not just things that [Amodei] thought up on his own. But it just seemed like a lot of people were kind of ready to embrace this and in some ways, [itâs] encouraging to see that thereâs a consensus. But it also makes me a little skeptical that this would represent genuine, major steps towards a slowdown. Kirsten Korosec:First of all, consensus can be a good thing. Also, it can be the beginnings of forming a cartel. And so, letâs be clear [about] who weâre talking about here. Weâre talking about frontier AI labs. and thatâs specific and important. You did say a minute ago that the details arenât really clear, but we do know that the general idea here is that independent third party evaluators would come in that would work inside [companies] like Anthropic or OpenAI and monitor AI safety practices and incidents. But there is a lot of vagueness around that. Then thereâs another proposal to have major AI companies in democratic countries coordinate on safety standards and limits. And then this international coordination piece. So those are the general ideas around this. Iâll also add that thereâs been very considerable pushback from very specific people. And surprisingly, some people I didnât think would push back on this. The obvious one, I guess, would be Nvidiaâs CEO Jensen Huang, who had some pretty choice words. I donât know what either of you think of [âŚ] some ofhis comments and the call he took from President Trump on-stage[at the All-In Summit] Sean:I think Jensen understands that, to a certain extent, he is seen as the adult in the room here. Which is interesting, because thatâs a dynamic that I think has changed. If you were to ask people a year, almost two years ago now, who was playing that role as these AI companies were really starting to blow up in big ways, I think a lot of people would have pointed to Microsoft and Satya Nadella, and I feel like Microsoft has â for a number of reasons that we donât need to get into right now â lost that grip on being the adult in the room. Certainly in part because Nadella saidhe was going to make Google dance, and then that never happened. and in fact, the opposite happened, in a lot of ways. Jensen, I think, understands not only that he needs to be pleasing the most amount of people and so he wants to say the most measured thing, he also is one of the most useful liaisons between this field and this administration, to the point that heâs getting a call from the president while heâs on-stage at this very well-attended and high-profile conference that allowed both of them to respond to all this mess. Kirsten:[To] your point about him being the adult in the room and the liaison, he is in a position where he could do that. But in my view, I would say that [his appearance,] which did feel a little staged, went a step too far and really highlighted the fact that Nvidia greatly benefits from AI moving forward in an unpaced manner. I hate to be cynical about it, but that was sort of my initial reaction to it. Anthony:Trumpâs and Huangâs interests are aligned, and also [Huangâs] telling [Trump] what he wants to hear. I did think some of the things he was specifically focusing on are worth unpacking a little bit. First he talked about this idea of, âWe are not going to have a slowdown.â Itâs interesting, just that phrase âslowdown,â which has come up a lot â but at the same time, both Altman and Amade [will] use the slowdown language, but the word they like to use more is âpace.â right? And these three proposals â the ones you just described, Kirsten â in theory, they could result in things slowing down, but theyâre not saying that explicitly. Itâs saying, âHey, weâre making some basic safety measures and having some people keep an eye on us.â But none of those things are intrinsically saying that things have to go slower than they are now, at least as I understand it. Kirsten:So I have a question for Sean. Couldnât you argue in a free market society, we have existing regulations in place, and also [in] the competitive environment in which there isnât protectionism, if there is something unsafe that is released by a company, that they would no longer be able to be a viable company? And there are regulators in place today that could go after these companies? Or do you reject that idea? Sean:In a vacuum, or in a market that is not being distorted by a whole bunch of different external pressures, yeah, I think thereâs an element of that. But we have a federal government at the moment that certainly does not seem eager to enforce regulations broadly speaking, let alone specifically speaking here. And weâre also in this weird situation where â I donât really know the right way to put it, but it does not seem like there is a ton of consumer choice driving this market, in the sense of, okay, if one of these companies does something really bad, then they will see an impact in how many cancellations there are or whatever. Especially now, as they have moved into enterprise and theyâre making so much more of their money from selling their services to companies, itâs just naturally harder to vote with your dollars there. Corporations are not going to pack up and move from [OpenAIâs] Codex to [Anthropicâs] Claude Code just because they disagree on principle with something that OpenAI did. And then theyâre also just being floated by so much investment money that it makes it easier for them to absorb any of those losses if they actually do face them. So I think itâs a nice idea in theory, but I feel like in practice, thereâs none of that really happening.
