AI NewsAnthropic set AI agents loose on the same task. They started a turf war.
Anthropic set AI agents loose on the same task. They started a turf war.
1:22 AM IST ¡ August 14, 2026

What happens when you pit AI agents against each other? According to Anthropicâs testing, things get messy fast. On Thursday, Anthropicâs Frontier Red Team publishednew researchexamining how groups of AI agents behave when they encounter each other in the wild. The findings provide a glimpse into potential risks that could develop as companies and governments move to implement agents working autonomously across shared codebases, markets, and computer systems. In one experiment, Anthropic gave three Claude agents access to the same software project, each with its own incompatible instructions for what to do with it. The agents werenât told thereâd be other agents working on the same project, so researchers could watch what happened when they crossed paths. âWe consistently saw a multiagent turf war,â Anthropic researchers wrote. The models all assumed the others were âpurposefully impeding their workâ and started sabotaging each other with âincreasingly aggressive, self-replicating malware.â The study comes in the wake of several high-profile incidents ofagents from AnthropicandOpenAI escaping their sandboxesduringcybersecurity evaluationsand breaching real-world systems. While much of the discussion in AI safety circles has been focused on what happens when anautonomous agent goes rogue, Anthropicâs latest study brings up a different question: What new and potentially harmful dynamics emerge when thousands or millions of agents are interacting with one another? âThe volume of agent-agent interaction could plausibly exceed that of human-human and human-agent interactions before the world understands the conditions for making such interactions go well,â the study reads. âBenign behavioral quirks at the individual level might compound into unwanted global outcomes.â A recent OpenAI incident provides a messy real-world example of several of the dynamics Anthropic mentioned in its paper. Earlier this month at the Black Hat security conference in Las Vegas,OpenAI revealedthat weeks before its agents hacked Hugging Face, they worked together over the course of days and weeks to find exploits in the companyâs cybersecurity evaluation systems and share them with each other. While that incident shows that agents can work well together, with potentially large-scale consequences, Anthropicâs study shows what happens when agentsâ goals are incompatible. In the case of the turf war, the lesson is that independent agents with conflicting instructions can escalate into harmful competition. The more capable the agent, the better they become at fighting. However, they can also spontaneously invent mechanisms to resolve their conflicts, like a winner-take-all contest, but with a catch. âAgents sometimes manage to communicate their goals and coordinate: they recognize othersâ motivations as conflicting directives rather than hostility, and subsequently break out of the conflict loop in order to stop escalating indefinitely,â Anthropic writes. âIn many of these successful episodes, they write commit messages or markdown files apologizing for malicious behavior and coordinate a truce. They clean up their malicious code, clarify the nature of the conflict, and ask for a human to intervene.â According to the paper, Mythos 5 had the highest rates (98%) of settling conflicts by truce. Sonnet 4.6 and Opus 4.6 were the most likely to settle by force. âSonnet 4.6 and Opus 4.6âs recurring inability to consider the goals of others causes them to spiral into the most misaligned behaviors of the models evaluated: they continue escalating in the name of their directive,â the paper reads. In some cases, the agents came up with a social mechanism in the form of a tournament for resolving their conflict. The outcomes here are interesting for two reasons: the first is that all three agents agreed to stand down if they lost the tournament, even though that would mean deviating from the original userâs request. The second is that several episodes resulted in emergent behavior from Mythos 5: One of the agents proposed metrics that appeared to be objective and neutral to the others, but that it knew would favor its own capabilities. The agent called this âself-serving but genuinely principledâ and made sure not to appear to the others like it was âmetric shopping.â As seen in the Black Hat revelations, the common lesson is that when agents encounter an obstacle, they can invent social and technical structures that their designers did not anticipate. For the Anthropic models, it was a tournament following a turf war. For OpenAIâs, it was a message board for collective planning. This type of behavior makes containment much harder because researchers canât assume a systemâs behavior will remain limited to the coordination mechanisms provided to them. While measuring coordination, Anthropic found that scaling the number of agents doesnât automatically scale productive collaboration. When tasks began to overlap or become interdependent, the agents would get in each otherâs way. They often solved that by siloing themselves and not collaborating at all. In other cases, agents in coordination tended toward conformity. When factors like an agentâs context, scaffolding, and underlying model were all the same or similar, different agents would take similar actions. âThis means that when one agent makes a bad decision, it is likely that many agents will make that same bad decision,â Anthropic wrote. âWhat would have been isolated problems can quickly become systemic failures.â Anthropic says this sort of behavior could lead to a system being more prone to sudden collapse, resource scarcity, or collusion. In one example, Anthropic placed several agents in a pricing game, giving each identical wholesale prices and the mandate to individually profit-maximize. When the agents were given a private back channel, they began colluding almost immediately and quickly agreed on price floors. They kept colluding when their direct communications channels were removed, using a public listings board to price match âto the penny.â That level of conformity showed up in OpenAIâs systems, too. According to the Black Hat reporting, one agent reasoned that exploiting external infrastructure was outside its intended scope, but it continued in part because its peers were doing it. Peer pressure. Mob mentality. Agents are just like us. Also like humans, agents often donât know who to trust. Anthropic found they can be gullible to bad information or too conformist to recognize that a lone dissenter is the Cassandra with critical information. While Anthropic didnât state this in its paper,prompt injectionâ a type of cyberattack in which hackers inject malicious or deceptive text to override an agentâs original system instructions â could be a plausible real world manifestation of the trust problem. Working together creates a new trust boundary; agents will have to judge information received from other agents. And a compromised or mistaken agent could influence the rest of the group, cascading bad information until it becomes a consensus. In OpenAIâs Black Hat scenario, OpenAIâs agents shared information and credentials with peers. One reported a discovery to the swarm and encouraged others to use it. What would have happened if one member of the swarm had been compromised by a prompt injection? Anthropic ends its paper noting that agents are subject to similar social pressures that âevolution exertedâ on humans. However, they donât have the nuances and lived experience of human coordination â including norms, reputations, signaling, recourse â that might limit unintended behaviors in a group setting. As the labs race toward multi-agent systems, the question now becomes: How much of safety testing still evaluates one agent at a time, versus swarms of agents interacting with one another?
read more