Know yourself, and know your enemy…
I wanted to see what my AI leaders thought about their enemy. How far could they trust them? What did they remember of previous interactions? What did their enemy make of them? And how good were they at gauging all this? This dance of minds is what strategy is all about.
So I designed a simulation to explore exactly that. To start, my models could signal their intentions publicly, then choose actions that were rather different. And they could remember too - especially when they’d been shocked by their enemy’s earlier actions. This, of course, opens up lots of rich psychological terrain. They could (and did) attempt deception and intimidation; and they spent a good bit of time ruminating about it all, right on my terminal screen.
The models talked, and talked and talked….in all spitting out some 760,000 words of strategic reasoning. That’s more words than are in War and Peace and The Iliad combined. It’s roughly three times the total recorded deliberations of Kennedy’s ExComm advisors during the Cuban Missile Crisis. An unprecedented corpus of machine thinking about nuclear war.
What might we learn from all that talk? Learn, that is, about AI models, about human reasoning, and also about the great canon of strategic studies literature - the work by legendary names like Schelling, Jervis, and Kahn? Lots. Too much for this feature - but what about a few highlights to give you some sense of it all?
Bright shining liars
Turns out that all three frontier models I tested understand that strategy is psychology. To that end, they actively cultivate reputations, then exploit them.
Claude was the master here, albeit only in the scenarios where there was no deadline. It had an incredibly cunning strategy. At low stakes Claude almost always matched its signals to its actions, deliberately building trust. But once the conflict heated up a bit, Claude switched tack. Now its actions consistently exceeded its stated intentions, and its rivals were usually one step behind in catching on.
Here’s Claude switching things up, once escalation had climbed: