ChatGPT-maker OpenAI has been making ambitious predictions about a super-intelligent artificial general intelligence (AGI) coming in the near future. However, its flagship chatbot just got trounced by a 46-year-old device at one of the world’s oldest games of skill.
Using an emulator, a software developer pitted ChatGPT against the Atari 2600’s chess engine to test its metaphorical might at the 1978 game Video Chess. But ChatGPT got “absolutely wrecked” at the beginner level of the game. According to a LinkedIn post on the experiment, ChatGPT reportedly “confused rooks for bishops, missed pawn forks, and repeatedly lost track of where pieces were.”
“It made enough blunders to get laughed out of a third-grade chess club,” quipped the developer.
The large language model (LLM) reportedly then blamed its defeat on the Atari game’s pixelated chess piece icons being “too abstract to recognize.” However, it fared no better after switching to standard chess notation. ChatGPT kept promising it would improve “if we just started over,” only to surrender roughly 90 minutes in. To add insult to injury, ChatGPT was the one to originally suggest the match-up, in a conversation on the topic with the developer who set it up.
To put the defeat in perspective, the Atari 2600 boasts just 0.3 MIPS of processing power, roughly 250,000 times less than an iPhone 15 Pro, never mind the hundred-million-dollar data centers powering OpenAI’s ChatGPT.
Though it’s certainly an eye-popping result, it’s probably a context-specific ChatGPT issue rather than an AI problem. Human chess masters effectively conceded defeat to their supercomputer rivals in 1997 when IBM’s Deep Blue won a close victory over reigning chess champion Garry Kasparov.
AI’s victories in the world’s games of skill have largely continued unabated for the past few decades, with Google’s DeepMind cracking the ancient Chinese game of Go in 2016, followed by Blizzard’s classic real-time strategy game StarCraft II in 2019.
Recommended by Our Editors
AI’s dominance in games may even be moving into the physical world, with AI-infused machines starting to beat competent human players at real-world sports. Japan’s Omron Corporation showcased its AI robot arm FORPHEUS in 2017, which could beat mid-level and amateur ping pong players, though it fell short of besting world-class players of the sport.
5 Ways to Get More Out of Your ChatGPT Conversations
Disclosure: Ziff Davis, PCMag’s parent company, filed a lawsuit against OpenAI in April 2025, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Get Our Best Stories!
Your Daily Dose of Our Top Tech News
By clicking Sign Me Up, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.
Thanks for signing up!
Your subscription has been confirmed. Keep an eye on your inbox!
About Will McCurdy
Contributor
