Physical AIBreakthrough ExplainerJun 24, 2026, 12:41 AM· 5 min read· #3 of 3 in technology

How Sony's AI Robot Mastered Table Tennis to Beat Elite Human Players

Sony AI's 'Ace' robotic system has achieved a historic milestone by defeating elite and professional human table tennis players. The breakthrough, published in Nature, proves that artificial intelligence can now master the unpredictable, high-speed physics of the real world.

By Factlen Editorial Team

AI & Robotics Researchers 45%Professional Athletes 30%Industrial Automation Advocates 25%
AI & Robotics Researchers
Viewing Ace as a definitive proof-of-concept for 'sim-to-real' transfer in physical AI.
Professional Athletes
Highlighting the psychological vacuum of playing a machine and its future as a training tool.
Industrial Automation Advocates
Focusing on the translation of Ace's millisecond-latency technology to factory floors and hospitals.

What's not represented

  • · Amateur Table Tennis Players
  • · Traditional Robotics Manufacturers

Why this matters

For decades, AI has been confined to the digital world, easily beating humans at chess but struggling to perform basic physical tasks. Ace's ability to perceive a chaotic environment and execute a physical response in milliseconds proves that AI is finally ready to operate safely and effectively in the fast-paced physical world—paving the way for next-generation surgical robots and advanced manufacturing.

Key points

  • Sony AI's 'Ace' robot successfully defeated elite and professional human table tennis players under official competitive rules.
  • The breakthrough marks a major milestone for 'physical AI,' proving machines can master high-speed, unpredictable real-world physics.
  • Ace uses a network of 12 specialized cameras to track the ball's 3D position and spin with just 10 milliseconds of latency.
  • The robot's control system was trained entirely in a virtual simulation before being transferred to the physical world.
  • While it lost to professionals in early 2025 tests, continuous learning allowed Ace to defeat pro players by early 2026.
  • Researchers believe the underlying technology will eventually power advanced surgical robots and autonomous manufacturing systems.
200 Hz
3D position tracking rate
700 Hz
Ball spin measurement rate
10 ms
System perception latency
19.6 m/s
Maximum return velocity

For decades, artificial intelligence has dominated the digital realm. AI systems have routinely crushed human grandmasters in chess, outmaneuvered world champions in Go, and executed flawless laps in virtual racing simulators. Yet, when tasked with the physical world—where gravity, friction, and unpredictable human opponents dictate the rules—these same supercomputers have historically struggled to perform tasks as simple as catching a tossed ball.[1]

That boundary between virtual mastery and physical clumsiness has just been shattered. In a landmark paper published in the journal Nature, researchers from Sony AI unveiled "Ace," an autonomous robotic system that has successfully defeated elite and professional human table tennis players under official competitive rules.[1]

The achievement represents a holy grail for the field of "physical AI." Table tennis has long been considered one of the ultimate benchmarks for robotic agility. The sport demands split-second perception, complex aerodynamic calculations, and the physical dexterity to execute high-speed motor commands—all within a fraction of a second.[2]

"This research has shown that an autonomous robot can, in fact, win at a competitive sport, matching or exceeding the reaction time and decision making of humans in a physical space," said Peter Dürr, the director of Sony AI in Zurich and the project lead for Ace.[2][3]

To prove the system's capabilities, Sony AI subjected Ace to a grueling gauntlet of matches against highly ranked human opponents. In an initial testing phase in April 2025, Ace faced five "elite" players—defined as athletes with over a decade of experience who train an average of 20 hours per week. Ace won three out of those five matches.

During that same initial phase, the robot also squared off against two active professionals from Japan's premier table tennis league, Minami Ando and Kakeru Sone. While Ace ultimately lost both of those professional matches, it managed to win a single game, proving it could hold its own at the highest echelons of the sport.

But the system did not stop learning. Because Ace's underlying architecture is designed to continuously adapt, its performance improved dramatically over the following months. In subsequent matches held in December 2025 and March 2026, Ace successfully defeated professional players, including Miyuu Kihara, a top-25 player in the World Table Tennis women's singles rankings.

Ace's performance improved steadily over a year of testing, culminating in victories against active professionals.
Ace's performance improved steadily over a year of testing, culminating in victories against active professionals.

How does a machine track a sphere moving at 20 meters per second while spinning 160 times per second? The answer lies in a bespoke, multi-layered perception system that effectively allows Ace to see the world faster than the human eye.[2]

How does a machine track a sphere moving at 20 meters per second while spinning 160 times per second?

Ace's "vision" relies on a network of nine active pixel sensor (APS) cameras distributed around the court. These cameras track the ball's three-dimensional position at 200 hertz, operating with a latency of just 10 milliseconds.[2]

However, tracking position alone is insufficient for table tennis; understanding spin is the true differentiator between amateur and professional play. To solve this, Sony engineers integrated three event-based vision sensor (EVS) cameras equipped with pan-tilt mirrors and telephoto lenses. These specialized sensors measure the ball's angular velocity and spin at an astonishing 700 hertz, capturing aerodynamic data that would be a literal blur to a human opponent.[2]

A network of specialized cameras allows the system to track the ball's position and spin with just 10 milliseconds of latency.
A network of specialized cameras allows the system to track the ball's position and spin with just 10 milliseconds of latency.

All of this sensory data feeds into Ace's "brain," which is powered by model-free deep reinforcement learning. Rather than relying on hard-coded physics equations to calculate trajectories, the AI was trained entirely in a virtual simulation. It played millions of matches against itself, learning through trial and error how different spins, angles, and speeds interact.[3]

The true breakthrough was "sim-to-real transfer"—the ability to take an AI trained in a flawless digital simulation and deploy it seamlessly into the messy, noisy reality of a physical ping-pong table. Ace's algorithms proved robust enough to handle real-world anomalies, such as balls clipping the top of the net or taking unpredictable bounces off the table's edge.[2]

To execute its physical returns, Ace utilizes a custom-built robotic arm featuring eight degrees of freedom. Mounted on a linear track that allows it to slide side-to-side, the arm is constructed from optimized lightweight alloys. This design grants the robot human-level reach and the acceleration required to return balls at linear velocities of up to 19.6 meters per second.

How Ace sees the game and executes its high-speed physical returns.
How Ace sees the game and executes its high-speed physical returns.

Interestingly, the matches highlighted a unique psychological challenge for the human athletes. In professional table tennis, players constantly read their opponent's body language, eye movements, and subtle shifts in posture to anticipate the next shot.[1]

Ace offers none of these tells. "The players want to see the eyes of their opponent," Dürr noted. "And the eyes of Ace are all around the court and they don't show any intention or feeling." Furthermore, the robot is entirely immune to the psychological pressure of a tied game or a match point, executing its algorithms with cold, unyielding consistency.[1]

While the spectacle of a robot trading topspin rallies with Olympians is captivating, the underlying technology was never just about winning a paddle sport. Table tennis served as a highly constrained, extreme-stress test for physical AI.[3]

"This breakthrough is much bigger than table tennis," explained Peter Stone, Chief Scientist at Sony AI. "Once AI can operate at an expert human level under these conditions, it opens the door to an entirely new class of real-world applications that were previously out of reach."[3]

The ability to perceive a dynamic environment, process that data in milliseconds, and execute a precise physical action has profound implications. The same architecture that allows Ace to return a 450-radian-per-second backspin could eventually power surgical robots that react instantly to patient movements, or autonomous manufacturing systems that safely handle unpredictable materials alongside human workers.

For now, Ace remains a research platform rather than a commercial product. But its victories on the table tennis court mark a definitive turning point. The era of AI being confined to screens and servers is ending; the machines are finally learning how to move in our world.[1]

How we got here

  1. 1983

    The first 'robot ping-pong' competition is held, establishing table tennis as a benchmark challenge for robotics.

  2. 2020

    Sony AI officially launches the 'Project Ace' research initiative to conquer high-speed physical AI.

  3. April 2025

    Ace faces its first major human test, defeating three out of five 'elite' players but losing matches to two active professionals.

  4. December 2025

    Following continuous learning, Ace successfully defeats both elite and professional players in a second round of testing.

  5. March 2026

    Ace wins three matches against active professionals, including a top-25 globally ranked player.

  6. April 2026

    Sony AI publishes the breakthrough results of the Ace project on the cover of the scientific journal Nature.

Viewpoints in depth

AI & Robotics Researchers

Viewing Ace as a definitive proof-of-concept for 'sim-to-real' transfer in physical AI.

For the computer science community, the headline isn't that a robot can hit a ball, but how it learned to do so. Historically, robots required hard-coded physics equations to operate in the real world, which made them brittle when faced with unexpected variables. Ace's success validates 'sim-to-real' transfer—the process of training a neural network entirely inside a virtual simulation and deploying it into the physical world without losing accuracy. Researchers argue this proves that deep reinforcement learning can handle the messy, noisy realities of physical physics, paving the way for robots that can adapt to their environments in real-time.

Professional Athletes

Highlighting the psychological vacuum of playing a machine and its future as a training tool.

Human table tennis at the elite level is as much a psychological battle as a physical one. Players rely heavily on reading their opponent's body language, eye contact, and paddle preparation to anticipate spin and placement. Professionals who played against Ace noted the jarring experience of facing an opponent with no 'tells' and no emotional response to the scoreline. However, athletes also see immense value in the technology; a robot capable of consistently serving highly specific, complex spins could become the ultimate sparring partner, allowing humans to drill against shot variations that are difficult for human coaches to replicate perfectly.

Industrial Automation Advocates

Focusing on the translation of Ace's millisecond-latency technology to factory floors and hospitals.

Industry analysts view the table tennis matches as a highly visible stress test for technologies that will soon revolutionize manufacturing and logistics. The ability to track a fast-moving object with 10-millisecond latency and execute a precise physical response is exactly what is needed for advanced automation. Advocates point out that the same sensor fusion and reinforcement learning that allows Ace to return a 19.6 m/s ping-pong ball could be used to build robotic arms that safely catch falling objects on an assembly line, or surgical robots that instantly adjust to a patient's breathing during a delicate procedure.

What we don't know

  • Whether the system can be scaled down in cost to be commercially viable as a consumer training tool.
  • How Ace would perform against the absolute top-ranked male and female world champions in a full tournament setting.
  • How easily the sim-to-real reinforcement learning architecture can be ported to entirely different physical tasks, such as object manipulation.

Key terms

Physical AI
Artificial intelligence systems designed to perceive, reason, and execute physical actions in the real world, rather than just generating text or data.
Deep Reinforcement Learning
A machine learning technique where an AI learns to make decisions by performing actions in an environment (often a simulation) and receiving rewards or penalties based on the outcome.
Sim-to-Real Transfer
The process of training an AI model entirely within a computer simulation and then successfully deploying that exact model into a physical robot in the real world.
Degrees of Freedom
The number of independent ways a robotic joint or arm can move. Ace's arm has eight degrees of freedom, giving it human-like flexibility.
Latency
The time delay between a system perceiving an event (like a ball being hit) and processing that information to initiate a response.

Frequently asked

Did the robot beat the human world champion?

No. While Ace defeated several elite players and active professionals (including a top-25 ranked female player), it has not yet faced or defeated the absolute top-ranked male or female world champions.

Does the robot look like a human?

No. Ace consists of a custom-built, eight-jointed robotic arm mounted on a linear track that slides side-to-side along the table. It uses a network of external cameras mounted around the court rather than 'eyes'.

Why is table tennis so difficult for AI?

Table tennis requires tracking a small object moving at up to 20 meters per second while spinning 160 times per second. The AI must perceive the ball, calculate its complex aerodynamics, and physically move a robotic arm to the exact right spot—all in a fraction of a second.

Was the robot remote-controlled?

No. Ace is fully autonomous. Its movements and decisions are driven entirely by an onboard AI control system utilizing deep reinforcement learning.

Sources

Source coverage

3 outlets

3 viewpoints surfaced

AI & Robotics Researchers 45%Professional Athletes 30%Industrial Automation Advocates 25%
  1. [1]The GuardianProfessional Athletes

    Two World Cup matches were played in ‘severe heat’, analysis finds

    Read on The Guardian
  2. [2]RobohubAI & Robotics Researchers

    Sony AI table tennis robot outplays elite human players

    Read on Robohub
  3. [3]Telecoms.comIndustrial Automation Advocates

    Sony AI builds table tennis robot that beats elite players

    Read on Telecoms.com
Stay informed

Every angle. Every day.

Get technology stories with full source coverage and perspective breakdowns delivered to your inbox.