# An open model learns to work a robot arm entirely in simulation

Researchers trained a 27-billion-parameter open-weight reasoning model to control robot arms using only simulated practice. On a real two-armed robot it had never seen, it succeeded in 18 of 30 trials. The work is a preprint and has not been peer reviewed.

- Category: Robotics
- Readiness level: III (Open source) on Science Underway's four-step scale, as proposed
- Published: 2026-11-16
- Editor: Stefan Perdal
- URL: https://scienceunderway.com/articles/an-open-model-learns-to-work-a-robot-arm-entirely-in-simulation

## The study

Training Reasoning Models in Simulation to Natively Use Real Robots (preprint, not peer reviewed). arXiv 2611.18562. https://arxiv.org/abs/2611.18562

## At a glance

- What it shows: A freely available AI model learned to move robot arms by trial and error inside a simulator, with no human demonstrations. It then completed 18 of 30 simple tasks on a real robot, while the untrained model completed none.
- What it does not show: It does not show reliable real-world use. The real test was small, covered two tasks the model had practised in simulation, and each move took several seconds of thinking.
- Why it matters: Until now, robots driven by general AI models worked well mainly with expensive closed models. This suggests open models can catch up through simulated practice alone.

## What the study shows

The team, from MIT, UC Berkeley, UCSD, NVIDIA and Inco AI, started from Qwen3.8-27B. This is an open-weight model, meaning anyone can download and run it. It can read images and reason in text before answering.

They set it up as a robot-use agent. This works like an AI that operates a computer from screenshots. In each round, the model looks at camera images and the arm's position, reasons in text, and outputs where the gripper should go next. Standard robot software then moves the arm there.

The model received no helper tools: no object detector, no motion planner, no library of ready-made skills. It had to find objects, plan moves and notice failures by itself.

Training used reinforcement learning, where a model learns from a reward signal. Here the reward was simply whether the simulated task succeeded. Training ran on two simulated benchmarks: LIBERO, with a single arm, then two tasks in RoboDojo, with two arms. It took about 50,000 GPU-hours.

On LIBERO, success rose from under 2% to 74.4%. The authors report this is close to the best closed models from OpenAI at their maximum reasoning setting, which scored about 76% and 81%.

The authors compared it with π0.5, a robot model trained by copying human demonstrations. π0.5 scored higher on the original LIBERO tasks. But when the scene stayed the same and the instruction asked for a different task, π0.5 succeeded under 1% of the time. The new model succeeded 57% of the time. The π0.5 figures come from earlier papers, not new runs.

On a real two-armed robot that no model had trained on, the final model succeeded in 18 of 30 trials. The base model succeeded in none. Scores on nine general tests of maths, coding and vision showed no measurable loss after robot training.

## Our reading

In our reading, the main result is that one recipe for training computer-using AI also works for robots. The model never saw a real robot or a human demonstration. Yet it moved from failing almost every task to succeeding in most simulated ones, and then carried some of that skill to real hardware.

The comparison with π0.5 is the most interesting part. Models that learn by imitation tend to repeat the motion they were shown. This model reads the instruction and acts on it. In practice, that could mean a warehouse arm that can be told to pick a different item from a familiar shelf without fresh demonstrations. That remains a hope, not something this paper tested.

The real-robot evidence is thin. Thirty trials on two tasks is a lab check, not proof of reliability. The final model had also practised both tasks in simulation, on a different robot. We rate the work at readiness level III, open source available: the training engine is public on GitHub, but the paper does not say whether the trained model weights are released.

The rest of the article (what it means, limits, what to watch) is free for members: https://scienceunderway.com/articles/an-open-model-learns-to-work-a-robot-arm-entirely-in-simulation

## How this was made

An AI model read the study and wrote this article in the structure Science Underway uses. An editor reviewed it and approved it for publication. Check the original study before you rely on the details.

---
Source: Science Underway, https://scienceunderway.com/. Please link to the article when you cite it.
