LIBERO-PRO
| Method / model | Success rate |
|---|
| Codex / GPT-6 Astra / low / reasoning | 92.63% |
| Claude Code / Opus-4.7 / max.reasoning | 82.4% |
| RPent Flash Mode | 72.63% |
| Codex / GPT-5.5 / xhigh / reasoning | 72.1% |
| ASPIRE | 61.36% |
| π_RLinf | 50.0% |
| π0.5 | 11.0% |
| AtomVLA | 6.3% |
| X-VLA | 3.8% |
| MolmoAct | 1.5% |
| π0 | 0.3% |
GPT-6 Astra: 92.63% (741/800). RPent Flash Mode / Molmo2-8B: 72.63% (581/800).
All methods & reported scores
| Method / model | Overall | Spatial Task | Spatial Swap | Object Task | Object Swap | Goal Task | Goal Swap | Long Task | Long Swap |
|---|
| GPT-6 Astra | 92.63% | 100% | 98% | 100% | 99% | 88% | 99% | 85% | 72% |
| Opus-4.7 / max.reasoning | 82.4% | — | — | — | — | — | — | — | — |
| RPent Flash Mode / Molmo2-8B | 72.63% | 79.00% | 70.00% | 86.00% | 93.00% | 74.00% | 65.00% | 60.00% | 54.00% |
| GPT-5.5 | 72.1% | 81.0% | 69.0% | 94.0% | 91.0% | 75.0% | 66.0% | 52.0% | 49.0% |
| ASPIRE | 61.36% | 60.0% | 51.0% | 95.0% | 98.0% | 45.0% | 81.0% | 38.3% | 22.6% |
| π_RLinf | 50.0% | 42.0% | 59.0% | 71.0% | 78.0% | 45.0% | 42.0% | 49.0% | 14.0% |
| π0.5 | 11.0% | 1.0% | 20.0% | 1.0% | 17.0% | 2.0% | 38.0% | 1.0% | 8.0% |
| AtomVLA | 6.3% | 1.0% | 16.0% | 0.0% | 10.0% | 11.0% | 2.0% | 9.0% | 1.0% |
| X-VLA | 3.8% | 0.0% | 0.0% | 8.0% | 2.0% | 9.0% | 1.0% | 10.0% | 0.0% |
| MolmoAct | 1.5% | 0.0% | 0.0% | 0.0% | 6.0% | 0.0% | 0.0% | 6.0% | 0.0% |
| π0 | 0.3% | 0.0% | 0.0% | 0.0% | 2.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| Cap-X | — | 14.0% | 12.0% | 18.0% | 22.0% | 17.0% | 26.0% | — | — |
| RATS | — | 31.0% | 29.0% | 63.0% | 61.0% | 36.0% | 43.0% | — | — |
ASPIRE: Long Task and Long Swap use zero-shot transfer from the LIBERO-90 skill library.
GPT-6 Astra: Long Task/Swap and the other six suites use separate memory-file snapshots frozen after their respective exploration phases, with no updates during evaluation. Overall combines two non-overlapping batches: Long 157/200 plus the other suites 584/600, giving 741/800 (92.63%); the 800 episodes do not share a single memory snapshot.