Loading...
Loading...
Standardized benchmarks for OpenClaw forks running on real hardware constraints. Each test runs in a Docker container matching the device's CPU and memory profile.
| # | Device | Fork | Score |
|---|---|---|---|
| 1 | Mac Mini M1 (used)Mini PC | PythonNanobot | 91 |
| 2 | Raspberry Pi 5 (8GB) |
A repeatable, containerized pipeline that tests every fork under real hardware constraints.
Fork is cloned into a Docker container with CPU and RAM limits matching the target device.
Dependencies installed via the native toolchain — Go, Rust, Python, TypeScript, or C.
Entry point detected, cold start timed, peak memory tracked via cgroup, disk usage measured.
Results combined into a 0–100 composite score weighted across four dimensions.
| PythonNanobot |
| 82 |
| 3 | Pinebook ProLaptop | PythonNanobot | 74 |
| 4 | Samsung Galaxy Tab S9Tablet | PythonNanobot | 69 |
| 5 | Google Pixel 8Phone | PythonNanobot | 69 |
| 6 | BeagleBone AI-64SBC | PythonNanobot | 69 |
| 7 | OnePlus 12Phone | PythonNanobot | 69 |
| 8 | Orange Pi 5 (8GB)SBC | PythonNanobot | 69 |
| 9 | TCL 30 SE (Budget Android)Phone | PythonNanobot | 69 |
| 10 | Samsung Galaxy S24Phone | PythonNanobot | 69 |
| 11 | Steam Deck (LCD)Handheld | PythonNanobot | 69 |
| 12 | Libre Computer Le PotatoSBC | PythonNanobot | 69 |
| 13 | Raspberry Pi Zero 2 WSBC | PythonNanobot | 69 |
| 14 | Home Assistant YellowAppliance | PythonNanobot | 64 |
| 15 | Home Assistant GreenAppliance | PythonNanobot | 64 |
| 16 | Asustor AS5402TNAS | PythonNanobot | 64 |
| 17 | Google Pixel 4a (used)Phone | PythonNanobot | 64 |
| 18 | Pine64 ROCK64SBC | PythonNanobot | 59 |
| 19 | Cloud VPS (2GB)Cloud | PythonNanobot | 59 |
| 20 | ThinkPad T480 (used)Laptop | PythonNanobot | 59 |
| 21 | Steam Deck OLEDHandheld | PythonNanobot | 59 |
| 22 | QNAP TS-464NAS | PythonNanobot | 59 |
| 23 | Lenovo Chromebook Duet 5Laptop | PythonNanobot | 59 |
| 24 | Synology DS923+NAS | PythonNanobot | 59 |
| 25 | ROG AllyHandheld | PythonNanobot | 59 |
| 26 | Raspberry Pi 4 (4GB)SBC | PythonNanobot | 49 |
Messaging, browser, code exec, memory, files, search, MCP, tool use
Cold start time — clone + install + startup. Under 5s = full marks
Disk footprint after install. Under 20MB = full marks
5 pts for dependency install, 5 pts for successful startup
Detected via static source analysis and runtime module probing. Each passed test contributes 5 pts to the capabilities score.
Run benchmarks locally or contribute improvements