Loading...
Loading...
Standardized benchmarks for OpenClaw forks running on real hardware constraints. Each test runs in a Docker container matching the device's CPU and memory profile.
| # | Device | Fork | Score |
|---|---|---|---|
| 1 | Mac Mini M3 (16GB)Desktop | TypeScriptOpenClaw | 88 |
| 2 | Mac Mini M1 (used) |
A repeatable, containerized pipeline that tests every fork under real hardware constraints.
Fork is cloned into a Docker container with CPU and RAM limits matching the target device.
Dependencies installed via the native toolchain — Go, Rust, Python, TypeScript, or C.
Entry point detected, cold start timed, peak memory tracked via cgroup, disk usage measured.
Results combined into a 0–100 composite score weighted across four dimensions.
| TypeScriptOpenClaw |
| 78 |
| 3 | Raspberry Pi 5 (8GB)SBC | TypeScriptOpenClaw | 58 |
| 4 | Umbrel HomeAppliance | TypeScriptOpenClaw | 55 |
| 5 | Samsung Galaxy Tab S9Tablet | TypeScriptOpenClaw | 50 |
| 6 | iPhone 15 ProPhone | TypeScriptOpenClaw | 50 |
| 7 | OnePlus 12Phone | TypeScriptOpenClaw | 50 |
| 8 | Google Pixel 8Phone | TypeScriptOpenClaw | 50 |
| 9 | MacBook Pro 14" M3 ProLaptop | TypeScriptOpenClaw | 50 |
| 10 | Samsung Galaxy S24Phone | TypeScriptOpenClaw | 50 |
| 11 | Beelink Mini S12 ProMini PC | TypeScriptOpenClaw | 50 |
| 12 | QNAP TS-464NAS | TypeScriptOpenClaw | 50 |
| 13 | Lenovo Chromebook Duet 5Laptop | TypeScriptOpenClaw | 50 |
| 14 | Steam Deck (LCD)Handheld | TypeScriptOpenClaw | 50 |
| 15 | Mac Studio M2 MaxDesktop | TypeScriptOpenClaw | 50 |
| 16 | Steam Deck OLEDHandheld | TypeScriptOpenClaw | 50 |
| 17 | Orange Pi 5 (8GB)SBC | TypeScriptOpenClaw | 50 |
| 18 | Ubiquiti Dream MachineRouter | TypeScriptOpenClaw | 50 |
| 19 | Home Assistant YellowAppliance | TypeScriptOpenClaw | 50 |
| 20 | Radxa ROCK 5BSBC | TypeScriptOpenClaw | 50 |
| 21 | NVIDIA Jetson Orin NanoSBC | TypeScriptOpenClaw | 50 |
| 22 | GPD Win 4Handheld | TypeScriptOpenClaw | 50 |
| 23 | ASUS PN53Mini PC | TypeScriptOpenClaw | 50 |
| 24 | Cloud VPS (4GB)Cloud | TypeScriptOpenClaw | 50 |
| 25 | Cloud VPS (8GB)Cloud | TypeScriptOpenClaw | 50 |
| 26 | Intel NUC 13 ProMini PC | TypeScriptOpenClaw | 50 |
| 27 | ThinkPad T480 (used)Laptop | TypeScriptOpenClaw | 50 |
| 28 | Framework Laptop 16Laptop | TypeScriptOpenClaw | 50 |
| 29 | Raspberry Pi 4 (4GB)SBC | TypeScriptOpenClaw | 50 |
| 30 | ThinkPad X1 Carbon Gen 11Laptop | TypeScriptOpenClaw | 50 |
| 31 | Geekom Mini IT12Mini PC | TypeScriptOpenClaw | 50 |
| 32 | GMKtec NucBox K8Mini PC | TypeScriptOpenClaw | 50 |
| 33 | HP EliteBook 845 G10Laptop | TypeScriptOpenClaw | 50 |
| 34 | Supermicro Mini-ITX (Xeon D)Server | TypeScriptOpenClaw | 50 |
| 35 | AWS Graviton3 ARM (4GB)Cloud | TypeScriptOpenClaw | 50 |
| 36 | Cloud GPU (T4)Cloud | TypeScriptOpenClaw | 50 |
| 37 | Cloud GPU (H100)Cloud | TypeScriptOpenClaw | 50 |
| 38 | Lambda Cloud (A100x8)Cloud | TypeScriptOpenClaw | 50 |
| 39 | Dell OptiPlex 7050 (refurb)Server | TypeScriptOpenClaw | 50 |
| 40 | Lenovo ThinkCentre M75q TinyMini PC | TypeScriptOpenClaw | 50 |
| 41 | LattePanda SigmaMini PC | TypeScriptOpenClaw | 50 |
| 42 | ROG AllyHandheld | TypeScriptOpenClaw | 50 |
| 43 | Custom PC (Ryzen 5600X + RTX 3060)Desktop | TypeScriptOpenClaw | 50 |
| 44 | Cloud VPS (2GB)Cloud | TypeScriptOpenClaw | 50 |
| 45 | System76 Lemur ProLaptop | TypeScriptOpenClaw | 50 |
| 46 | Dell XPS 15Laptop | TypeScriptOpenClaw | 50 |
| 47 | HP Z2 Mini G9Desktop | TypeScriptOpenClaw | 50 |
| 48 | HP ProLiant DL380 Gen10Server | TypeScriptOpenClaw | 50 |
| 49 | Custom PC (i5-12400 Budget)Desktop | TypeScriptOpenClaw | 50 |
| 50 | Dell OptiPlex Micro 7010Desktop | TypeScriptOpenClaw | 50 |
| 51 | Mac Pro M2 UltraDesktop | TypeScriptOpenClaw | 45 |
| 52 | Banana Pi BPI-M7SBC | TypeScriptOpenClaw | 45 |
| 53 | Libre Computer Le PotatoSBC | TypeScriptOpenClaw | 45 |
| 54 | Google Pixel 4a (used)Phone | TypeScriptOpenClaw | 45 |
| 55 | iPad Pro M2Tablet | TypeScriptOpenClaw | 45 |
| 56 | BeagleBone AI-64SBC | TypeScriptOpenClaw | 45 |
| 57 | Pinebook ProLaptop | TypeScriptOpenClaw | 45 |
| 58 | MacBook Air M2Laptop | TypeScriptOpenClaw | 45 |
Messaging, browser, code exec, memory, files, search, MCP, tool use
Cold start time — clone + install + startup. Under 5s = full marks
Disk footprint after install. Under 20MB = full marks
5 pts for dependency install, 5 pts for successful startup
Detected via static source analysis and runtime module probing. Each passed test contributes 5 pts to the capabilities score.
Run benchmarks locally or contribute improvements