Loading...
Loading...
Standardized benchmarks for OpenClaw forks running on real hardware constraints. Each test runs in a Docker container matching the device's CPU and memory profile.
| # | Device | Fork | Score |
|---|---|---|---|
| 1 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 77 |
| 2 | Cloud VPS (4GB) |
A repeatable, containerized pipeline that tests every fork under real hardware constraints.
Fork is cloned into a Docker container with CPU and RAM limits matching the target device.
Dependencies installed via the native toolchain — Go, Rust, Python, TypeScript, or C.
Entry point detected, cold start timed, peak memory tracked via cgroup, disk usage measured.
Results combined into a 0–100 composite score weighted across four dimensions.
| TypeScriptMoltworker |
| 72 |
| 3 | Cloud VPS (4GB)Cloud | CMimiClaw | 65 |
| 4 | Lambda Cloud (A100x8)Cloud | TypeScriptNanoClaw | 60 |
| 5 | Cloud VPS (8GB)Cloud | TypeScriptNanoClaw | 60 |
| 6 | Cloud GPU (H100)Cloud | TypeScriptNanoClaw | 60 |
| 7 | AWS Graviton3 ARM (4GB)Cloud | TypeScriptNanoClaw | 60 |
| 8 | Cloud VPS (2GB)Cloud | TypeScriptNanoClaw | 60 |
| 9 | Cloud GPU (T4)Cloud | TypeScriptNanoClaw | 60 |
| 10 | Cloud VPS (2GB)Cloud | PythonNanobot | 59 |
| 11 | AWS Graviton3 ARM (4GB)Cloud | GoPicoClaw | 57 |
| 12 | Cloud VPS (2GB)Cloud | GoPicoClaw | 57 |
| 13 | Cloud VPS (4GB)Cloud | TypeScriptOpenClaw | 50 |
| 14 | Cloud VPS (8GB)Cloud | TypeScriptOpenClaw | 50 |
| 15 | AWS Graviton3 ARM (4GB)Cloud | TypeScriptOpenClaw | 50 |
| 16 | Cloud GPU (T4)Cloud | TypeScriptOpenClaw | 50 |
| 17 | Cloud GPU (H100)Cloud | TypeScriptOpenClaw | 50 |
| 18 | Lambda Cloud (A100x8)Cloud | TypeScriptOpenClaw | 50 |
| 19 | Cloud VPS (2GB)Cloud | TypeScriptOpenClaw | 50 |
| 20 | Cloud VPS (2GB)Cloud | CMimiClaw | 42 |
| 21 | Cloud VPS (2GB)Cloud | CMimiClaw | 42 |
| 22 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 7.5 |
| 23 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 7.5 |
| 24 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 7.5 |
| 25 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 7.5 |
| 26 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 7.5 |
| 27 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 7.5 |
| 28 | Cloud VPS (2GB)Cloud | TypeScriptMoltworker | 7.5 |
Messaging, browser, code exec, memory, files, search, MCP, tool use
Cold start time — clone + install + startup. Under 5s = full marks
Disk footprint after install. Under 20MB = full marks
5 pts for dependency install, 5 pts for successful startup
Detected via static source analysis and runtime module probing. Each passed test contributes 5 pts to the capabilities score.
Run benchmarks locally or contribute improvements