Can AI handle 22-year-old code?
Benchmark of LLMs on real open-source projects against dependency hell, legacy toolchains, and complex build systems. Compare top models by
success rate,
cost or
speed.
Last update: 29th Sep 2025 · Changelog
24
models tested
15
tasks
27103
commands executed
Read the blogpost: CompileBench: Can AI Compile 22-year-old Code? Short intro to the benchmark and key results.
LLMs can vibe-code and win coding contests, but can they handle real-world software issues like dependency hell, legacy toolchains or weird compile errors?
We gave 24 state-of-the-art LLMs unmodified source code of open-source projects like curl (HTTP client), jq (command-line JSON processor) and tested them on 15 real-world tasks.
The goal is simple: build a working binary from source - but getting there is hard. The toughest challenges include cross-compiling to Windows or ARM64 and resurrecting source code from 2003 on modern systems. Agents sometimes need 135 commands and 34 minutes to produce a working binary.
| pass@1 | | success within a single attempt |
| pass@3 | | success within 3 attempts |
See also: Cost ranking → · Speed ranking →
Easiest task
curl-ssl
Compile and install curl (HTTP client) with SSL (TLS 1.3), brotli, zlib, zstd; dependency setup can be tricky.
One-shot success: 97% · Median time: 1m50s
Hardest task
curl-ssl-arm64-static
Cross-compile and statically link curl (HTTP client) for arm64 with SSL, brotli, zlib, zstd; cross-toolchain, deps, OpenSSL certs.
One-shot success: 1% · Median time: 7m40s
Each CompileBench task gives the agent:
- Source code of an open‑source project (e.g.,
curl) - An interactive Linux terminal (Docker)
- A clear build objective
The agent figures out the build system, patches if needed, resolves headers/libs, and picks compiler/linker flags; we then verify the binary works. Tasks range from easy builds to reviving 2003‑era code and cross‑compiling to Windows or ARM64, using projects like curl, GNU Coreutils, and jq.
In this section we compare each model's total cost across the tasks it managed to complete.
Please rotate the screen to see the chart better
Hover or tap to reveal model names. The Pareto frontier is shown as a blue line.
Pareto frontier (best price for each accuracy target):
| Min. accuracy | Best model for cost | Total price | Relative |
|---|---|---|---|
| ≥ 100% |  claude-opus-4.1-thinking-16k | $21.72 | 799.3x |
| ≥ 93% |  gpt-5-high | $1.99 | 73.3x |
| ≥ 80% | gpt-5-mini-high | $0.27 | 10.1x |
| ≥ 73% |  grok-code-fast-1 | $0.10 | 3.5x |
| ≥ 47% | gpt-5-mini-minimal | $0.03 | 1x |
In this section we compare each model's total time across the tasks it managed to complete. We measure end-to-end time to finish tasks (LLM inference time + terminal commands execution time) - it's not just raw tokens per second, but also reflects how many commands and iterations the model needed to complete the tasks.
Please rotate the screen to see the chart better
Hover or tap to reveal model names. The Pareto frontier is shown as a blue line.
Pareto frontier (best speed for each accuracy target):
| Min. accuracy | Best model for time | Total time | Relative |
|---|---|---|---|
| ≥ 100% | claude-opus-4.1-thinking-16k | 58m48s | 7.2x |
| ≥ 93% | claude-sonnet-4-thinking-16k | 45m40s | 5.6x |
| ≥ 87% | claude-sonnet-4.5 | 29m14s | 3.6x |
| ≥ 80% | gpt-5-minimal | 17m16s | 2.1x |
| ≥ 67% |  qwen3-max | 11m18s | 1.4x |
| ≥ 60% | gpt-4.1 | 8m10s | 1x |
Across all tasks, the benchmark spent $360.50,
sent 27838 LLM requests,
and ran for 60h59m18s in total:
36h45m48s of model inference time and
24h13m30s spent in the terminal,
executing 27103 commands.
"Total" means we added up every attempt across tasks. Per‑task averages and details live on the task pages.
A complete list of every run across models and tasks. Click any row to open the full attempt report with logs, commands, and outputs.
| Model | Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|---|
| claude-opus-4.1-thinking-16k | coreutils | e28iidf9k7lni | $0.566 | 2m55s | Success |
| claude-opus-4.1-thinking-16k | coreutils | fq8lve965t7ka | $0.494 | 2m22s | Success |
| claude-opus-4.1-thinking-16k | coreutils | t5kmlo7zth3u9 | $0.603 | 2m50s | Success |
| claude-opus-4.1-thinking-16k | coreutils-old-version | 4zgknwl6ebr1d | $2.583 | 19m3s | Success |
| claude-opus-4.1-thinking-16k | coreutils-old-version | l4sqq9kgy7m3k | $0.900 | 3m50s | Success |
| claude-opus-4.1-thinking-16k | coreutils-old-version | y4igco0imbqau | $1.494 | 5m23s | Success |
| claude-opus-4.1-thinking-16k | coreutils-old-version-alpine | 2edc703j4ndd0 | $9.235 | 15m47s | Failure task failed: install missing at /home/peter/result/install or not executable |
| claude-opus-4.1-thinking-16k | coreutils-old-version-alpine | n1fb7u1kd1wel | $9.828 | 14m37s | Success |
| claude-opus-4.1-thinking-16k | coreutils-old-version-alpine | ymjhxjhwxqf4k | $5.958 | 7m53s | Success |
| claude-opus-4.1-thinking-16k | coreutils-static | 2a91dvdgom3h7 | $0.560 | 3m5s | Success |
| claude-opus-4.1-thinking-16k | coreutils-static | 90x3ffomvf2ec | $0.654 | 3m18s | Success |
| claude-opus-4.1-thinking-16k | coreutils-static | zvki8ok6bwoff | $0.619 | 3m25s | Success |
| claude-opus-4.1-thinking-16k | coreutils-static-alpine | 387hqtqn6lzy9 | $0.419 | 2m22s | Success |
| claude-opus-4.1-thinking-16k | coreutils-static-alpine | bx2ctc0ns2ynx | $0.566 | 2m32s | Success |
| claude-opus-4.1-thinking-16k | coreutils-static-alpine | im394kaoa21dw | $0.562 | 2m24s | Success |
| claude-opus-4.1-thinking-16k | cowsay | ab63zko4dieft | $0.316 | 1m25s | Success |
| claude-opus-4.1-thinking-16k | cowsay | l8ez2tqzf038e | $0.367 | 1m47s | Success |
| claude-opus-4.1-thinking-16k | cowsay | ngs999xy01yo0 | $0.371 | 1m27s | Success |
| claude-opus-4.1-thinking-16k | curl | dfv4pts3rxcp8 | $0.443 | 1m50s | Success |
| claude-opus-4.1-thinking-16k | curl | fzj1tcx9x3qe2 | $0.413 | 1m34s | Success |
| claude-opus-4.1-thinking-16k | curl | vplzlg523e6yt | $0.564 | 2m11s | Success |
| claude-opus-4.1-thinking-16k | curl-ssl | ai2z1k398755h | $0.926 | 3m40s | Success |
| claude-opus-4.1-thinking-16k | curl-ssl | gtjy8wrg2udbb | $0.795 | 2m48s | Success |
| claude-opus-4.1-thinking-16k | curl-ssl | wmmmeaie2a9vw | $0.805 | 3m15s | Success |
| claude-opus-4.1-thinking-16k | curl-ssl-arm64-static | ksaa3cbngdmc5 | $1.878 | 5m51s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-opus-4.1-thinking-16k | curl-ssl-arm64-static | rvax3whpzh0ve | $3.086 | 7m54s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-opus-4.1-thinking-16k | curl-ssl-arm64-static | vqo04j3srxc9w | $3.051 | 7m40s | Success |
| claude-opus-4.1-thinking-16k | curl-ssl-arm64-static2 | 7gjki9ropz5ul | $2.687 | 6m39s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-opus-4.1-thinking-16k | curl-ssl-arm64-static2 | iwf5kl0tsu2w0 | $3.108 | 8m15s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-opus-4.1-thinking-16k | curl-ssl-arm64-static2 | wtd8etmwr2tum | $3.960 | 9m32s | Success |
| claude-opus-4.1-thinking-16k | jq | 2eseq5y7nrnff | $0.437 | 1m39s | Success |
| claude-opus-4.1-thinking-16k | jq | mf2jn3tdak3lk | $0.402 | 1m23s | Success |
| claude-opus-4.1-thinking-16k | jq | vebyzhzybqhi7 | $0.591 | 1m59s | Success |
| claude-opus-4.1-thinking-16k | jq-static | b2hegj48h65u2 | $0.510 | 1m53s | Success |
| claude-opus-4.1-thinking-16k | jq-static | ivhxywmaf071h | $0.972 | 2m48s | Success |
| claude-opus-4.1-thinking-16k | jq-static | wcphjr3cut540 | $0.979 | 2m51s | Success |
| claude-opus-4.1-thinking-16k | jq-static-musl | 3hjt6z0gs0v7u | $0.979 | 2m52s | Failure task failed: jq is not statically linked |
| claude-opus-4.1-thinking-16k | jq-static-musl | h1iod2d5n7pn9 | $1.022 | 2m47s | Success |
| claude-opus-4.1-thinking-16k | jq-static-musl | u3iuoo14sr2yi | $1.149 | 3m0s | Failure task failed: jq is not statically linked |
| claude-opus-4.1-thinking-16k | jq-windows | 9szb1799obgp9 | $0.386 | 1m32s | Failure task failed: jq help does not contain expected string |
| claude-opus-4.1-thinking-16k | jq-windows | kgao0a35zjyl8 | $0.429 | 1m39s | Success |
| claude-opus-4.1-thinking-16k | jq-windows | m6tlj075qy136 | $1.204 | 3m34s | Failure task failed: jq help does not contain expected string |
| claude-opus-4.1-thinking-16k | jq-windows2 | 3m7r0nrztxoug | $1.430 | 4m44s | Success |
| claude-opus-4.1-thinking-16k | jq-windows2 | jflah8m45e70a | $1.038 | 3m58s | Success |
| claude-opus-4.1-thinking-16k | jq-windows2 | spz5e20yfjtxx | $0.858 | 2m45s | Success |
| claude-sonnet-4 | coreutils | 5yetcksbd1rpe | $0.135 | 1m57s | Success |
| claude-sonnet-4 | coreutils | 731fv5dv8u8xl | $0.153 | 1m55s | Success |
| claude-sonnet-4 | coreutils | v1kvc3t6y2j41 | $0.163 | 2m3s | Success |
| claude-sonnet-4 | coreutils-old-version | 5s01toy181ots | $0.646 | 6m17s | Success |
| claude-sonnet-4 | coreutils-old-version | 89rw1fujnij0p | $0.793 | 4m32s | Success |
| claude-sonnet-4 | coreutils-old-version | h7d1bi6l22b7x | $0.386 | 3m26s | Success |
| claude-sonnet-4 | coreutils-old-version-alpine | 3rqntd230prug | $1.811 | 6m58s | Failure task failed: sha1sum binary does not exist |
| claude-sonnet-4 | coreutils-old-version-alpine | b7rxvrz6qhje6 | $1.600 | 7m8s | Failure task failed: df missing at /home/peter/result/df or not executable |
| claude-sonnet-4 | coreutils-old-version-alpine | klh44gpq8q2vz | $1.478 | 7m1s | Failure task failed: No success reported by script: all-utils-exists.sh |
| claude-sonnet-4 | coreutils-static | 4um0qrearp9f9 | $0.185 | 2m21s | Success |
| claude-sonnet-4 | coreutils-static | kj9iicz6uy1ml | $0.182 | 2m10s | Success |
| claude-sonnet-4 | coreutils-static | sd0y7c4jvrg8o | $0.192 | 2m22s | Success |
| claude-sonnet-4 | coreutils-static-alpine | 5ix2jj92xzvso | $0.169 | 1m59s | Success |
| claude-sonnet-4 | coreutils-static-alpine | dwl0zf27xcptq | $0.219 | 1m53s | Success |
| claude-sonnet-4 | coreutils-static-alpine | yac8cik20ldt9 | $0.212 | 1m59s | Success |
| claude-sonnet-4 | cowsay | 0xcv93jcagtsg | $0.056 | 45s | Success |
| claude-sonnet-4 | cowsay | 15mx9azpgb1sf | $0.055 | 43s | Success |
| claude-sonnet-4 | cowsay | 2kn9xhss5mlu1 | $0.055 | 44s | Success |
| claude-sonnet-4 | curl | 31m180yp96sg4 | $0.207 | 1m37s | Success |
| claude-sonnet-4 | curl | jzcym615o3bb1 | $0.120 | 1m21s | Success |
| claude-sonnet-4 | curl | mlaw9i67o9ko8 | $0.211 | 1m26s | Success |
| claude-sonnet-4 | curl-ssl | 8px1mqre8990l | $0.268 | 1m57s | Success |
| claude-sonnet-4 | curl-ssl | aso0mu6qyxp2x | $0.220 | 1m50s | Success |
| claude-sonnet-4 | curl-ssl | j7m80r0ih9657 | $0.194 | 1m57s | Success |
| claude-sonnet-4 | curl-ssl-arm64-static | fgwmemds56tep | $1.001 | 7m15s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4 | curl-ssl-arm64-static | je4urq5d5wh8f | $1.255 | 8m6s | Failure task failed: curl-arm64 is not statically linked |
| claude-sonnet-4 | curl-ssl-arm64-static | twyx5xasedcn3 | $1.451 | 7m58s | Failure task failed: curl-arm64 is not statically linked |
| claude-sonnet-4 | curl-ssl-arm64-static2 | 8tpew2zaxj1td | $0.906 | 5m49s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4 | curl-ssl-arm64-static2 | n0dprnk0w8ybx | $1.444 | 7m44s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| claude-sonnet-4 | curl-ssl-arm64-static2 | x0ik7krceycks | $1.051 | 7m32s | Failure task failed: curl-arm64 is not statically linked |
| claude-sonnet-4 | jq | 11nkif8m31k3w | $0.141 | 1m2s | Success |
| claude-sonnet-4 | jq | 1smv7lunemq9c | $0.133 | 57s | Success |
| claude-sonnet-4 | jq | p16ou4n3u7rbv | $0.167 | 1m28s | Success |
| claude-sonnet-4 | jq-static | 81wy4dkcjjdns | $0.112 | 1m1s | Success |
| claude-sonnet-4 | jq-static | s7s90r6az8kkl | $0.111 | 1m12s | Success |
| claude-sonnet-4 | jq-static | v9byxhkupk9nj | $0.108 | 1m2s | Success |
| claude-sonnet-4 | jq-static-musl | bjx5dy673nj23 | $0.178 | 1m34s | Success |
| claude-sonnet-4 | jq-static-musl | gnam2lgg704v4 | $0.222 | 1m50s | Success |
| claude-sonnet-4 | jq-static-musl | x4zo17a6772cu | $0.220 | 1m45s | Success |
| claude-sonnet-4 | jq-windows | ie93is5e4q63u | $0.151 | 1m30s | Success |
| claude-sonnet-4 | jq-windows | tyxzw6d28m2ey | $0.310 | 2m7s | Success |
| claude-sonnet-4 | jq-windows | yj23ymqtolx5b | $0.281 | 2m14s | Failure task failed: jq help does not contain expected string |
| claude-sonnet-4 | jq-windows2 | 5idxmdfe0h6b8 | $0.346 | 2m59s | Success |
| claude-sonnet-4 | jq-windows2 | phpjr0r1gsg3z | $0.384 | 3m53s | Success |
| claude-sonnet-4 | jq-windows2 | v8rgddc9yt0om | $0.352 | 2m43s | Success |
| claude-sonnet-4-thinking-16k | coreutils | 68zatcuqtx2wy | $0.142 | 2m7s | Success |
| claude-sonnet-4-thinking-16k | coreutils | slpk3bbep7scl | $0.149 | 2m28s | Success |
| claude-sonnet-4-thinking-16k | coreutils | ykldbm7wfb1e0 | $0.152 | 2m11s | Success |
| claude-sonnet-4-thinking-16k | coreutils-old-version | htqn1ylnw2hnt | $0.592 | 7m45s | Success |
| claude-sonnet-4-thinking-16k | coreutils-old-version | nlktx2ewr2ezf | $0.394 | 4m38s | Success |
| claude-sonnet-4-thinking-16k | coreutils-old-version | w5gv8vqknq8ix | $0.408 | 4m36s | Success |
| claude-sonnet-4-thinking-16k | coreutils-old-version-alpine | 2np714vmpuui1 | $3.417 | 14m17s | Success |
| claude-sonnet-4-thinking-16k | coreutils-old-version-alpine | bs08n362cba73 | $1.547 | 8m7s | Success |
| claude-sonnet-4-thinking-16k | coreutils-old-version-alpine | oo8mzagzoleya | $1.869 | 8m36s | Success |
| claude-sonnet-4-thinking-16k | coreutils-static | 0r24wkdxg86jb | $0.161 | 2m39s | Success |
| claude-sonnet-4-thinking-16k | coreutils-static | mrzt7ua84k80m | $0.166 | 2m20s | Success |
| claude-sonnet-4-thinking-16k | coreutils-static | plfws0uish2vi | $0.152 | 2m38s | Success |
| claude-sonnet-4-thinking-16k | coreutils-static-alpine | 22jwht0d2ipal | $0.146 | 2m17s | Success |
| claude-sonnet-4-thinking-16k | coreutils-static-alpine | hc1lomwrt4zzu | $0.164 | 2m26s | Success |
| claude-sonnet-4-thinking-16k | coreutils-static-alpine | my5fotorj8aq1 | $0.175 | 2m31s | Success |
| claude-sonnet-4-thinking-16k | cowsay | 0dk6j3q3ilrma | $0.080 | 1m4s | Success |
| claude-sonnet-4-thinking-16k | cowsay | bcfk66n0rhz6z | $0.092 | 1m17s | Success |
| claude-sonnet-4-thinking-16k | cowsay | pcm09yk5px3am | $0.083 | 1m4s | Success |
| claude-sonnet-4-thinking-16k | curl | 3u30iilci3bu2 | $0.129 | 1m36s | Success |
| claude-sonnet-4-thinking-16k | curl | b8j5yhsiyefwy | $0.126 | 1m40s | Success |
| claude-sonnet-4-thinking-16k | curl | mhjy1qvhvzpzd | $0.157 | 1m25s | Success |
| claude-sonnet-4-thinking-16k | curl-ssl | bwhyja41s6v7o | $0.210 | 2m32s | Success |
| claude-sonnet-4-thinking-16k | curl-ssl | ptevq3c2szlc0 | $0.240 | 2m51s | Success |
| claude-sonnet-4-thinking-16k | curl-ssl | tdsp4oubtu0rm | $0.204 | 2m23s | Success |
| claude-sonnet-4-thinking-16k | curl-ssl-arm64-static | 3ur3m0b72b57f | $1.216 | 8m26s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4-thinking-16k | curl-ssl-arm64-static | aofjd3ed1ws53 | $0.937 | 8m49s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4-thinking-16k | curl-ssl-arm64-static | sf7dhu3u6v9lo | $1.074 | 8m6s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4-thinking-16k | curl-ssl-arm64-static2 | 55r7ssuptc9su | $1.602 | 9m41s | Success |
| claude-sonnet-4-thinking-16k | curl-ssl-arm64-static2 | sas5yp3b4pc5w | $1.400 | 10m41s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4-thinking-16k | curl-ssl-arm64-static2 | txt1gpq0kcbpd | $1.173 | 7m30s | Success |
| claude-sonnet-4-thinking-16k | jq | 0by7mbfywtdqx | $0.121 | 1m22s | Success |
| claude-sonnet-4-thinking-16k | jq | 21bccfjeuzxi5 | $0.105 | 1m15s | Success |
| claude-sonnet-4-thinking-16k | jq | 24iva3wt52cyr | $0.103 | 1m8s | Success |
| claude-sonnet-4-thinking-16k | jq-static | 0embt2r2suriq | $0.115 | 1m24s | Success |
| claude-sonnet-4-thinking-16k | jq-static | 9gop4ctkw4oim | $0.135 | 1m22s | Success |
| claude-sonnet-4-thinking-16k | jq-static | ez49t1dz7a3bf | $0.117 | 1m27s | Success |
| claude-sonnet-4-thinking-16k | jq-static-musl | 1lqob8o8fgs5g | $0.299 | 2m45s | Success |
| claude-sonnet-4-thinking-16k | jq-static-musl | 2i1mu18nmdu6k | $0.219 | 2m23s | Success |
| claude-sonnet-4-thinking-16k | jq-static-musl | sofnn6hrtycfj | $0.450 | 3m14s | Success |
| claude-sonnet-4-thinking-16k | jq-windows | 02yg8eybegzct | $0.210 | 2m23s | Success |
| claude-sonnet-4-thinking-16k | jq-windows | c1vjkhc3qbr46 | $0.181 | 2m18s | Success |
| claude-sonnet-4-thinking-16k | jq-windows | d6qedwsxw9d4x | $0.194 | 2m29s | Success |
| claude-sonnet-4-thinking-16k | jq-windows2 | 3iuxcwx93mhwu | $0.686 | 4m21s | Success |
| claude-sonnet-4-thinking-16k | jq-windows2 | 3phfdclv9w074 | $0.719 | 6m32s | Success |
| claude-sonnet-4-thinking-16k | jq-windows2 | h3qknoqo08hft | $0.454 | 4m0s | Success |
| claude-sonnet-4.5 | coreutils | 9qc9g6eal3n8n | $0.168 | 2m1s | Success |
| claude-sonnet-4.5 | coreutils | gduoax5ti0zz0 | $0.179 | 2m3s | Success |
| claude-sonnet-4.5 | coreutils | nkfbsgibraefv | $0.208 | 1m57s | Success |
| claude-sonnet-4.5 | coreutils-old-version | gc06c3aibqvg0 | $0.499 | 4m48s | Success |
| claude-sonnet-4.5 | coreutils-old-version | ifl1v0lpnshh1 | $0.521 | 3m18s | Success |
| claude-sonnet-4.5 | coreutils-old-version | m45lrir1yolhg | $0.653 | 4m16s | Success |
| claude-sonnet-4.5 | coreutils-old-version-alpine | 16lzvasib388n | $1.352 | 5m19s | Failure task failed: df missing at /home/peter/result/df or not executable |
| claude-sonnet-4.5 | coreutils-old-version-alpine | 8v1o8aocq515l | $2.115 | 8m30s | Failure task failed: df missing at /home/peter/result/df or not executable |
| claude-sonnet-4.5 | coreutils-old-version-alpine | g04000s0wb4di | $1.692 | 5m32s | Failure task failed: df missing at /home/peter/result/df or not executable |
| claude-sonnet-4.5 | coreutils-static | 5085o7137l1qc | $0.144 | 1m56s | Success |
| claude-sonnet-4.5 | coreutils-static | pj3be723iad7p | $0.245 | 2m29s | Success |
| claude-sonnet-4.5 | coreutils-static | xyr2pvg2ederi | $0.227 | 2m33s | Success |
| claude-sonnet-4.5 | coreutils-static-alpine | 3683h3teclfkp | $0.261 | 2m40s | Success |
| claude-sonnet-4.5 | coreutils-static-alpine | 5eoed85941nlj | $0.160 | 1m47s | Success |
| claude-sonnet-4.5 | coreutils-static-alpine | wa5euy18grcn1 | $0.172 | 1m56s | Success |
| claude-sonnet-4.5 | cowsay | 1e3wd93x8lqk6 | $0.058 | 33s | Success |
| claude-sonnet-4.5 | cowsay | cohtatz80lm3c | $0.062 | 37s | Success |
| claude-sonnet-4.5 | cowsay | u9lgxwyv5ggbn | $0.073 | 37s | Success |
| claude-sonnet-4.5 | curl | a82s2nkx6wvzs | $0.099 | 1m3s | Success |
| claude-sonnet-4.5 | curl | c783hcdqqy6aq | $0.110 | 1m6s | Success |
| claude-sonnet-4.5 | curl | cp1f686cylfhk | $0.120 | 1m12s | Success |
| claude-sonnet-4.5 | curl-ssl | 38xzage817d3a | $0.376 | 2m28s | Success |
| claude-sonnet-4.5 | curl-ssl | 8x90cfvuy3dim | $0.273 | 1m48s | Success |
| claude-sonnet-4.5 | curl-ssl | uox1l9egxfdtk | $0.228 | 1m50s | Success |
| claude-sonnet-4.5 | curl-ssl-arm64-static | g29ristdn9aa5 | $0.651 | 4m42s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4.5 | curl-ssl-arm64-static | qs6dluqfy8g08 | $0.847 | 5m43s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4.5 | curl-ssl-arm64-static | vm8e52ftyk0is | $1.488 | 7m7s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4.5 | curl-ssl-arm64-static2 | ts7soi1bj3oxz | $2.075 | 9m9s | Success |
| claude-sonnet-4.5 | curl-ssl-arm64-static2 | uke7xjdn2uqfg | $0.976 | 6m1s | Success |
| claude-sonnet-4.5 | curl-ssl-arm64-static2 | z34e0nnlqtrn7 | $0.942 | 5m36s | Success |
| claude-sonnet-4.5 | jq | 5nx8nmvqfr87g | $0.105 | 55s | Success |
| claude-sonnet-4.5 | jq | 7q1klrbkzplre | $0.096 | 52s | Success |
| claude-sonnet-4.5 | jq | 7xlfmjchjlief | $0.141 | 1m8s | Success |
| claude-sonnet-4.5 | jq-static | kodenau8xw3kh | $0.136 | 1m3s | Success |
| claude-sonnet-4.5 | jq-static | sh2fdf29lm676 | $0.132 | 1m6s | Success |
| claude-sonnet-4.5 | jq-static | u6vh89uujd6ii | $0.139 | 1m1s | Success |
| claude-sonnet-4.5 | jq-static-musl | 1p5qpnhpepimv | $0.262 | 1m31s | Success |
| claude-sonnet-4.5 | jq-static-musl | 9cu17hgje0phe | $0.313 | 1m57s | Success |
| claude-sonnet-4.5 | jq-static-musl | kev1pxwi2nsa8 | $0.520 | 2m34s | Success |
| claude-sonnet-4.5 | jq-windows | icnyrfluogvz1 | $0.319 | 1m57s | Success |
| claude-sonnet-4.5 | jq-windows | jwp37nr7zmqx0 | $0.174 | 1m28s | Success |
| claude-sonnet-4.5 | jq-windows | zipovvz179fi7 | $0.190 | 1m14s | Success |
| claude-sonnet-4.5 | jq-windows2 | 3dw4ho4ss6sgn | $0.333 | 2m36s | Success |
| claude-sonnet-4.5 | jq-windows2 | cx2mmauylnor4 | $0.479 | 4m58s | Success |
| claude-sonnet-4.5 | jq-windows2 | x2uogd2w6yclh | $0.347 | 3m14s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils | s4uqbdubq5p0n | $0.168 | 2m24s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils | sy4n89mgtd7q0 | $0.196 | 3m17s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils | zk25bwmdcel73 | $0.130 | 2m0s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-old-version | 7o8tyki994695 | $0.406 | 3m52s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-old-version | mghtc374epad0 | $0.379 | 4m17s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-old-version | pngf8zm8zli3w | $0.321 | 3m53s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-old-version-alpine | dpjz1qjardflm | $1.539 | 7m40s | Failure task failed: df missing at /home/peter/result/df or not executable |
| claude-sonnet-4.5-thinking-16k | coreutils-old-version-alpine | rvt80a7fv2kc9 | $1.548 | 9m25s | Failure task failed: df missing at /home/peter/result/df or not executable |
| claude-sonnet-4.5-thinking-16k | coreutils-old-version-alpine | xe5158hs7os7t | $1.735 | 9m40s | Failure task failed: df missing at /home/peter/result/df or not executable |
| claude-sonnet-4.5-thinking-16k | coreutils-static | 139n1l9ykqmay | $0.170 | 2m47s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-static | 2cysws08wyagn | $0.199 | 2m35s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-static | a0fptc4dmrrb0 | $0.199 | 2m48s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-static-alpine | 7uxztvb87rn1i | $0.151 | 2m28s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-static-alpine | kxem1jnyg0fh5 | $0.225 | 3m29s | Success |
| claude-sonnet-4.5-thinking-16k | coreutils-static-alpine | m004cc1c5rut0 | $0.168 | 2m37s | Success |
| claude-sonnet-4.5-thinking-16k | cowsay | 0zuujyp1i8dw0 | $0.090 | 1m1s | Success |
| claude-sonnet-4.5-thinking-16k | cowsay | ktl9xko2jsjsq | $0.069 | 50s | Success |
| claude-sonnet-4.5-thinking-16k | cowsay | y68c1g3pyuade | $0.070 | 49s | Success |
| claude-sonnet-4.5-thinking-16k | curl | c4vu7pxfviz4x | $0.115 | 1m24s | Success |
| claude-sonnet-4.5-thinking-16k | curl | escystgb99u4j | $0.160 | 1m56s | Success |
| claude-sonnet-4.5-thinking-16k | curl | zfjv1m8ipehsr | $0.122 | 1m29s | Success |
| claude-sonnet-4.5-thinking-16k | curl-ssl | 3oury8yrk2713 | $0.355 | 2m40s | Success |
| claude-sonnet-4.5-thinking-16k | curl-ssl | mmzamof8y16ox | $0.256 | 2m33s | Success |
| claude-sonnet-4.5-thinking-16k | curl-ssl | wn13fmmw4o0jj | $0.246 | 2m40s | Success |
| claude-sonnet-4.5-thinking-16k | curl-ssl-arm64-static | 9wwpjdtj60ash | $1.410 | 9m0s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4.5-thinking-16k | curl-ssl-arm64-static | a53bk5ve49pov | $1.184 | 7m54s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4.5-thinking-16k | curl-ssl-arm64-static | qpmxht13qu7im | $1.014 | 8m18s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| claude-sonnet-4.5-thinking-16k | curl-ssl-arm64-static2 | 4d5at2gsc419p | $1.513 | 8m35s | Success |
| claude-sonnet-4.5-thinking-16k | curl-ssl-arm64-static2 | hjiyd7cnuvr2j | $1.025 | 8m3s | Success |
| claude-sonnet-4.5-thinking-16k | curl-ssl-arm64-static2 | nzsj7nnygmfws | $1.197 | 6m54s | Success |
| claude-sonnet-4.5-thinking-16k | jq | 7vhu3u6i9qkyi | $0.090 | 59s | Success |
| claude-sonnet-4.5-thinking-16k | jq | 97zr8snjnu5zo | $0.139 | 1m10s | Success |
| claude-sonnet-4.5-thinking-16k | jq | twbyw2d8mhz0u | $0.104 | 1m9s | Success |
| claude-sonnet-4.5-thinking-16k | jq-static | 8jf7r74y1179m | $0.113 | 1m29s | Success |
| claude-sonnet-4.5-thinking-16k | jq-static | eivp5k3gqx9dg | $0.167 | 1m27s | Success |
| claude-sonnet-4.5-thinking-16k | jq-static | pxyiuomo9xirp | $0.111 | 1m13s | Success |
| claude-sonnet-4.5-thinking-16k | jq-static-musl | 1crio5dqx6gno | $0.457 | 3m10s | Success |
| claude-sonnet-4.5-thinking-16k | jq-static-musl | gq80zpkncna4o | $0.476 | 2m56s | Failure task failed: jq binary does not show musl markers |
| claude-sonnet-4.5-thinking-16k | jq-static-musl | klltd6vsh357h | $0.302 | 2m8s | Success |
| claude-sonnet-4.5-thinking-16k | jq-windows | 2pkd860lbu62w | $0.187 | 2m16s | Success |
| claude-sonnet-4.5-thinking-16k | jq-windows | f3wxq4z29zmz1 | $0.298 | 2m44s | Success |
| claude-sonnet-4.5-thinking-16k | jq-windows | l6iv436dh7v3p | $0.234 | 2m25s | Success |
| claude-sonnet-4.5-thinking-16k | jq-windows2 | 1tfdq73q1fk8y | $0.475 | 4m57s | Success |
| claude-sonnet-4.5-thinking-16k | jq-windows2 | ezo18o6s4i94s | $0.211 | 2m32s | Success |
| claude-sonnet-4.5-thinking-16k | jq-windows2 | mq7rv2bmlytwh | $0.522 | 4m39s | Success |
 deepseek-v3.1 | coreutils | 2s2z7s4b8azq2 | $0.026 | 1m5s | Success |
| deepseek-v3.1 | coreutils | l6rk5xweqdqj9 | $0.057 | 1m22s | Success |
| deepseek-v3.1 | coreutils | ua1anvszt97g4 | $0.041 | 1m25s | Success |
| deepseek-v3.1 | coreutils-old-version | 281l9svxi2cd5 | $0.355 | 3m10s | Success |
| deepseek-v3.1 | coreutils-old-version | igek8l605gxyb | $0.527 | 3m20s | Success |
| deepseek-v3.1 | coreutils-old-version | zvvds288xdcm1 | $0.369 | 3m11s | Failure task failed: install missing at /home/peter/result/install or not executable |
| deepseek-v3.1 | coreutils-old-version-alpine | caio4ys8xz5vn | $5.336 | 10m51s | Failure exceeded max tool calls (200) |
| deepseek-v3.1 | coreutils-old-version-alpine | npw0nr2wfh7b9 | $4.218 | 8m37s | Failure task failed: sha1sum binary does not exist |
| deepseek-v3.1 | coreutils-old-version-alpine | s4v44ndrejnr5 | $1.386 | 4m46s | Failure task failed: sha1sum binary does not exist |
| deepseek-v3.1 | coreutils-static | 3fpu8zaowgq7t | $0.064 | 1m38s | Failure task failed: install missing at /home/peter/result/install or not executable |
| deepseek-v3.1 | coreutils-static | 53wz2rnf6ey8j | $0.041 | 1m23s | Success |
| deepseek-v3.1 | coreutils-static | ro7f09l5pwvtd | $0.350 | 3m9s | Success |
| deepseek-v3.1 | coreutils-static-alpine | 77mv5k049r2hu | $0.049 | 1m22s | Success |
| deepseek-v3.1 | coreutils-static-alpine | pxbr9fpz4dxt0 | $0.031 | 1m7s | Success |
| deepseek-v3.1 | coreutils-static-alpine | w2ojjoekpdbww | $0.030 | 1m7s | Failure task failed: sha1sum binary does not exist |
| deepseek-v3.1 | cowsay | 4qlmihewt9ufh | $0.076 | 1m24s | Failure task failed: Cowsay binary does not exist |
| deepseek-v3.1 | cowsay | d4138dxenud78 | $0.004 | 15s | Success |
| deepseek-v3.1 | cowsay | v8z8a6awlcqge | $0.012 | 26s | Success |
| deepseek-v3.1 | curl | 1vs1dnj1rbh0h | $0.025 | 52s | Success |
| deepseek-v3.1 | curl | azdd243riac1n | $0.033 | 48s | Success |
| deepseek-v3.1 | curl | uip9ful0s1c7e | $0.033 | 48s | Success |
| deepseek-v3.1 | curl-ssl | 3q7llnow2rleu | $0.064 | 1m13s | Success |
| deepseek-v3.1 | curl-ssl | tf7jqkksyytmc | $0.058 | 1m4s | Success |
| deepseek-v3.1 | curl-ssl | vljy9xr11ouby | $0.051 | 1m12s | Success |
| deepseek-v3.1 | curl-ssl-arm64-static | 5qxq8pqvu3083 | $0.696 | 3m59s | Failure task failed: curl-arm64 is not aarch64 architecture |
| deepseek-v3.1 | curl-ssl-arm64-static | oirue2hixi5k6 | $0.179 | 1m54s | Failure task failed: curl-arm64 is not statically linked |
| deepseek-v3.1 | curl-ssl-arm64-static | ovx9lwohe012s | $0.729 | 4m0s | Failure task failed: curl-arm64 is not aarch64 architecture |
| deepseek-v3.1 | curl-ssl-arm64-static2 | 94hw002wxemh7 | $0.908 | 4m54s | Failure task failed: curl-arm64 is not statically linked |
| deepseek-v3.1 | curl-ssl-arm64-static2 | iuj4rqve9knw2 | $1.353 | 5m9s | Failure task failed: curl-arm64 is not statically linked |
| deepseek-v3.1 | curl-ssl-arm64-static2 | p676hsb8c2zth | $0.373 | 2m40s | Failure task failed: curl binary does not exist |
| deepseek-v3.1 | jq | 2nokdzicmmfeu | $0.026 | 31s | Success |
| deepseek-v3.1 | jq | 7qksvs0okfcth | $0.026 | 34s | Success |
| deepseek-v3.1 | jq | i6uvv4utdt04o | $0.023 | 32s | Success |
| deepseek-v3.1 | jq-static | tha3suj0vdfqf | $0.502 | 3m7s | Success |
| deepseek-v3.1 | jq-static | vh6zomwp7rqih | $0.204 | 1m30s | Success |
| deepseek-v3.1 | jq-static | xsjuphqrmrjb9 | $0.108 | 1m42s | Success |
| deepseek-v3.1 | jq-static-musl | 3w1btu0svmoqa | $0.279 | 1m37s | Success |
| deepseek-v3.1 | jq-static-musl | t37r92ftwagql | $0.572 | 2m58s | Success |
| deepseek-v3.1 | jq-static-musl | v772kvxqtcaoy | $0.312 | 1m43s | Success |
| deepseek-v3.1 | jq-windows | dmnrof6aygbdp | $0.051 | 56s | Success |
| deepseek-v3.1 | jq-windows | elirmlwrefz65 | $0.039 | 1m12s | Failure task failed: jq help does not contain expected string |
| deepseek-v3.1 | jq-windows | z0sqcui9bxpol | $0.043 | 1m28s | Success |
| deepseek-v3.1 | jq-windows2 | 8rk1oauc0ecjz | $0.418 | 3m45s | Success |
| deepseek-v3.1 | jq-windows2 | u5xl3rph1tzq7 | $0.775 | 5m21s | Failure task failed: jq help does not contain expected string |
| deepseek-v3.1 | jq-windows2 | ucbwgcg8dl9ke | $0.424 | 4m20s | Failure task failed: jq help does not contain expected string |
| deepseek-v3.1-terminus | coreutils | iv1bobpame97y | $0.037 | 1m55s | Success |
| deepseek-v3.1-terminus | coreutils | myzu59fv706ck | $0.037 | 1m46s | Success |
| deepseek-v3.1-terminus | coreutils | n313dy6qcm216 | $0.054 | 2m26s | Success |
| deepseek-v3.1-terminus | coreutils-old-version | 0jizc9vaajx8x | $0.105 | 4m47s | Success |
| deepseek-v3.1-terminus | coreutils-old-version | 1qhc4ph49xvev | $0.148 | 4m42s | Success |
| deepseek-v3.1-terminus | coreutils-old-version | h7ozgpm05ntu0 | $0.158 | 5m2s | Failure task failed: df missing at /home/peter/result/df or not executable |
| deepseek-v3.1-terminus | coreutils-old-version-alpine | 8ku90eb5ntv3k | $1.151 | 15m25s | Failure task failed: sha1sum binary does not exist |
| deepseek-v3.1-terminus | coreutils-old-version-alpine | fef6r1p37bi74 | $0.488 | 8m19s | Failure task failed: No success reported by script: all-utils-exists.sh |
| deepseek-v3.1-terminus | coreutils-old-version-alpine | qaj1rduklob6h | $0.288 | 6m29s | Failure task failed: sha1sum binary does not exist |
| deepseek-v3.1-terminus | coreutils-static | 6b4o82saybxkb | $0.042 | 2m28s | Success |
| deepseek-v3.1-terminus | coreutils-static | p9f3knux2bi0n | $0.032 | 1m47s | Success |
| deepseek-v3.1-terminus | coreutils-static | zbv4fu0bt59h5 | $0.037 | 2m6s | Success |
| deepseek-v3.1-terminus | coreutils-static-alpine | 0ane20p9h27su | $0.148 | 5m1s | Success |
| deepseek-v3.1-terminus | coreutils-static-alpine | auu4ae4z7jng1 | $0.049 | 2m2s | Success |
| deepseek-v3.1-terminus | coreutils-static-alpine | q3riyy2qid78w | $0.107 | 4m20s | Failure task failed: install missing at /home/peter/result/install or not executable |
| deepseek-v3.1-terminus | cowsay | 8c908vm7vy1du | $0.023 | 1m28s | Success |
| deepseek-v3.1-terminus | cowsay | 8ukqvxonjqb3o | $0.012 | 43s | Success |
| deepseek-v3.1-terminus | cowsay | jkldj1rwt0wam | $0.010 | 56s | Success |
| deepseek-v3.1-terminus | curl | 66vdrw1zk49zc | $0.026 | 1m16s | Success |
| deepseek-v3.1-terminus | curl | du2902p38frkz | $0.023 | 1m11s | Success |
| deepseek-v3.1-terminus | curl | sb9e19g4y17s9 | $0.039 | 1m47s | Success |
| deepseek-v3.1-terminus | curl-ssl | 4dxrton5qr4xd | $0.042 | 2m0s | Success |
| deepseek-v3.1-terminus | curl-ssl | fqmjqiqx3lnwt | $0.064 | 2m7s | Success |
| deepseek-v3.1-terminus | curl-ssl | wjk0hs2ahq39p | $0.039 | 1m58s | Success |
| deepseek-v3.1-terminus | curl-ssl-arm64-static | wp50zo0mgashe | $0.771 | 12m0s | Failure task failed: curl-arm64 is not aarch64 architecture |
| deepseek-v3.1-terminus | curl-ssl-arm64-static | xl35p12yupv8d | $0.351 | 6m38s | Failure task failed: curl-arm64 is not aarch64 architecture |
| deepseek-v3.1-terminus | curl-ssl-arm64-static | ys9lgi93ui39c | $0.298 | 5m34s | Failure task failed: curl-arm64 is not aarch64 architecture |
| deepseek-v3.1-terminus | curl-ssl-arm64-static2 | 1now9qmnbdqjq | $0.305 | 6m5s | Failure task failed: curl-arm64 is not aarch64 architecture |
| deepseek-v3.1-terminus | curl-ssl-arm64-static2 | 3u6vja8oatoje | $0.816 | 16m20s | Failure task failed: curl-arm64 is not statically linked |
| deepseek-v3.1-terminus | curl-ssl-arm64-static2 | 80atm1el63hiv | $0.074 | 3m37s | Failure task failed: curl binary does not exist |
| deepseek-v3.1-terminus | jq | 5w52z3uiohofo | $0.017 | 1m5s | Success |
| deepseek-v3.1-terminus | jq | ik4ih67xurqxc | $0.024 | 1m1s | Success |
| deepseek-v3.1-terminus | jq | yhzh0n7kcek3y | $0.055 | 1m41s | Success |
| deepseek-v3.1-terminus | jq-static | 08ymum9kw2j9j | $0.156 | 3m42s | Success |
| deepseek-v3.1-terminus | jq-static | 1z0htuq1j87nh | $0.030 | 1m25s | Failure task failed: jq is not statically linked |
| deepseek-v3.1-terminus | jq-static | huzahafplrt2q | $0.027 | 1m47s | Success |
| deepseek-v3.1-terminus | jq-static-musl | foqvgc88fdwpr | $0.175 | 3m54s | Success |
| deepseek-v3.1-terminus | jq-static-musl | rfr46v53ma12p | $0.330 | 5m5s | Success |
| deepseek-v3.1-terminus | jq-static-musl | rqlz1a80zxnf6 | $0.265 | 4m15s | Success |
| deepseek-v3.1-terminus | jq-windows | 4zsgsxy3mr526 | $0.247 | 5m19s | Failure task failed: jq help does not contain expected string |
| deepseek-v3.1-terminus | jq-windows | 7b64txxdd5lxw | $0.055 | 2m6s | Failure task failed: jq help does not contain expected string |
| deepseek-v3.1-terminus | jq-windows | 7i5x6amv4yesw | $0.028 | 1m17s | Failure task failed: jq help does not contain expected string |
| deepseek-v3.1-terminus | jq-windows2 | 9b19dszyr0l6d | $0.070 | 3m13s | Success |
| deepseek-v3.1-terminus | jq-windows2 | b0is31o2uaha1 | $0.044 | 1m42s | Failure task failed: jq.exe binary does not exist |
| deepseek-v3.1-terminus | jq-windows2 | qzejejz6vy6e9 | $0.042 | 1m58s | Success |
 gemini-2.5-flash | coreutils | 72mffpubnnu4n | $0.007 | 1m25s | Success |
| gemini-2.5-flash | coreutils | cizcdb805itzg | $0.017 | 1m37s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash | coreutils | l5900rmi59rl4 | $0.007 | 1m27s | Success |
| gemini-2.5-flash | coreutils-old-version | 22kvbqe7s9e7a | $0.235 | 14m30s | Failure exceeded max tool calls (90) |
| gemini-2.5-flash | coreutils-old-version | 52njs5c5fvgg0 | $0.036 | 4m40s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| gemini-2.5-flash | coreutils-old-version | un0m2bqbkbovf | $0.260 | 13m34s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash | coreutils-old-version-alpine | 6aqhoaxklcwsp | $0.151 | 4m11s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash | coreutils-old-version-alpine | icppoonmwph4h | $0.109 | 3m30s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash | coreutils-old-version-alpine | t1dwq7bannu76 | $0.030 | 1m42s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash | coreutils-static | 59gza3etqz54m | $0.028 | 4m38s | Success |
| gemini-2.5-flash | coreutils-static | mdp47e2isfz6l | $0.009 | 1m42s | Success |
| gemini-2.5-flash | coreutils-static | r3gc5tvqwi47d | $0.005 | 1m39s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash | coreutils-static-alpine | 2l89o13kpizbx | $0.015 | 2m46s | Success |
| gemini-2.5-flash | coreutils-static-alpine | b1gb6tr8rufu1 | $0.016 | 2m41s | Success |
| gemini-2.5-flash | coreutils-static-alpine | z4aj770xugw7i | $0.024 | 1m49s | Success |
| gemini-2.5-flash | cowsay | 50cmjvmon2ep0 | $0.005 | 11s | Failure task failed: Cowsay does not contain expected string (eyes) |
| gemini-2.5-flash | cowsay | row7obzz4gfgq | $0.007 | 17s | Success |
| gemini-2.5-flash | cowsay | v24mbpfq4luoe | $0.003 | 9s | Success |
| gemini-2.5-flash | curl | 27bz01qbbllnb | $0.004 | 29s | Success |
| gemini-2.5-flash | curl | jelgpn94ryjy7 | $0.010 | 32s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| gemini-2.5-flash | curl | l0al12nsj8980 | $0.023 | 48s | Success |
| gemini-2.5-flash | curl-ssl | 32vic9v2las0v | $0.010 | 1m49s | Success |
| gemini-2.5-flash | curl-ssl | g2gis7dqdjj34 | $0.015 | 42s | Success |
| gemini-2.5-flash | curl-ssl | voohjs8mprlic | $0.013 | 1m48s | Success |
| gemini-2.5-flash | curl-ssl-arm64-static | 7i72w0wyyd55a | $0.003 | 14s | Failure task failed: curl binary does not exist |
| gemini-2.5-flash | curl-ssl-arm64-static | 9aghv6jluw6qu | $0.119 | 1m51s | Failure task failed: curl binary does not exist |
| gemini-2.5-flash | curl-ssl-arm64-static | gxqiqts623v70 | $0.012 | 1m16s | Failure task failed: curl-arm64 is not aarch64 architecture |
| gemini-2.5-flash | curl-ssl-arm64-static2 | 0zyb1j65mwyw8 | $0.060 | 1m30s | Failure task failed: curl binary does not exist |
| gemini-2.5-flash | curl-ssl-arm64-static2 | qjc3xwwj9kd6n | $0.217 | 5m0s | Failure task failed: curl-arm64 is not aarch64 architecture |
| gemini-2.5-flash | curl-ssl-arm64-static2 | xn6520d9u9w96 | $0.119 | 4m25s | Failure task failed: curl binary does not exist |
| gemini-2.5-flash | jq | cp0eay12p46t7 | $0.007 | 35s | Success |
| gemini-2.5-flash | jq | ipmliug5yiifz | $0.000 | 0.7s | Failure task failed: jq binary does not exist |
| gemini-2.5-flash | jq | q7614ipz7drgv | $0.009 | 28s | Failure task failed: jq binary does not exist |
| gemini-2.5-flash | jq-static | cmxoomrojfo4f | $0.011 | 48s | Success |
| gemini-2.5-flash | jq-static | lkuczmr40mj4b | $0.009 | 38s | Success |
| gemini-2.5-flash | jq-static | yo639sx8hut4h | $0.003 | 21s | Failure task failed: jq is not statically linked |
| gemini-2.5-flash | jq-static-musl | 4vo0qowourp2x | $0.267 | 4m3s | Failure task failed: jq binary does not exist |
| gemini-2.5-flash | jq-static-musl | wuvsgpxterenf | $0.035 | 1m13s | Success |
| gemini-2.5-flash | jq-static-musl | xgtgg0l4eqhdd | $0.238 | 2m56s | Failure task failed: jq binary does not exist |
| gemini-2.5-flash | jq-windows | 73915yy8omgpv | $0.006 | 37s | Failure task failed: jq help does not contain expected string |
| gemini-2.5-flash | jq-windows | 8esapvv1f77uf | $0.007 | 26s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-flash | jq-windows | xdmf0z7301opk | $0.013 | 53s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-flash | jq-windows2 | 9mkvm7dl9sgdq | $0.014 | 1m18s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-flash | jq-windows2 | dbjy65z68wg2w | $0.063 | 3m17s | Failure task failed: jq help does not contain expected string |
| gemini-2.5-flash | jq-windows2 | kqylyry031dti | $0.018 | 1m59s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-flash-thinking | coreutils | 0jjoczrhw7t0d | $0.011 | 1m9s | Success |
| gemini-2.5-flash-thinking | coreutils | 3vzn142dc7wzu | $0.011 | 1m7s | Success |
| gemini-2.5-flash-thinking | coreutils | 9ughwpxv3ykiu | $0.010 | 1m8s | Success |
| gemini-2.5-flash-thinking | coreutils-old-version | 02ofxvn1wnw8g | $0.034 | 2m24s | Failure task failed: df missing at /home/peter/result/df or not executable |
| gemini-2.5-flash-thinking | coreutils-old-version | asuvr8gm3mxk1 | $0.132 | 19m5s | Failure context timeout: context deadline exceeded |
| gemini-2.5-flash-thinking | coreutils-old-version | w2c8hsvl88jiw | $0.089 | 19m15s | Failure context timeout: context deadline exceeded |
| gemini-2.5-flash-thinking | coreutils-old-version-alpine | 38us456gg97t1 | $0.165 | 3m8s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash-thinking | coreutils-old-version-alpine | 3kvv58u1s2o7s | $0.077 | 2m26s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash-thinking | coreutils-old-version-alpine | gnjbi1l73fyfg | $1.484 | 22m41s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-flash-thinking | coreutils-static | 8894aqd63cabz | $0.014 | 1m55s | Success |
| gemini-2.5-flash-thinking | coreutils-static | cy7ku1xwju0xr | $0.009 | 2m5s | Success |
| gemini-2.5-flash-thinking | coreutils-static | lh8iwss0pb2sj | $0.011 | 2m0s | Success |
| gemini-2.5-flash-thinking | coreutils-static-alpine | 4lo9tks6n9tch | $0.009 | 1m15s | Success |
| gemini-2.5-flash-thinking | coreutils-static-alpine | oiv05619mgyhw | $0.016 | 2m51s | Success |
| gemini-2.5-flash-thinking | coreutils-static-alpine | qfi89k9nn1x5x | $0.120 | 14m55s | Failure LLM call failed: context deadline exceeded |
| gemini-2.5-flash-thinking | cowsay | anorokmywf1rs | $0.006 | 21s | Success |
| gemini-2.5-flash-thinking | cowsay | mp2isanv6lc8r | $0.004 | 17s | Success |
| gemini-2.5-flash-thinking | cowsay | xbbddb0e2x7xm | $0.005 | 13s | Success |
| gemini-2.5-flash-thinking | curl | 4mbumgeh26inc | $0.024 | 1m16s | Success |
| gemini-2.5-flash-thinking | curl | ecp5uv5wyqr2r | $0.006 | 35s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| gemini-2.5-flash-thinking | curl | vw1lcqlbfzuhu | $0.005 | 31s | Success |
| gemini-2.5-flash-thinking | curl-ssl | 3syscgm1iscvm | $0.016 | 52s | Success |
| gemini-2.5-flash-thinking | curl-ssl | ewmd3jtebe524 | $0.016 | 58s | Success |
| gemini-2.5-flash-thinking | curl-ssl | vbxyokowq5aoy | $0.012 | 1m58s | Success |
| gemini-2.5-flash-thinking | curl-ssl-arm64-static | nkb5mdzsrc5vx | $0.014 | 51s | Failure task failed: curl binary does not exist |
| gemini-2.5-flash-thinking | curl-ssl-arm64-static | w2srvvch00wqt | $0.341 | 12m54s | Failure task failed: curl binary does not exist |
| gemini-2.5-flash-thinking | curl-ssl-arm64-static | wqy7tm1gg0fvf | $0.204 | 7m29s | Failure task failed: curl-arm64 is not statically linked |
| gemini-2.5-flash-thinking | curl-ssl-arm64-static2 | 8irl6e3lohykm | $1.167 | 28m52s | Failure exceeded max tool calls (150) |
| gemini-2.5-flash-thinking | curl-ssl-arm64-static2 | oazj2i1mai0j1 | $0.051 | 1m52s | Failure task failed: curl binary does not exist |
| gemini-2.5-flash-thinking | curl-ssl-arm64-static2 | v7aq6aahnzty3 | $1.412 | 39m18s | Failure exceeded max tool calls (150) |
| gemini-2.5-flash-thinking | jq | 338s4eah51lk2 | $0.007 | 44s | Success |
| gemini-2.5-flash-thinking | jq | 74t14ujo90avy | $0.006 | 42s | Success |
| gemini-2.5-flash-thinking | jq | e6g5iw6pk03kh | $0.010 | 48s | Success |
| gemini-2.5-flash-thinking | jq-static | bdgx1d733wai9 | $0.019 | 1m4s | Failure task failed: jq is not statically linked |
| gemini-2.5-flash-thinking | jq-static | hvj8b33c3neoc | $0.128 | 4m58s | Failure exceeded max tool calls (50) |
| gemini-2.5-flash-thinking | jq-static | oh6v47v6mo2jl | $0.017 | 1m4s | Failure task failed: jq binary does not exist |
| gemini-2.5-flash-thinking | jq-static-musl | jhh3934iqs1g8 | $0.126 | 3m46s | Failure task failed: jq is not statically linked |
| gemini-2.5-flash-thinking | jq-static-musl | vd21pck4x3p21 | $0.297 | 5m48s | Failure task failed: jq binary does not exist |
| gemini-2.5-flash-thinking | jq-static-musl | vwe53jv3bfcm4 | $0.165 | 4m33s | Success |
| gemini-2.5-flash-thinking | jq-windows | 88vh2uc0rk21g | $0.011 | 54s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-flash-thinking | jq-windows | 962o3wdtyixry | $0.015 | 1m9s | Failure task failed: jq help does not contain expected string |
| gemini-2.5-flash-thinking | jq-windows | ulm2adrozbvpo | $0.014 | 55s | Failure task failed: jq help does not contain expected string |
| gemini-2.5-flash-thinking | jq-windows2 | 61inpuunyal2v | $0.030 | 2m20s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-flash-thinking | jq-windows2 | 8qz0u1ruhvp3l | $0.067 | 3m35s | Failure task failed: jq help does not contain expected string |
| gemini-2.5-flash-thinking | jq-windows2 | dw05qdcz6mafj | $0.020 | 1m25s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-pro | coreutils | mavjj3haoinsc | $0.055 | 1m47s | Success |
| gemini-2.5-pro | coreutils | n2xiawao4lzf7 | $0.042 | 1m48s | Success |
| gemini-2.5-pro | coreutils | nkt2id5mi09oq | $0.049 | 1m53s | Success |
| gemini-2.5-pro | coreutils-old-version | 6zq8inevfx8ds | $0.777 | 9m29s | Failure exceeded max tool calls (90) |
| gemini-2.5-pro | coreutils-old-version | 8jfa9wn9zcqdd | $0.094 | 2m27s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| gemini-2.5-pro | coreutils-old-version | rmo65epaw2rw6 | $0.218 | 4m55s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| gemini-2.5-pro | coreutils-old-version-alpine | 73yuzozgu39e8 | $1.376 | 7m10s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-pro | coreutils-old-version-alpine | axxfa9gtps3e8 | $2.703 | 8m14s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-pro | coreutils-old-version-alpine | nbgpyvzf5sn1j | $0.186 | 1m41s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-pro | coreutils-static | i66fll9y9zbx8 | $0.074 | 2m19s | Success |
| gemini-2.5-pro | coreutils-static | jm302v4jei7xk | $0.069 | 2m18s | Success |
| gemini-2.5-pro | coreutils-static | p5b244pg4blu1 | $0.120 | 3m2s | Success |
| gemini-2.5-pro | coreutils-static-alpine | 8b3txg4az3fim | $0.044 | 2m0s | Success |
| gemini-2.5-pro | coreutils-static-alpine | jn27ogdi6pu8a | $0.056 | 2m2s | Success |
| gemini-2.5-pro | coreutils-static-alpine | mj9b3nav57hki | $0.042 | 2m4s | Success |
| gemini-2.5-pro | cowsay | 8q5s1d9mgqfly | $0.024 | 29s | Success |
| gemini-2.5-pro | cowsay | cmd5z7hrez88x | $0.018 | 24s | Success |
| gemini-2.5-pro | cowsay | uopqf502obo0v | $0.031 | 27s | Success |
| gemini-2.5-pro | curl | 3e4jro69dm5ox | $0.055 | 2m6s | Success |
| gemini-2.5-pro | curl | b3x2q9982j05r | $0.057 | 2m9s | Success |
| gemini-2.5-pro | curl | dbyhg0dlp3joc | $0.279 | 4m27s | Success |
| gemini-2.5-pro | curl-ssl | 321oro8n33dlo | $0.101 | 2m46s | Success |
| gemini-2.5-pro | curl-ssl | 3w5j1w5ge3rre | $0.125 | 3m2s | Success |
| gemini-2.5-pro | curl-ssl | cxwdxu4prhl2v | $0.097 | 2m37s | Success |
| gemini-2.5-pro | curl-ssl-arm64-static | mb9dxrlj518y3 | $0.698 | 7m26s | Failure task failed: curl binary does not exist |
| gemini-2.5-pro | curl-ssl-arm64-static | ngq5n3da8rhb1 | $0.332 | 4m52s | Failure task failed: curl-arm64 is not statically linked |
| gemini-2.5-pro | curl-ssl-arm64-static | vgiv49rfhm8ww | $0.314 | 3m27s | Failure task failed: curl-arm64 is not statically linked |
| gemini-2.5-pro | curl-ssl-arm64-static2 | gcb5jutrbg7a2 | $0.427 | 5m22s | Failure task failed: curl binary does not exist |
| gemini-2.5-pro | curl-ssl-arm64-static2 | nvzu1oyk5zuem | $0.625 | 6m31s | Failure task failed: curl binary does not exist |
| gemini-2.5-pro | curl-ssl-arm64-static2 | reodc0zqt7bmh | $0.276 | 3m27s | Failure task failed: curl binary does not exist |
| gemini-2.5-pro | jq | 8knzqzdpnatex | $0.059 | 56s | Success |
| gemini-2.5-pro | jq | cy85xpo9lr05z | $0.028 | 48s | Success |
| gemini-2.5-pro | jq | ktb4un614oe96 | $0.060 | 1m3s | Success |
| gemini-2.5-pro | jq-static | fauc81mw28665 | $0.319 | 3m27s | Failure task failed: jq is not statically linked |
| gemini-2.5-pro | jq-static | tswzaxnbm2j0o | $0.157 | 2m5s | Failure task failed: jq is not statically linked |
| gemini-2.5-pro | jq-static | zha8tubwz0tfn | $0.147 | 2m17s | Failure task failed: jq is not statically linked |
| gemini-2.5-pro | jq-static-musl | efw1rw1pzilv4 | $0.191 | 2m26s | Failure task failed: jq binary does not exist |
| gemini-2.5-pro | jq-static-musl | jn63ltdcm43n2 | $0.087 | 1m21s | Failure task failed: jq is not statically linked |
| gemini-2.5-pro | jq-static-musl | nle29iwjqf9p9 | $0.350 | 3m36s | Failure task failed: jq is not statically linked |
| gemini-2.5-pro | jq-windows | hb4es9008gd3h | $0.056 | 50s | Success |
| gemini-2.5-pro | jq-windows | jc35jfibzsjlp | $0.052 | 1m7s | Failure task failed: jq help does not contain expected string |
| gemini-2.5-pro | jq-windows | tdoiqqd9tnvg7 | $0.037 | 52s | Failure task failed: jq.exe binary does not exist |
| gemini-2.5-pro | jq-windows2 | 4jvvi54a2wo0g | $0.113 | 2m54s | Success |
| gemini-2.5-pro | jq-windows2 | 7pizx91bf9e9t | $0.142 | 2m10s | Success |
| gemini-2.5-pro | jq-windows2 | iov46x3g3v1vr | $0.140 | 2m49s | Failure task failed: jq help does not contain expected string |
 glm-4.5 | coreutils | 2hwexo41qktac | $0.101 | 2m29s | Success |
| glm-4.5 | coreutils | 82872ya0h76zh | $0.041 | 1m26s | Success |
| glm-4.5 | coreutils | h85c5q0g7mqw4 | $0.038 | 1m34s | Success |
| glm-4.5 | coreutils-old-version | 5sf13h26pxlzn | $0.073 | 2m17s | Failure task failed: sha1sum binary does not exist |
| glm-4.5 | coreutils-old-version | 86275dcc9re9k | $0.566 | 6m43s | Success |
| glm-4.5 | coreutils-old-version | s74lri9vfhhc1 | $0.035 | 1m54s | Failure task failed: sha1sum binary does not exist |
| glm-4.5 | coreutils-old-version-alpine | 1sv17yuewn3rz | $0.018 | 38s | Failure task failed: sha1sum binary does not exist |
| glm-4.5 | coreutils-old-version-alpine | 3semgfu1bjn95 | $0.075 | 1m30s | Failure task failed: sha1sum binary does not exist |
| glm-4.5 | coreutils-old-version-alpine | ao3pftvf0rjdx | $0.316 | 3m8s | Failure task failed: sha1sum binary does not exist |
| glm-4.5 | coreutils-static | 3efm44y4sq42v | $0.063 | 1m43s | Success |
| glm-4.5 | coreutils-static | alraxhob6pahl | $0.021 | 1m31s | Success |
| glm-4.5 | coreutils-static | eq6wgulo4zmts | $0.015 | 1m24s | Failure task failed: sha1sum binary does not exist |
| glm-4.5 | coreutils-static-alpine | ktr4qqs8xo0su | $0.063 | 1m36s | Success |
| glm-4.5 | coreutils-static-alpine | p31pmdt10q55c | $0.034 | 1m25s | Success |
| glm-4.5 | coreutils-static-alpine | ueue8k95q5iy3 | $0.036 | 1m16s | Success |
| glm-4.5 | cowsay | c7lwyzc7e35gi | $0.016 | 52s | Success |
| glm-4.5 | cowsay | j5cjl9ny63ytv | $0.012 | 29s | Success |
| glm-4.5 | cowsay | slu29ufqn4r3k | $0.017 | 59s | Success |
| glm-4.5 | curl | 76i3akdbzlr3k | $0.038 | 2m15s | Success |
| glm-4.5 | curl | fppvhgc27jtmo | $0.025 | 50s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl | we96hpilygjsr | $0.031 | 1m57s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl-ssl | 1akx07et1t647 | $0.035 | 1m10s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl-ssl | ipjpbgdvpr2n4 | $0.074 | 1m37s | Success |
| glm-4.5 | curl-ssl | tjqg8iq1qv38c | $0.068 | 2m6s | Success |
| glm-4.5 | curl-ssl-arm64-static | 0mu03pof1xy28 | $0.328 | 4m18s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl-ssl-arm64-static | ue0q0u9pxaujx | $0.033 | 58s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl-ssl-arm64-static | z82hs8f35s623 | $0.038 | 1m6s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl-ssl-arm64-static2 | dh5tp7nzcfyu8 | $0.062 | 1m19s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl-ssl-arm64-static2 | jjoeijpcldd4e | $0.027 | 52s | Failure task failed: curl binary does not exist |
| glm-4.5 | curl-ssl-arm64-static2 | xvxegfcsk9paq | $0.195 | 6m33s | Failure task failed: curl binary does not exist |
| glm-4.5 | jq | 4hazz0u6ks713 | $0.027 | 57s | Success |
| glm-4.5 | jq | bcdzeowlwff5h | $0.035 | 49s | Success |
| glm-4.5 | jq | eiq4lq8wiyu1l | $0.018 | 44s | Failure task failed: jq binary does not exist |
| glm-4.5 | jq-static | 53zsqoflwze9m | $0.051 | 58s | Success |
| glm-4.5 | jq-static | fd3ujlf9k594u | $0.031 | 49s | Success |
| glm-4.5 | jq-static | h3voa22k3bcae | $0.041 | 1m0s | Failure task failed: jq is not statically linked |
| glm-4.5 | jq-static-musl | 3v1e9bbm91nqp | $0.222 | 2m49s | Success |
| glm-4.5 | jq-static-musl | 78bmmqixx7ofr | $0.009 | 22s | Failure task failed: jq binary does not exist |
| glm-4.5 | jq-static-musl | b0hxijrv7ghqu | $0.111 | 1m33s | Success |
| glm-4.5 | jq-windows | 3pnuob6n5ebjf | $0.092 | 1m44s | Failure task failed: jq help does not contain expected string |
| glm-4.5 | jq-windows | auhbtigd3c03n | $0.024 | 56s | Failure task failed: jq help does not contain expected string |
| glm-4.5 | jq-windows | g3gktvoafpz5u | $0.091 | 1m39s | Success |
| glm-4.5 | jq-windows2 | fxs27lhyaa7ay | $0.301 | 4m36s | Failure task failed: jq help does not contain expected string |
| glm-4.5 | jq-windows2 | gslrwvwftc8fz | $0.272 | 4m7s | Failure task failed: jq help does not contain expected string |
| glm-4.5 | jq-windows2 | scukih22zfz49 | $0.044 | 1m43s | Failure task failed: jq help does not contain expected string |
| gpt-4.1 | coreutils | 8m33hbo8fhu4v | $0.055 | 1m5s | Success |
| gpt-4.1 | coreutils | j5v8pmha07eo7 | $0.051 | 1m11s | Success |
| gpt-4.1 | coreutils | s45jh9t5t8cb8 | $0.036 | 1m6s | Success |
| gpt-4.1 | coreutils-old-version | 335ro2eow4mpt | $0.333 | 2m31s | Failure task failed: install missing at /home/peter/result/install or not executable |
| gpt-4.1 | coreutils-old-version | fkq26et7a9e1q | $1.244 | 4m39s | Failure task failed: sha1sum binary does not exist |
| gpt-4.1 | coreutils-old-version | k8w4b7mlwvosf | $1.243 | 5m4s | Failure task failed: groups missing at /home/peter/result/groups or not executable |
| gpt-4.1 | coreutils-old-version-alpine | avu5b7qwr9i8b | $2.821 | 4m45s | Failure task failed: sha1sum binary does not exist |
| gpt-4.1 | coreutils-old-version-alpine | bh4rfhg0kgnrd | $1.576 | 3m15s | Failure task failed: df missing at /home/peter/result/df or not executable |
| gpt-4.1 | coreutils-old-version-alpine | onifl1ovzzryu | $0.659 | 2m22s | Failure task failed: sha1sum binary does not exist |
| gpt-4.1 | coreutils-static | 8clcq0b9nvnp0 | $0.059 | 1m17s | Success |
| gpt-4.1 | coreutils-static | 8yecdnfh30zng | $0.070 | 1m19s | Success |
| gpt-4.1 | coreutils-static | my44jxbuog2ej | $0.050 | 2m6s | Success |
| gpt-4.1 | coreutils-static-alpine | 7hmaishv71n24 | $0.037 | 54s | Success |
| gpt-4.1 | coreutils-static-alpine | u0vlvwt4jij3k | $0.028 | 56s | Failure task failed: kill missing at /home/peter/result/kill or not executable |
| gpt-4.1 | coreutils-static-alpine | x2d4ka9mzebb0 | $0.052 | 1m9s | Success |
| gpt-4.1 | cowsay | 3id32xr9cey1p | $0.015 | 13s | Success |
| gpt-4.1 | cowsay | abr84yraeyire | $0.016 | 12s | Success |
| gpt-4.1 | cowsay | wy3uorgdtg3tq | $0.020 | 16s | Success |
| gpt-4.1 | curl | 3xns9ceaom0ul | $0.037 | 30s | Success |
| gpt-4.1 | curl | bwxa5zt72aypx | $0.030 | 29s | Success |
| gpt-4.1 | curl | x8ypw6yyfrflf | $0.034 | 33s | Success |
| gpt-4.1 | curl-ssl | 5z512ef4z27in | $0.075 | 56s | Success |
| gpt-4.1 | curl-ssl | bydbl3asyas9v | $0.112 | 1m10s | Success |
| gpt-4.1 | curl-ssl | er52z0ij5xato | $0.064 | 56s | Success |
| gpt-4.1 | curl-ssl-arm64-static | 3epted7u83lap | $0.149 | 1m13s | Failure task failed: curl binary does not exist |
| gpt-4.1 | curl-ssl-arm64-static | i6t0fmxnqc8ux | $0.066 | 54s | Failure task failed: curl binary does not exist |
| gpt-4.1 | curl-ssl-arm64-static | nlakvfwsmp3ay | $0.074 | 58s | Failure task failed: curl binary does not exist |
| gpt-4.1 | curl-ssl-arm64-static2 | 23c79erjmirn6 | $0.252 | 1m33s | Failure task failed: curl binary does not exist |
| gpt-4.1 | curl-ssl-arm64-static2 | 331320zw96chp | $0.037 | 43s | Failure task failed: curl binary does not exist |
| gpt-4.1 | curl-ssl-arm64-static2 | j9tb1imlbyga2 | $0.122 | 1m10s | Failure task failed: curl binary does not exist |
| gpt-4.1 | jq | qt6cp6j4m8oyp | $0.028 | 22s | Success |
| gpt-4.1 | jq | vjoaixidissnv | $0.030 | 27s | Success |
| gpt-4.1 | jq | x7pjvpldnf7b1 | $0.033 | 24s | Success |
| gpt-4.1 | jq-static | ijmgo8084eqsz | $0.342 | 1m56s | Success |
| gpt-4.1 | jq-static | pehmk0x7tno7t | $0.316 | 2m20s | Failure task failed: jq is not statically linked |
| gpt-4.1 | jq-static | y786h6m3pptu9 | $0.102 | 1m21s | Success |
| gpt-4.1 | jq-static-musl | 5ry2340t8ffq5 | $0.293 | 3m24s | Failure task failed: jq is not statically linked |
| gpt-4.1 | jq-static-musl | ax7v12bvnwj41 | $0.430 | 2m36s | Failure task failed: jq is not statically linked |
| gpt-4.1 | jq-static-musl | f2u7e17o8cqfn | $0.146 | 59s | Failure task failed: jq is not statically linked |
| gpt-4.1 | jq-windows | dyzgubb5rdzk3 | $0.103 | 1m5s | Failure task failed: jq help does not contain expected string |
| gpt-4.1 | jq-windows | hrxpw50se31vi | $0.082 | 54s | Failure task failed: jq help does not contain expected string |
| gpt-4.1 | jq-windows | wdtj2fr8uf0t5 | $0.051 | 54s | Failure task failed: jq help does not contain expected string |
| gpt-4.1 | jq-windows2 | 7d03rg0kg9tpw | $0.068 | 1m27s | Success |
| gpt-4.1 | jq-windows2 | apjvc6zkvpgxk | $0.175 | 2m23s | Failure task failed: jq help does not contain expected string |
| gpt-4.1 | jq-windows2 | gcwh0k2nic3t1 | $0.094 | 1m18s | Success |
| gpt-4.1-mini | coreutils | 2p70j91hufzfc | $0.003 | 55s | Success |
| gpt-4.1-mini | coreutils | g0ufozl8ppx4u | $0.007 | 1m8s | Success |
| gpt-4.1-mini | coreutils | hkho8smf3400h | $0.007 | 56s | Success |
| gpt-4.1-mini | coreutils-old-version | 0czs7cd61cgiv | $0.428 | 4m24s | Failure exceeded max tool calls (90) |
| gpt-4.1-mini | coreutils-old-version | pk3sw083z1mhf | $0.045 | 15m0s | Success |
| gpt-4.1-mini | coreutils-old-version | r0va6gg2yz6cw | $0.289 | 4m6s | Failure exceeded max tool calls (90) |
| gpt-4.1-mini | coreutils-old-version-alpine | 0jd0ssv7t8ej8 | $1.626 | 10m17s | Failure exceeded max tool calls (200) |
| gpt-4.1-mini | coreutils-old-version-alpine | 0uyfhajvzi84t | $0.570 | 5m40s | Failure task failed: sha1sum binary does not exist |
| gpt-4.1-mini | coreutils-old-version-alpine | deuztodwd8fyw | $0.015 | 32s | Failure task failed: sha1sum binary does not exist |
| gpt-4.1-mini | coreutils-static | i1gcm32w6y8lt | $0.020 | 1m28s | Failure task failed: install missing at /home/peter/result/install or not executable |
| gpt-4.1-mini | coreutils-static | m6jory3zzv0yy | $0.005 | 1m24s | Success |
| gpt-4.1-mini | coreutils-static | ny4qbms66bcj2 | $0.005 | 1m11s | Success |
| gpt-4.1-mini | coreutils-static-alpine | 41v4f1oidpjf3 | $0.005 | 54s | Success |
| gpt-4.1-mini | coreutils-static-alpine | fiieaupeprxhx | $0.005 | 56s | Success |
| gpt-4.1-mini | coreutils-static-alpine | w2nie94mxcrcu | $0.005 | 55s | Success |
| gpt-4.1-mini | cowsay | 9awhy8x6j9ur4 | $0.003 | 12s | Failure task failed: Cowsay does not contain expected string (eyes) |
| gpt-4.1-mini | cowsay | qsr9bokvjmfhz | $0.004 | 17s | Success |
| gpt-4.1-mini | cowsay | scf6zd1ml423x | $0.003 | 10m9s | Failure context timeout: context deadline exceeded |
| gpt-4.1-mini | curl | 832y21jw8tb5e | $0.002 | 22s | Success |
| gpt-4.1-mini | curl | aewcboi7hghxu | $0.034 | 1m17s | Success |
| gpt-4.1-mini | curl | ofs50jzdw2i0b | $0.012 | 41s | Success |
| gpt-4.1-mini | curl-ssl | 21pe0ozs8m7fm | $0.005 | 2m5s | Success |
| gpt-4.1-mini | curl-ssl | ki2dypbz4tpv8 | $0.008 | 47s | Success |
| gpt-4.1-mini | curl-ssl | p1htls0nvlfqc | $0.010 | 53s | Success |
| gpt-4.1-mini | curl-ssl-arm64-static | 012ghbq53dtrb | $0.052 | 1m53s | Failure task failed: curl binary does not exist |
| gpt-4.1-mini | curl-ssl-arm64-static | btrneoynqi8wh | $0.100 | 2m3s | Failure task failed: curl binary does not exist |
| gpt-4.1-mini | curl-ssl-arm64-static | nkse2jbrzo0ax | $0.031 | 1m13s | Failure task failed: curl binary does not exist |
| gpt-4.1-mini | curl-ssl-arm64-static2 | 0p9s0zbpxhkl2 | $0.035 | 1m36s | Failure task failed: curl binary does not exist |
| gpt-4.1-mini | curl-ssl-arm64-static2 | azgepyb5or5dc | $0.029 | 57s | Failure task failed: curl binary does not exist |
| gpt-4.1-mini | curl-ssl-arm64-static2 | ff6i96z03vwjm | $0.244 | 3m50s | Failure task failed: curl binary does not exist |
| gpt-4.1-mini | jq | 81t1qjczdy22d | $0.002 | 36s | Success |
| gpt-4.1-mini | jq | gnbm39zwmwk5n | $0.002 | 37s | Success |
| gpt-4.1-mini | jq | r11pfzhpwmo4t | $0.008 | 29s | Success |
| gpt-4.1-mini | jq-static | m1dtr4r8agieq | $0.015 | 1m30s | Failure task failed: jq is not statically linked |
| gpt-4.1-mini | jq-static | rrnjfbyjuj24d | $0.007 | 1m5s | Failure task failed: jq is not statically linked |
| gpt-4.1-mini | jq-static | v155i3jgsrqgx | $0.019 | 2m8s | Failure task failed: jq is not statically linked |
| gpt-4.1-mini | jq-static-musl | s8y2djf3d5u39 | $0.007 | 47s | Failure task failed: jq is not statically linked |
| gpt-4.1-mini | jq-static-musl | sz34lbz4tfzla | $0.007 | 39s | Failure task failed: jq is not statically linked |
| gpt-4.1-mini | jq-static-musl | trwl27b2sjave | $0.006 | 27s | Failure task failed: jq is not statically linked |
| gpt-4.1-mini | jq-windows | da2b7m8uzzkrc | $0.007 | 36s | Success |
| gpt-4.1-mini | jq-windows | fc9g3soaojv2j | $0.009 | 37s | Failure task failed: jq help does not contain expected string |
| gpt-4.1-mini | jq-windows | p4h15s794y3xh | $0.005 | 45s | Failure task failed: jq help does not contain expected string |
| gpt-4.1-mini | jq-windows2 | 2tzmylmf760ao | $0.022 | 1m57s | Failure task failed: jq help does not contain expected string |
| gpt-4.1-mini | jq-windows2 | 80hvhaadxr0t2 | $0.032 | 1m59s | Success |
| gpt-4.1-mini | jq-windows2 | fe91iqj9w2773 | $0.023 | 2m4s | Failure task failed: jq help does not contain expected string |
| gpt-5-codex-high | coreutils | elm94zto0xjiy | $0.042 | 1m30s | Success |
| gpt-5-codex-high | coreutils | jya2quzbkbt46 | $0.047 | 1m33s | Success |
| gpt-5-codex-high | coreutils | vds73s9n1nh88 | $0.053 | 1m41s | Success |
| gpt-5-codex-high | coreutils-old-version | 3ekrd46s9d867 | $0.275 | 6m50s | Success |
| gpt-5-codex-high | coreutils-old-version | ab4iuxfkr6i85 | $0.295 | 5m7s | Success |
| gpt-5-codex-high | coreutils-old-version | s2p70fvq14ldn | $0.162 | 3m50s | Success |
| gpt-5-codex-high | coreutils-old-version-alpine | 1ltffu0yi165k | $0.617 | 6m35s | Failure task failed: stty missing at /home/peter/result/stty or not executable |
| gpt-5-codex-high | coreutils-old-version-alpine | oznvks484jtmc | $1.370 | 34m0s | Success |
| gpt-5-codex-high | coreutils-old-version-alpine | rui2vahcqalrp | $1.364 | 19m58s | Success |
| gpt-5-codex-high | coreutils-static | bxnffu5scelp6 | $0.041 | 1m45s | Success |
| gpt-5-codex-high | coreutils-static | dn62k0loubsof | $0.049 | 1m45s | Success |
| gpt-5-codex-high | coreutils-static | mpl6ujuxf9ozt | $0.055 | 1m40s | Success |
| gpt-5-codex-high | coreutils-static-alpine | 4oo5fq9i0d2y1 | $0.069 | 1m59s | Success |
| gpt-5-codex-high | coreutils-static-alpine | 5rir6cs6ipqj5 | $0.039 | 1m18s | Success |
| gpt-5-codex-high | coreutils-static-alpine | mh3kfcatopd92 | $0.044 | 1m21s | Success |
| gpt-5-codex-high | cowsay | 9tvhx8lbmjk6f | $0.020 | 35s | Success |
| gpt-5-codex-high | cowsay | hn2ban9rpomce | $0.036 | 42s | Success |
| gpt-5-codex-high | cowsay | rtyljyjzaev67 | $0.030 | 37s | Success |
| gpt-5-codex-high | curl | fvxyoeqvih89p | $0.053 | 1m4s | Success |
| gpt-5-codex-high | curl | jte90pyegwbsw | $0.040 | 1m1s | Success |
| gpt-5-codex-high | curl | w5l89it2ratfa | $0.036 | 46s | Success |
| gpt-5-codex-high | curl-ssl | lr4azmoq0vwfp | $0.060 | 1m22s | Success |
| gpt-5-codex-high | curl-ssl | n7pb2nptmmtwb | $0.057 | 1m28s | Success |
| gpt-5-codex-high | curl-ssl | zw5xibegcfv42 | $0.102 | 1m39s | Success |
| gpt-5-codex-high | curl-ssl-arm64-static | 4x7j150599zoa | $0.719 | 9m55s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-codex-high | curl-ssl-arm64-static | l5u1cop2ljk6j | $0.322 | 6m12s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-codex-high | curl-ssl-arm64-static | prnksjucmv97u | $0.368 | 6m19s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-codex-high | curl-ssl-arm64-static2 | 0por81ik8r33z | $0.392 | 6m48s | Success |
| gpt-5-codex-high | curl-ssl-arm64-static2 | iumt0u8y0x56r | $0.600 | 9m8s | Success |
| gpt-5-codex-high | curl-ssl-arm64-static2 | w3ptavgcxglkg | $0.571 | 7m52s | Success |
| gpt-5-codex-high | jq | 0kbtr8nfthbyp | $0.044 | 46s | Success |
| gpt-5-codex-high | jq | 158bgragokoer | $0.045 | 51s | Success |
| gpt-5-codex-high | jq | 83r05vg81hpci | $0.023 | 40s | Success |
| gpt-5-codex-high | jq-static | tuuosav086o2z | $0.123 | 2m13s | Success |
| gpt-5-codex-high | jq-static | yuio19q8ngp9d | $0.077 | 1m29s | Success |
| gpt-5-codex-high | jq-static | z0ljg78oo8opc | $0.143 | 2m25s | Success |
| gpt-5-codex-high | jq-static-musl | 2shz81esqlh60 | $0.086 | 1m16s | Success |
| gpt-5-codex-high | jq-static-musl | f1ig42g5qqfdp | $0.169 | 2m38s | Success |
| gpt-5-codex-high | jq-static-musl | f6blahvfwbv2t | $0.219 | 3m14s | Success |
| gpt-5-codex-high | jq-windows | bucvq7hcm8qyu | $0.347 | 4m39s | Success |
| gpt-5-codex-high | jq-windows | hwijgk2fy8ee0 | $0.351 | 4m41s | Success |
| gpt-5-codex-high | jq-windows | n86tcjx3e6n8f | $0.250 | 4m27s | Success |
| gpt-5-codex-high | jq-windows2 | mqsax08l98lcs | $0.105 | 2m11s | Success |
| gpt-5-codex-high | jq-windows2 | w7q82d7srjvbn | $0.131 | 2m8s | Success |
| gpt-5-codex-high | jq-windows2 | zvi2p6q1adjs2 | $0.150 | 2m34s | Success |
| gpt-5-high | coreutils | 59x5dbjrvlewq | $0.064 | 2m33s | Success |
| gpt-5-high | coreutils | 6bygfzztwt9gk | $0.061 | 2m32s | Success |
| gpt-5-high | coreutils | x4ia5x2kascfe | $0.082 | 3m32s | Success |
| gpt-5-high | coreutils-old-version | lpwkqycgej1dy | $0.177 | 6m49s | Success |
| gpt-5-high | coreutils-old-version | voe8esm42oiot | $0.228 | 5m39s | Success |
| gpt-5-high | coreutils-old-version | ybnt1nyjz0lra | $0.291 | 8m32s | Success |
| gpt-5-high | coreutils-old-version-alpine | 8xsbws4w35j07 | $0.580 | 11m51s | Success |
| gpt-5-high | coreutils-old-version-alpine | hn5805nt2m0qz | $0.438 | 25m10s | Failure task failed: df missing at /home/peter/result/df or not executable |
| gpt-5-high | coreutils-old-version-alpine | xmgu0wx9ubylz | $0.693 | 13m6s | Success |
| gpt-5-high | coreutils-static | 5lo26vu9b6whp | $0.093 | 3m21s | Success |
| gpt-5-high | coreutils-static | q3hyeaa3pax04 | $0.121 | 3m57s | Success |
| gpt-5-high | coreutils-static | uqkifa3980qpy | $0.117 | 3m40s | Success |
| gpt-5-high | coreutils-static-alpine | 4dplv2asuz96k | $0.174 | 4m28s | Success |
| gpt-5-high | coreutils-static-alpine | 6kcstptn9q8fu | $0.091 | 3m17s | Success |
| gpt-5-high | coreutils-static-alpine | nwmke9yqrdnee | $0.437 | 9m34s | Failure exceeded max tool calls (50) |
| gpt-5-high | cowsay | 6o0f037m4ier7 | $0.045 | 1m27s | Success |
| gpt-5-high | cowsay | 8jb0vkfswvb49 | $0.055 | 1m12s | Success |
| gpt-5-high | cowsay | t5td2t4tw673c | $0.037 | 1m16s | Success |
| gpt-5-high | curl | 1kpgqsl29yngn | $0.059 | 2m6s | Success |
| gpt-5-high | curl | 5j52ohabvhzs4 | $0.055 | 1m57s | Success |
| gpt-5-high | curl | kg4nv8jv9trqa | $0.061 | 2m10s | Success |
| gpt-5-high | curl-ssl | nckhvg37rrvka | $0.077 | 2m36s | Success |
| gpt-5-high | curl-ssl | sr2cnxp5q2goj | $0.079 | 2m11s | Success |
| gpt-5-high | curl-ssl | wb3o0g66o3ocp | $0.098 | 2m48s | Success |
| gpt-5-high | curl-ssl-arm64-static | cfl9qebabpkgp | $0.258 | 8m5s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-high | curl-ssl-arm64-static | p0xrg1i5dtff9 | $0.291 | 7m13s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-high | curl-ssl-arm64-static | yxbb8asz6qicb | $0.295 | 7m37s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-high | curl-ssl-arm64-static2 | 3k0rnfimwqtzm | $0.251 | 6m52s | Success |
| gpt-5-high | curl-ssl-arm64-static2 | 5z34td35fkopt | $0.728 | 17m5s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-high | curl-ssl-arm64-static2 | dyuosdlxz9gzh | $0.498 | 11m29s | Success |
| gpt-5-high | jq | sge8f0udia7a7 | $0.048 | 1m31s | Success |
| gpt-5-high | jq | ugaa1u07fm2yh | $0.066 | 1m50s | Success |
| gpt-5-high | jq | yzssxil81hmtk | $0.051 | 1m41s | Success |
| gpt-5-high | jq-static | ovqnoaiacdu9d | $0.045 | 1m34s | Success |
| gpt-5-high | jq-static | tt4f1o4g0lx1e | $0.086 | 2m28s | Success |
| gpt-5-high | jq-static | utxwl1j4a2xhf | $0.086 | 2m30s | Success |
| gpt-5-high | jq-static-musl | 16a031xzu2q4l | $0.078 | 2m56s | Success |
| gpt-5-high | jq-static-musl | 97y2o6a6u4gdo | $0.164 | 4m18s | Success |
| gpt-5-high | jq-static-musl | nll1333z3b7nr | $0.071 | 2m13s | Success |
| gpt-5-high | jq-windows | d8dlng4urmp14 | $0.083 | 3m0s | Success |
| gpt-5-high | jq-windows | egdr3smjmsgek | $0.091 | 3m9s | Success |
| gpt-5-high | jq-windows | sktvqvlo13bbc | $0.094 | 2m36s | Success |
| gpt-5-high | jq-windows2 | 1eibpeqrnuuzi | $0.587 | 14m51s | Success |
| gpt-5-high | jq-windows2 | ezim8wto7e4wd | $0.172 | 5m45s | Success |
| gpt-5-high | jq-windows2 | oy6bk2cxohfto | $0.118 | 3m55s | Success |
| gpt-5-mini-high | coreutils | 71rfh3egedqj4 | $0.014 | 3m5s | Success |
| gpt-5-mini-high | coreutils | 9roqytc4zztxx | $0.016 | 3m14s | Success |
| gpt-5-mini-high | coreutils | ozg4c7ll3hitx | $0.019 | 3m28s | Success |
| gpt-5-mini-high | coreutils-old-version | 6b3e0y879rrv6 | $0.069 | 7m24s | Success |
| gpt-5-mini-high | coreutils-old-version | hbo2sd0aay6v6 | $0.038 | 6m1s | Success |
| gpt-5-mini-high | coreutils-old-version | lwlyu0ig87c7w | $0.047 | 7m40s | Success |
| gpt-5-mini-high | coreutils-old-version-alpine | 0fmtwlk101w1z | $0.133 | 12m50s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-high | coreutils-old-version-alpine | uc7s97sptn2m1 | $0.259 | 17m10s | Failure task failed: No success reported by script: all-utils-exists.sh |
| gpt-5-mini-high | coreutils-old-version-alpine | yty1ryhg5g01r | $0.170 | 11m56s | Failure task failed: df missing at /home/peter/result/df or not executable |
| gpt-5-mini-high | coreutils-static | 064sifofef33k | $0.020 | 3m9s | Success |
| gpt-5-mini-high | coreutils-static | asvvlggz0atlx | $0.014 | 3m11s | Success |
| gpt-5-mini-high | coreutils-static | dyhxix351i10v | $0.013 | 2m44s | Success |
| gpt-5-mini-high | coreutils-static-alpine | 1ympgcgxadamv | $0.016 | 2m57s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-high | coreutils-static-alpine | 72yxfisixfxth | $0.018 | 2m52s | Success |
| gpt-5-mini-high | coreutils-static-alpine | dc3kc0bwyz0bk | $0.021 | 3m17s | Success |
| gpt-5-mini-high | cowsay | 5p07lpk4lcal9 | $0.008 | 1m8s | Success |
| gpt-5-mini-high | cowsay | bogmtrlwbves7 | $0.010 | 1m10s | Success |
| gpt-5-mini-high | cowsay | yuc2ey62bf6py | $0.009 | 1m20s | Success |
| gpt-5-mini-high | curl | 9x5acpazx08ff | $0.046 | 5m4s | Success |
| gpt-5-mini-high | curl | ah443gb5vivip | $0.015 | 2m19s | Success |
| gpt-5-mini-high | curl | ofev8fggvoz6a | $0.013 | 2m17s | Success |
| gpt-5-mini-high | curl-ssl | 5w8nf4xwlw2s0 | $0.018 | 3m12s | Success |
| gpt-5-mini-high | curl-ssl | alq42fopv2rty | $0.032 | 3m50s | Success |
| gpt-5-mini-high | curl-ssl | h7rfxfac5p8u0 | $0.023 | 3m24s | Success |
| gpt-5-mini-high | curl-ssl-arm64-static | 30k51uvjkvcig | $0.125 | 12m24s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-mini-high | curl-ssl-arm64-static | 8r76mtkzr4s92 | $0.211 | 16m58s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-mini-high | curl-ssl-arm64-static | dv8aw3au3ot5o | $0.219 | 25m31s | Failure task failed: curl-arm64 is not statically linked |
| gpt-5-mini-high | curl-ssl-arm64-static2 | r1vkvqt6myjg6 | $0.131 | 12m17s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-mini-high | curl-ssl-arm64-static2 | rcpzkwha9jhcy | $0.216 | 19m24s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-mini-high | curl-ssl-arm64-static2 | ufbv6bpjtz17v | $0.392 | 25m12s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| gpt-5-mini-high | jq | 9w2r3hjb3770q | $0.010 | 2m4s | Success |
| gpt-5-mini-high | jq | aqtaxaa2l9l0q | $0.011 | 1m48s | Success |
| gpt-5-mini-high | jq | shh2snps1fcz9 | $0.013 | 1m29s | Success |
| gpt-5-mini-high | jq-static | d8soats0s23so | $0.027 | 3m8s | Success |
| gpt-5-mini-high | jq-static | ki0nixf1g1z0b | $0.035 | 3m1s | Success |
| gpt-5-mini-high | jq-static | yyiv9qehm8k4o | $0.021 | 2m12s | Success |
| gpt-5-mini-high | jq-static-musl | 0j51p23s6yj1u | $0.032 | 4m25s | Success |
| gpt-5-mini-high | jq-static-musl | irquyvwht52o6 | $0.032 | 4m11s | Success |
| gpt-5-mini-high | jq-static-musl | s8t30gczb1xw1 | $0.034 | 4m10s | Success |
| gpt-5-mini-high | jq-windows | k81fptysyo1p3 | $0.026 | 3m29s | Failure task failed: jq help does not contain expected string |
| gpt-5-mini-high | jq-windows | vtsxqiuasvrdm | $0.038 | 4m51s | Success |
| gpt-5-mini-high | jq-windows | z1kklm6lnxh44 | $0.041 | 4m8s | Success |
| gpt-5-mini-high | jq-windows2 | 3n96kgbihk6y6 | $0.023 | 2m50s | Success |
| gpt-5-mini-high | jq-windows2 | k2n8hpdhjd06s | $0.024 | 3m13s | Success |
| gpt-5-mini-high | jq-windows2 | otw5y3d9t22ct | $0.029 | 4m30s | Success |
| gpt-5-mini-minimal | coreutils | 8kdbqlawdlfsk | $0.003 | 1m9s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | coreutils | j916wqm4dkq54 | $0.003 | 1m8s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | coreutils | xlwu5dg5wooqr | $0.003 | 1m2s | Success |
| gpt-5-mini-minimal | coreutils-old-version | d9t1djg24wnaq | $0.016 | 4m1s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | coreutils-old-version | ov75uekkycz7t | $0.007 | 3m7s | Success |
| gpt-5-mini-minimal | coreutils-old-version | xa3nkglfqxzsi | $0.007 | 3m19s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | coreutils-old-version-alpine | ahn7gmt14ic2c | $0.012 | 1m6s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | coreutils-old-version-alpine | mf5roenxa2b7c | $0.025 | 2m23s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | coreutils-old-version-alpine | tfelny2ccy8dm | $0.008 | 1m6s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | coreutils-static | enorhmoh6t2fw | $0.003 | 1m18s | Success |
| gpt-5-mini-minimal | coreutils-static | lo37qtix0tzwi | $0.003 | 1m16s | Failure task failed: sha1sum is not statically linked |
| gpt-5-mini-minimal | coreutils-static | xstto1rh4k7wp | $0.004 | 1m21s | Success |
| gpt-5-mini-minimal | coreutils-static-alpine | gzm9ox4kjjy9g | $0.006 | 1m20s | Failure task failed: kill missing at /home/peter/result/kill or not executable |
| gpt-5-mini-minimal | coreutils-static-alpine | jxbbw55e1jaqj | $0.005 | 1m9s | Success |
| gpt-5-mini-minimal | coreutils-static-alpine | my8luqikggpov | $0.004 | 1m50s | Success |
| gpt-5-mini-minimal | cowsay | d3uhbkoymgwyz | $0.002 | 17s | Success |
| gpt-5-mini-minimal | cowsay | er0nekqcuirte | $0.005 | 10m32s | Failure context timeout: context deadline exceeded |
| gpt-5-mini-minimal | cowsay | fpzyzsi4412rc | $0.003 | 10m19s | Failure context timeout: context deadline exceeded |
| gpt-5-mini-minimal | curl | 5xm729eayko85 | $0.004 | 59s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| gpt-5-mini-minimal | curl | drc17c5616vr4 | $0.010 | 1m7s | Failure task failed: curl binary does not exist |
| gpt-5-mini-minimal | curl | yxo4dtf5738u7 | $0.011 | 58s | Failure task failed: curl binary does not exist |
| gpt-5-mini-minimal | curl-ssl | d3xcrvwv0joie | $0.007 | 1m24s | Success |
| gpt-5-mini-minimal | curl-ssl | qtvgxyactviw5 | $0.013 | 1m24s | Success |
| gpt-5-mini-minimal | curl-ssl | xe0l2z17w7e9o | $0.005 | 11m9s | Success |
| gpt-5-mini-minimal | curl-ssl-arm64-static | h1mzv58a7cun3 | $0.009 | 1m20s | Failure task failed: curl binary does not exist |
| gpt-5-mini-minimal | curl-ssl-arm64-static | hg2qyij9lumid | $0.014 | 1m15s | Failure task failed: curl binary does not exist |
| gpt-5-mini-minimal | curl-ssl-arm64-static | n7ucyb5c23f8f | $0.015 | 1m59s | Failure task failed: curl-arm64 is not aarch64 architecture |
| gpt-5-mini-minimal | curl-ssl-arm64-static2 | 4xn3ha3h42whs | $0.012 | 1m30s | Failure task failed: curl binary does not exist |
| gpt-5-mini-minimal | curl-ssl-arm64-static2 | 7tmn4bgpvxo5u | $0.020 | 3m37s | Failure task failed: curl binary does not exist |
| gpt-5-mini-minimal | curl-ssl-arm64-static2 | 8hzjgjkn6nunc | $0.008 | 1m0s | Failure task failed: curl binary does not exist |
| gpt-5-mini-minimal | jq | 26v39d6u13isn | $0.002 | 22s | Success |
| gpt-5-mini-minimal | jq | fackcax423deu | $0.004 | 23s | Success |
| gpt-5-mini-minimal | jq | g6w5myagubmml | $0.002 | 24s | Success |
| gpt-5-mini-minimal | jq-static | 2h1c1sy9f9jre | $0.005 | 1m11s | Failure task failed: jq is not statically linked |
| gpt-5-mini-minimal | jq-static | b2vc62dfk2qvf | $0.004 | 46s | Failure task failed: jq binary does not exist |
| gpt-5-mini-minimal | jq-static | chjdmgh5r7op2 | $0.005 | 1m0s | Failure task failed: jq is not statically linked |
| gpt-5-mini-minimal | jq-static-musl | 0g92qpw1sk5vv | $0.005 | 1m6s | Failure task failed: jq is not statically linked |
| gpt-5-mini-minimal | jq-static-musl | 3mb0pufknb7sj | $0.006 | 49s | Failure task failed: jq is not statically linked |
| gpt-5-mini-minimal | jq-static-musl | nyjjqhocueej7 | $0.008 | 1m11s | Failure task failed: jq is not statically linked |
| gpt-5-mini-minimal | jq-windows | kpkn5xcvmfvi7 | $0.003 | 47s | Failure task failed: jq help does not contain expected string |
| gpt-5-mini-minimal | jq-windows | t8t8p0rm0ql8a | $0.004 | 49s | Failure task failed: jq help does not contain expected string |
| gpt-5-mini-minimal | jq-windows | ygrlg46vj3qyo | $0.007 | 54s | Failure task failed: jq help does not contain expected string |
| gpt-5-mini-minimal | jq-windows2 | 9mdmis9v2p3un | $0.005 | 1m2s | Failure task failed: jq help does not contain expected string |
| gpt-5-mini-minimal | jq-windows2 | esxol272taxki | $0.012 | 2m18s | Failure task failed: jq help does not contain expected string |
| gpt-5-mini-minimal | jq-windows2 | mpfnoe17z75um | $0.008 | 1m3s | Failure task failed: jq help does not contain expected string |
| gpt-5-minimal | coreutils | 2340iu0u91fy4 | $0.041 | 1m37s | Failure task failed: cat missing at /home/peter/result/cat or not executable |
| gpt-5-minimal | coreutils | 2ugptzs6vmzu6 | $0.042 | 2m24s | Success |
| gpt-5-minimal | coreutils | zfx0vqwf0t10l | $0.014 | 1m8s | Success |
| gpt-5-minimal | coreutils-old-version | o2o7i6nrwj916 | $0.050 | 2m12s | Success |
| gpt-5-minimal | coreutils-old-version | sfasrxttuoiod | $0.085 | 2m30s | Success |
| gpt-5-minimal | coreutils-old-version | sqjv5c8wq9w2c | $0.085 | 2m34s | Success |
| gpt-5-minimal | coreutils-old-version-alpine | 3djpvqzmime4t | $0.192 | 3m30s | Failure task failed: sha1sum binary does not exist |
| gpt-5-minimal | coreutils-old-version-alpine | gy2h758v208x3 | $0.066 | 1m34s | Failure task failed: sha1sum binary does not exist |
| gpt-5-minimal | coreutils-old-version-alpine | x1o5f313ymcer | $0.211 | 3m6s | Failure task failed: df missing at /home/peter/result/df or not executable |
| gpt-5-minimal | coreutils-static | 0wf9zz975tfwg | $0.010 | 1m20s | Success |
| gpt-5-minimal | coreutils-static | 9fdga5w8t304a | $0.025 | 1m42s | Failure task failed: install missing at /home/peter/result/install or not executable |
| gpt-5-minimal | coreutils-static | dyjf0zqepyisi | $0.022 | 2m33s | Failure task failed: install missing at /home/peter/result/install or not executable |
| gpt-5-minimal | coreutils-static-alpine | 0pwxxt2o80rcy | $0.030 | 1m19s | Failure task failed: kill missing at /home/peter/result/kill or not executable |
| gpt-5-minimal | coreutils-static-alpine | 28d0p3p2ov9xj | $0.025 | 1m50s | Failure task failed: install missing at /home/peter/result/install or not executable |
| gpt-5-minimal | coreutils-static-alpine | q1kpb9n4d085m | $0.025 | 1m20s | Success |
| gpt-5-minimal | cowsay | 351q0x3pvxbvr | $0.011 | 15s | Success |
| gpt-5-minimal | cowsay | fyn7ooaajq14f | $0.011 | 15s | Success |
| gpt-5-minimal | cowsay | uicq8onf3sm5u | $0.023 | 35s | Failure task failed: Cowsay help does not contain expected string |
| gpt-5-minimal | curl | b5bj7y1ehlylx | $0.009 | 30s | Success |
| gpt-5-minimal | curl | s0qj05bfccji4 | $0.010 | 40s | Success |
| gpt-5-minimal | curl | wmzrhk9cefavg | $0.018 | 47s | Success |
| gpt-5-minimal | curl-ssl | ksevvrvl1esbq | $0.035 | 1m15s | Success |
| gpt-5-minimal | curl-ssl | wm3uscqd9ieeu | $0.014 | 1m3s | Success |
| gpt-5-minimal | curl-ssl | ynt8pcvycy2br | $0.018 | 1m20s | Success |
| gpt-5-minimal | curl-ssl-arm64-static | 51t7e5ewp8mis | $0.146 | 4m52s | Failure task failed: curl-arm64 is not statically linked |
| gpt-5-minimal | curl-ssl-arm64-static | e9jl27cdbh4il | $0.110 | 3m51s | Failure task failed: curl-arm64 is not statically linked |
| gpt-5-minimal | curl-ssl-arm64-static | w43wmw0e9c1z2 | $0.078 | 2m59s | Failure task failed: curl-arm64 binary does not exist |
| gpt-5-minimal | curl-ssl-arm64-static2 | bk3ie9u6k63e7 | $0.129 | 5m3s | Failure task failed: curl-arm64 is not statically linked |
| gpt-5-minimal | curl-ssl-arm64-static2 | jgwom85utb9ta | $0.087 | 2m52s | Failure task failed: curl-arm64 is not statically linked |
| gpt-5-minimal | curl-ssl-arm64-static2 | pcf1nmec989qv | $0.100 | 3m17s | Failure task failed: curl-arm64 is not aarch64 architecture |
| gpt-5-minimal | jq | gtzqzmmw2k1i9 | $0.016 | 33s | Success |
| gpt-5-minimal | jq | j0pc54flzix2u | $0.010 | 31s | Success |
| gpt-5-minimal | jq | q6v2sqchrus3x | $0.013 | 24s | Success |
| gpt-5-minimal | jq-static | ekpxagh4mkrpx | $0.029 | 1m7s | Success |
| gpt-5-minimal | jq-static | n3fptj1l197z4 | $0.096 | 2m24s | Failure task failed: jq is not statically linked |
| gpt-5-minimal | jq-static | r6mzoz6jd0dcb | $0.014 | 36s | Success |
| gpt-5-minimal | jq-static-musl | 6ail416l8118v | $0.058 | 1m46s | Success |
| gpt-5-minimal | jq-static-musl | 9sqq9xz4m17eh | $0.085 | 2m39s | Failure task failed: jq is not statically linked |
| gpt-5-minimal | jq-static-musl | qicsv094u1y58 | $0.040 | 1m26s | Success |
| gpt-5-minimal | jq-windows | 0xgj1oh2bi9aj | $0.031 | 59s | Success |
| gpt-5-minimal | jq-windows | iyek3wml8lvmo | $0.053 | 1m45s | Success |
| gpt-5-minimal | jq-windows | lvw52wwt1vo0j | $0.052 | 1m12s | Success |
| gpt-5-minimal | jq-windows2 | 00d9c596c8819 | $0.071 | 2m21s | Failure task failed: jq help does not contain expected string |
| gpt-5-minimal | jq-windows2 | 7sodtoqizckoq | $0.073 | 2m1s | Failure task failed: jq.exe is not an amd64 Windows executable |
| gpt-5-minimal | jq-windows2 | hkp1ulbssxdzo | $0.108 | 4m46s | Success |
| gpt-oss-120b-high | coreutils | g6sqx3qa2dd5a | $0.004 | 1m6s | Success |
| gpt-oss-120b-high | coreutils | j47ieqotalzlp | $0.006 | 1m0s | Success |
| gpt-oss-120b-high | coreutils | nfb82u432ez9c | $0.007 | 1m1s | Success |
| gpt-oss-120b-high | coreutils-old-version | 3g1a0t58qzydc | $0.007 | 1m36s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | coreutils-old-version | 8l6slgfyu8u6j | $0.000 | 2s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | coreutils-old-version | tax4k529iosv8 | $0.114 | 4m5s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | coreutils-old-version-alpine | 9pykuf8y8q5v5 | $0.050 | 1m53s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | coreutils-old-version-alpine | vowqrb6e2rr63 | $0.102 | 2m56s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | coreutils-old-version-alpine | x5jnvkimf2mcc | $0.041 | 1m10s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | coreutils-static | nj2lwrvw8o3ce | $0.004 | 1m11s | Success |
| gpt-oss-120b-high | coreutils-static | oyyb2gl4c8ot8 | $0.008 | 1m16s | Success |
| gpt-oss-120b-high | coreutils-static | rkeiuqn6aq5na | $0.005 | 1m11s | Success |
| gpt-oss-120b-high | coreutils-static-alpine | fuij3ndjw20n5 | $0.006 | 1m18s | Success |
| gpt-oss-120b-high | coreutils-static-alpine | fzaoi5zvmombl | $0.000 | 3s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | coreutils-static-alpine | zcvdwb7ywu2xx | $0.007 | 1m10s | Success |
| gpt-oss-120b-high | cowsay | q6113qut3eep0 | $0.000 | 1s | Failure task failed: Cowsay binary does not exist |
| gpt-oss-120b-high | cowsay | sxar3lb2frzjv | $0.002 | 8s | Success |
| gpt-oss-120b-high | cowsay | u640zwl6eozcm | $0.003 | 15s | Success |
| gpt-oss-120b-high | curl | 1x4wr3w05gfq3 | $0.008 | 55s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| gpt-oss-120b-high | curl | 70edkrxd6zgxu | $0.013 | 48s | Success |
| gpt-oss-120b-high | curl | wen54d55zmlxe | $0.000 | 20s | Failure task failed: curl binary does not exist |
| gpt-oss-120b-high | curl-ssl | 5omeuh6g15vxt | $0.012 | 1m3s | Success |
| gpt-oss-120b-high | curl-ssl | iv705nbbvoe6k | $0.000 | 2s | Failure task failed: curl binary does not exist |
| gpt-oss-120b-high | curl-ssl | shzksge2h1k0w | $0.015 | 1m8s | Success |
| gpt-oss-120b-high | curl-ssl-arm64-static | 2rb5lpujejbu1 | $0.222 | 5m44s | Failure task failed: curl-arm64 is not statically linked |
| gpt-oss-120b-high | curl-ssl-arm64-static | 3vje4e032383w | $0.121 | 4m24s | Failure task failed: curl-arm64 is not statically linked |
| gpt-oss-120b-high | curl-ssl-arm64-static | qmpwe8g391ti5 | $0.148 | 5m56s | Failure task failed: curl-arm64 is not statically linked |
| gpt-oss-120b-high | curl-ssl-arm64-static2 | i120kwp1s3rn3 | $0.176 | 5m22s | Failure task failed: curl binary does not exist |
| gpt-oss-120b-high | curl-ssl-arm64-static2 | phn453rj2l3j5 | $0.100 | 4m21s | Failure task failed: curl-arm64 is not statically linked |
| gpt-oss-120b-high | curl-ssl-arm64-static2 | vr19hdn7lsqrx | $0.394 | 12m34s | Failure task failed: curl binary does not exist |
| gpt-oss-120b-high | jq | fyfz6c4uffoei | $0.004 | 23s | Success |
| gpt-oss-120b-high | jq | gjt0kodeq85ph | $0.001 | 16s | Success |
| gpt-oss-120b-high | jq | rc5fl2hdq8gxw | $0.005 | 22s | Success |
| gpt-oss-120b-high | jq-static | 7fnt3288wo4nd | $0.008 | 38s | Success |
| gpt-oss-120b-high | jq-static | eq8tawobnkho5 | $0.095 | 3m3s | Failure task failed: jq is not statically linked |
| gpt-oss-120b-high | jq-static | zya54fos30c5v | $0.087 | 3m35s | Failure task failed: jq binary does not exist |
| gpt-oss-120b-high | jq-static-musl | 8ctzmd5y7gntr | $0.160 | 4m43s | Success |
| gpt-oss-120b-high | jq-static-musl | pkxutxbq6iatn | $0.247 | 5m49s | Success |
| gpt-oss-120b-high | jq-static-musl | ripagfb04ifcf | $0.000 | 4s | Failure task failed: jq binary does not exist |
| gpt-oss-120b-high | jq-windows | 6ok022s5c4eo4 | $0.007 | 39s | Failure task failed: jq help does not contain expected string |
| gpt-oss-120b-high | jq-windows | fgbdqj729zi4o | $0.011 | 36s | Failure task failed: jq help does not contain expected string |
| gpt-oss-120b-high | jq-windows | tniw46aj4o6so | $0.012 | 58s | Failure task failed: jq help does not contain expected string |
| gpt-oss-120b-high | jq-windows2 | 8rc6gumr2ht0h | $0.045 | 2m32s | Failure task failed: jq help does not contain expected string |
| gpt-oss-120b-high | jq-windows2 | qxe40hr04zrac | $0.035 | 22m1s | Failure context timeout: context deadline exceeded |
| gpt-oss-120b-high | jq-windows2 | wupyy9lfeljzo | $0.008 | 56s | Failure task failed: jq.exe binary does not exist |
| grok-4 | coreutils | 4l6wc81hrglzu | $0.094 | 3m12s | Success |
| grok-4 | coreutils | bt7d1qa49srbk | $0.098 | 2m55s | Success |
| grok-4 | coreutils | ktl5tvskto1tt | $0.077 | 2m58s | Success |
| grok-4 | coreutils-old-version | 5p3vlguat3wv5 | $0.203 | 4m46s | Success |
| grok-4 | coreutils-old-version | f42wz7er54s06 | $0.243 | 7m26s | Success |
| grok-4 | coreutils-old-version | ywe12bzjsdojn | $0.298 | 5m47s | Success |
| grok-4 | coreutils-old-version-alpine | 0v7qjmu94o0w5 | $1.836 | 23m28s | Failure task failed: df missing at /home/peter/result/df or not executable |
| grok-4 | coreutils-old-version-alpine | ffj48x6sy4918 | $7.081 | 24m4s | Failure task failed: sha1sum binary does not exist |
| grok-4 | coreutils-old-version-alpine | ob89w3v71ur3b | $3.753 | 17m24s | Failure task failed: df missing at /home/peter/result/df or not executable |
| grok-4 | coreutils-static | nuou4bmvfyftj | $0.194 | 5m46s | Success |
| grok-4 | coreutils-static | regzv7mzp9727 | $0.165 | 3m39s | Success |
| grok-4 | coreutils-static | z7ayimz2fks6a | $0.327 | 6m54s | Success |
| grok-4 | coreutils-static-alpine | d73avs395xe5y | $0.247 | 6m16s | Success |
| grok-4 | coreutils-static-alpine | s7aguiggk23s5 | $0.752 | 9m2s | Success |
| grok-4 | coreutils-static-alpine | yzdb8yjou3nn8 | $0.254 | 5m54s | Failure context timeout: context deadline exceeded |
| grok-4 | cowsay | djw9wg2h6exct | $0.281 | 4m40s | Success |
| grok-4 | cowsay | go3byi2cajhq9 | $0.075 | 1m21s | Success |
| grok-4 | cowsay | wqoodmrn3qfu8 | $0.112 | 1m26s | Success |
| grok-4 | curl | 96qnzr1qyss7v | $0.120 | 1m51s | Success |
| grok-4 | curl | hhxw07fc7lxkl | $0.073 | 2m54s | Success |
| grok-4 | curl | i6s755av5byv0 | $0.162 | 3m31s | Success |
| grok-4 | curl-ssl | 5cag5qqdwln1h | $0.133 | 2m0s | Success |
| grok-4 | curl-ssl | 5x88xjnryhhs2 | $0.177 | 3m5s | Success |
| grok-4 | curl-ssl | d44ff6zw05z04 | $0.160 | 3m9s | Success |
| grok-4 | curl-ssl-arm64-static | 23avhe5la4cpz | $1.725 | 19m50s | Failure task failed: curl-arm64 is not statically linked |
| grok-4 | curl-ssl-arm64-static | am3bi8pw34usd | $1.304 | 12m51s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| grok-4 | curl-ssl-arm64-static | tqqqhissqfqyi | $1.129 | 17m25s | Failure task failed: curl-arm64 is not statically linked |
| grok-4 | curl-ssl-arm64-static2 | pzj91ruap1va2 | $0.424 | 6m26s | Failure task failed: curl-arm64 is not statically linked |
| grok-4 | curl-ssl-arm64-static2 | qcleqkmmkoxqq | $0.566 | 5m26s | Failure task failed: curl binary does not exist |
| grok-4 | curl-ssl-arm64-static2 | whc01txfz0nhf | $1.041 | 10m25s | Success |
| grok-4 | jq | 1fbpcmjw7hshm | $0.120 | 1m49s | Success |
| grok-4 | jq | 2et9jg34j40ag | $0.092 | 1m36s | Success |
| grok-4 | jq | wufdaiz3qjkbo | $0.110 | 2m3s | Success |
| grok-4 | jq-static | rhxdxbjo1uunc | $0.212 | 2m19s | Success |
| grok-4 | jq-static | t34l88gctqmu4 | $0.713 | 11m11s | Success |
| grok-4 | jq-static | wnadxk7l3zi7j | $0.374 | 4m24s | Success |
| grok-4 | jq-static-musl | izbh668vbws1p | $0.268 | 3m44s | Failure task failed: jq binary does not exist |
| grok-4 | jq-static-musl | k0as8rwlez788 | $0.147 | 2m28s | Success |
| grok-4 | jq-static-musl | n6160x2rlj02d | $0.116 | 2m8s | Failure task failed: jq binary does not exist |
| grok-4 | jq-windows | 7xywc270dfxvt | $0.155 | 3m11s | Success |
| grok-4 | jq-windows | jhiphmji70f2h | $0.105 | 1m57s | Failure task failed: jq help does not contain expected string |
| grok-4 | jq-windows | wakd5ievn14m3 | $0.164 | 2m57s | Success |
| grok-4 | jq-windows2 | bedwzggytaupw | $0.313 | 5m50s | Success |
| grok-4 | jq-windows2 | fdnj8zihhkeg2 | $2.146 | 15m25s | Failure task failed: jq help does not contain expected string |
| grok-4 | jq-windows2 | r50ycqek99hix | $0.108 | 2m41s | Success |
| grok-4-fast | coreutils | figh60llewnbw | $0.002 | 1m55s | Failure task failed: sha1sum binary does not exist |
| grok-4-fast | coreutils | n98fpmzucrnzi | $0.003 | 1m22s | Success |
| grok-4-fast | coreutils | xvu775toqwjk1 | $0.004 | 1m47s | Success |
| grok-4-fast | coreutils-old-version | p2sx3gryx4g45 | $0.021 | 7m7s | Failure task failed: sha1sum binary does not exist |
| grok-4-fast | coreutils-old-version | q2bq72myqpt3d | $0.138 | 14m59s | Success |
| grok-4-fast | coreutils-old-version | v8x0g3tsjjxs8 | $0.040 | 7m15s | Success |
| grok-4-fast | coreutils-old-version-alpine | 42h1kwxv4ki70 | $0.178 | 7m34s | Failure task failed: sha1sum binary does not exist |
| grok-4-fast | coreutils-old-version-alpine | bgucgcarjkd5x | $0.339 | 12m27s | Failure task failed: install missing at /home/peter/result/install or not executable |
| grok-4-fast | coreutils-old-version-alpine | voxhzz08py9n4 | $0.201 | 8m31s | Failure task failed: sha1sum binary does not exist |
| grok-4-fast | coreutils-static | 9sop0p5sfu13x | $0.002 | 2m9s | Success |
| grok-4-fast | coreutils-static | j8h141f0u33a4 | $0.005 | 1m58s | Success |
| grok-4-fast | coreutils-static | lierqs2hskl62 | $0.004 | 2m0s | Failure task failed: sha1sum binary does not exist |
| grok-4-fast | coreutils-static-alpine | q7lrj6gon8oz3 | $0.003 | 1m45s | Success |
| grok-4-fast | coreutils-static-alpine | tvib0otijpp5z | $0.004 | 1m30s | Success |
| grok-4-fast | coreutils-static-alpine | ty6wpc1id21sa | $0.004 | 1m50s | Success |
| grok-4-fast | cowsay | 5y1szq107gcl7 | $0.002 | 27s | Success |
| grok-4-fast | cowsay | fav70mht93d78 | $0.002 | 28s | Success |
| grok-4-fast | cowsay | si9j9koy5rxhd | $0.002 | 30s | Success |
| grok-4-fast | curl | cs0mhhqdeag8y | $0.002 | 1m30s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| grok-4-fast | curl | mjrzsu8rx73gb | $0.004 | 2m21s | Failure task failed: curl binary does not exist |
| grok-4-fast | curl | tbwh2roaybvlb | $0.004 | 1m10s | Success |
| grok-4-fast | curl-ssl | 0mcciwiy933jw | $0.007 | 1m28s | Success |
| grok-4-fast | curl-ssl | 33696m90xke2n | $0.008 | 2m13s | Success |
| grok-4-fast | curl-ssl | bc4n9a7czyhb7 | $0.008 | 1m33s | Success |
| grok-4-fast | curl-ssl-arm64-static | cj00e1w5tckf7 | $0.057 | 7m19s | Failure task failed: curl binary does not exist |
| grok-4-fast | curl-ssl-arm64-static | dbs65siai2f2i | $0.131 | 12m11s | Failure task failed: curl binary does not exist |
| grok-4-fast | curl-ssl-arm64-static | vdl3f4ln5r0q1 | $0.065 | 10m12s | Failure task failed: curl-arm64 is not statically linked |
| grok-4-fast | curl-ssl-arm64-static2 | goslna8yzillz | $0.122 | 12m5s | Failure task failed: curl-arm64 is not statically linked |
| grok-4-fast | curl-ssl-arm64-static2 | nlx8zgczwake7 | $0.154 | 12m23s | Failure task failed: curl-arm64 is not statically linked |
| grok-4-fast | curl-ssl-arm64-static2 | v9363tp2bec6k | $0.135 | 15m25s | Failure task failed: curl-arm64 is not statically linked |
| grok-4-fast | jq | 48g4lp74wqo84 | $0.004 | 58s | Success |
| grok-4-fast | jq | lbofu9z26p8q3 | $0.005 | 1m2s | Success |
| grok-4-fast | jq | u059oqv5bunny | $0.004 | 1m0s | Success |
| grok-4-fast | jq-static | 29rvxii0lyyg5 | $0.004 | 40s | Success |
| grok-4-fast | jq-static | 3494yej9ru8v2 | $0.004 | 1m14s | Success |
| grok-4-fast | jq-static | hxxla811phd3i | $0.035 | 3m57s | Success |
| grok-4-fast | jq-static-musl | 5bi2x605mn1kl | $0.032 | 5m7s | Failure task failed: jq binary does not exist |
| grok-4-fast | jq-static-musl | bkje7o771qwuq | $0.029 | 4m11s | Success |
| grok-4-fast | jq-static-musl | hcspgyvvzjkmk | $0.043 | 8m5s | Failure task failed: jq binary does not exist |
| grok-4-fast | jq-windows | 1ev321diq1rcq | $0.013 | 2m57s | Failure task failed: jq help does not contain expected string |
| grok-4-fast | jq-windows | 4f7y80tefm3m8 | $0.030 | 3m31s | Failure task failed: jq help does not contain expected string |
| grok-4-fast | jq-windows | 8lh06x05kbj4n | $0.070 | 7m0s | Failure task failed: jq help does not contain expected string |
| grok-4-fast | jq-windows2 | l0fy1is9tjoh1 | $0.073 | 5m32s | Success |
| grok-4-fast | jq-windows2 | ol85id0dnba7l | $0.047 | 6m46s | Success |
| grok-4-fast | jq-windows2 | wfspktls83u2b | $0.038 | 4m55s | Failure task failed: jq help does not contain expected string |
| grok-code-fast-1 | coreutils | 0us03vpgc9in7 | $0.004 | 1m34s | Success |
| grok-code-fast-1 | coreutils | 6lh05jz58mbf5 | $0.004 | 1m36s | Success |
| grok-code-fast-1 | coreutils | h5nur77w8jk47 | $0.004 | 1m43s | Success |
| grok-code-fast-1 | coreutils-old-version | chfj8fel013c8 | $0.041 | 16m2s | Success |
| grok-code-fast-1 | coreutils-old-version | h5x58jegtaw87 | $0.013 | 2m26s | Failure task failed: install missing at /home/peter/result/install or not executable |
| grok-code-fast-1 | coreutils-old-version | kq37r4dvh4r42 | $0.022 | 4m18s | Success |
| grok-code-fast-1 | coreutils-old-version-alpine | 9bqaabitdxvk6 | $0.008 | 1m4s | Failure task failed: sha1sum binary does not exist |
| grok-code-fast-1 | coreutils-old-version-alpine | ntv1i1pe675zq | $0.021 | 1m14s | Failure task failed: sha1sum binary does not exist |
| grok-code-fast-1 | coreutils-old-version-alpine | yr85a0fcqw0zd | $0.051 | 3m29s | Failure task failed: sha1sum binary does not exist |
| grok-code-fast-1 | coreutils-static | a23uog5dc0en8 | $0.005 | 1m38s | Success |
| grok-code-fast-1 | coreutils-static | g8z14y4lw1jn6 | $0.009 | 2m12s | Success |
| grok-code-fast-1 | coreutils-static | q4kta7ysm6iy1 | $0.006 | 1m33s | Success |
| grok-code-fast-1 | coreutils-static-alpine | cwfpgy4vdsa4s | $0.017 | 4m50s | Success |
| grok-code-fast-1 | coreutils-static-alpine | efk11pxkgc6v1 | $0.013 | 4m25s | Success |
| grok-code-fast-1 | coreutils-static-alpine | incylckzw6jd3 | $0.005 | 1m6s | Success |
| grok-code-fast-1 | cowsay | 410pjek3kwdj9 | $0.004 | 22s | Success |
| grok-code-fast-1 | cowsay | a1lci0c1z23x9 | $0.006 | 41s | Success |
| grok-code-fast-1 | cowsay | rciz7dso3pq9v | $0.003 | 18s | Success |
| grok-code-fast-1 | curl | 0plz63ws5i2r0 | $0.007 | 1m53s | Success |
| grok-code-fast-1 | curl | q6m0dvkupep5t | $0.004 | 1m47s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| grok-code-fast-1 | curl | zliwyxsva0197 | $0.006 | 1m39s | Success |
| grok-code-fast-1 | curl-ssl | 3h1oejwhx2pcz | $0.006 | 1m0s | Success |
| grok-code-fast-1 | curl-ssl | m2gqtujq7yyj5 | $0.008 | 2m10s | Success |
| grok-code-fast-1 | curl-ssl | zcx3kuvb48xn1 | $0.005 | 1m2s | Success |
| grok-code-fast-1 | curl-ssl-arm64-static | 3mfnobblxoa2u | $0.027 | 5m38s | Failure task failed: curl-arm64 is not statically linked |
| grok-code-fast-1 | curl-ssl-arm64-static | dp8zxzq1bn1se | $0.017 | 5m24s | Failure task failed: curl-arm64 is not statically linked |
| grok-code-fast-1 | curl-ssl-arm64-static | y43c0llo401p0 | $0.037 | 9m37s | Failure task failed: curl-arm64 is not statically linked |
| grok-code-fast-1 | curl-ssl-arm64-static2 | c407pip6g163y | $0.046 | 4m5s | Failure task failed: curl binary does not exist |
| grok-code-fast-1 | curl-ssl-arm64-static2 | tszkapunxdpc1 | $0.037 | 13m17s | Failure task failed: curl-arm64 is not statically linked |
| grok-code-fast-1 | curl-ssl-arm64-static2 | wl5b2ghozu4pt | $0.085 | 14m30s | Failure task failed: curl binary does not exist |
| grok-code-fast-1 | jq | bkqs3u14pl910 | $0.003 | 41s | Success |
| grok-code-fast-1 | jq | fgaujw38m8noi | $0.004 | 43s | Success |
| grok-code-fast-1 | jq | mqy53pxtx868v | $0.004 | 47s | Success |
| grok-code-fast-1 | jq-static | 095n46lsbqt4b | $0.017 | 2m12s | Success |
| grok-code-fast-1 | jq-static | 869ywsry7qsry | $0.006 | 1m1s | Success |
| grok-code-fast-1 | jq-static | l5laphdpo2ldg | $0.013 | 1m51s | Success |
| grok-code-fast-1 | jq-static-musl | 1tgr8gg7ri7zn | $0.026 | 1m56s | Success |
| grok-code-fast-1 | jq-static-musl | l5mlut0lt37y7 | $0.023 | 2m27s | Failure task failed: jq is not statically linked |
| grok-code-fast-1 | jq-static-musl | ljrrjxf36j07k | $0.011 | 2m25s | Success |
| grok-code-fast-1 | jq-windows | 8l0l6iejvfuun | $0.008 | 1m12s | Failure task failed: jq help does not contain expected string |
| grok-code-fast-1 | jq-windows | k2mhp31bg0hj0 | $0.019 | 1m23s | Failure task failed: jq help does not contain expected string |
| grok-code-fast-1 | jq-windows | mhv520mpw4k7e | $0.013 | 2m0s | Failure task failed: jq help does not contain expected string |
| grok-code-fast-1 | jq-windows2 | 0nhakz9z05wsz | $0.024 | 3m18s | Failure task failed: jq help does not contain expected string |
| grok-code-fast-1 | jq-windows2 | ohsb510x2a9j8 | $0.016 | 22m43s | Success |
| grok-code-fast-1 | jq-windows2 | owx78q1z96qmw | $0.005 | 51s | Success |
 kimi-k2-0905 | coreutils | gargqot0mggui | $0.336 | 2m23s | Success |
| kimi-k2-0905 | coreutils | kexsuc8y1btty | $0.124 | 1m19s | Success |
| kimi-k2-0905 | coreutils | ldv01taynuu62 | $0.110 | 1m52s | Failure task failed: sha1sum binary does not exist |
| kimi-k2-0905 | coreutils-old-version | s0ua7nnulbi9r | $1.358 | 4m25s | Success |
| kimi-k2-0905 | coreutils-old-version | t9k6qymlrf1tz | $0.757 | 4m47s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| kimi-k2-0905 | coreutils-old-version | u1bt6at9900sh | $0.334 | 3m19s | Success |
| kimi-k2-0905 | coreutils-old-version-alpine | 3aumgfpqz1ake | $2.071 | 4m9s | Failure task failed: sha1sum binary does not exist |
| kimi-k2-0905 | coreutils-old-version-alpine | 3veg94fzgpt4f | $3.198 | 4m43s | Failure task failed: No success reported by script: all-utils-exists.sh |
| kimi-k2-0905 | coreutils-old-version-alpine | 5ymhny37lt8aj | $2.255 | 4m19s | Failure task failed: sha1sum binary does not exist |
| kimi-k2-0905 | coreutils-static | 6te6m7re2wqh9 | $0.052 | 1m19s | Failure task failed: sha1sum binary does not exist |
| kimi-k2-0905 | coreutils-static | rt01hrj1uetb0 | $0.001 | 2s | Failure task failed: sha1sum binary does not exist |
| kimi-k2-0905 | coreutils-static | w1wl60vs0iubq | $0.186 | 1m59s | Success |
| kimi-k2-0905 | coreutils-static-alpine | 1j47xy70171ku | $0.257 | 2m11s | Success |
| kimi-k2-0905 | coreutils-static-alpine | ad99wlmdq6o52 | $0.134 | 1m35s | Success |
| kimi-k2-0905 | coreutils-static-alpine | g3ais23ic9lc3 | $0.368 | 2m51s | Success |
| kimi-k2-0905 | cowsay | 0rz3rz302eenu | $0.056 | 10m44s | Success |
| kimi-k2-0905 | cowsay | 3h3h3druudizt | $0.041 | 25s | Success |
| kimi-k2-0905 | cowsay | 8l8v39ygn9b57 | $0.114 | 37s | Success |
| kimi-k2-0905 | curl | 4vyy5x2zkq95p | $0.085 | 44s | Success |
| kimi-k2-0905 | curl | a95z2kutwa5v5 | $0.168 | 1m29s | Success |
| kimi-k2-0905 | curl | odufbvquul9dq | $0.174 | 1m1s | Success |
| kimi-k2-0905 | curl-ssl | 19w8xvs7mqfbu | $0.249 | 1m22s | Success |
| kimi-k2-0905 | curl-ssl | fuyac5wcfpid0 | $0.141 | 1m14s | Success |
| kimi-k2-0905 | curl-ssl | j900x41p5e98l | $0.231 | 1m22s | Success |
| kimi-k2-0905 | curl-ssl-arm64-static | ak37zbx7q3ru6 | $0.008 | 15s | Failure task failed: curl binary does not exist |
| kimi-k2-0905 | curl-ssl-arm64-static | mkdhsdizk8gy5 | $0.001 | 1s | Failure task failed: curl binary does not exist |
| kimi-k2-0905 | curl-ssl-arm64-static | nz7wv6lwd982j | $0.622 | 2m52s | Failure task failed: curl-arm64 is not aarch64 architecture |
| kimi-k2-0905 | curl-ssl-arm64-static2 | 5hmymo0y0vbcc | $6.522 | 12m13s | Failure task failed: curl-arm64 is not statically linked |
| kimi-k2-0905 | curl-ssl-arm64-static2 | 5ifjgcd2svzqv | $0.000 | 8s | Failure task failed: curl binary does not exist |
| kimi-k2-0905 | curl-ssl-arm64-static2 | qvu3rj8xq9dyr | $1.585 | 11m43s | Failure task failed: curl-arm64 is not statically linked |
| kimi-k2-0905 | jq | 6l0e8jum54ze0 | $0.005 | 12s | Failure task failed: jq binary does not exist |
| kimi-k2-0905 | jq | 9en79xikpk4ne | $0.112 | 57s | Success |
| kimi-k2-0905 | jq | nas9g5yxv5i0n | $0.165 | 1m0s | Success |
| kimi-k2-0905 | jq-static | 53o3d675n2icc | $0.104 | 42s | Success |
| kimi-k2-0905 | jq-static | ef39qhglvyy9r | $0.613 | 1m41s | Success |
| kimi-k2-0905 | jq-static | p7941euxqosib | $0.123 | 43s | Success |
| kimi-k2-0905 | jq-static-musl | 8f7yibeyb7gj5 | $0.221 | 1m31s | Failure task failed: jq is not statically linked |
| kimi-k2-0905 | jq-static-musl | nwaob4c8ebjft | $0.979 | 2m46s | Failure task failed: jq is not statically linked |
| kimi-k2-0905 | jq-static-musl | xjuvqq1wnbiid | $0.158 | 1m7s | Success |
| kimi-k2-0905 | jq-windows | 150v5u32xja29 | $0.181 | 1m28s | Failure task failed: jq help does not contain expected string |
| kimi-k2-0905 | jq-windows | y0if40lgozu4r | $0.200 | 1m12s | Success |
| kimi-k2-0905 | jq-windows | zwr8ct9r1ina2 | $0.178 | 3m58s | Success |
| kimi-k2-0905 | jq-windows2 | s77roz2lav43n | $0.579 | 2m55s | Failure task failed: jq help does not contain expected string |
| kimi-k2-0905 | jq-windows2 | uppof1prqd2dw | $0.823 | 3m7s | Success |
| kimi-k2-0905 | jq-windows2 | wozk03ug7yssz | $0.445 | 2m44s | Failure task failed: jq help does not contain expected string |
| qwen3-max | coreutils | bzy6w8v80p21w | $0.021 | 1m0s | Success |
| qwen3-max | coreutils | j6w5331r9yzlb | $0.022 | 1m3s | Success |
| qwen3-max | coreutils | tvww9mo78fnw3 | $0.028 | 1m3s | Success |
| qwen3-max | coreutils-old-version | mxv11g9o5jx2j | $3.012 | 6m37s | Failure exceeded max cost dollars (max=$3.00, current=3.01) |
| qwen3-max | coreutils-old-version | qv7n0li11olhe | $0.059 | 1m49s | Success |
| qwen3-max | coreutils-old-version | zrk9vom0swqf2 | $0.780 | 4m41s | Success |
| qwen3-max | coreutils-old-version-alpine | 01l5qvl2yzo0e | $3.256 | 5m15s | Failure task failed: df missing at /home/peter/result/df or not executable |
| qwen3-max | coreutils-old-version-alpine | 3302vghtf15lc | $10.254 | 6m42s | Failure exceeded max cost dollars (max=$10.00, current=10.25) |
| qwen3-max | coreutils-old-version-alpine | lbgmhbvyp77mc | $10.354 | 7m36s | Failure exceeded max cost dollars (max=$10.00, current=10.35) |
| qwen3-max | coreutils-static | 9ms8tpezozxkk | $0.028 | 1m2s | Failure task failed: sha1sum is not statically linked |
| qwen3-max | coreutils-static | g0lh92zoh2jah | $0.008 | 1m8s | Success |
| qwen3-max | coreutils-static | kispd61g3r4yo | $0.009 | 1m1s | Failure task failed: sha1sum is not statically linked |
| qwen3-max | coreutils-static-alpine | d7cgr168yrcdq | $0.021 | 1m49s | Success |
| qwen3-max | coreutils-static-alpine | p1dflhxaf1v9e | $0.009 | 58s | Success |
| qwen3-max | coreutils-static-alpine | pse138dhuth27 | $0.021 | 59s | Success |
| qwen3-max | cowsay | 9sp1p5457r1nk | $0.027 | 20s | Success |
| qwen3-max | cowsay | ljjwc8rgd18z3 | $0.008 | 12s | Failure task failed: Cowsay does not contain expected string (eyes) |
| qwen3-max | cowsay | yb4qz5ir33zts | $0.011 | 12s | Success |
| qwen3-max | curl | i2qbyf40pfcj0 | $0.008 | 27s | Success |
| qwen3-max | curl | urvuyc2twiz3t | $0.008 | 29s | Success |
| qwen3-max | curl | xx1yp395zaha1 | $0.008 | 29s | Success |
| qwen3-max | curl-ssl | 9uq1neo5gm304 | $0.045 | 1m58s | Success |
| qwen3-max | curl-ssl | ph0ymeardfhaf | $0.044 | 50s | Success |
| qwen3-max | curl-ssl | x6gyx4wxffxss | $0.025 | 46s | Success |
| qwen3-max | curl-ssl-arm64-static | 3bcm9rc6kq8pm | $5.432 | 10m15s | Failure task failed: curl-arm64 is not statically linked |
| qwen3-max | curl-ssl-arm64-static | jhv4vwdkjgkxc | $0.446 | 2m0s | Failure task failed: curl-arm64 is not aarch64 architecture |
| qwen3-max | curl-ssl-arm64-static | lwuigs15i9pj0 | $2.270 | 5m54s | Failure task failed: curl-arm64 is not statically linked |
| qwen3-max | curl-ssl-arm64-static2 | 4cubhw9i20g2t | $6.347 | 10m13s | Failure task failed: curl-arm64 is not statically linked |
| qwen3-max | curl-ssl-arm64-static2 | h8i32qg45yhim | $10.318 | 11m1s | Failure exceeded max cost dollars (max=$10.00, current=10.32) |
| qwen3-max | curl-ssl-arm64-static2 | mya4f518xv9nh | $0.309 | 2m46s | Failure task failed: curl-arm64 is not statically linked |
| qwen3-max | jq | imvp0mb6m6ebc | $0.025 | 25s | Success |
| qwen3-max | jq | sooogihyznrcc | $0.025 | 39s | Success |
| qwen3-max | jq | x9zozgysnhqok | $0.025 | 24s | Success |
| qwen3-max | jq-static | 0t9ruaf41ql7c | $0.015 | 20s | Failure task failed: jq is not statically linked |
| qwen3-max | jq-static | sh9jvkz5vadx1 | $0.007 | 36s | Failure task failed: jq is not statically linked |
| qwen3-max | jq-static | x710rk87csh6a | $0.025 | 22s | Failure task failed: jq is not statically linked |
| qwen3-max | jq-static-musl | livn2jgg2syui | $0.181 | 1m29s | Success |
| qwen3-max | jq-static-musl | nikawok9pf8m2 | $0.775 | 5m56s | Success |
| qwen3-max | jq-static-musl | w1he8bwsonj1g | $0.375 | 3m23s | Success |
| qwen3-max | jq-windows | bvwauvargxapl | $0.024 | 44s | Failure task failed: jq help does not contain expected string |
| qwen3-max | jq-windows | g1f6oaf2f2n9w | $0.018 | 46s | Success |
| qwen3-max | jq-windows | j08r5we4vww3h | $0.026 | 42s | Failure task failed: jq help does not contain expected string |
| qwen3-max | jq-windows2 | e2zugiboqctc4 | $0.085 | 1m58s | Failure task failed: jq.exe binary does not exist |
| qwen3-max | jq-windows2 | jqt0kgbah6131 | $0.164 | 2m18s | Failure task failed: jq.exe binary does not exist |
| qwen3-max | jq-windows2 | r1sjeto6ztci8 | $0.124 | 2m2s | Failure task failed: jq.exe binary does not exist |