| Shell | Model | Backend | Hash | Format | Test | Status | Reason | Trajectory | Invoked | Match | Warmup (s) | Measured (s) | Details |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gptme | local/orieg/gemma3-tools:12b-ft-v2 | ollama | unknown | tool | Patch File | TIMEOUT | clean | yes | 0% | 120.024 | 120.014 | details | |
| gptme | local/orieg/gemma3-tools:12b-ft-v2 | ollama | unknown | tool | Python File Simple | TIMEOUT artifact reached | clean | yes | 100% | 120.01 | 120.026 | details | |
| gptme | local/orieg/gemma3-tools:12b-ft-v2 | ollama | unknown | tool | Shell Date | TIMEOUT artifact reached | clean | yes | 100% | 120.559 | 120.801 | details | |
| gptme | local/orieg/gemma3-tools:12b-ft-v2 | ollama | unknown | tool | Shell PWD | NO_TOOL_CALL | clean | no | 0% | 106.896 | 73.518 | details |