| Shell | Model | Backend | Hash | Format | Test | Status | Reason | Trajectory | Invoked | Match | Warmup (s) | Measured (s) | Details |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gptme | local/mistral-nemo:12b | ollama | unknown | tool | Patch File | NO_TOOL_CALL | clean | maybe | 0% | 77.582 | 37.645 | details | |
| gptme | local/mistral-nemo:12b | ollama | unknown | tool | Python File Simple | PASS | recovered | yes | 100% | 27.525 | 27.673 | details | |
| gptme | local/mistral-nemo:12b | ollama | unknown | tool | Shell Date | PASS | recovered | yes | 100% | 32.333 | 32.334 | details | |
| gptme | local/mistral-nemo:12b | ollama | unknown | tool | Shell PWD | PASS | recovered | yes | 100% | 35.337 | 34.738 | details |