agentic-workspace live run — 2026-08-26

Model: google/gemma-4-26b-a4b-qat

Driver: in-process · Context length: 16384

Scenario	Result	Checks	Tool calls	Rounds	Invalid	Wall (s)	Tokens (prompt/predicted)
S1	✅	6/6	12	13	0	11.3	80640/1414
S3	✅	11/11	10	12	0	13.6	79786/1789
S5	❌	2/3	9	10	0	9.9	52260/994
S9	❌	7/11	4	6	1	62.8	26096/11803

Failures

S5 — foreground command, background job, cancel
- job was canceled — 0 cancel envelopes; final status "running"
S9 — full project from an empty directory
- package.json parses with scripts.test running node --test — no package.json
- at least one file under src/ — src/ is empty or missing
- at least one test file under tests/ — tests/ has no .js file
- node --test exits 0 with at least three ok lines — exit 0, 0 ok lines | TAP version 13 | 1..0 | # tests 0 | # suites 0 | # pass 0 | # fail 0 | # cancelled 0 | # skipped 0 | # todo 0 | # duration_ms 5.3759 |

⚠️ = the run reached the context ceiling. Where the row still passes, the scored work had already completed and been written to disk before the model ran out of context; a longer task at the same context length would be cut off mid-work. Pair the plugin with a context compressor, or raise the context length.

Pass = every check ok. Checks assert filesystem, git and .agentic state, never model prose. Results are comparable only within one model.

agentic-workspace live run — 2026-08-26

Model: google/gemma-4-26b-a4b-qat

Driver: in-process · Context length: 16384

Scenario	Result	Checks	Tool calls	Rounds	Invalid	Wall (s)	Tokens (prompt/predicted)
S1	✅	6/6	12	13	0	11.3	80640/1414
S3	✅	11/11	10	12	0	13.6	79786/1789
S5	❌	2/3	9	10	0	9.9	52260/994
S9	❌	7/11	4	6	1	62.8	26096/11803

Failures

S5 — foreground command, background job, cancel
- job was canceled — 0 cancel envelopes; final status "running"
S9 — full project from an empty directory
- package.json parses with scripts.test running node --test — no package.json
- at least one file under src/ — src/ is empty or missing
- at least one test file under tests/ — tests/ has no .js file
- node --test exits 0 with at least three ok lines — exit 0, 0 ok lines | TAP version 13 | 1..0 | # tests 0 | # suites 0 | # pass 0 | # fail 0 | # cancelled 0 | # skipped 0 | # todo 0 | # duration_ms 5.3759 |

Pass = every check ok. Checks assert filesystem, git and .agentic state, never model prose. Results are comparable only within one model.