agentic-workspace live run — 2026-08-26

Model: glm-4.7-flash-uncensored-heretic-neo-code-imatrix-max

Driver: in-process · Context length: 16384

Scenario	Result	Checks	Tool calls	Rounds	Invalid	Wall (s)	Tokens (prompt/predicted)
S1	❌	2/6	8	9	0	76.3	45613/11498
S3	❌	8/11	13	15	0	17.9	91418/2283
S5	❌	0/3	8	10	1	21.6	51835/3203
S9	❌	7/11	39	40	0	64.3	362920/8765

Failures

S1 — inspect → read → edit → verify
- bug fixed in src/math.js — module.exports = { add: (a, b) => a + b + 1 }; |
- node --test passes — 0) | at Test.runInAsyncScope (node:async_hooks:214:14) | at Test.run (node:internal/test_runner/test:1106:25) | at Test.start (node:internal/test_runner/test:1003:17) | at startSubtestAfterBootstrap (node:internal/test_runner/harness:358:17) { | generatedMessage: true, | code: 'ERR_ASSERTION', | actual: 5, | expected: 4, | operator: 'strictEqual', | diff: 'simple' | } |
- at least one applied transaction — 8 recorded calls
- ran node --test through workspace_command — 0 run envelopes
S3 — plan mode: propose, /accept, execute
- exactly one plan approved — no plan records
- bug fixed in src/math.js — module.exports = { add: (a, b) => a + b + 1 }; |
- node --test passes — 0) | at Test.runInAsyncScope (node:async_hooks:214:14) | at Test.run (node:internal/test_runner/test:1106:25) | at Test.start (node:internal/test_runner/test:1003:17) | at startSubtestAfterBootstrap (node:internal/test_runner/harness:358:17) { | generatedMessage: true, | code: 'ERR_ASSERTION', | actual: 5, | expected: 4, | operator: 'strictEqual', | diff: 'simple' | } |
S5 — foreground command, background job, cancel
- foreground run reported an exit code — 2 run envelopes
- background job started — no job id
- job was canceled — 0 cancel envelopes; final status ""
S9 — full project from an empty directory
- package.json parses with scripts.test running node --test — no package.json
- at least one file under src/ — src/ is empty or missing
- at least one test file under tests/ — tests/ has no .js file
- node --test exits 0 with at least three ok lines — exit 0, 0 ok lines | TAP version 13 | 1..0 | # tests 0 | # suites 0 | # pass 0 | # fail 0 | # cancelled 0 | # skipped 0 | # todo 0 | # duration_ms 5.7277 |

⚠️ = the run reached the context ceiling. Where the row still passes, the scored work had already completed and been written to disk before the model ran out of context; a longer task at the same context length would be cut off mid-work. Pair the plugin with a context compressor, or raise the context length.

Pass = every check ok. Checks assert filesystem, git and .agentic state, never model prose. Results are comparable only within one model.

agentic-workspace live run — 2026-08-26

Model: glm-4.7-flash-uncensored-heretic-neo-code-imatrix-max

Driver: in-process · Context length: 16384

Scenario

Result

Checks

Tool calls

Rounds

Invalid

Envelope

Wall (s)

Tokens (prompt/predicted)

❌

2/6

76.3

45613/11498

❌

8/11

17.9

91418/2283

❌

0/3

21.6

51835/3203

❌

7/11

64.3

362920/8765

Failures

S1 — inspect → read → edit → verify

bug fixed in src/math.js — module.exports = { add: (a, b) => a + b + 1 }; |
node --test passes — 0) | at Test.runInAsyncScope (node:async_hooks:214:14) | at Test.run (node:internal/test_runner/test:1106:25) | at Test.start (node:internal/test_runner/test:1003:17) | at startSubtestAfterBootstrap (node:internal/test_runner/harness:358:17) { | generatedMessage: true, | code: 'ERR_ASSERTION', | actual: 5, | expected: 4, | operator: 'strictEqual', | diff: 'simple' | } |
at least one applied transaction — 8 recorded calls
ran node --test through workspace_command — 0 run envelopes

S3 — plan mode: propose, /accept, execute

exactly one plan approved — no plan records
bug fixed in src/math.js — module.exports = { add: (a, b) => a + b + 1 }; |
node --test passes — 0) | at Test.runInAsyncScope (node:async_hooks:214:14) | at Test.run (node:internal/test_runner/test:1106:25) | at Test.start (node:internal/test_runner/test:1003:17) | at startSubtestAfterBootstrap (node:internal/test_runner/harness:358:17) { | generatedMessage: true, | code: 'ERR_ASSERTION', | actual: 5, | expected: 4, | operator: 'strictEqual', | diff: 'simple' | } |

S5 — foreground command, background job, cancel

foreground run reported an exit code — 2 run envelopes
background job started — no job id
job was canceled — 0 cancel envelopes; final status ""

S9 — full project from an empty directory

package.json parses with scripts.test running node --test — no package.json
at least one file under src/ — src/ is empty or missing
at least one test file under tests/ — tests/ has no .js file
node --test exits 0 with at least three ok lines — exit 0, 0 ok lines | TAP version 13 | 1..0 | # tests 0 | # suites 0 | # pass 0 | # fail 0 | # cancelled 0 | # skipped 0 | # todo 0 | # duration_ms 5.7277 |

Pass = every check ok. Checks assert filesystem, git and .agentic state, never model prose. Results are comparable only within one model.