docs + dev.sh: loop in README/REPORT, ./dev.sh loop runner, scan-failure exit codes
README gains the self-host loop section (flow diagram, config reference
rows for [loop]/[redmine.status_map]/[keyproxy]/[gitea], CLI flags,
status table); REPORT.md records phase 3a including the die list for the
bash stack it replaces. dev.sh grows a `loop` runner (repo bind-mounted,
key env passthrough). `harness loop --once` now exits 2 when the intake
scan itself fails so cron setups alert loudly; daemon mode still logs
and retries.
💘 Generated with Crush
Assisted-by: Crush:glm-5.2
This commit is contained in:
@@ -3,14 +3,17 @@
|
||||
The MOPAC harness is a headless agent conductor written in Go: it pulls a task
|
||||
from Redmine (or a demo issue), routes it to the right model through LiteLLM,
|
||||
runs ONE bounded turn with an allow-listed bash tool, and writes the result as
|
||||
a REPORT file. There is no daemon and no TUI — callers chain turns by
|
||||
re-invoking `harness once`. It is the execution core for the org's vertical
|
||||
stacks: humans and other agents interact with a stack only through Redmine
|
||||
(SoR), Discourse (docs) and Gitea (code), never by attaching to the loop.
|
||||
a REPORT file — with `harness loop` it also drives ITSELF: Redmine is the SoR,
|
||||
the loop is the worker, no bash middle layer. There is no TUI — humans and
|
||||
other agents interact with a stack only through Redmine (SoR), Discourse
|
||||
(docs) and Gitea (code), never by attaching to the loop.
|
||||
|
||||
Status: 2026-08-28 — skeleton + event receiver; MVP demo path live (single
|
||||
GLM turn through LiteLLM to REPORT, proven live 2026-08-28); `harness
|
||||
events` webhook receiver smoke-proven on LAN port 4100 the same day.
|
||||
Status: 2026-08-28 — skeleton + event receiver + **self-host loop live**:
|
||||
`harness loop` polls the intake, runs one bounded turn per new/updated issue,
|
||||
notes the REPORT back on the issue and transitions status (fake-Redmine e2e
|
||||
test-asserted); MVP demo path live since earlier the same day (single GLM turn
|
||||
through LiteLLM to REPORT); `harness events` webhook receiver smoke-proven on
|
||||
LAN port 4100.
|
||||
|
||||
## Quickstart
|
||||
|
||||
@@ -103,6 +106,45 @@ exit code 1 (config error). The with-key path was proven live on 2026-08-28:
|
||||
the `[demo]` prompt "tell me about yourself" routed to `glm-5.3` via tier
|
||||
`mopac-primary` and the GLM self-description landed as the REPORT.
|
||||
|
||||
### Self-host loop (`harness loop`)
|
||||
|
||||
The loop makes the harness its own worker: Redmine is the SoR, the loop is
|
||||
the conductor. It polls the `/issues.json` intake every `[loop]
|
||||
poll_interval_secs` (default 120; `-interval` overrides, `--once` = single
|
||||
scan for cron-style setups) and, for every issue not yet processed at its
|
||||
current `updated_on`:
|
||||
|
||||
1. runs ONE bounded turn (the same conductor `once` uses; sequential, v0 —
|
||||
one turn at a time, no concurrency knob yet);
|
||||
2. writes the REPORT file as always;
|
||||
3. POSTs the REPORT body back onto the issue as a Redmine journal note
|
||||
(PUT `/issues/{id}.json`);
|
||||
4. transitions status per `[redmine.status_map]` (e.g. `"In Progress" =
|
||||
"Done"`; names resolved via `/issue_statuses.json`, cached);
|
||||
5. optionally commits the REPORT to Gitea (`[gitea] commit_reports`, off by
|
||||
default);
|
||||
6. refreshes its dedup marker to the issue's post-writeback `updated_on` so
|
||||
its own note never re-triggers it.
|
||||
|
||||
State is an append-only `state/loop/loop.jsonl` (`[loop] state_dir`): one JSON
|
||||
line per action (dispatch / report / note / status / commit / refresh /
|
||||
error), rebuilt into the dedup index at startup — restarts keep
|
||||
exactly-once-reaction semantics. A failed turn is recorded and NOT retried
|
||||
(update the issue to re-release it), so a down proxy cannot hot-loop the
|
||||
poll. Every action logs one line to stdout and one to the JSONL.
|
||||
|
||||
```sh
|
||||
./bin/harness loop # daemon: poll, dispatch, write back; SIGINT stops
|
||||
./bin/harness loop --dry-run # scan + print what would dispatch; no turns, no state
|
||||
./bin/harness loop --once # single scan (cron-able)
|
||||
```
|
||||
|
||||
Secrets may come from the keyproxy hop: `key_ref = "mpk:mpk-redmine"` in
|
||||
`harness.toml` plus a `[keyproxy]` section resolves through
|
||||
[mopac-keyproxy](https://git.knownelement.com/ukrrs/mopac-keyproxy)'s
|
||||
`POST /v1/resolve` (short in-memory cache). `env:` / `file:` / `literal:`
|
||||
refs keep working untouched, so the loop runs with or without keyproxy up.
|
||||
|
||||
### Webhook receiver (`harness events`)
|
||||
|
||||
Redmine / Discourse / Gitea webhooks punch the harness through the event
|
||||
@@ -144,6 +186,26 @@ Prints the full usage block reproduced under [CLI reference](#cli-reference).
|
||||
|
||||
## Architecture
|
||||
|
||||
```mermaid
|
||||
flowchart LR
|
||||
P(["harness loop<br/>poll every poll_interval_secs"]) --> I["INTAKE<br/>/issues.json scope query"]
|
||||
I -->|"id + updated_on not in loop.jsonl"| T["BOUNDED TURN<br/>per issue, sequential (v0)"]
|
||||
T --> R["REPORT<br/>reports/ file (atomic)"]
|
||||
R --> N["REDMINE WRITEBACK<br/>journal note (PUT /issues/{id}.json)<br/>+ status per [redmine.status_map]"]
|
||||
G["GITEA COMMIT<br/>optional, [gitea] commit_reports"] -.-> N
|
||||
R -.-> G
|
||||
N --> S[("state/loop/loop.jsonl<br/>append-only, dedup index<br/>refreshed to post-writeback updated_on")]
|
||||
S -->|"next scan skips processed"| I
|
||||
```
|
||||
|
||||
The loop replaces the crossfeed bash stack (semaphore slot files, queue
|
||||
scripts, screen doorbells): concurrency is simply "one turn at a time"
|
||||
for v0, wake discipline is the poll interval, and the only cross-process
|
||||
state is the append-only JSONL.
|
||||
|
||||
One conductor iteration per process (`harness once`) still works exactly
|
||||
as before for manual/chained runs:
|
||||
|
||||
```mermaid
|
||||
flowchart TD
|
||||
S(["harness once"]) --> I["INTAKE<br/>Redmine /issues.json scope query<br/>or the [demo] issue"]
|
||||
@@ -164,7 +226,9 @@ bash exec whose gate denials feed back to the model as tool results instead
|
||||
of failing the turn; WRITEBACK persists the final assistant reply as a REPORT
|
||||
file plus `REPORT-latest.md` (atomic tmp+rename). On a mid-turn LLM failure
|
||||
after content exists, a partial REPORT is still written with the error as the
|
||||
stop reason. Chaining is by re-invocation — there is no daemon.
|
||||
stop reason. Chaining is by re-invocation; the loop is the daemon form of
|
||||
the same iteration, run per new/updated issue with the SoR writebacks on
|
||||
top.
|
||||
|
||||
The event path is a second door into the same loop:
|
||||
|
||||
@@ -191,6 +255,7 @@ Subcommands (from `harness help`):
|
||||
|---|---|
|
||||
| `harness help` | print usage (also `-h`, `--help`) |
|
||||
| `harness once` | run ONE conductor iteration, then exit |
|
||||
| `harness loop` | run the self-host daemon until SIGINT (poll -> turn -> note/status writeback) |
|
||||
| `harness events` | run the webhook receiver until SIGINT/SIGTERM |
|
||||
|
||||
Flags for `once`:
|
||||
@@ -202,6 +267,15 @@ Flags for `once`:
|
||||
| `-demo` | run the `[demo]` issue instead of Redmine intake |
|
||||
| `-task-id ID` | run only the task/issue with this id |
|
||||
|
||||
Flags for `loop`:
|
||||
|
||||
| Flag | Meaning |
|
||||
|---|---|
|
||||
| `-config PATH` | config file (default `$HARNESS_CONFIG`, then `./harness.toml`) |
|
||||
| `-interval DUR` | poll interval (overrides `[loop]` poll_interval_secs) |
|
||||
| `-once` | single scan then exit (cron-able) |
|
||||
| `-dry-run` | scan + print what would dispatch; no turns, no state writes |
|
||||
|
||||
Flags for `events`:
|
||||
|
||||
| Flag | Meaning |
|
||||
@@ -213,7 +287,7 @@ Exit codes:
|
||||
|
||||
| Code | Meaning |
|
||||
|---|---|
|
||||
| 0 | ok (including "no tasks in scope") |
|
||||
| 0 | ok (including "no tasks in scope"; loop: clean SIGINT stop) |
|
||||
| 1 | usage / config / routing / writeback error |
|
||||
| 2 | intake error |
|
||||
| 4 | llm / turn error |
|
||||
@@ -229,12 +303,19 @@ cannot rot):
|
||||
| | `work_root` | where the bash tool executes (default `.`) |
|
||||
| | `report_dir` | where REPORT files land (default `reports`) |
|
||||
| `[loop]` | `max_rounds` | max LLM round trips per turn, tool calls included (default 8) |
|
||||
| | `poll_interval_secs` | `harness loop` scan interval (default 120) |
|
||||
| | `state_dir` | loop state dir (default `state/loop`); `loop.jsonl` created 0600, one JSON line per action |
|
||||
| `[redmine]` | `url`, `key_ref` | SoR issues endpoint + auth key ref |
|
||||
| | `scope_query` / `scope_query_id` | released-scope filter: raw `/issues.json` params, or a saved query id (`scope_query` wins when both are set) |
|
||||
| | `class_field`, `default_class` | custom field carrying the task class; fallback for issues without it (default `Class` / `primary`) |
|
||||
| | `limit` | max issues fetched per intake (default 50) |
|
||||
| `[redmine.status_map]` | `"In Progress" = "Done"` style entries | loop: after a REPORT is noted, an issue whose current status matches a key moves to the value (names resolved via `/issue_statuses.json`); empty map = no transitions. Quoted keys allow spaces |
|
||||
| `[litellm]` | `base_url`, `key_ref` | OpenAI-compatible proxy endpoint + key ref |
|
||||
| | `timeout_secs`, `max_retries` | per-request timeout (default 120) and retry count (default 2) |
|
||||
| `[keyproxy]` | `url`, `token_ref` | optional mopac-keyproxy resolve hop for `mpk:` refs (bearer token is itself a LOCAL ref); url + token_ref are all-or-nothing |
|
||||
| | `cache_ttl_secs` | in-memory `mpk:` resolution cache TTL (default 60) |
|
||||
| `[gitea]` | `url`, `key_ref`, `owner`, `repo` | optional REPORT-commit step; all required when `commit_reports = true` |
|
||||
| | `branch`, `commit_reports` | target branch (empty = repo default); the whole step is off by default |
|
||||
| `[models]` | tier keys, `default_tier` | tier alias → concrete proxy model (see below) |
|
||||
| `[models.classes]` | class keys | task class → tier alias (see below) |
|
||||
| `[tools.bash]` | `enabled`, `timeout_secs`, `max_output_bytes` | bash gate on/off, per-command timeout (default 60s), output truncation (default 100000) |
|
||||
@@ -248,8 +329,10 @@ cannot rot):
|
||||
| `[events.gitea]` | `secret_ref` | HMAC secret ref; verification is always `X-Gitea-Signature` (hex HMAC-SHA256 of the raw body) |
|
||||
|
||||
Key refs accepted anywhere a `*_ref` appears: `env:NAME`, `file:PATH`,
|
||||
`literal:VALUE` (last resort), and `bw:REF` (reserved; errors until the
|
||||
bitwarden wrapper lands in build phase 3).
|
||||
`literal:VALUE` (last resort), `mpk:PLACEHOLDER` (resolved through the
|
||||
optional `[keyproxy]` hop — see [mopac-keyproxy](https://git.knownelement.com/ukrrs/mopac-keyproxy);
|
||||
`mpk:redmine` and `mpk:mpk-redmine` are equivalent), and `bw:REF`
|
||||
(reserved; errors until the bitwarden wrapper lands in build phase 3).
|
||||
|
||||
## Model routing
|
||||
|
||||
@@ -296,17 +379,21 @@ Sourced from [REPORT.md](REPORT.md) — keep both in sync.
|
||||
| Exec tool | Works | allow-listed bash, segment-wise compound checks, timeout + truncation |
|
||||
| REPORT writeback | Works | timestamped file + `REPORT-latest.md`, atomic, full telemetry |
|
||||
| Event receiver | Works | `harness events`: verify (HMAC/shared-secret) → normalize → append-only JSONL with provider-id dedup → action mapping; smoke-proven on LAN port 4100 |
|
||||
| Self-host loop | Works | `harness loop`: poll intake → sequential bounded turns → REPORT note writeback → status map → dedup by id + updated_on (append-only loop.jsonl); `--once`, `--dry-run`, `-interval`; fake-Redmine e2e test-asserted |
|
||||
| Redmine note writeback | Works | loop path POSTs the REPORT body as a journal note (PUT `/issues/{id}.json`); `once` stays file-only |
|
||||
| Status transitions | Works | `[redmine.status_map]` names → ids via `/issue_statuses.json`; refresh advances the dedup marker past its own writes |
|
||||
| `mpk:` key refs | Works | `[keyproxy]` hop (POST `/v1/resolve`, bearer, cached); local refs unaffected |
|
||||
| Gitea REPORT commit | Works (off) | `[gitea] commit_reports`: contents-API create-or-update right after the REPORT lands |
|
||||
| Event → turn dispatch | Stubbed | conductor `DispatchEvent` prints what it would do; wiring is phase 3 |
|
||||
| Tests | Works | table-driven, stdlib only; build/vet/test clean on go1.26 |
|
||||
| Redmine note writeback | Stubbed | REPORT is file-only today |
|
||||
| Budget/semaphore gate | Stubbed | tokens in REPORT, no cost/spend enforcement yet |
|
||||
| `bw:` key refs | Stubbed | error until the bitwarden wrapper (phase 3) |
|
||||
| Loop concurrency | Stubbed | v0 = one turn at a time; in-process concurrency knob later |
|
||||
| Streaming + turn resume | Stubbed | retry is request-level today |
|
||||
| Session persistence/repair | Stubbed | not started |
|
||||
| Write confinement | Stubbed | declared roots + symlink checks land with the permission layer |
|
||||
| Task ordering | Stubbed | first-in-scope; chain with `--task-id` until status transitions land |
|
||||
| Local inbox intake | Stubbed | not started |
|
||||
| Next (phase 3) | Next | bitwarden wrapper, full permission layer, Redmine note writeback + status transitions, budget gate via LiteLLM spend APIs, streaming with resume |
|
||||
| Next (phase 3) | Next | bitwarden wrapper, full permission layer, event → turn wiring, budget gate via LiteLLM spend APIs, streaming with resume, loop concurrency knob |
|
||||
|
||||
## Docs and links
|
||||
|
||||
|
||||
Reference in New Issue
Block a user