docs/DEEP_WORK_LOOP_LOG.md

# Deep Work Loop Log — Composer 2.5 Replication Framework

Started: 2026-05-26
Operator: Codeseys (Hermes Agent autonomous loop)
Skill: `deep-work-loop` v1.0.0

## Vision

> Take any HuggingFace model → further RL train it using:
> 1. RLVR (tests-pass reward),
> 2. SDPO/hint-distillation (Composer 2.5's "targeted RL with textual feedback"),
> 3. multi-teacher trace-replay DPO,
> integrated against TRL/VeRL/OpenEnv with DiLoCo-style outer loop sync.
>
> Output: a published, reproducible framework — the "Composer 2.5 replication" the open ecosystem is missing.

## Starting state

- HEAD: `040eff8` (Wave 6: vision validation self-audit, 5/10 scorecard)
- Tests: 38/38 green in `spikes/005-integrated-trainer-skeleton/`
- Working tree: clean

## Phase ledger

| Phase | Description | Status | Started | Done |
|---|---|---|---|---|
| 1 | commit-state | ✅ | 2026-05-26 | 2026-05-26 |
| 2 | backlog-audit (BACKLOG.md from VISION_VALIDATION) | ✅ | 2026-05-26 | 2026-05-26 |
| 3 | parallel-research (3 subagents) | 🟡 | 2026-05-26 |  |
| 4 | architect with ADRs (ADR-001..003) | ⏳ |  |  |
| 5 | plan in waves (W7–W10) | ⏳ |  |  |
| 6 | execute W7 — Spike 006 (real HF model smoke) | ⏳ |  |  |
| 7 | execute W8 — Spike 007 (real trace ingestion) | ⏳ |  |  |
| 8 | execute W9 — Spike 008 (DiLoCo smoke) | ⏳ |  |  |
| 9 | execute W10 — packaging | ⏳ |  |  |
| 10 | (Modal-gated) Spike 002a-mini real GPU smoke | ⏳ |  |  |
| 11 | cross-model-final-review | ⏳ |  |  |
| 12 | update scorecard + push | ⏳ |  |  |

## Constraints

- Verify ALL claims against primary sources (Wave 2 lesson — subagent synthesis is not evidence).
- Tests must pass before commit.
- Memory L1 is at 99% — write to L2 wiki + L3 fact_store, not L1.
- Modal budget: $20 hard cap for this loop. Anything more goes to user for approval.
- No `upload_file` mixing with `git push` — `git push hf master:main` only.
- Commit messages via `-F /tmp/<wave>-commit-msg.txt`.