This repository has been archived on 2026-09-12. You can view files and clone it. You cannot open issues or pull requests or push a commit.
Files
praxis/.ciagent/AUDIT.md
T
Praxis CI fbd6602814 docs(milestone): complete v0.1 foundation
---ci---
phase: 0
milestone: v0.1
status: complete
---/ci---
2026-08-01 13:32:48 +00:00

19 KiB

Praxis — Final Phase (P2) Audit Report

Phase: 2 — Review + Ship (FINAL PHASE audit) Milestone: v0.1 (foundation) Branch: phase/02-final-review-ship (current; created from milestone/v0.1-praxis) Auditor: CIAgent doc-verifier (mechanical, autonomy full, single-project mode) Date: 2026-08-01 Mode: P2 final audit per /root/.config/opencode/ci/workflows/audit.md Codebase state at audit: 33 commits across all branches; working tree clean; HEAD = 97f6cf1 (phase/02 branched at milestone tip, no P2 commits yet) Inputs: git log (all branches), .ciagent/ files (11), ---ci--- blocks (32), live test run, e2e smoke, client typecheck, secret scan, branch/merge topology


Overall Verdict

Verdict HEALTHY
Confidence 0.95
Critical issues 0
Warnings 3 (all cosmetic — stale Status: header lines + a planning-snapshot table; no behavioral drift)
Reconstruction test PASS — project state fully reconstructable from git log alone
Ship-ready YES (subject to orchestrator's milestone-ship decision; 2 release-pending escalations auto-deferred to ship)

One-line summary: The Praxis v0.1 foundation milestone is internally consistent, fully reconstructable from git history, free of committed secrets, and behaviorally verified (73 tests pass, e2e smoke passes, client typechecks). The git log, .ciagent/ files, branch topology, tags, and ---ci--- blocks all agree. Three cosmetic warnings (stale Status: header strings in PROJECT.md/REQUIREMENTS.md and a planning-snapshot coverage table in ROADMAP.md) are non-blocking and reflect intentional phase-0-era artifacts left in place; the authoritative phase status (ROADMAP phase markers, CHECKPOINT.json, ---ci--- blocks) is correct. No fixes required to ship.


Audit Check Results

1. Reconstruction Test — PASS

Goal: Can the full project state be reconstructed from git history alone?

Method: Parsed all ---ci--- blocks from git log --all; reconstructed phase/stage/decisions/escalations/requirements; compared against .ciagent/ file contents.

Findings:

Source Reconstructable? Evidence
Current phase Latest milestone commit 97f6cf1phase: 1, status: complete; phase/02 branch is the active review phase (no commits yet — expected, audit is first P2 action)
Milestone All 32 CI commits carry milestone: v0.1
Phases shipped Phase 0: commits f02dff248cbd4a (specify→clarify→research→plan→grill→complete), tagged v0.0.0; Phase 1: commits ea1b775b77536a (execute x22 → verify → complete), tagged v0.0.1
Decisions D-001..D-012 in clarify commit 7282524; D-013..D-020 in research commit d4e6086; D-P1-01..06 in plan commit cf05b41; G-001..G-008 in grill commit 65cebdc — all match PROJECT.md / GRILL.md / PLAN.md
Escalations 2 release-pending escalations in commits 415c8ac (P0) + 97f6cf1 (P1), both resolution: auto, type: release_pending — matches ROADMAP.md "release pending — Gitea repo not yet created" + CHECKPOINT.json release_status: pending
Requirements 15 P1 REQ-IDs listed as covered in commits 48cbd4a, b77536a, fe29bf0 (verify) — matches REQUIREMENTS.md + PLAN.md coverage matrix + VERIFY.md traceability
Lessons 4 lessons in verify commit fe29bf0 (2 P0 fixes, pending-keys test file, test tally) — matches VERIFY.md §Layer 4
CHECKPOINT consistency CHECKPOINT.json = {phase: 1, stage: complete, milestone: v0.1, release_status: pending} — matches latest milestone commit 97f6cf1 (phase: 1, status: complete + escalation release_pending). HEAD on phase/02 has no P2 commits yet, so checkpoint correctly reflects last committed state.

Reconstruction verdict: PASS. The project state is fully reconstructable from the 32 ---ci--- blocks. The single commit without a ---ci--- block (bcb0118 chore: seed .gitignore for env secrets) is the initial seed — explicitly exempted per the audit workflow.


2. File Discipline — PASS

Expected .ciagent/ files (11):

File Present? Valid?
config.json Valid JSON; required fields present (projects, active_project, autonomy, git, release, secrets)
PROJECT.md Required sections present (Vision, Objective, v0.1 Scope, Product Principles, Requirements, Constraints, Key Decisions D-001..D-020, Target Users, Success Metrics)
ARCHITECTURE.md Topology + v0.1 component map + latency budget + risks; matches actual server/, client/, db/, scenarios/ code structure
ROADMAP.md 2 phases documented; Phase 0 + Phase 1 marked ✓ complete (tagged v0.0.0/v0.0.1); Final Phase (P2) documented
REQUIREMENTS.md Formal REQ-IDs across 8 categories; 15 P1 must/principle REQs + deferred REQs; binding constraints C-1..C-8
RESEARCH.md R1-R10 risks; D-003/D-007 confidence bumps; D-013..D-020 recorded; prior-art scan
PERSONAS.md 4 active personas (lead-developer, backend-engineer, frontend-engineer, data-engineer) + 2 proposed (voice-engineer, ml-engineer)
PLAN.md 5 slices / 3 waves / 26 tasks / 10 exit criteria / 15/15 REQ coverage matrix / 6 planning decisions D-P1-01..06
GRILL.md 28 challenges / 10 axes / 8 binding decisions G-001..G-008 / 0 escalations / verdict PROCEED @ 0.72
VERIFY.md Phase 1 verification report — 4 layers (Structural/Behavioral/Security/Quality); 73 tests, 15/15 REQs, 2 P0 fixes, 6 P1+ flags
CHECKPOINT.json Valid JSON; phase/stage/milestone/release_status consistent with latest commit

Stale-file check: No stale files referencing old milestones. All .ciagent/ files are scoped to v0.1.

Secrets handling:

Check Result
.ciagent/.env.secrets exists
Permissions 0600 (-rw-------)
Gitignored (git check-ignore .ciagent/.env.secrets → matches; .gitignore lines 11-13 cover .env, .env.secrets, .env.*)
NOT committed (git ls-files .ciagent/ lists 11 files — .env.secrets absent; git ls-files repo-wide shows no .env*/.db/key/credential files)

File discipline verdict: PASS.


3. Branch Hygiene — PASS

Expected branches (5):

Branch Exists? State
main 1 commit (bcb0118 — initial .gitignore seed); milestone not yet merged to main (correct — orchestrator runs milestone ship after this audit)
milestone/v0.1-praxis 5 commits (seed + 2 P0 docs + 2 P1 docs); contains all 81 project files (squash-merged phase content); tags v0.0.0 + v0.0.1 point here
phase/00-pre-execution 6 commits (specify→clarify→research→plan→grill + complete); merged to milestone via squash (content present on milestone)
phase/01-minimal-voice-loop 23 commits (skeleton + 22 execute/verify + complete); merged to milestone via squash (content present on milestone)
phase/02-final-review-ship Current branch; created at milestone tip (97f6cf1); 0 P2 commits yet (audit is first P2 action)

Merge topology:

  • git branch --merged milestone/v0.1-praxismain, milestone/v0.1-praxis (the phase branches are NOT in --merged because they were squash-merged, not merge-committed). The milestone tree contains all phase content (verified: git ls-tree -r milestone/v0.1-praxis lists all 81 files including server/, client/, db/, tests/). Squash-merge is a valid phase→milestone integration strategy — the detailed per-task commit history is preserved on the phase branches, while the milestone carries consolidated "phase complete" commits. This satisfies "phase branches merged into milestone before milestone merges to main."
  • main has only the seed commit — milestone has NOT merged to main yet. Correct: the orchestrator runs milestone ship after review + audit complete (per the task instructions: "Do NOT run ship").

HEAD not on main: (HEAD = phase/02-final-review-ship)

Tags: v0.0.0 (annotated, points at P0 complete commit 48cbd4a), v0.0.1 (annotated, points at P1 complete commit b77536a). Both present and correct.

Branch hygiene verdict: PASS.


4. Commit Discipline — PASS

Commit inventory (33 total across all branches):

Prefix Count Valid?
docs(...) 10 (init, research, plan, grill, phase-complete x4)
feat(P01-...) 21 (slice/task-scoped feature commits)
decision(P00) 1 (clarify stage — D-006..D-012)
verify(P01) 1 (code review — quality + security)
chore 1 ⚠️ (initial .gitignore seed — the ONE exempted commit per audit spec)

---ci--- block coverage: 32 / 33 commits (97%). The 1 commit without is bcb0118 chore: seed .gitignore for env secrets — the initial seed, explicitly exempted. All 32 CI-generated commits have ---ci--- blocks.

Phase/milestone/status in ---ci--- blocks:

Field Values observed Consistent?
phase: 0 (7 commits), 1 (25 commits) matches ROADMAP phases
milestone: v0.1 (all 32) matches config.json + all .ciagent files
status: specify, clarify, research, plan, grill, execute (x22), verify, complete (x4) matches pipeline stages

Commit message convention: All commits use the prefix(scope): description convention with valid prefixes (docs, feat, decision, verify, chore). Slice/task-scoped feature commits use feat(P01-NN-NN): ... format consistently.

Secret scan:

Scan Result
git ls-files for env/secret/key/.db/credential/token filenames 0 matches (no tracked secret files)
Full-history pickaxe -S'GITEA_TOKEN' 0 secret values — GITEA_TOKEN appears only as an env-var name in config.json (secrets scope), docs/latency-report.md (prose), and tests/test_pending_keys.py (prose) — never as a hardcoded value
Grep for sk-[a-zA-Z0-9]{20,} and _API_KEY="[^"]{15,}" in working tree 0 hardcoded key values found
.ciagent/.env.secrets content NOT committed (gitignored, 0600); not inspected for audit (out of scope — file is correctly excluded from VCS)

Commit discipline verdict: PASS. No secrets committed. Convention followed. All CI commits have ---ci--- blocks.


5. Requirement Traceability — PASS

15 P1 REQ-IDs from REQUIREMENTS.md → code + test coverage:

REQ-ID Priority Code path (verified) Tests Covered?
REQ-VOICE-01 must server/pipeline.py:_build_stt (Deepgram Nova-3) structural + pending-key live test
REQ-VOICE-02 must server/services/base.py:TTSProvider, server/tts/cartesia_tts.py, server/tts/piper_tts.py 7 tests + pending live
REQ-VOICE-03 must server/latency.py, docs/latency-report.md 5 tests; live number pending keys
REQ-VOICE-04 must server/pipeline.py (allow_interruptions=True), server/interruptibility.py 3 tests
REQ-SCEN-01 must scenarios/customer_service_refund_ca_v01.yaml, server/scenarios/runtime.py 7 runtime + 5 schema
REQ-STATE-01 must db/schema.sql, db/store.py (HARDCODED_LEARNER_ID="learner-1"), db/migrations/0001_init.sql, server/session_recorder.py 6 store + 7 recorder
REQ-LLM-01 must server/llm/ollama_cloud.py (gemma4:cloud) 6 tests + pending live
REQ-LLM-02 must server/llm/ollama_cloud.py (no_think), server/debrief.py, server/scenarios/classifier.py 5 debrief + pending live
REQ-DEBRIEF-01 must server/debrief.py, docs/debrief/default.yaml, server/session_recorder.py 5 debrief + 2 persistence
REQ-ORCH-01 must server/pipeline.py (Pipecat + Silero VAD + interrupt) imports + e2e smoke
REQ-ORCH-02 must server/services/base.py:Guardrail, server/guardrails/customer_service.py, server/services/registry.py 9 guardrail tests
REQ-SCEN-FMT-01 must server/scenarios/schema.py, loader.py, runtime.py 5 schema + 7 runtime
REQ-NFR-LAT-01 must server/latency.py, docs/latency-report.md, scripts/probe_*.py 5 tests; live pending keys
REQ-NFR-SAFE-01 must (baseline) server/guardrails/customer_service.py (disclaimer + 4 block categories + debrief filter) 9 guardrail tests
REQ-NFR-COST-01 must (logging) server/cost.py, scenarios/cost_rates.yaml, server/session_recorder.py 7 cost/recorder tests

Coverage: 15 / 15 P1 REQ-IDs covered by code + at least one offline test (live-key-dependent REQs have auto-activated pending-key tests). No orphaned requirements. Coverage matches PLAN.md §5 coverage matrix exactly.

Test-suite reproduction (run at audit):

python3 -m pytest -q  →  73 passed, 9 skipped (pending-keys), 0 failed, 1 warning

Matches VERIFY.md §2.1 exactly (73/9/0). The 1 warning is the benign audioop DeprecationWarning from Pipecat (third-party, Python 3.13 advisory).

E2e smoke reproduction:

python3 scripts/e2e_smoke.py  →  E2E SMOKE TEST — PASSED
  session_id: sess-..., branch_id: accept_resolution, outcome: success,
  turns_logged: 4, cost_cents: 1, debrief_chars: 194,
  max_latency_ms: 510.0, within_budget: True, budget_ms: 600.0

Matches VERIFY.md §2.2.

Client typecheck reproduction: npm run typecheck → clean (exit 0). Matches VERIFY.md §1.5.

Requirement traceability verdict: PASS.


6. Escalation Review — PASS

Expected: 2 release-pending escalations (Phase 0 + Phase 1 — Gitea repo not created), 0 grill escalations.

Found:

Escalation Commit Phase resolution type reason Matches orchestrator expectation?
1 415c8ac (P0 complete) 0 auto release_pending "Gitea repo coreci/praxis does not exist (HTTP 404); tag+merge succeeded; release retries at milestone ship"
2 97f6cf1 (P1 complete) 1 auto release_pending "Gitea repo coreci/praxis does not exist (HTTP 404); tag+merge succeeded; release retries at milestone ship"

Grill escalations: 0. G-001..G-008 in GRILL.md are binding decisions (not escalations) — correctly logged in the grill commit 65cebdc under decisions:, not escalation:. GRILL.md §Escalations explicitly states "None. All nine axes plus meta resolved with confidence ≥ 0.60."

Cross-reference:

  • ROADMAP.md lines 16, 33: "release pending — Gitea repo not yet created"
  • CHECKPOINT.json: release_status: pending, release_reason: "Gitea repo coreci/praxis does not exist..."
  • All three sources (commits, ROADMAP, CHECKPOINT) agree.

Escalation review verdict: PASS. 2 release-pending (auto, correctly deferred to milestone ship), 0 grill escalations.


Warnings (3 — all cosmetic, non-blocking)

These are minor drift items that do NOT block milestone ship. They are documented for completeness; the authoritative project status (ROADMAP phase markers, CHECKPOINT.json, ---ci--- blocks) is correct in all three cases.

# Severity File:line Finding Impact Recommendation
W-1 Nit PROJECT.md:4 Status: research — stale Phase-0-era status header. Never updated after Phase 0 completed. Cosmetic. The authoritative status is in ROADMAP.md (✓ complete) + CHECKPOINT.json (stage: complete). No behavioral impact. Optional: update to Status: complete (v0.1 foundation — phases 0+1 shipped) at milestone ship.
W-2 Nit REQUIREMENTS.md:4 Status: clarify — stale Phase-0-era status header. Never updated after the clarify stage completed. Cosmetic. The authoritative status is the Status column in each REQ table (all P1 REQs planned → shipped). No behavioral impact. Optional: update to Status: shipped (P1) at milestone ship.
W-3 Nit ROADMAP.md:69-83 "Requirement Coverage (initial — to be refined by ci-planner)" table shows all 15 REQ-IDs as planned. This is the Phase-0 planning snapshot; the REQs are now complete (shipped in Phase 1). Cosmetic. The table is explicitly labeled "initial" (a planning snapshot, not a live status tracker). ROADMAP.md lines 12-44 correctly mark Phase 0 + Phase 1 as ✓ complete. VERIFY.md §2.4 has the live coverage matrix (15/15 covered). No behavioral impact. Optional: either relabel the table header to "(planning snapshot — see VERIFY.md for live status)" or update statuses to complete. Leaving as-is is acceptable since the "initial" label already signals it's a snapshot.

No critical issues. No fixes required to ship. The warnings are header-line / snapshot-table cosmetics that could be tidied at the orchestrator's discretion during milestone ship but do not represent documentation drift that would mislead a reader or break reconstruction.


Audit Checks Summary

# Check Result Detail
1 Reconstruction test PASS 32/33 commits have ---ci--- blocks (1 seed exempted); state fully reconstructable; CHECKPOINT consistent with latest commit
2 File discipline PASS 11/11 expected .ciagent/ files present + valid; .env.secrets 0600 + gitignored + untracked; no stale files
3 Branch hygiene PASS 5/5 expected branches exist; HEAD not on main; tags v0.0.0 + v0.0.1 present; phase branches squash-merged to milestone; milestone not yet merged to main (correct — orchestrator ships)
4 Commit discipline PASS 32/33 commits have ---ci--- blocks; convention followed (docs/feat/decision/verify/chore); 0 secrets committed (pickaxe + grep + ls-files clean)
5 Requirement traceability PASS 15/15 P1 REQ-IDs covered by code + tests; 0 orphaned; matches PLAN.md matrix; 73 tests pass, 9 skip (pending keys), 0 fail; e2e smoke + typecheck reproduce
6 Escalation review PASS 2 release-pending (auto, Gitea 404); 0 grill escalations; G-001..G-008 are binding decisions; all 3 sources (commits, ROADMAP, CHECKPOINT) agree

All 6 audit checks PASS.


Critical Issues

None. No critical issues found. No fixes required on phase/02-final-review-ship before the audit-report commit. The project is ship-ready subject to the orchestrator's milestone-ship decision.


Overall Audit Verdict

HEALTHY

The Praxis v0.1 foundation milestone is:

  • Fully reconstructable from git history (32 ---ci--- blocks across 5 branches + 2 tags)
  • Internally consistent (git log ↔ .ciagent/ files ↔ CHECKPOINT.json ↔ ROADMAP phases all agree)
  • Secret-clean (no secrets committed; .env.secrets correctly excluded)
  • Behaviorally verified (73 tests pass, e2e smoke passes, client typechecks — reproduces VERIFY.md exactly)
  • Requirement-complete (15/15 P1 REQ-IDs covered, 0 orphaned)
  • Escalation-correct (2 release-pending auto-deferred to ship, 0 grill escalations)

3 cosmetic warnings (stale Status: header lines + a planning-snapshot table) are non-blocking nits. No critical issues. No fixes applied. The milestone is ready for the orchestrator to ship.


End of final phase (P2) audit report. AUDIT only — SHIP is the orchestrator's next step.