Jon Chery
9897df04b2
The prior VERIFY stage was diff-scoped: it checked the phase diff only
and never re-ran underlying platform capability. This structural defect
(D-091) let 8 NFR-patch phases (v1.9.1-v1.9.8, deck rework) pass VERIFY
while the platform they described decayed underneath.
Phase 52 remediation:
- core/regression_verify.py: regression-class VERIFY with 10 seeded
local-tier capability checks (CAP-001..CAP-010). Tags each
Verified/Decayed/Broken; fails closed on any non-Verified.
- scripts/run_regression.sh: shell wrapper; writes
.ciagent/REGRESSION_REPORT.{md,json}; exits non-zero on decay.
- tests/test_verify_regression_mode.py: 11 tests (8 fast + 3 slow).
Confirms the gate catches decay (fails closed) and that regression
mode is additive (diff-scoped VERIFY behavior preserved).
- pyproject.toml: slow marker registered; run_ci.sh excludes slow
tests to avoid recursion.
Verified: 502 fast tests pass (was 493 at v1.9; +9 new). 3 slow
integration tests pass. run_regression.sh reports all 10 seeded
local-tier capabilities Verified against current code. The
decay-surfacing test injects a broken cloud-backed check and confirms
the run tags it Broken and fails closed.
Cloud-backed capability re-verification (live ECS, DynamoDB writes,
Lambda invocation) lands in Phase 54 (D-093).
---ci---
project: acdl
phase: 52
milestone: v1.10
status: verify
requirements:
covered: [REQ-112]
partial: []
decisions: [D-091]
regression:
- { capability: CAP-001, status: Verified }
- { capability: CAP-002, status: Verified }
- { capability: CAP-003, status: Verified }
- { capability: CAP-004, status: Verified }
- { capability: CAP-005, status: Verified }
- { capability: CAP-006, status: Verified }
- { capability: CAP-007, status: Verified }
- { capability: CAP-008, status: Verified }
- { capability: CAP-009, status: Verified }
- { capability: CAP-010, status: Verified }
---/ci---
94 lines
2.8 KiB
JSON
94 lines
2.8 KiB
JSON
{
|
|
"run_id": "regr-1785172853",
|
|
"run_at_utc": "2026-07-27T17:20:53Z",
|
|
"milestone": "v1.10",
|
|
"phase": 52,
|
|
"summary": {
|
|
"Verified": 10,
|
|
"Decayed": 0,
|
|
"Broken": 0
|
|
},
|
|
"passed": true,
|
|
"results": [
|
|
{
|
|
"capability_id": "CAP-001",
|
|
"name": "contract.schema.json validates sample contracts",
|
|
"status": "Verified",
|
|
"detail": "exit 0; 2 sample contracts validate",
|
|
"tier": "local",
|
|
"duration_ms": 219
|
|
},
|
|
{
|
|
"capability_id": "CAP-002",
|
|
"name": "environment.schema.json validates env files",
|
|
"status": "Verified",
|
|
"detail": "exit 0; env schema validates",
|
|
"tier": "local",
|
|
"duration_ms": 215
|
|
},
|
|
{
|
|
"capability_id": "CAP-003",
|
|
"name": "contract_resolver resolves static-assets",
|
|
"status": "Verified",
|
|
"detail": "exit 0; ",
|
|
"tier": "local",
|
|
"duration_ms": 236
|
|
},
|
|
{
|
|
"capability_id": "CAP-004",
|
|
"name": "contract_resolver resolves microservice",
|
|
"status": "Verified",
|
|
"detail": "exit 0; ",
|
|
"tier": "local",
|
|
"duration_ms": 245
|
|
},
|
|
{
|
|
"capability_id": "CAP-005",
|
|
"name": "terraform adapter emits .tf files",
|
|
"status": "Verified",
|
|
"detail": "exit 0; ",
|
|
"tier": "local",
|
|
"duration_ms": 300
|
|
},
|
|
{
|
|
"capability_id": "CAP-006",
|
|
"name": "contract interpolation expands env/contract tokens",
|
|
"status": "Verified",
|
|
"detail": "exit 0; interpolation ok",
|
|
"tier": "local",
|
|
"duration_ms": 216
|
|
},
|
|
{
|
|
"capability_id": "CAP-007",
|
|
"name": "confidence_signal.compute returns a band",
|
|
"status": "Verified",
|
|
"detail": "exit 0; confidence band=pass",
|
|
"tier": "local",
|
|
"duration_ms": 82
|
|
},
|
|
{
|
|
"capability_id": "CAP-008",
|
|
"name": "outbox_writer builds a hash-chained item",
|
|
"status": "Verified",
|
|
"detail": "exit 0; outbox hash chain ok",
|
|
"tier": "local",
|
|
"duration_ms": 330
|
|
},
|
|
{
|
|
"capability_id": "CAP-009",
|
|
"name": "offline pytest suite passes",
|
|
"status": "Verified",
|
|
"detail": "exit 0; [ 98%]\ntests/test_wiz_adapter_real_client.py ......... [100%]\n\n============================= 464 passed in 12.09s =============================",
|
|
"tier": "local",
|
|
"duration_ms": 13516
|
|
},
|
|
{
|
|
"capability_id": "CAP-010",
|
|
"name": "run_ci.sh reproduces CI pipeline locally",
|
|
"status": "Verified",
|
|
"detail": "exit 0; resource(s))\n\n=== PLATFORM CHECK OK ===\ncontract -> resolver -> stack -> adapter -> structure validated (offline, no AWS)\ncheck-only: OK\n\n=== CI PIPELINE OK ===\n3 stages passed: lint, test, check-only",
|
|
"tier": "local",
|
|
"duration_ms": 17839
|
|
}
|
|
]
|
|
} |