Files

T

Jon Chery 9897df04b2 fix(P52): add regression-class VERIFY (D-091) — catches capability decay

The prior VERIFY stage was diff-scoped: it checked the phase diff only
and never re-ran underlying platform capability. This structural defect
(D-091) let 8 NFR-patch phases (v1.9.1-v1.9.8, deck rework) pass VERIFY
while the platform they described decayed underneath.

Phase 52 remediation:
- core/regression_verify.py: regression-class VERIFY with 10 seeded
  local-tier capability checks (CAP-001..CAP-010). Tags each
  Verified/Decayed/Broken; fails closed on any non-Verified.
- scripts/run_regression.sh: shell wrapper; writes
  .ciagent/REGRESSION_REPORT.{md,json}; exits non-zero on decay.
- tests/test_verify_regression_mode.py: 11 tests (8 fast + 3 slow).
  Confirms the gate catches decay (fails closed) and that regression
  mode is additive (diff-scoped VERIFY behavior preserved).
- pyproject.toml: slow marker registered; run_ci.sh excludes slow
  tests to avoid recursion.

Verified: 502 fast tests pass (was 493 at v1.9; +9 new). 3 slow
integration tests pass. run_regression.sh reports all 10 seeded
local-tier capabilities Verified against current code. The
decay-surfacing test injects a broken cloud-backed check and confirms
the run tags it Broken and fails closed.

Cloud-backed capability re-verification (live ECS, DynamoDB writes,
Lambda invocation) lands in Phase 54 (D-093).

---ci---
project: acdl
phase: 52
milestone: v1.10
status: verify
requirements:
  covered: [REQ-112]
  partial: []
decisions: [D-091]
regression:
  - { capability: CAP-001, status: Verified }
  - { capability: CAP-002, status: Verified }
  - { capability: CAP-003, status: Verified }
  - { capability: CAP-004, status: Verified }
  - { capability: CAP-005, status: Verified }
  - { capability: CAP-006, status: Verified }
  - { capability: CAP-007, status: Verified }
  - { capability: CAP-008, status: Verified }
  - { capability: CAP-009, status: Verified }
  - { capability: CAP-010, status: Verified }
---/ci---

2026-07-27 17:29:52 +00:00

1.7 KiB

Raw Blame History

Regression Report — v1.10 Phase 52

Run ID: regr-1785172853
Run at (UTC): 2026-07-27T17:20:53Z
Summary: {'Verified': 10, 'Decayed': 0, 'Broken': 0}
Passed (milestone gate): True

Capability	Name	Tier	Status	Duration (ms)	Detail
CAP-001	contract.schema.json validates sample contracts	local	Verified	219	exit 0; 2 sample contracts validate
CAP-002	environment.schema.json validates env files	local	Verified	215	exit 0; env schema validates
CAP-003	contract_resolver resolves static-assets	local	Verified	236	exit 0;
CAP-004	contract_resolver resolves microservice	local	Verified	245	exit 0;
CAP-005	terraform adapter emits .tf files	local	Verified	300	exit 0;
CAP-006	contract interpolation expands env/contract tokens	local	Verified	216	exit 0; interpolation ok
CAP-007	confidence_signal.compute returns a band	local	Verified	82	exit 0; confidence band=pass
CAP-008	outbox_writer builds a hash-chained item	local	Verified	330	exit 0; outbox hash chain ok
CAP-009	offline pytest suite passes	local	Verified	13516	exit 0; [ 98%]
tests/test_wiz_adapter_real_client.py ......... [100%]

============================= 46 | | CAP-010 | run_ci.sh reproduces CI pipeline locally | local | Verified | 17839 | exit 0; resource(s))

=== PLATFORM CHECK OK === contract -> resolver -> stack -> adapter -> structure validated (offline, no AWS) check-only: OK

=== CI PIPELIN |

1.7 KiB Raw Blame History

Regression Report — v1.10 Phase 52

1.7 KiB

Raw Blame History