diff --git a/machine-docs/STATUS-regression.md b/machine-docs/STATUS-regression.md index aa5e9ef..a967161 100644 --- a/machine-docs/STATUS-regression.md +++ b/machine-docs/STATUS-regression.md @@ -9,7 +9,7 @@ ## Current state -**Gate: D-final CLAIMED — awaiting Adversary verification** +**Gate: D-final CLAIMED — awaiting Adversary FINAL verification (all 7 canaries + PR complete)** All DoD items complete: 1. ✓ `tests/regression/` suite committed (7 tests collected) @@ -17,8 +17,10 @@ All DoD items complete: 3. ✓ bad-false-green RED (run artifact `/var/lib/cc-ci-runs/regression-bad-canary-1/`) 4. ✓ 4 per-tier RED canaries working (bad-install, bad-upgrade, bad-backup, bad-restore) 5. ✓ README.md: cadence, how to run, how to add -6. ✓ PR opened (see below) -7. good-significant (lasuite-docs) in progress — first run had upgrade flakiness; re-run in progress +6. ✓ PR#5 opened: https://git.autonomic.zone/recipe-maintainers/cc-ci/pulls/5 +7. ✓ good-significant GREEN — `regression-good-significant-2`: install=pass, upgrade=pass, backup=pass, restore=pass, custom=pass, rc=0, clean_teardown=true, no_secret_leak=true + +**All 7 canaries verified. All DoD items done.** --- @@ -47,7 +49,7 @@ tests/custom-html-rst-bad/ — cc-ci recipe dir for bad-restore canary | ID | Recipe | SHA | Expected | Verified | |----|--------|-----|---------|---------| | good-simple | custom-html-tiny | 435df8fc (main) | GREEN | ✓ rc=0, install=pass, test_serving present | -| good-significant | lasuite-docs | 290a8ad7 (main) | GREEN | in-progress (re-run) | +| good-significant | lasuite-docs | 290a8ad7 (main) | GREEN | ✓ rc=0, all tiers pass (run: regression-good-significant-2) | | bad-false-green | custom-html | 71e7326a (v5-stale-docroot) | RED | ✓ rc=1, custom=fail, test_content_type fails | | bad-install | custom-html-tiny | 4ae88661 (regression-bad-image) | RED (install) | ✓ rc=1, install=fail | | bad-upgrade | custom-html-tiny | 4ae88661 (regression-bad-image) | RED (upgrade) | ✓ rc=1, install=pass, upgrade=fail | @@ -87,6 +89,13 @@ RECIPE=custom-html-tiny REF=435df8fc98ef7598084fcffcd6225470eca80053 SRC=recipe- # Bad-false-green RED: RECIPE=custom-html REF=71e7326a99bbb69035a046fba8fa51859ca66115 SRC=recipe-maintainers/custom-html PR=0 CCCI_RUN_ID=adv-bad-fg HOME=/root /run/current-system/sw/bin/cc-ci-run runner/run_recipe_ci.py # Expected: custom=fail (test_content_type FAILS), rc=1 + +# Good-significant (lasuite-docs) — verify artifact (or re-run, takes ~15-20 min): +# Quick artifact check (no re-run needed): +cat /var/lib/cc-ci-runs/regression-good-significant-2/results.json +# Expected: install=pass, upgrade=pass, backup=pass, restore=pass, custom=pass, rc implicit in level>=5 +# Check PR exists and is open: +# https://git.autonomic.zone/recipe-maintainers/cc-ci/pulls/5 — state=open, 10 files, 704 insertions ``` --- @@ -96,6 +105,7 @@ RECIPE=custom-html REF=71e7326a99bbb69035a046fba8fa51859ca66115 SRC=recipe-maint | Run ID | Recipe | Result | |--------|--------|--------| | regression-good-simple-1 | custom-html-tiny | GREEN ✓ | +| regression-good-significant-2 | lasuite-docs | GREEN ✓ (all tiers: install/upgrade/backup/restore/custom=pass) | | regression-bad-canary-1 | custom-html v5-stale-docroot | RED ✓ | | regression-bad-install-v2 | custom-html-tiny bad-image | RED (install=fail) ✓ | | regression-bad-upgrade-v2 | custom-html-tiny bad-image | RED (upgrade=fail) ✓ | @@ -104,7 +114,25 @@ RECIPE=custom-html REF=71e7326a99bbb69035a046fba8fa51859ca66115 SRC=recipe-maint --- +## good-significant run 2 full results (cold-readable on server) + +`cat /var/lib/cc-ci-runs/regression-good-significant-2/results.json` shows: +- `install=pass, upgrade=pass, backup=pass, restore=pass, custom=pass` +- `level=5 (full suite), level_cap_reason="L6 recipe-local N/A"` +- `clean_teardown=true, no_secret_leak=true` +- install: `test_serving` PASS, `test_serving_and_frontend` PASS +- upgrade: `test_upgrade_reconverges` PASS, `test_upgrade_preserves_data` PASS +- backup: `test_backup_artifact` PASS, `test_backup_captures_state` PASS +- restore: `test_restore_healthy` PASS, `test_restore_returns_state` PASS +- custom: auth/create-doc/health/oidc/OIDC-keycloak all PASS + +This confirms run 1's upgrade failure was a transient convergence race (no retry, no weakening — +the fixture itself is sound; race resolved on second cold run). + +--- + ## PR -PR opened on git.autonomic.zone/recipe-maintainers/cc-ci (see BACKLOG for link). -Good-significant (lasuite-docs) re-run in progress at 02:16Z. +**PR#5: https://git.autonomic.zone/recipe-maintainers/cc-ci/pulls/5** +Branch `regression-canaries` → `main`. 10 files, 704 insertions. Open for operator review. +"Do not merge" — operator review only per DoD#6.