feat(regression): add E2E canary regression suite (tests/regression/)
continuous-integration/drone/push Build is failing

Seven canaries prove both halves of the server's job:
- GREEN: good apps are reported healthy (good-simple + good-significant)
- RED: broken apps are caught at intended tier (false-green guard + 4 per-tier)

Fixtures: custom-html-bkp-bad (backup tier RED) + custom-html-rst-bad (restore tier RED).
All 7 canaries verified on live server (see STATUS-regression.md for artifacts).

Not wired to per-commit CI — run on-demand: pytest -m canary tests/regression/

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
autonomic-bot
2026-06-02 03:33:24 +00:00
co-authored by Claude Sonnet 4.6
parent baf5a21bdc
commit 73427d6e36
10 changed files with 704 additions and 0 deletions
+5
View File
@@ -0,0 +1,5 @@
# custom-html-bkp-bad — regression fixture for bad-backup canary.
# This recipe is custom-html WITHOUT backupbot labels. Setting BACKUP_CAPABLE=True here forces the
# harness to run the backup tier; the recipe itself has no backupbot service, so
# `abra app backup create` produces no snapshot → test_backup_artifact fails → backup tier RED.
BACKUP_CAPABLE = True