fix: reclaim unused images during critical disk pressure #49

2026-11-02T17:56:45Z

autonomic-bot commented

2026-11-02 17:56:45 +00:00

What changed

At 90% disk usage, prune unused Docker images older than seven days even when a warm service has unmet replicas. Preserve the live test stack guard and never prune volumes.

Why

On 2026-11-02, cc-ci reached 100% disk usage with about 83 GB of unused images. Gitea and Keycloak warm services crash-looped. Daily cleanup skipped because Gitea was converging.

Verification

Nix syntax, module evaluation, and a full nixos-rebuild build passed.
Manual image cleanup reclaimed 86.25 GB; all warm services returned to 1/1 and their HTTP endpoints responded.
The new built cleanup binary is active through a persistent systemd drop-in at /etc/systemd/system.control/ci-docker-prune.service.d/disk-pressure.conf; a manual service run at 46% disk usage correctly kept the cache.
A full NixOS switch was deliberately avoided: /root/cc-ci builds an older host generation than the running orchestrator-managed system. The drop-in should be removed when this module is included in the next orchestrator rebuild.

## What changed At 90% disk usage, prune unused Docker images older than seven days even when a warm service has unmet replicas. Preserve the live test stack guard and never prune volumes. ## Why On 2026-11-02, cc-ci reached 100% disk usage with about 83 GB of unused images. Gitea and Keycloak warm services crash-looped. Daily cleanup skipped because Gitea was converging. ## Verification - Nix syntax, module evaluation, and a full `nixos-rebuild build` passed. - Manual image cleanup reclaimed 86.25 GB; all warm services returned to 1/1 and their HTTP endpoints responded. - The new built cleanup binary is active through a persistent systemd drop-in at `/etc/systemd/system.control/ci-docker-prune.service.d/disk-pressure.conf`; a manual service run at 46% disk usage correctly kept the cache. - A full NixOS switch was deliberately avoided: `/root/cc-ci` builds an older host generation than the running orchestrator-managed system. The drop-in should be removed when this module is included in the next orchestrator rebuild.

autonomic-bot added 1 commit 2026-11-02 17:56:45 +00:00

fix: reclaim unused images during critical disk pressure

continuous-integration/drone/push Build is passing

Details

eb675e6e10

autonomic-bot merged commit a47c1caa8c into main

2026-11-02 17:58:53 +00:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: recipe-maintainers/cc-ci#49