canonical-ci-engineering team mailing list archive

[Francis Ginther <francis.ginther@xxxxxxxxxxxxx>]

Builds are now failing due to insufficient disk space [1]. I've
determined that 60% of / is consumed by /var/cache/pbuilder/build [2]
and most of those directories have older timestamps. My theory is that
these were created by failed or aborted builds and were not cleaned
up.

I would like to request that any directory with a timestamp > 1 day be
purged by IS. However, I don't want to request deletion from IS
without someone to confirm this proposal. If someone with a little
more ci-train knowledge can confirm, I'll send the rt request.

Long term I recommend a cleanup job to run at least daily to purge the
old build dirs. It will need sudo permissions as these directories are
owned by root.

For the short term, I recommend only executing one build at a time (at
least through the cow build portion of the build).

[1] - https://ci-train.ubuntu.com/job/landing-002-1-build/41/console
 - mktemp: failed to create directory via template
'/tmp/debsign.XXXXXXXX': No space left on device
[2] - https://ci-train.ubuntu.com/job/fginther-test/9/console

Francis
-- 
Francis Ginther
Canonical - Ubuntu Engineering - Continuous Integration Team