buildd-scripts.git
17 months agoTrack what logs still need analysis
Steve McIntyre [Wed, 19 Dec 2018 16:40:04 +0000 (16:40 +0000)]
Track what logs still need analysis

If we have a .note file, or it's a common category like missing
build-dep then don't worry about analysis.

17 months agoAdd text to help track what things need looking at
Steve McIntyre [Wed, 19 Dec 2018 16:25:27 +0000 (16:25 +0000)]
Add text to help track what things need looking at

18 months agoSeparate out build and out dirs by arch too
Steve McIntyre [Thu, 15 Nov 2018 13:27:51 +0000 (13:27 +0000)]
Separate out build and out dirs by arch too

18 months agoAdd a new helper script requeue_by_log
Steve McIntyre [Thu, 15 Nov 2018 13:10:58 +0000 (13:10 +0000)]
Add a new helper script requeue_by_log

18 months agoGah, cut and paste from test script failed
Steve McIntyre [Tue, 6 Nov 2018 18:03:31 +0000 (18:03 +0000)]
Gah, cut and paste from test script failed

18 months agoFix log message
Steve McIntyre [Tue, 6 Nov 2018 17:01:09 +0000 (17:01 +0000)]
Fix log message

18 months agoDon't reset the counter every loop
Steve McIntyre [Tue, 6 Nov 2018 17:00:12 +0000 (17:00 +0000)]
Don't reset the counter every loop

18 months agoDetect if our script file has been changed and restart
Steve McIntyre [Tue, 6 Nov 2018 16:58:36 +0000 (16:58 +0000)]
Detect if our script file has been changed and restart

Can happen if we have more than one instance running

18 months agoSlow down polling for jobs after we've been idle a while
Steve McIntyre [Tue, 6 Nov 2018 16:28:43 +0000 (16:28 +0000)]
Slow down polling for jobs after we've been idle a while

18 months agoLoosen the match for dpkg-buildpackage
Steve McIntyre [Mon, 29 Oct 2018 23:44:01 +0000 (23:44 +0000)]
Loosen the match for dpkg-buildpackage

Pick up on "fakeroot foo" too

18 months agoAdd match for missing source package
Steve McIntyre [Mon, 29 Oct 2018 23:11:26 +0000 (23:11 +0000)]
Add match for missing source package

18 months agoDeal with whitespace from the hostname command
Steve McIntyre [Mon, 29 Oct 2018 17:54:02 +0000 (17:54 +0000)]
Deal with whitespace from the hostname command

18 months agoAdd more error matches
Steve McIntyre [Mon, 29 Oct 2018 17:41:15 +0000 (17:41 +0000)]
Add more error matches

18 months agoPick up on broken build-conflicts
Steve McIntyre [Mon, 29 Oct 2018 17:27:23 +0000 (17:27 +0000)]
Pick up on broken build-conflicts

18 months agoAdd parentheses for clarity
Steve McIntyre [Mon, 29 Oct 2018 17:27:03 +0000 (17:27 +0000)]
Add parentheses for clarity

18 months agoGrab the failed target name if we can
Steve McIntyre [Mon, 29 Oct 2018 17:07:39 +0000 (17:07 +0000)]
Grab the failed target name if we can

18 months agoMore tweaks to match rules
Steve McIntyre [Mon, 29 Oct 2018 17:03:10 +0000 (17:03 +0000)]
More tweaks to match rules

18 months agoAdd some boilerplate
Steve McIntyre [Mon, 29 Oct 2018 16:32:47 +0000 (16:32 +0000)]
Add some boilerplate

Copyright headers etc.
Also add a footer showing information and metadata from our run

18 months agoClassify errors found into groups
Steve McIntyre [Mon, 29 Oct 2018 15:27:01 +0000 (15:27 +0000)]
Classify errors found into groups

And then sort by group in the summary

18 months agoAdd a timestamp on the "nothing to do" message
Steve McIntyre [Mon, 29 Oct 2018 11:43:16 +0000 (11:43 +0000)]
Add a timestamp on the "nothing to do" message

18 months agoReduce noise from apt
Steve McIntyre [Mon, 29 Oct 2018 11:41:44 +0000 (11:41 +0000)]
Reduce noise from apt

18 months agoMake get_package less noisy when there are no jobs
Steve McIntyre [Mon, 29 Oct 2018 11:41:22 +0000 (11:41 +0000)]
Make get_package less noisy when there are no jobs

18 months agoFix up perms for chroot.d better
Steve McIntyre [Mon, 29 Oct 2018 11:18:54 +0000 (11:18 +0000)]
Fix up perms for chroot.d better

Don't sync into place directly and then fix up - sync to an incoming
location, then use install to make sure perms are right.

18 months agoDisable the binutils-aarch64 match, seeing false positives
Steve McIntyre [Mon, 29 Oct 2018 11:05:38 +0000 (11:05 +0000)]
Disable the binutils-aarch64 match, seeing false positives

18 months agoRemove the post-build-commands; not using any more
Steve McIntyre [Mon, 29 Oct 2018 01:26:19 +0000 (01:26 +0000)]
Remove the post-build-commands; not using any more

18 months agoFix java message
Steve McIntyre [Mon, 29 Oct 2018 01:25:51 +0000 (01:25 +0000)]
Fix java message

19 months agoSwitch on emulation for CP15 barriers for all builds
Steve McIntyre [Fri, 26 Oct 2018 18:38:42 +0000 (19:38 +0100)]
Switch on emulation for CP15 barriers for all builds

19 months agoAdd post-failed-build-commands to grab core dumps
Steve McIntyre [Fri, 26 Oct 2018 18:36:47 +0000 (19:36 +0100)]
Add post-failed-build-commands to grab core dumps

Depends on my locally-patched sbuild to work, for now

19 months agoRemove the pbuilder code
Steve McIntyre [Fri, 26 Oct 2018 15:41:52 +0000 (16:41 +0100)]
Remove the pbuilder code

It's commented out. Remove now:

 * we're in git anyway
 * not going back...

19 months agoAutomatically grab and save core dumps if any are generated
Steve McIntyre [Fri, 26 Oct 2018 15:34:13 +0000 (16:34 +0100)]
Automatically grab and save core dumps if any are generated

19 months agoSet the temp dirs to be owned by sbuild
Steve McIntyre [Fri, 26 Oct 2018 13:52:29 +0000 (14:52 +0100)]
Set the temp dirs to be owned by sbuild

19 months agoCall the new ulimit wrapper script inside the schroot
Steve McIntyre [Fri, 26 Oct 2018 12:53:06 +0000 (13:53 +0100)]
Call the new ulimit wrapper script inside the schroot

19 months agoModofy the sbuild/schroot fstab setup
Steve McIntyre [Fri, 26 Oct 2018 12:50:08 +0000 (13:50 +0100)]
Modofy the sbuild/schroot fstab setup

Bind-mount /chroot/rebuildd/sbuild/build for build space

Also bind-mount /etc/schroot/extra, the location of our ulimit wrapper
script

19 months agoAdd a wrapper script to turn on core dumps via ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:49:22 +0000 (13:49 +0100)]
Add a wrapper script to turn on core dumps via ulimit

19 months agoAdd a starting-build-command to call ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:45:39 +0000 (13:45 +0100)]
Add a starting-build-command to call ulimit

19 months agoMake sure we're running with linux32
Steve McIntyre [Thu, 25 Oct 2018 21:47:34 +0000 (22:47 +0100)]
Make sure we're running with linux32

19 months agoCheck for cockups in the schroot setup
Steve McIntyre [Thu, 25 Oct 2018 17:10:07 +0000 (18:10 +0100)]
Check for cockups in the schroot setup

19 months agoMake sure we're in the queue directory
Steve McIntyre [Thu, 25 Oct 2018 17:06:47 +0000 (18:06 +0100)]
Make sure we're in the queue directory

19 months agoTighten the missing build-deps match - ignore version
Steve McIntyre [Thu, 25 Oct 2018 16:02:36 +0000 (17:02 +0100)]
Tighten the missing build-deps match - ignore version

19 months agoCosmetic tweaks
Steve McIntyre [Thu, 25 Oct 2018 15:21:11 +0000 (16:21 +0100)]
Cosmetic tweaks

19 months agoAdd an anchor link to the Summary section
Steve McIntyre [Thu, 25 Oct 2018 15:15:38 +0000 (16:15 +0100)]
Add an anchor link to the Summary section

19 months agoSort the summary output
Steve McIntyre [Thu, 25 Oct 2018 15:11:19 +0000 (16:11 +0100)]
Sort the summary output

19 months agoMatch more specific failures
Steve McIntyre [Thu, 25 Oct 2018 14:42:20 +0000 (15:42 +0100)]
Match more specific failures

19 months agoAdd support for logging some of what was matched in our scan
Steve McIntyre [Thu, 25 Oct 2018 14:20:30 +0000 (15:20 +0100)]
Add support for logging some of what was matched in our scan

Rather than just "build-deps failed", say what was missing if we can
work it out.

19 months agoMake single-line matches faster
Steve McIntyre [Thu, 25 Oct 2018 14:19:03 +0000 (15:19 +0100)]
Make single-line matches faster

Only consider matching the previous line if we need to, rather than
always matching with .*

19 months agoMore verbose logging of timeouts
Steve McIntyre [Wed, 24 Oct 2018 23:20:31 +0000 (00:20 +0100)]
More verbose logging of timeouts

19 months agoDon't append to the .running file, not needed
Steve McIntyre [Wed, 24 Oct 2018 23:14:20 +0000 (00:14 +0100)]
Don't append to the .running file, not needed

Just redirect straight

19 months agoDetect misidentified architecture on the build system
Steve McIntyre [Wed, 24 Oct 2018 22:34:03 +0000 (23:34 +0100)]
Detect misidentified architecture on the build system

19 months agoFix broken regexp for BTS
Steve McIntyre [Wed, 24 Oct 2018 22:22:49 +0000 (23:22 +0100)]
Fix broken regexp for BTS

19 months agoBe more explicit about pbuilder dep resolution failing
Steve McIntyre [Wed, 24 Oct 2018 22:21:24 +0000 (23:21 +0100)]
Be more explicit about pbuilder dep resolution failing

19 months agoList sbuild and pbuilder timeouts separately
Steve McIntyre [Wed, 24 Oct 2018 22:13:22 +0000 (23:13 +0100)]
List sbuild and pbuilder timeouts separately

19 months agoPick up on EPERM errors, seeing quite a few
Steve McIntyre [Wed, 24 Oct 2018 22:13:01 +0000 (23:13 +0100)]
Pick up on EPERM errors, seeing quite a few

19 months agoMatch java errors reported by gradle
Steve McIntyre [Wed, 24 Oct 2018 22:11:10 +0000 (23:11 +0100)]
Match java errors reported by gradle

19 months agoMatch build timeouts reported but sbuild
Steve McIntyre [Wed, 24 Oct 2018 17:48:31 +0000 (18:48 +0100)]
Match build timeouts reported but sbuild

19 months agoCheck for dh_auto_test reporting test failure
Steve McIntyre [Wed, 24 Oct 2018 17:14:00 +0000 (18:14 +0100)]
Check for dh_auto_test reporting test failure

19 months agoschroot really cares about ownership of its config
Steve McIntyre [Wed, 24 Oct 2018 16:44:14 +0000 (17:44 +0100)]
schroot really cares about ownership of its config

19 months agoAdd support for notes from manual analysis
Steve McIntyre [Wed, 24 Oct 2018 16:24:43 +0000 (17:24 +0100)]
Add support for notes from manual analysis

Look for a .note file to match the .log file
If found, grab the text.
Check for know BTS entries referenced there too

19 months agoClose log file too
Steve McIntyre [Wed, 24 Oct 2018 16:07:39 +0000 (17:07 +0100)]
Close log file too

19 months agoPick up on make errors from debian/rules
Steve McIntyre [Wed, 24 Oct 2018 16:01:15 +0000 (17:01 +0100)]
Pick up on make errors from debian/rules

19 months agoStop saving FAIL_SOURCE logs separately
Steve McIntyre [Wed, 24 Oct 2018 15:37:29 +0000 (16:37 +0100)]
Stop saving FAIL_SOURCE logs separately

We'll be analysing them all together anyway

19 months agoadd a state file to help track what's building where
Steve McIntyre [Wed, 24 Oct 2018 15:03:40 +0000 (15:03 +0000)]
add a state file to help track what's building where

19 months agoInitial commit of build scripts and config
Steve McIntyre [Tue, 23 Oct 2018 17:30:33 +0000 (17:30 +0000)]
Initial commit of build scripts and config