buildd-scripts.git
6 months agoAdd option to parse a list of known FTBFS bugs from UDD
Steve McIntyre [Thu, 20 Dec 2018 18:10:20 +0000 (18:10 +0000)]
Add option to parse a list of known FTBFS bugs from UDD

Helmut's script gives nice input. Save time on analysis where we can.

6 months agoAdd Helmut's lovely UDD script
Steve McIntyre [Thu, 20 Dec 2018 17:20:05 +0000 (17:20 +0000)]
Add Helmut's lovely UDD script

6 months agoreportbug wrapper and template file for filing alignment bugs
Steve McIntyre [Thu, 20 Dec 2018 16:01:15 +0000 (16:01 +0000)]
reportbug wrapper and template file for filing alignment bugs

6 months agoCheck the logfile exists
Steve McIntyre [Thu, 20 Dec 2018 16:01:01 +0000 (16:01 +0000)]
Check the logfile exists

6 months agoNew helper script
Steve McIntyre [Thu, 20 Dec 2018 15:49:42 +0000 (15:49 +0000)]
New helper script

Tage a source package as already removed from unstable, based on the
logfile we already have.

6 months agoSwitch ordering of two matches
Steve McIntyre [Thu, 20 Dec 2018 13:44:45 +0000 (13:44 +0000)]
Switch ordering of two matches

Reduce duplicate matches

6 months agoTrack what logs still need analysis
Steve McIntyre [Wed, 19 Dec 2018 16:40:04 +0000 (16:40 +0000)]
Track what logs still need analysis

If we have a .note file, or it's a common category like missing
build-dep then don't worry about analysis.

6 months agoAdd text to help track what things need looking at
Steve McIntyre [Wed, 19 Dec 2018 16:25:27 +0000 (16:25 +0000)]
Add text to help track what things need looking at

8 months agoSeparate out build and out dirs by arch too
Steve McIntyre [Thu, 15 Nov 2018 13:27:51 +0000 (13:27 +0000)]
Separate out build and out dirs by arch too

8 months agoAdd a new helper script requeue_by_log
Steve McIntyre [Thu, 15 Nov 2018 13:10:58 +0000 (13:10 +0000)]
Add a new helper script requeue_by_log

8 months agoGah, cut and paste from test script failed
Steve McIntyre [Tue, 6 Nov 2018 18:03:31 +0000 (18:03 +0000)]
Gah, cut and paste from test script failed

8 months agoFix log message
Steve McIntyre [Tue, 6 Nov 2018 17:01:09 +0000 (17:01 +0000)]
Fix log message

8 months agoDon't reset the counter every loop
Steve McIntyre [Tue, 6 Nov 2018 17:00:12 +0000 (17:00 +0000)]
Don't reset the counter every loop

8 months agoDetect if our script file has been changed and restart
Steve McIntyre [Tue, 6 Nov 2018 16:58:36 +0000 (16:58 +0000)]
Detect if our script file has been changed and restart

Can happen if we have more than one instance running

8 months agoSlow down polling for jobs after we've been idle a while
Steve McIntyre [Tue, 6 Nov 2018 16:28:43 +0000 (16:28 +0000)]
Slow down polling for jobs after we've been idle a while

8 months agoLoosen the match for dpkg-buildpackage
Steve McIntyre [Mon, 29 Oct 2018 23:44:01 +0000 (23:44 +0000)]
Loosen the match for dpkg-buildpackage

Pick up on "fakeroot foo" too

8 months agoAdd match for missing source package
Steve McIntyre [Mon, 29 Oct 2018 23:11:26 +0000 (23:11 +0000)]
Add match for missing source package

8 months agoDeal with whitespace from the hostname command
Steve McIntyre [Mon, 29 Oct 2018 17:54:02 +0000 (17:54 +0000)]
Deal with whitespace from the hostname command

8 months agoAdd more error matches
Steve McIntyre [Mon, 29 Oct 2018 17:41:15 +0000 (17:41 +0000)]
Add more error matches

8 months agoPick up on broken build-conflicts
Steve McIntyre [Mon, 29 Oct 2018 17:27:23 +0000 (17:27 +0000)]
Pick up on broken build-conflicts

8 months agoAdd parentheses for clarity
Steve McIntyre [Mon, 29 Oct 2018 17:27:03 +0000 (17:27 +0000)]
Add parentheses for clarity

8 months agoGrab the failed target name if we can
Steve McIntyre [Mon, 29 Oct 2018 17:07:39 +0000 (17:07 +0000)]
Grab the failed target name if we can

8 months agoMore tweaks to match rules
Steve McIntyre [Mon, 29 Oct 2018 17:03:10 +0000 (17:03 +0000)]
More tweaks to match rules

8 months agoAdd some boilerplate
Steve McIntyre [Mon, 29 Oct 2018 16:32:47 +0000 (16:32 +0000)]
Add some boilerplate

Copyright headers etc.
Also add a footer showing information and metadata from our run

8 months agoClassify errors found into groups
Steve McIntyre [Mon, 29 Oct 2018 15:27:01 +0000 (15:27 +0000)]
Classify errors found into groups

And then sort by group in the summary

8 months agoAdd a timestamp on the "nothing to do" message
Steve McIntyre [Mon, 29 Oct 2018 11:43:16 +0000 (11:43 +0000)]
Add a timestamp on the "nothing to do" message

8 months agoReduce noise from apt
Steve McIntyre [Mon, 29 Oct 2018 11:41:44 +0000 (11:41 +0000)]
Reduce noise from apt

8 months agoMake get_package less noisy when there are no jobs
Steve McIntyre [Mon, 29 Oct 2018 11:41:22 +0000 (11:41 +0000)]
Make get_package less noisy when there are no jobs

8 months agoFix up perms for chroot.d better
Steve McIntyre [Mon, 29 Oct 2018 11:18:54 +0000 (11:18 +0000)]
Fix up perms for chroot.d better

Don't sync into place directly and then fix up - sync to an incoming
location, then use install to make sure perms are right.

8 months agoDisable the binutils-aarch64 match, seeing false positives
Steve McIntyre [Mon, 29 Oct 2018 11:05:38 +0000 (11:05 +0000)]
Disable the binutils-aarch64 match, seeing false positives

8 months agoRemove the post-build-commands; not using any more
Steve McIntyre [Mon, 29 Oct 2018 01:26:19 +0000 (01:26 +0000)]
Remove the post-build-commands; not using any more

8 months agoFix java message
Steve McIntyre [Mon, 29 Oct 2018 01:25:51 +0000 (01:25 +0000)]
Fix java message

8 months agoSwitch on emulation for CP15 barriers for all builds
Steve McIntyre [Fri, 26 Oct 2018 18:38:42 +0000 (19:38 +0100)]
Switch on emulation for CP15 barriers for all builds

8 months agoAdd post-failed-build-commands to grab core dumps
Steve McIntyre [Fri, 26 Oct 2018 18:36:47 +0000 (19:36 +0100)]
Add post-failed-build-commands to grab core dumps

Depends on my locally-patched sbuild to work, for now

8 months agoRemove the pbuilder code
Steve McIntyre [Fri, 26 Oct 2018 15:41:52 +0000 (16:41 +0100)]
Remove the pbuilder code

It's commented out. Remove now:

 * we're in git anyway
 * not going back...

8 months agoAutomatically grab and save core dumps if any are generated
Steve McIntyre [Fri, 26 Oct 2018 15:34:13 +0000 (16:34 +0100)]
Automatically grab and save core dumps if any are generated

8 months agoSet the temp dirs to be owned by sbuild
Steve McIntyre [Fri, 26 Oct 2018 13:52:29 +0000 (14:52 +0100)]
Set the temp dirs to be owned by sbuild

8 months agoCall the new ulimit wrapper script inside the schroot
Steve McIntyre [Fri, 26 Oct 2018 12:53:06 +0000 (13:53 +0100)]
Call the new ulimit wrapper script inside the schroot

8 months agoModofy the sbuild/schroot fstab setup
Steve McIntyre [Fri, 26 Oct 2018 12:50:08 +0000 (13:50 +0100)]
Modofy the sbuild/schroot fstab setup

Bind-mount /chroot/rebuildd/sbuild/build for build space

Also bind-mount /etc/schroot/extra, the location of our ulimit wrapper
script

8 months agoAdd a wrapper script to turn on core dumps via ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:49:22 +0000 (13:49 +0100)]
Add a wrapper script to turn on core dumps via ulimit

8 months agoAdd a starting-build-command to call ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:45:39 +0000 (13:45 +0100)]
Add a starting-build-command to call ulimit

8 months agoMake sure we're running with linux32
Steve McIntyre [Thu, 25 Oct 2018 21:47:34 +0000 (22:47 +0100)]
Make sure we're running with linux32

8 months agoCheck for cockups in the schroot setup
Steve McIntyre [Thu, 25 Oct 2018 17:10:07 +0000 (18:10 +0100)]
Check for cockups in the schroot setup

8 months agoMake sure we're in the queue directory
Steve McIntyre [Thu, 25 Oct 2018 17:06:47 +0000 (18:06 +0100)]
Make sure we're in the queue directory

8 months agoTighten the missing build-deps match - ignore version
Steve McIntyre [Thu, 25 Oct 2018 16:02:36 +0000 (17:02 +0100)]
Tighten the missing build-deps match - ignore version

8 months agoCosmetic tweaks
Steve McIntyre [Thu, 25 Oct 2018 15:21:11 +0000 (16:21 +0100)]
Cosmetic tweaks

8 months agoAdd an anchor link to the Summary section
Steve McIntyre [Thu, 25 Oct 2018 15:15:38 +0000 (16:15 +0100)]
Add an anchor link to the Summary section

8 months agoSort the summary output
Steve McIntyre [Thu, 25 Oct 2018 15:11:19 +0000 (16:11 +0100)]
Sort the summary output

8 months agoMatch more specific failures
Steve McIntyre [Thu, 25 Oct 2018 14:42:20 +0000 (15:42 +0100)]
Match more specific failures

8 months agoAdd support for logging some of what was matched in our scan
Steve McIntyre [Thu, 25 Oct 2018 14:20:30 +0000 (15:20 +0100)]
Add support for logging some of what was matched in our scan

Rather than just "build-deps failed", say what was missing if we can
work it out.

8 months agoMake single-line matches faster
Steve McIntyre [Thu, 25 Oct 2018 14:19:03 +0000 (15:19 +0100)]
Make single-line matches faster

Only consider matching the previous line if we need to, rather than
always matching with .*

8 months agoMore verbose logging of timeouts
Steve McIntyre [Wed, 24 Oct 2018 23:20:31 +0000 (00:20 +0100)]
More verbose logging of timeouts

8 months agoDon't append to the .running file, not needed
Steve McIntyre [Wed, 24 Oct 2018 23:14:20 +0000 (00:14 +0100)]
Don't append to the .running file, not needed

Just redirect straight

8 months agoDetect misidentified architecture on the build system
Steve McIntyre [Wed, 24 Oct 2018 22:34:03 +0000 (23:34 +0100)]
Detect misidentified architecture on the build system

8 months agoFix broken regexp for BTS
Steve McIntyre [Wed, 24 Oct 2018 22:22:49 +0000 (23:22 +0100)]
Fix broken regexp for BTS

8 months agoBe more explicit about pbuilder dep resolution failing
Steve McIntyre [Wed, 24 Oct 2018 22:21:24 +0000 (23:21 +0100)]
Be more explicit about pbuilder dep resolution failing

8 months agoList sbuild and pbuilder timeouts separately
Steve McIntyre [Wed, 24 Oct 2018 22:13:22 +0000 (23:13 +0100)]
List sbuild and pbuilder timeouts separately

8 months agoPick up on EPERM errors, seeing quite a few
Steve McIntyre [Wed, 24 Oct 2018 22:13:01 +0000 (23:13 +0100)]
Pick up on EPERM errors, seeing quite a few

8 months agoMatch java errors reported by gradle
Steve McIntyre [Wed, 24 Oct 2018 22:11:10 +0000 (23:11 +0100)]
Match java errors reported by gradle

8 months agoMatch build timeouts reported but sbuild
Steve McIntyre [Wed, 24 Oct 2018 17:48:31 +0000 (18:48 +0100)]
Match build timeouts reported but sbuild

8 months agoCheck for dh_auto_test reporting test failure
Steve McIntyre [Wed, 24 Oct 2018 17:14:00 +0000 (18:14 +0100)]
Check for dh_auto_test reporting test failure

8 months agoschroot really cares about ownership of its config
Steve McIntyre [Wed, 24 Oct 2018 16:44:14 +0000 (17:44 +0100)]
schroot really cares about ownership of its config

8 months agoAdd support for notes from manual analysis
Steve McIntyre [Wed, 24 Oct 2018 16:24:43 +0000 (17:24 +0100)]
Add support for notes from manual analysis

Look for a .note file to match the .log file
If found, grab the text.
Check for know BTS entries referenced there too

8 months agoClose log file too
Steve McIntyre [Wed, 24 Oct 2018 16:07:39 +0000 (17:07 +0100)]
Close log file too

8 months agoPick up on make errors from debian/rules
Steve McIntyre [Wed, 24 Oct 2018 16:01:15 +0000 (17:01 +0100)]
Pick up on make errors from debian/rules

8 months agoStop saving FAIL_SOURCE logs separately
Steve McIntyre [Wed, 24 Oct 2018 15:37:29 +0000 (16:37 +0100)]
Stop saving FAIL_SOURCE logs separately

We'll be analysing them all together anyway

8 months agoadd a state file to help track what's building where
Steve McIntyre [Wed, 24 Oct 2018 15:03:40 +0000 (15:03 +0000)]
add a state file to help track what's building where

8 months agoInitial commit of build scripts and config
Steve McIntyre [Tue, 23 Oct 2018 17:30:33 +0000 (17:30 +0000)]
Initial commit of build scripts and config