buildd-scripts.git
21 months agoQuery buildd.d.o for details about failed packages
Steve McIntyre [Sat, 22 Dec 2018 00:07:38 +0000 (00:07 +0000)]
Query buildd.d.o for details about failed packages

Let's help with analysis - see what's already happened, or if the
package is meant to build on our arch

21 months agoTweak existing_bugs output
Steve McIntyre [Thu, 20 Dec 2018 21:27:56 +0000 (21:27 +0000)]
Tweak existing_bugs output

21 months agoAdd option to parse a list of known FTBFS bugs from UDD
Steve McIntyre [Thu, 20 Dec 2018 18:10:20 +0000 (18:10 +0000)]
Add option to parse a list of known FTBFS bugs from UDD

Helmut's script gives nice input. Save time on analysis where we can.

21 months agoAdd Helmut's lovely UDD script
Steve McIntyre [Thu, 20 Dec 2018 17:20:05 +0000 (17:20 +0000)]
Add Helmut's lovely UDD script

21 months agoreportbug wrapper and template file for filing alignment bugs
Steve McIntyre [Thu, 20 Dec 2018 16:01:15 +0000 (16:01 +0000)]
reportbug wrapper and template file for filing alignment bugs

21 months agoCheck the logfile exists
Steve McIntyre [Thu, 20 Dec 2018 16:01:01 +0000 (16:01 +0000)]
Check the logfile exists

21 months agoNew helper script
Steve McIntyre [Thu, 20 Dec 2018 15:49:42 +0000 (15:49 +0000)]
New helper script

Tage a source package as already removed from unstable, based on the
logfile we already have.

21 months agoSwitch ordering of two matches
Steve McIntyre [Thu, 20 Dec 2018 13:44:45 +0000 (13:44 +0000)]
Switch ordering of two matches

Reduce duplicate matches

21 months agoTrack what logs still need analysis
Steve McIntyre [Wed, 19 Dec 2018 16:40:04 +0000 (16:40 +0000)]
Track what logs still need analysis

If we have a .note file, or it's a common category like missing
build-dep then don't worry about analysis.

21 months agoAdd text to help track what things need looking at
Steve McIntyre [Wed, 19 Dec 2018 16:25:27 +0000 (16:25 +0000)]
Add text to help track what things need looking at

22 months agoSeparate out build and out dirs by arch too
Steve McIntyre [Thu, 15 Nov 2018 13:27:51 +0000 (13:27 +0000)]
Separate out build and out dirs by arch too

22 months agoAdd a new helper script requeue_by_log
Steve McIntyre [Thu, 15 Nov 2018 13:10:58 +0000 (13:10 +0000)]
Add a new helper script requeue_by_log

22 months agoGah, cut and paste from test script failed
Steve McIntyre [Tue, 6 Nov 2018 18:03:31 +0000 (18:03 +0000)]
Gah, cut and paste from test script failed

22 months agoFix log message
Steve McIntyre [Tue, 6 Nov 2018 17:01:09 +0000 (17:01 +0000)]
Fix log message

22 months agoDon't reset the counter every loop
Steve McIntyre [Tue, 6 Nov 2018 17:00:12 +0000 (17:00 +0000)]
Don't reset the counter every loop

22 months agoDetect if our script file has been changed and restart
Steve McIntyre [Tue, 6 Nov 2018 16:58:36 +0000 (16:58 +0000)]
Detect if our script file has been changed and restart

Can happen if we have more than one instance running

22 months agoSlow down polling for jobs after we've been idle a while
Steve McIntyre [Tue, 6 Nov 2018 16:28:43 +0000 (16:28 +0000)]
Slow down polling for jobs after we've been idle a while

22 months agoLoosen the match for dpkg-buildpackage
Steve McIntyre [Mon, 29 Oct 2018 23:44:01 +0000 (23:44 +0000)]
Loosen the match for dpkg-buildpackage

Pick up on "fakeroot foo" too

22 months agoAdd match for missing source package
Steve McIntyre [Mon, 29 Oct 2018 23:11:26 +0000 (23:11 +0000)]
Add match for missing source package

22 months agoDeal with whitespace from the hostname command
Steve McIntyre [Mon, 29 Oct 2018 17:54:02 +0000 (17:54 +0000)]
Deal with whitespace from the hostname command

22 months agoAdd more error matches
Steve McIntyre [Mon, 29 Oct 2018 17:41:15 +0000 (17:41 +0000)]
Add more error matches

22 months agoPick up on broken build-conflicts
Steve McIntyre [Mon, 29 Oct 2018 17:27:23 +0000 (17:27 +0000)]
Pick up on broken build-conflicts

22 months agoAdd parentheses for clarity
Steve McIntyre [Mon, 29 Oct 2018 17:27:03 +0000 (17:27 +0000)]
Add parentheses for clarity

22 months agoGrab the failed target name if we can
Steve McIntyre [Mon, 29 Oct 2018 17:07:39 +0000 (17:07 +0000)]
Grab the failed target name if we can

22 months agoMore tweaks to match rules
Steve McIntyre [Mon, 29 Oct 2018 17:03:10 +0000 (17:03 +0000)]
More tweaks to match rules

22 months agoAdd some boilerplate
Steve McIntyre [Mon, 29 Oct 2018 16:32:47 +0000 (16:32 +0000)]
Add some boilerplate

Copyright headers etc.
Also add a footer showing information and metadata from our run

22 months agoClassify errors found into groups
Steve McIntyre [Mon, 29 Oct 2018 15:27:01 +0000 (15:27 +0000)]
Classify errors found into groups

And then sort by group in the summary

22 months agoAdd a timestamp on the "nothing to do" message
Steve McIntyre [Mon, 29 Oct 2018 11:43:16 +0000 (11:43 +0000)]
Add a timestamp on the "nothing to do" message

22 months agoReduce noise from apt
Steve McIntyre [Mon, 29 Oct 2018 11:41:44 +0000 (11:41 +0000)]
Reduce noise from apt

22 months agoMake get_package less noisy when there are no jobs
Steve McIntyre [Mon, 29 Oct 2018 11:41:22 +0000 (11:41 +0000)]
Make get_package less noisy when there are no jobs

22 months agoFix up perms for chroot.d better
Steve McIntyre [Mon, 29 Oct 2018 11:18:54 +0000 (11:18 +0000)]
Fix up perms for chroot.d better

Don't sync into place directly and then fix up - sync to an incoming
location, then use install to make sure perms are right.

22 months agoDisable the binutils-aarch64 match, seeing false positives
Steve McIntyre [Mon, 29 Oct 2018 11:05:38 +0000 (11:05 +0000)]
Disable the binutils-aarch64 match, seeing false positives

22 months agoRemove the post-build-commands; not using any more
Steve McIntyre [Mon, 29 Oct 2018 01:26:19 +0000 (01:26 +0000)]
Remove the post-build-commands; not using any more

22 months agoFix java message
Steve McIntyre [Mon, 29 Oct 2018 01:25:51 +0000 (01:25 +0000)]
Fix java message

22 months agoSwitch on emulation for CP15 barriers for all builds
Steve McIntyre [Fri, 26 Oct 2018 18:38:42 +0000 (19:38 +0100)]
Switch on emulation for CP15 barriers for all builds

22 months agoAdd post-failed-build-commands to grab core dumps
Steve McIntyre [Fri, 26 Oct 2018 18:36:47 +0000 (19:36 +0100)]
Add post-failed-build-commands to grab core dumps

Depends on my locally-patched sbuild to work, for now

22 months agoRemove the pbuilder code
Steve McIntyre [Fri, 26 Oct 2018 15:41:52 +0000 (16:41 +0100)]
Remove the pbuilder code

It's commented out. Remove now:

 * we're in git anyway
 * not going back...

22 months agoAutomatically grab and save core dumps if any are generated
Steve McIntyre [Fri, 26 Oct 2018 15:34:13 +0000 (16:34 +0100)]
Automatically grab and save core dumps if any are generated

22 months agoSet the temp dirs to be owned by sbuild
Steve McIntyre [Fri, 26 Oct 2018 13:52:29 +0000 (14:52 +0100)]
Set the temp dirs to be owned by sbuild

22 months agoCall the new ulimit wrapper script inside the schroot
Steve McIntyre [Fri, 26 Oct 2018 12:53:06 +0000 (13:53 +0100)]
Call the new ulimit wrapper script inside the schroot

22 months agoModofy the sbuild/schroot fstab setup
Steve McIntyre [Fri, 26 Oct 2018 12:50:08 +0000 (13:50 +0100)]
Modofy the sbuild/schroot fstab setup

Bind-mount /chroot/rebuildd/sbuild/build for build space

Also bind-mount /etc/schroot/extra, the location of our ulimit wrapper
script

22 months agoAdd a wrapper script to turn on core dumps via ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:49:22 +0000 (13:49 +0100)]
Add a wrapper script to turn on core dumps via ulimit

22 months agoAdd a starting-build-command to call ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:45:39 +0000 (13:45 +0100)]
Add a starting-build-command to call ulimit

22 months agoMake sure we're running with linux32
Steve McIntyre [Thu, 25 Oct 2018 21:47:34 +0000 (22:47 +0100)]
Make sure we're running with linux32

22 months agoCheck for cockups in the schroot setup
Steve McIntyre [Thu, 25 Oct 2018 17:10:07 +0000 (18:10 +0100)]
Check for cockups in the schroot setup

22 months agoMake sure we're in the queue directory
Steve McIntyre [Thu, 25 Oct 2018 17:06:47 +0000 (18:06 +0100)]
Make sure we're in the queue directory

22 months agoTighten the missing build-deps match - ignore version
Steve McIntyre [Thu, 25 Oct 2018 16:02:36 +0000 (17:02 +0100)]
Tighten the missing build-deps match - ignore version

22 months agoCosmetic tweaks
Steve McIntyre [Thu, 25 Oct 2018 15:21:11 +0000 (16:21 +0100)]
Cosmetic tweaks

22 months agoAdd an anchor link to the Summary section
Steve McIntyre [Thu, 25 Oct 2018 15:15:38 +0000 (16:15 +0100)]
Add an anchor link to the Summary section

22 months agoSort the summary output
Steve McIntyre [Thu, 25 Oct 2018 15:11:19 +0000 (16:11 +0100)]
Sort the summary output

22 months agoMatch more specific failures
Steve McIntyre [Thu, 25 Oct 2018 14:42:20 +0000 (15:42 +0100)]
Match more specific failures

22 months agoAdd support for logging some of what was matched in our scan
Steve McIntyre [Thu, 25 Oct 2018 14:20:30 +0000 (15:20 +0100)]
Add support for logging some of what was matched in our scan

Rather than just "build-deps failed", say what was missing if we can
work it out.

22 months agoMake single-line matches faster
Steve McIntyre [Thu, 25 Oct 2018 14:19:03 +0000 (15:19 +0100)]
Make single-line matches faster

Only consider matching the previous line if we need to, rather than
always matching with .*

22 months agoMore verbose logging of timeouts
Steve McIntyre [Wed, 24 Oct 2018 23:20:31 +0000 (00:20 +0100)]
More verbose logging of timeouts

22 months agoDon't append to the .running file, not needed
Steve McIntyre [Wed, 24 Oct 2018 23:14:20 +0000 (00:14 +0100)]
Don't append to the .running file, not needed

Just redirect straight

22 months agoDetect misidentified architecture on the build system
Steve McIntyre [Wed, 24 Oct 2018 22:34:03 +0000 (23:34 +0100)]
Detect misidentified architecture on the build system

22 months agoFix broken regexp for BTS
Steve McIntyre [Wed, 24 Oct 2018 22:22:49 +0000 (23:22 +0100)]
Fix broken regexp for BTS

22 months agoBe more explicit about pbuilder dep resolution failing
Steve McIntyre [Wed, 24 Oct 2018 22:21:24 +0000 (23:21 +0100)]
Be more explicit about pbuilder dep resolution failing

22 months agoList sbuild and pbuilder timeouts separately
Steve McIntyre [Wed, 24 Oct 2018 22:13:22 +0000 (23:13 +0100)]
List sbuild and pbuilder timeouts separately

22 months agoPick up on EPERM errors, seeing quite a few
Steve McIntyre [Wed, 24 Oct 2018 22:13:01 +0000 (23:13 +0100)]
Pick up on EPERM errors, seeing quite a few

22 months agoMatch java errors reported by gradle
Steve McIntyre [Wed, 24 Oct 2018 22:11:10 +0000 (23:11 +0100)]
Match java errors reported by gradle

22 months agoMatch build timeouts reported but sbuild
Steve McIntyre [Wed, 24 Oct 2018 17:48:31 +0000 (18:48 +0100)]
Match build timeouts reported but sbuild

22 months agoCheck for dh_auto_test reporting test failure
Steve McIntyre [Wed, 24 Oct 2018 17:14:00 +0000 (18:14 +0100)]
Check for dh_auto_test reporting test failure

22 months agoschroot really cares about ownership of its config
Steve McIntyre [Wed, 24 Oct 2018 16:44:14 +0000 (17:44 +0100)]
schroot really cares about ownership of its config

22 months agoAdd support for notes from manual analysis
Steve McIntyre [Wed, 24 Oct 2018 16:24:43 +0000 (17:24 +0100)]
Add support for notes from manual analysis

Look for a .note file to match the .log file
If found, grab the text.
Check for know BTS entries referenced there too

22 months agoClose log file too
Steve McIntyre [Wed, 24 Oct 2018 16:07:39 +0000 (17:07 +0100)]
Close log file too

22 months agoPick up on make errors from debian/rules
Steve McIntyre [Wed, 24 Oct 2018 16:01:15 +0000 (17:01 +0100)]
Pick up on make errors from debian/rules

22 months agoStop saving FAIL_SOURCE logs separately
Steve McIntyre [Wed, 24 Oct 2018 15:37:29 +0000 (16:37 +0100)]
Stop saving FAIL_SOURCE logs separately

We'll be analysing them all together anyway

22 months agoadd a state file to help track what's building where
Steve McIntyre [Wed, 24 Oct 2018 15:03:40 +0000 (15:03 +0000)]
add a state file to help track what's building where

22 months agoInitial commit of build scripts and config
Steve McIntyre [Tue, 23 Oct 2018 17:30:33 +0000 (17:30 +0000)]
Initial commit of build scripts and config