buildd-scripts.git
11 months agoIgnore emacs backup files master
Steve McIntyre [Fri, 11 Jan 2019 15:55:53 +0000 (15:55 +0000)]
Ignore emacs backup files

11 months agoBe tighter on matching "SIGBUS"
Steve McIntyre [Sat, 5 Jan 2019 14:18:55 +0000 (14:18 +0000)]
Be tighter on matching "SIGBUS"

A few places mention SIGBUS in normal use. Instead, look for "signal
SIGBUS".

11 months agoHelper script to copy note files from one arch to another
Steve McIntyre [Mon, 31 Dec 2018 15:56:06 +0000 (15:56 +0000)]
Helper script to copy note files from one arch to another

11 months agoFix missing >
Steve McIntyre [Mon, 31 Dec 2018 05:18:19 +0000 (05:18 +0000)]
Fix missing >

11 months agoCosmetic tweaks for the bug filing data
Steve McIntyre [Mon, 31 Dec 2018 04:39:17 +0000 (04:39 +0000)]
Cosmetic tweaks for the bug filing data

11 months agoTally the new bugs filed
Steve McIntyre [Mon, 31 Dec 2018 03:49:59 +0000 (03:49 +0000)]
Tally the new bugs filed

11 months agoCatch another alignment fault message
Steve McIntyre [Sat, 29 Dec 2018 20:07:56 +0000 (20:07 +0000)]
Catch another alignment fault message

11 months agoCosmetic tweak
Steve McIntyre [Sat, 29 Dec 2018 19:37:00 +0000 (19:37 +0000)]
Cosmetic tweak

11 months agoUpdate count of logs needing analysis better
Steve McIntyre [Sat, 29 Dec 2018 18:04:55 +0000 (18:04 +0000)]
Update count of logs needing analysis better

If I've already added a .note file, don't count it!

11 months agoAdd better version tracking
Steve McIntyre [Sun, 23 Dec 2018 17:55:36 +0000 (17:55 +0000)]
Add better version tracking

Check on what versions have been built, including non-buildd all
packages.

11 months agoAdd new test for detecting integer overflow in go code
Steve McIntyre [Sun, 23 Dec 2018 16:07:01 +0000 (16:07 +0000)]
Add new test for detecting integer overflow in go code

11 months agoAdd helper for "never built on $ARCH" logs
Steve McIntyre [Sun, 23 Dec 2018 15:57:59 +0000 (15:57 +0000)]
Add helper for "never built on $ARCH" logs

11 months agoQuery buildd.d.o for details about failed packages
Steve McIntyre [Sat, 22 Dec 2018 00:07:38 +0000 (00:07 +0000)]
Query buildd.d.o for details about failed packages

Let's help with analysis - see what's already happened, or if the
package is meant to build on our arch

11 months agoTweak existing_bugs output
Steve McIntyre [Thu, 20 Dec 2018 21:27:56 +0000 (21:27 +0000)]
Tweak existing_bugs output

11 months agoAdd option to parse a list of known FTBFS bugs from UDD
Steve McIntyre [Thu, 20 Dec 2018 18:10:20 +0000 (18:10 +0000)]
Add option to parse a list of known FTBFS bugs from UDD

Helmut's script gives nice input. Save time on analysis where we can.

11 months agoAdd Helmut's lovely UDD script
Steve McIntyre [Thu, 20 Dec 2018 17:20:05 +0000 (17:20 +0000)]
Add Helmut's lovely UDD script

11 months agoreportbug wrapper and template file for filing alignment bugs
Steve McIntyre [Thu, 20 Dec 2018 16:01:15 +0000 (16:01 +0000)]
reportbug wrapper and template file for filing alignment bugs

11 months agoCheck the logfile exists
Steve McIntyre [Thu, 20 Dec 2018 16:01:01 +0000 (16:01 +0000)]
Check the logfile exists

11 months agoNew helper script
Steve McIntyre [Thu, 20 Dec 2018 15:49:42 +0000 (15:49 +0000)]
New helper script

Tage a source package as already removed from unstable, based on the
logfile we already have.

11 months agoSwitch ordering of two matches
Steve McIntyre [Thu, 20 Dec 2018 13:44:45 +0000 (13:44 +0000)]
Switch ordering of two matches

Reduce duplicate matches

11 months agoTrack what logs still need analysis
Steve McIntyre [Wed, 19 Dec 2018 16:40:04 +0000 (16:40 +0000)]
Track what logs still need analysis

If we have a .note file, or it's a common category like missing
build-dep then don't worry about analysis.

11 months agoAdd text to help track what things need looking at
Steve McIntyre [Wed, 19 Dec 2018 16:25:27 +0000 (16:25 +0000)]
Add text to help track what things need looking at

12 months agoSeparate out build and out dirs by arch too
Steve McIntyre [Thu, 15 Nov 2018 13:27:51 +0000 (13:27 +0000)]
Separate out build and out dirs by arch too

12 months agoAdd a new helper script requeue_by_log
Steve McIntyre [Thu, 15 Nov 2018 13:10:58 +0000 (13:10 +0000)]
Add a new helper script requeue_by_log

13 months agoGah, cut and paste from test script failed
Steve McIntyre [Tue, 6 Nov 2018 18:03:31 +0000 (18:03 +0000)]
Gah, cut and paste from test script failed

13 months agoFix log message
Steve McIntyre [Tue, 6 Nov 2018 17:01:09 +0000 (17:01 +0000)]
Fix log message

13 months agoDon't reset the counter every loop
Steve McIntyre [Tue, 6 Nov 2018 17:00:12 +0000 (17:00 +0000)]
Don't reset the counter every loop

13 months agoDetect if our script file has been changed and restart
Steve McIntyre [Tue, 6 Nov 2018 16:58:36 +0000 (16:58 +0000)]
Detect if our script file has been changed and restart

Can happen if we have more than one instance running

13 months agoSlow down polling for jobs after we've been idle a while
Steve McIntyre [Tue, 6 Nov 2018 16:28:43 +0000 (16:28 +0000)]
Slow down polling for jobs after we've been idle a while

13 months agoLoosen the match for dpkg-buildpackage
Steve McIntyre [Mon, 29 Oct 2018 23:44:01 +0000 (23:44 +0000)]
Loosen the match for dpkg-buildpackage

Pick up on "fakeroot foo" too

13 months agoAdd match for missing source package
Steve McIntyre [Mon, 29 Oct 2018 23:11:26 +0000 (23:11 +0000)]
Add match for missing source package

13 months agoDeal with whitespace from the hostname command
Steve McIntyre [Mon, 29 Oct 2018 17:54:02 +0000 (17:54 +0000)]
Deal with whitespace from the hostname command

13 months agoAdd more error matches
Steve McIntyre [Mon, 29 Oct 2018 17:41:15 +0000 (17:41 +0000)]
Add more error matches

13 months agoPick up on broken build-conflicts
Steve McIntyre [Mon, 29 Oct 2018 17:27:23 +0000 (17:27 +0000)]
Pick up on broken build-conflicts

13 months agoAdd parentheses for clarity
Steve McIntyre [Mon, 29 Oct 2018 17:27:03 +0000 (17:27 +0000)]
Add parentheses for clarity

13 months agoGrab the failed target name if we can
Steve McIntyre [Mon, 29 Oct 2018 17:07:39 +0000 (17:07 +0000)]
Grab the failed target name if we can

13 months agoMore tweaks to match rules
Steve McIntyre [Mon, 29 Oct 2018 17:03:10 +0000 (17:03 +0000)]
More tweaks to match rules

13 months agoAdd some boilerplate
Steve McIntyre [Mon, 29 Oct 2018 16:32:47 +0000 (16:32 +0000)]
Add some boilerplate

Copyright headers etc.
Also add a footer showing information and metadata from our run

13 months agoClassify errors found into groups
Steve McIntyre [Mon, 29 Oct 2018 15:27:01 +0000 (15:27 +0000)]
Classify errors found into groups

And then sort by group in the summary

13 months agoAdd a timestamp on the "nothing to do" message
Steve McIntyre [Mon, 29 Oct 2018 11:43:16 +0000 (11:43 +0000)]
Add a timestamp on the "nothing to do" message

13 months agoReduce noise from apt
Steve McIntyre [Mon, 29 Oct 2018 11:41:44 +0000 (11:41 +0000)]
Reduce noise from apt

13 months agoMake get_package less noisy when there are no jobs
Steve McIntyre [Mon, 29 Oct 2018 11:41:22 +0000 (11:41 +0000)]
Make get_package less noisy when there are no jobs

13 months agoFix up perms for chroot.d better
Steve McIntyre [Mon, 29 Oct 2018 11:18:54 +0000 (11:18 +0000)]
Fix up perms for chroot.d better

Don't sync into place directly and then fix up - sync to an incoming
location, then use install to make sure perms are right.

13 months agoDisable the binutils-aarch64 match, seeing false positives
Steve McIntyre [Mon, 29 Oct 2018 11:05:38 +0000 (11:05 +0000)]
Disable the binutils-aarch64 match, seeing false positives

13 months agoRemove the post-build-commands; not using any more
Steve McIntyre [Mon, 29 Oct 2018 01:26:19 +0000 (01:26 +0000)]
Remove the post-build-commands; not using any more

13 months agoFix java message
Steve McIntyre [Mon, 29 Oct 2018 01:25:51 +0000 (01:25 +0000)]
Fix java message

13 months agoSwitch on emulation for CP15 barriers for all builds
Steve McIntyre [Fri, 26 Oct 2018 18:38:42 +0000 (19:38 +0100)]
Switch on emulation for CP15 barriers for all builds

13 months agoAdd post-failed-build-commands to grab core dumps
Steve McIntyre [Fri, 26 Oct 2018 18:36:47 +0000 (19:36 +0100)]
Add post-failed-build-commands to grab core dumps

Depends on my locally-patched sbuild to work, for now

13 months agoRemove the pbuilder code
Steve McIntyre [Fri, 26 Oct 2018 15:41:52 +0000 (16:41 +0100)]
Remove the pbuilder code

It's commented out. Remove now:

 * we're in git anyway
 * not going back...

13 months agoAutomatically grab and save core dumps if any are generated
Steve McIntyre [Fri, 26 Oct 2018 15:34:13 +0000 (16:34 +0100)]
Automatically grab and save core dumps if any are generated

13 months agoSet the temp dirs to be owned by sbuild
Steve McIntyre [Fri, 26 Oct 2018 13:52:29 +0000 (14:52 +0100)]
Set the temp dirs to be owned by sbuild

13 months agoCall the new ulimit wrapper script inside the schroot
Steve McIntyre [Fri, 26 Oct 2018 12:53:06 +0000 (13:53 +0100)]
Call the new ulimit wrapper script inside the schroot

13 months agoModofy the sbuild/schroot fstab setup
Steve McIntyre [Fri, 26 Oct 2018 12:50:08 +0000 (13:50 +0100)]
Modofy the sbuild/schroot fstab setup

Bind-mount /chroot/rebuildd/sbuild/build for build space

Also bind-mount /etc/schroot/extra, the location of our ulimit wrapper
script

13 months agoAdd a wrapper script to turn on core dumps via ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:49:22 +0000 (13:49 +0100)]
Add a wrapper script to turn on core dumps via ulimit

13 months agoAdd a starting-build-command to call ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:45:39 +0000 (13:45 +0100)]
Add a starting-build-command to call ulimit

13 months agoMake sure we're running with linux32
Steve McIntyre [Thu, 25 Oct 2018 21:47:34 +0000 (22:47 +0100)]
Make sure we're running with linux32

13 months agoCheck for cockups in the schroot setup
Steve McIntyre [Thu, 25 Oct 2018 17:10:07 +0000 (18:10 +0100)]
Check for cockups in the schroot setup

13 months agoMake sure we're in the queue directory
Steve McIntyre [Thu, 25 Oct 2018 17:06:47 +0000 (18:06 +0100)]
Make sure we're in the queue directory

13 months agoTighten the missing build-deps match - ignore version
Steve McIntyre [Thu, 25 Oct 2018 16:02:36 +0000 (17:02 +0100)]
Tighten the missing build-deps match - ignore version

13 months agoCosmetic tweaks
Steve McIntyre [Thu, 25 Oct 2018 15:21:11 +0000 (16:21 +0100)]
Cosmetic tweaks

13 months agoAdd an anchor link to the Summary section
Steve McIntyre [Thu, 25 Oct 2018 15:15:38 +0000 (16:15 +0100)]
Add an anchor link to the Summary section

13 months agoSort the summary output
Steve McIntyre [Thu, 25 Oct 2018 15:11:19 +0000 (16:11 +0100)]
Sort the summary output

13 months agoMatch more specific failures
Steve McIntyre [Thu, 25 Oct 2018 14:42:20 +0000 (15:42 +0100)]
Match more specific failures

13 months agoAdd support for logging some of what was matched in our scan
Steve McIntyre [Thu, 25 Oct 2018 14:20:30 +0000 (15:20 +0100)]
Add support for logging some of what was matched in our scan

Rather than just "build-deps failed", say what was missing if we can
work it out.

13 months agoMake single-line matches faster
Steve McIntyre [Thu, 25 Oct 2018 14:19:03 +0000 (15:19 +0100)]
Make single-line matches faster

Only consider matching the previous line if we need to, rather than
always matching with .*

13 months agoMore verbose logging of timeouts
Steve McIntyre [Wed, 24 Oct 2018 23:20:31 +0000 (00:20 +0100)]
More verbose logging of timeouts

13 months agoDon't append to the .running file, not needed
Steve McIntyre [Wed, 24 Oct 2018 23:14:20 +0000 (00:14 +0100)]
Don't append to the .running file, not needed

Just redirect straight

13 months agoDetect misidentified architecture on the build system
Steve McIntyre [Wed, 24 Oct 2018 22:34:03 +0000 (23:34 +0100)]
Detect misidentified architecture on the build system

13 months agoFix broken regexp for BTS
Steve McIntyre [Wed, 24 Oct 2018 22:22:49 +0000 (23:22 +0100)]
Fix broken regexp for BTS

13 months agoBe more explicit about pbuilder dep resolution failing
Steve McIntyre [Wed, 24 Oct 2018 22:21:24 +0000 (23:21 +0100)]
Be more explicit about pbuilder dep resolution failing

13 months agoList sbuild and pbuilder timeouts separately
Steve McIntyre [Wed, 24 Oct 2018 22:13:22 +0000 (23:13 +0100)]
List sbuild and pbuilder timeouts separately

13 months agoPick up on EPERM errors, seeing quite a few
Steve McIntyre [Wed, 24 Oct 2018 22:13:01 +0000 (23:13 +0100)]
Pick up on EPERM errors, seeing quite a few

13 months agoMatch java errors reported by gradle
Steve McIntyre [Wed, 24 Oct 2018 22:11:10 +0000 (23:11 +0100)]
Match java errors reported by gradle

13 months agoMatch build timeouts reported but sbuild
Steve McIntyre [Wed, 24 Oct 2018 17:48:31 +0000 (18:48 +0100)]
Match build timeouts reported but sbuild

13 months agoCheck for dh_auto_test reporting test failure
Steve McIntyre [Wed, 24 Oct 2018 17:14:00 +0000 (18:14 +0100)]
Check for dh_auto_test reporting test failure

13 months agoschroot really cares about ownership of its config
Steve McIntyre [Wed, 24 Oct 2018 16:44:14 +0000 (17:44 +0100)]
schroot really cares about ownership of its config

13 months agoAdd support for notes from manual analysis
Steve McIntyre [Wed, 24 Oct 2018 16:24:43 +0000 (17:24 +0100)]
Add support for notes from manual analysis

Look for a .note file to match the .log file
If found, grab the text.
Check for know BTS entries referenced there too

13 months agoClose log file too
Steve McIntyre [Wed, 24 Oct 2018 16:07:39 +0000 (17:07 +0100)]
Close log file too

13 months agoPick up on make errors from debian/rules
Steve McIntyre [Wed, 24 Oct 2018 16:01:15 +0000 (17:01 +0100)]
Pick up on make errors from debian/rules

13 months agoStop saving FAIL_SOURCE logs separately
Steve McIntyre [Wed, 24 Oct 2018 15:37:29 +0000 (16:37 +0100)]
Stop saving FAIL_SOURCE logs separately

We'll be analysing them all together anyway

13 months agoadd a state file to help track what's building where
Steve McIntyre [Wed, 24 Oct 2018 15:03:40 +0000 (15:03 +0000)]
add a state file to help track what's building where

13 months agoInitial commit of build scripts and config
Steve McIntyre [Tue, 23 Oct 2018 17:30:33 +0000 (17:30 +0000)]
Initial commit of build scripts and config