buildd-scripts.git
5 months agoIgnore emacs backup files master
Steve McIntyre [Fri, 11 Jan 2019 15:55:53 +0000 (15:55 +0000)]
Ignore emacs backup files

5 months agoBe tighter on matching "SIGBUS"
Steve McIntyre [Sat, 5 Jan 2019 14:18:55 +0000 (14:18 +0000)]
Be tighter on matching "SIGBUS"

A few places mention SIGBUS in normal use. Instead, look for "signal
SIGBUS".

5 months agoHelper script to copy note files from one arch to another
Steve McIntyre [Mon, 31 Dec 2018 15:56:06 +0000 (15:56 +0000)]
Helper script to copy note files from one arch to another

5 months agoFix missing >
Steve McIntyre [Mon, 31 Dec 2018 05:18:19 +0000 (05:18 +0000)]
Fix missing >

5 months agoCosmetic tweaks for the bug filing data
Steve McIntyre [Mon, 31 Dec 2018 04:39:17 +0000 (04:39 +0000)]
Cosmetic tweaks for the bug filing data

5 months agoTally the new bugs filed
Steve McIntyre [Mon, 31 Dec 2018 03:49:59 +0000 (03:49 +0000)]
Tally the new bugs filed

5 months agoCatch another alignment fault message
Steve McIntyre [Sat, 29 Dec 2018 20:07:56 +0000 (20:07 +0000)]
Catch another alignment fault message

5 months agoCosmetic tweak
Steve McIntyre [Sat, 29 Dec 2018 19:37:00 +0000 (19:37 +0000)]
Cosmetic tweak

5 months agoUpdate count of logs needing analysis better
Steve McIntyre [Sat, 29 Dec 2018 18:04:55 +0000 (18:04 +0000)]
Update count of logs needing analysis better

If I've already added a .note file, don't count it!

5 months agoAdd better version tracking
Steve McIntyre [Sun, 23 Dec 2018 17:55:36 +0000 (17:55 +0000)]
Add better version tracking

Check on what versions have been built, including non-buildd all
packages.

5 months agoAdd new test for detecting integer overflow in go code
Steve McIntyre [Sun, 23 Dec 2018 16:07:01 +0000 (16:07 +0000)]
Add new test for detecting integer overflow in go code

5 months agoAdd helper for "never built on $ARCH" logs
Steve McIntyre [Sun, 23 Dec 2018 15:57:59 +0000 (15:57 +0000)]
Add helper for "never built on $ARCH" logs

5 months agoQuery buildd.d.o for details about failed packages
Steve McIntyre [Sat, 22 Dec 2018 00:07:38 +0000 (00:07 +0000)]
Query buildd.d.o for details about failed packages

Let's help with analysis - see what's already happened, or if the
package is meant to build on our arch

5 months agoTweak existing_bugs output
Steve McIntyre [Thu, 20 Dec 2018 21:27:56 +0000 (21:27 +0000)]
Tweak existing_bugs output

5 months agoAdd option to parse a list of known FTBFS bugs from UDD
Steve McIntyre [Thu, 20 Dec 2018 18:10:20 +0000 (18:10 +0000)]
Add option to parse a list of known FTBFS bugs from UDD

Helmut's script gives nice input. Save time on analysis where we can.

5 months agoAdd Helmut's lovely UDD script
Steve McIntyre [Thu, 20 Dec 2018 17:20:05 +0000 (17:20 +0000)]
Add Helmut's lovely UDD script

5 months agoreportbug wrapper and template file for filing alignment bugs
Steve McIntyre [Thu, 20 Dec 2018 16:01:15 +0000 (16:01 +0000)]
reportbug wrapper and template file for filing alignment bugs

5 months agoCheck the logfile exists
Steve McIntyre [Thu, 20 Dec 2018 16:01:01 +0000 (16:01 +0000)]
Check the logfile exists

5 months agoNew helper script
Steve McIntyre [Thu, 20 Dec 2018 15:49:42 +0000 (15:49 +0000)]
New helper script

Tage a source package as already removed from unstable, based on the
logfile we already have.

5 months agoSwitch ordering of two matches
Steve McIntyre [Thu, 20 Dec 2018 13:44:45 +0000 (13:44 +0000)]
Switch ordering of two matches

Reduce duplicate matches

5 months agoTrack what logs still need analysis
Steve McIntyre [Wed, 19 Dec 2018 16:40:04 +0000 (16:40 +0000)]
Track what logs still need analysis

If we have a .note file, or it's a common category like missing
build-dep then don't worry about analysis.

5 months agoAdd text to help track what things need looking at
Steve McIntyre [Wed, 19 Dec 2018 16:25:27 +0000 (16:25 +0000)]
Add text to help track what things need looking at

7 months agoSeparate out build and out dirs by arch too
Steve McIntyre [Thu, 15 Nov 2018 13:27:51 +0000 (13:27 +0000)]
Separate out build and out dirs by arch too

7 months agoAdd a new helper script requeue_by_log
Steve McIntyre [Thu, 15 Nov 2018 13:10:58 +0000 (13:10 +0000)]
Add a new helper script requeue_by_log

7 months agoGah, cut and paste from test script failed
Steve McIntyre [Tue, 6 Nov 2018 18:03:31 +0000 (18:03 +0000)]
Gah, cut and paste from test script failed

7 months agoFix log message
Steve McIntyre [Tue, 6 Nov 2018 17:01:09 +0000 (17:01 +0000)]
Fix log message

7 months agoDon't reset the counter every loop
Steve McIntyre [Tue, 6 Nov 2018 17:00:12 +0000 (17:00 +0000)]
Don't reset the counter every loop

7 months agoDetect if our script file has been changed and restart
Steve McIntyre [Tue, 6 Nov 2018 16:58:36 +0000 (16:58 +0000)]
Detect if our script file has been changed and restart

Can happen if we have more than one instance running

7 months agoSlow down polling for jobs after we've been idle a while
Steve McIntyre [Tue, 6 Nov 2018 16:28:43 +0000 (16:28 +0000)]
Slow down polling for jobs after we've been idle a while

7 months agoLoosen the match for dpkg-buildpackage
Steve McIntyre [Mon, 29 Oct 2018 23:44:01 +0000 (23:44 +0000)]
Loosen the match for dpkg-buildpackage

Pick up on "fakeroot foo" too

7 months agoAdd match for missing source package
Steve McIntyre [Mon, 29 Oct 2018 23:11:26 +0000 (23:11 +0000)]
Add match for missing source package

7 months agoDeal with whitespace from the hostname command
Steve McIntyre [Mon, 29 Oct 2018 17:54:02 +0000 (17:54 +0000)]
Deal with whitespace from the hostname command

7 months agoAdd more error matches
Steve McIntyre [Mon, 29 Oct 2018 17:41:15 +0000 (17:41 +0000)]
Add more error matches

7 months agoPick up on broken build-conflicts
Steve McIntyre [Mon, 29 Oct 2018 17:27:23 +0000 (17:27 +0000)]
Pick up on broken build-conflicts

7 months agoAdd parentheses for clarity
Steve McIntyre [Mon, 29 Oct 2018 17:27:03 +0000 (17:27 +0000)]
Add parentheses for clarity

7 months agoGrab the failed target name if we can
Steve McIntyre [Mon, 29 Oct 2018 17:07:39 +0000 (17:07 +0000)]
Grab the failed target name if we can

7 months agoMore tweaks to match rules
Steve McIntyre [Mon, 29 Oct 2018 17:03:10 +0000 (17:03 +0000)]
More tweaks to match rules

7 months agoAdd some boilerplate
Steve McIntyre [Mon, 29 Oct 2018 16:32:47 +0000 (16:32 +0000)]
Add some boilerplate

Copyright headers etc.
Also add a footer showing information and metadata from our run

7 months agoClassify errors found into groups
Steve McIntyre [Mon, 29 Oct 2018 15:27:01 +0000 (15:27 +0000)]
Classify errors found into groups

And then sort by group in the summary

7 months agoAdd a timestamp on the "nothing to do" message
Steve McIntyre [Mon, 29 Oct 2018 11:43:16 +0000 (11:43 +0000)]
Add a timestamp on the "nothing to do" message

7 months agoReduce noise from apt
Steve McIntyre [Mon, 29 Oct 2018 11:41:44 +0000 (11:41 +0000)]
Reduce noise from apt

7 months agoMake get_package less noisy when there are no jobs
Steve McIntyre [Mon, 29 Oct 2018 11:41:22 +0000 (11:41 +0000)]
Make get_package less noisy when there are no jobs

7 months agoFix up perms for chroot.d better
Steve McIntyre [Mon, 29 Oct 2018 11:18:54 +0000 (11:18 +0000)]
Fix up perms for chroot.d better

Don't sync into place directly and then fix up - sync to an incoming
location, then use install to make sure perms are right.

7 months agoDisable the binutils-aarch64 match, seeing false positives
Steve McIntyre [Mon, 29 Oct 2018 11:05:38 +0000 (11:05 +0000)]
Disable the binutils-aarch64 match, seeing false positives

7 months agoRemove the post-build-commands; not using any more
Steve McIntyre [Mon, 29 Oct 2018 01:26:19 +0000 (01:26 +0000)]
Remove the post-build-commands; not using any more

7 months agoFix java message
Steve McIntyre [Mon, 29 Oct 2018 01:25:51 +0000 (01:25 +0000)]
Fix java message

7 months agoSwitch on emulation for CP15 barriers for all builds
Steve McIntyre [Fri, 26 Oct 2018 18:38:42 +0000 (19:38 +0100)]
Switch on emulation for CP15 barriers for all builds

7 months agoAdd post-failed-build-commands to grab core dumps
Steve McIntyre [Fri, 26 Oct 2018 18:36:47 +0000 (19:36 +0100)]
Add post-failed-build-commands to grab core dumps

Depends on my locally-patched sbuild to work, for now

7 months agoRemove the pbuilder code
Steve McIntyre [Fri, 26 Oct 2018 15:41:52 +0000 (16:41 +0100)]
Remove the pbuilder code

It's commented out. Remove now:

 * we're in git anyway
 * not going back...

7 months agoAutomatically grab and save core dumps if any are generated
Steve McIntyre [Fri, 26 Oct 2018 15:34:13 +0000 (16:34 +0100)]
Automatically grab and save core dumps if any are generated

7 months agoSet the temp dirs to be owned by sbuild
Steve McIntyre [Fri, 26 Oct 2018 13:52:29 +0000 (14:52 +0100)]
Set the temp dirs to be owned by sbuild

7 months agoCall the new ulimit wrapper script inside the schroot
Steve McIntyre [Fri, 26 Oct 2018 12:53:06 +0000 (13:53 +0100)]
Call the new ulimit wrapper script inside the schroot

7 months agoModofy the sbuild/schroot fstab setup
Steve McIntyre [Fri, 26 Oct 2018 12:50:08 +0000 (13:50 +0100)]
Modofy the sbuild/schroot fstab setup

Bind-mount /chroot/rebuildd/sbuild/build for build space

Also bind-mount /etc/schroot/extra, the location of our ulimit wrapper
script

7 months agoAdd a wrapper script to turn on core dumps via ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:49:22 +0000 (13:49 +0100)]
Add a wrapper script to turn on core dumps via ulimit

7 months agoAdd a starting-build-command to call ulimit
Steve McIntyre [Fri, 26 Oct 2018 12:45:39 +0000 (13:45 +0100)]
Add a starting-build-command to call ulimit

7 months agoMake sure we're running with linux32
Steve McIntyre [Thu, 25 Oct 2018 21:47:34 +0000 (22:47 +0100)]
Make sure we're running with linux32

7 months agoCheck for cockups in the schroot setup
Steve McIntyre [Thu, 25 Oct 2018 17:10:07 +0000 (18:10 +0100)]
Check for cockups in the schroot setup

7 months agoMake sure we're in the queue directory
Steve McIntyre [Thu, 25 Oct 2018 17:06:47 +0000 (18:06 +0100)]
Make sure we're in the queue directory

7 months agoTighten the missing build-deps match - ignore version
Steve McIntyre [Thu, 25 Oct 2018 16:02:36 +0000 (17:02 +0100)]
Tighten the missing build-deps match - ignore version

7 months agoCosmetic tweaks
Steve McIntyre [Thu, 25 Oct 2018 15:21:11 +0000 (16:21 +0100)]
Cosmetic tweaks

7 months agoAdd an anchor link to the Summary section
Steve McIntyre [Thu, 25 Oct 2018 15:15:38 +0000 (16:15 +0100)]
Add an anchor link to the Summary section

7 months agoSort the summary output
Steve McIntyre [Thu, 25 Oct 2018 15:11:19 +0000 (16:11 +0100)]
Sort the summary output

7 months agoMatch more specific failures
Steve McIntyre [Thu, 25 Oct 2018 14:42:20 +0000 (15:42 +0100)]
Match more specific failures

7 months agoAdd support for logging some of what was matched in our scan
Steve McIntyre [Thu, 25 Oct 2018 14:20:30 +0000 (15:20 +0100)]
Add support for logging some of what was matched in our scan

Rather than just "build-deps failed", say what was missing if we can
work it out.

7 months agoMake single-line matches faster
Steve McIntyre [Thu, 25 Oct 2018 14:19:03 +0000 (15:19 +0100)]
Make single-line matches faster

Only consider matching the previous line if we need to, rather than
always matching with .*

7 months agoMore verbose logging of timeouts
Steve McIntyre [Wed, 24 Oct 2018 23:20:31 +0000 (00:20 +0100)]
More verbose logging of timeouts

7 months agoDon't append to the .running file, not needed
Steve McIntyre [Wed, 24 Oct 2018 23:14:20 +0000 (00:14 +0100)]
Don't append to the .running file, not needed

Just redirect straight

7 months agoDetect misidentified architecture on the build system
Steve McIntyre [Wed, 24 Oct 2018 22:34:03 +0000 (23:34 +0100)]
Detect misidentified architecture on the build system

7 months agoFix broken regexp for BTS
Steve McIntyre [Wed, 24 Oct 2018 22:22:49 +0000 (23:22 +0100)]
Fix broken regexp for BTS

7 months agoBe more explicit about pbuilder dep resolution failing
Steve McIntyre [Wed, 24 Oct 2018 22:21:24 +0000 (23:21 +0100)]
Be more explicit about pbuilder dep resolution failing

7 months agoList sbuild and pbuilder timeouts separately
Steve McIntyre [Wed, 24 Oct 2018 22:13:22 +0000 (23:13 +0100)]
List sbuild and pbuilder timeouts separately

7 months agoPick up on EPERM errors, seeing quite a few
Steve McIntyre [Wed, 24 Oct 2018 22:13:01 +0000 (23:13 +0100)]
Pick up on EPERM errors, seeing quite a few

7 months agoMatch java errors reported by gradle
Steve McIntyre [Wed, 24 Oct 2018 22:11:10 +0000 (23:11 +0100)]
Match java errors reported by gradle

7 months agoMatch build timeouts reported but sbuild
Steve McIntyre [Wed, 24 Oct 2018 17:48:31 +0000 (18:48 +0100)]
Match build timeouts reported but sbuild

7 months agoCheck for dh_auto_test reporting test failure
Steve McIntyre [Wed, 24 Oct 2018 17:14:00 +0000 (18:14 +0100)]
Check for dh_auto_test reporting test failure

7 months agoschroot really cares about ownership of its config
Steve McIntyre [Wed, 24 Oct 2018 16:44:14 +0000 (17:44 +0100)]
schroot really cares about ownership of its config

7 months agoAdd support for notes from manual analysis
Steve McIntyre [Wed, 24 Oct 2018 16:24:43 +0000 (17:24 +0100)]
Add support for notes from manual analysis

Look for a .note file to match the .log file
If found, grab the text.
Check for know BTS entries referenced there too

7 months agoClose log file too
Steve McIntyre [Wed, 24 Oct 2018 16:07:39 +0000 (17:07 +0100)]
Close log file too

7 months agoPick up on make errors from debian/rules
Steve McIntyre [Wed, 24 Oct 2018 16:01:15 +0000 (17:01 +0100)]
Pick up on make errors from debian/rules

7 months agoStop saving FAIL_SOURCE logs separately
Steve McIntyre [Wed, 24 Oct 2018 15:37:29 +0000 (16:37 +0100)]
Stop saving FAIL_SOURCE logs separately

We'll be analysing them all together anyway

7 months agoadd a state file to help track what's building where
Steve McIntyre [Wed, 24 Oct 2018 15:03:40 +0000 (15:03 +0000)]
add a state file to help track what's building where

7 months agoInitial commit of build scripts and config
Steve McIntyre [Tue, 23 Oct 2018 17:30:33 +0000 (17:30 +0000)]
Initial commit of build scripts and config