debian-cd-search.git
2 years agoremove the 'new' db before trying to create a fresh one master
Steve McIntyre [Fri, 10 Mar 2017 08:25:56 +0000 (08:25 +0000)]
remove the 'new' db before trying to create a fresh one

2 years agoRelease version 0.11 v0.11
Steve McIntyre [Fri, 24 Feb 2017 16:35:21 +0000 (16:35 +0000)]
Release version 0.11

Update copyright statements too

2 years agoActually use the new conf var for treedir
Steve McIntyre [Fri, 24 Feb 2017 15:06:33 +0000 (15:06 +0000)]
Actually use the new conf var for treedir

2 years agoAdd proper command-line parsing
Steve McIntyre [Fri, 24 Feb 2017 15:04:51 +0000 (15:04 +0000)]
Add proper command-line parsing

2 years agoSet sane defaults for the update config
Steve McIntyre [Fri, 24 Feb 2017 15:00:47 +0000 (15:00 +0000)]
Set sane defaults for the update config

2 years agoAdd support for sqlite database instead of a hashdb file
Steve McIntyre [Fri, 24 Feb 2017 14:45:32 +0000 (14:45 +0000)]
Add support for sqlite database instead of a hashdb file

It's massively quicker to run queries against
For now, support both

2 years agoDetach the keepalive child thread, no need to wait for it
Steve McIntyre [Fri, 24 Feb 2017 14:43:24 +0000 (14:43 +0000)]
Detach the keepalive child thread, no need to wait for it

2 years agoAdd keepalive code and debug to the local command line tool
Steve McIntyre [Mon, 20 Feb 2017 01:14:04 +0000 (01:14 +0000)]
Add keepalive code and debug to the local command line tool

To aid in debugging

2 years agoMore tweaks for the keepalive code
Steve McIntyre [Mon, 20 Feb 2017 01:13:37 +0000 (01:13 +0000)]
More tweaks for the keepalive code

2 years agoReduce problem with timeouts on long-running queries v0.10
Steve McIntyre [Sun, 19 Feb 2017 00:36:45 +0000 (00:36 +0000)]
Reduce problem with timeouts on long-running queries

Add a keepalive thread to print comments every 10 seconds. This stops
Apache from timing out and killing things.

2 years agoAdd favicon
Steve McIntyre [Tue, 31 Jan 2017 21:08:03 +0000 (21:08 +0000)]
Add favicon

2 years agoadd default config for cdimage-search.debian.org
Steve McIntyre [Tue, 31 Jan 2017 21:06:10 +0000 (21:06 +0000)]
add default config for cdimage-search.debian.org

2 years agouse https for resources
Steve McIntyre [Tue, 31 Jan 2017 21:04:45 +0000 (21:04 +0000)]
use https for resources

3 years agoMore sanitisation
Steve McIntyre [Sun, 27 Mar 2016 01:35:21 +0000 (02:35 +0100)]
More sanitisation

3 years agoFix for another XSS hole
Steve McIntyre [Sat, 26 Mar 2016 22:04:07 +0000 (22:04 +0000)]
Fix for another XSS hole

If we've detected an attempt to subvert the query term, don't print it
back at people! Reset the string.

3 years agoRelease v0.9 v0.9
Steve McIntyre [Thu, 22 Oct 2015 16:03:28 +0000 (17:03 +0100)]
Release v0.9

3 years agoSanitise input to stop cross site scripting attacks
Steve McIntyre [Thu, 22 Oct 2015 16:03:14 +0000 (17:03 +0100)]
Sanitise input to stop cross site scripting attacks

7 years agoVersion 0.8 v0.8
Steve McIntyre [Wed, 17 Aug 2011 10:46:21 +0000 (11:46 +0100)]
Version 0.8

7 years agoAdd a link to the git repo for the source code
Steve McIntyre [Wed, 17 Aug 2011 10:45:08 +0000 (11:45 +0100)]
Add a link to the git repo for the source code

Make it easier for people to contribute, add a footer link to the
source code.

7 years agoVersion 0.7 v0.7
Steve McIntyre [Wed, 3 Aug 2011 11:55:10 +0000 (12:55 +0100)]
Version 0.7

Add a field in the footer to say when the DB was last updated - useful
for status checking.

8 years agoVersion 0.6 v0.6
Steve McIntyre [Sat, 16 Apr 2011 21:53:12 +0000 (22:53 +0100)]
Version 0.6

8 years agoAdd an extra 'search again' link at the top of the results
Steve McIntyre [Sat, 16 Apr 2011 21:52:59 +0000 (22:52 +0100)]
Add an extra 'search again' link at the top of the results

8 years agoVersion 0.5 v0.5
Steve McIntyre [Sat, 16 Apr 2011 21:26:03 +0000 (22:26 +0100)]
Version 0.5

8 years agoAdd configurable debug
Steve McIntyre [Sat, 16 Apr 2011 21:23:09 +0000 (22:23 +0100)]
Add configurable debug

Add debug=1 in the config file to cause the script to dump config
variables and query settings.

8 years agoCode shuffle
Steve McIntyre [Sat, 16 Apr 2011 21:20:32 +0000 (22:20 +0100)]
Code shuffle

Move set_default_config() and read_config() to the top of the file.

8 years agoAdd support for simple substring searches
Steve McIntyre [Sat, 16 Apr 2011 21:16:13 +0000 (22:16 +0100)]
Add support for simple substring searches

Deal with simple substring searches, whitespace separated: add "*" at
beginning and end and in between each query term.

Add extra option for query type (defaulting to the simple substring)
to allow for old behaviour and new.

8 years agoAdd config file handling v0.4
Steve McIntyre [Sat, 16 Apr 2011 18:36:59 +0000 (19:36 +0100)]
Add config file handling

Version 0.4

Move config variables into the %conf hash.

Set default config values in set_default_config()

In read_config(), look for a config file called find_file.cfg in the
same dir as the script is run from. If it exists, use the
ConfigReader::Simple library to load and parse the config file,
looking for directives that match the keys already in the %conf hash.

Makes it much easier to run the script on multiple hosts directly from
git - now we can store config in a separate file and we don't have to
modify the script itself.

8 years agoadd missing paren
Steve McIntyre [Fri, 15 Apr 2011 10:39:25 +0000 (11:39 +0100)]
add missing paren

8 years agoreindent, lose tabs
Steve McIntyre [Fri, 15 Apr 2011 10:36:24 +0000 (11:36 +0100)]
reindent, lose tabs

8 years agoAdd 'search again' link after successful search
Steve McIntyre [Fri, 15 Apr 2011 10:29:25 +0000 (11:29 +0100)]
Add 'search again' link after successful search

8 years agoTrivial layout tweaks
Steve McIntyre [Fri, 15 Apr 2011 10:28:03 +0000 (11:28 +0100)]
Trivial layout tweaks

8 years agoMore wording / layout tweaks
Steve McIntyre [Fri, 15 Apr 2011 10:08:34 +0000 (11:08 +0100)]
More wording / layout tweaks

8 years agoTweak wording slightly
Steve McIntyre [Fri, 15 Apr 2011 10:02:53 +0000 (11:02 +0100)]
Tweak wording slightly

8 years agocron script for polling and pulling backend db from cdimage.d.o
Steve McIntyre [Thu, 14 Apr 2011 20:56:42 +0000 (21:56 +0100)]
cron script for polling and pulling backend db from cdimage.d.o

8 years agoAdd scraper to grab bits of text and style from www.d.o/CD/
Steve McIntyre [Thu, 14 Apr 2011 20:44:48 +0000 (21:44 +0100)]
Add scraper to grab bits of text and style from d.o/CD/

Grab http://www.debian.org/CD/index.$LANG.html, split up and
search/replace some of the text to make it useful for the search CGI.

8 years agoAdd prettiness so we look more like the CD pages on www.d.o v0.3
Steve McIntyre [Thu, 14 Apr 2011 20:41:30 +0000 (21:41 +0100)]
Add prettiness so we look more like the CD pages on d.o

Add support for reading in various lumps of html that we can scrape
from www.debian.org/CD/

Reference the standard debian.css stylesheet.

Refactor generation a little.

8 years agoAdd message to say exact lookups are faster
Steve McIntyre [Tue, 5 Apr 2011 18:15:11 +0000 (19:15 +0100)]
Add message to say exact lookups are faster

8 years agoCount the results on the direct lookup too
Steve McIntyre [Tue, 5 Apr 2011 18:12:23 +0000 (19:12 +0100)]
Count the results on the direct lookup too

8 years agoIf we're given an exact search term, shortcut
Steve McIntyre [Tue, 5 Apr 2011 18:04:36 +0000 (19:04 +0100)]
If we're given an exact search term, shortcut

If we're given an exact term containing no glob characters, then we
may as well save a lot of time and just do the direct key lookup in
the database!

Simplify the two query scripts: make the actual search code
common. Might split out into a separate module later, or even combine
the scripts.

8 years agoAdd copyright headers and boilerplate
Steve McIntyre [Tue, 5 Apr 2011 17:41:23 +0000 (18:41 +0100)]
Add copyright headers and boilerplate

8 years agoSimple tools to query the CD contents database v0.2
Steve McIntyre [Mon, 4 Apr 2011 13:10:09 +0000 (14:10 +0100)]
Simple tools to query the CD contents database

Two tools:

 * find_file_db.pl is a command-line interface
 * find_file.cgi is a simple web interface.

8 years agoInitial code for generating CD contents database
Steve McIntyre [Mon, 4 Apr 2011 12:57:36 +0000 (13:57 +0100)]
Initial code for generating CD contents database

Scan all the areas defined for .list.gz files, parse the contents and
build a hash database per area ready for users to work with.