debian-cd-search.git
5 months agoTweak to cope with different DB file names master
Steve McIntyre [Mon, 21 Jun 2021 08:25:18 +0000 (09:25 +0100)]
Tweak to cope with different DB file names

4 years agoremove the 'new' db before trying to create a fresh one
Steve McIntyre [Fri, 10 Mar 2017 08:25:56 +0000 (08:25 +0000)]
remove the 'new' db before trying to create a fresh one

4 years agoRelease version 0.11 v0.11
Steve McIntyre [Fri, 24 Feb 2017 16:35:21 +0000 (16:35 +0000)]
Release version 0.11

Update copyright statements too

4 years agoActually use the new conf var for treedir
Steve McIntyre [Fri, 24 Feb 2017 15:06:33 +0000 (15:06 +0000)]
Actually use the new conf var for treedir

4 years agoAdd proper command-line parsing
Steve McIntyre [Fri, 24 Feb 2017 15:04:51 +0000 (15:04 +0000)]
Add proper command-line parsing

4 years agoSet sane defaults for the update config
Steve McIntyre [Fri, 24 Feb 2017 15:00:47 +0000 (15:00 +0000)]
Set sane defaults for the update config

4 years agoAdd support for sqlite database instead of a hashdb file
Steve McIntyre [Fri, 24 Feb 2017 14:45:32 +0000 (14:45 +0000)]
Add support for sqlite database instead of a hashdb file

It's massively quicker to run queries against
For now, support both

4 years agoDetach the keepalive child thread, no need to wait for it
Steve McIntyre [Fri, 24 Feb 2017 14:43:24 +0000 (14:43 +0000)]
Detach the keepalive child thread, no need to wait for it

4 years agoAdd keepalive code and debug to the local command line tool
Steve McIntyre [Mon, 20 Feb 2017 01:14:04 +0000 (01:14 +0000)]
Add keepalive code and debug to the local command line tool

To aid in debugging

4 years agoMore tweaks for the keepalive code
Steve McIntyre [Mon, 20 Feb 2017 01:13:37 +0000 (01:13 +0000)]
More tweaks for the keepalive code

4 years agoReduce problem with timeouts on long-running queries v0.10
Steve McIntyre [Sun, 19 Feb 2017 00:36:45 +0000 (00:36 +0000)]
Reduce problem with timeouts on long-running queries

Add a keepalive thread to print comments every 10 seconds. This stops
Apache from timing out and killing things.

4 years agoAdd favicon
Steve McIntyre [Tue, 31 Jan 2017 21:08:03 +0000 (21:08 +0000)]
Add favicon

4 years agoadd default config for cdimage-search.debian.org
Steve McIntyre [Tue, 31 Jan 2017 21:06:10 +0000 (21:06 +0000)]
add default config for cdimage-search.debian.org

4 years agouse https for resources
Steve McIntyre [Tue, 31 Jan 2017 21:04:45 +0000 (21:04 +0000)]
use https for resources

5 years agoMore sanitisation
Steve McIntyre [Sun, 27 Mar 2016 01:35:21 +0000 (02:35 +0100)]
More sanitisation

5 years agoFix for another XSS hole
Steve McIntyre [Sat, 26 Mar 2016 22:04:07 +0000 (22:04 +0000)]
Fix for another XSS hole

If we've detected an attempt to subvert the query term, don't print it
back at people! Reset the string.

6 years agoRelease v0.9 v0.9
Steve McIntyre [Thu, 22 Oct 2015 16:03:28 +0000 (17:03 +0100)]
Release v0.9

6 years agoSanitise input to stop cross site scripting attacks
Steve McIntyre [Thu, 22 Oct 2015 16:03:14 +0000 (17:03 +0100)]
Sanitise input to stop cross site scripting attacks

10 years agoVersion 0.8 v0.8
Steve McIntyre [Wed, 17 Aug 2011 10:46:21 +0000 (11:46 +0100)]
Version 0.8

10 years agoAdd a link to the git repo for the source code
Steve McIntyre [Wed, 17 Aug 2011 10:45:08 +0000 (11:45 +0100)]
Add a link to the git repo for the source code

Make it easier for people to contribute, add a footer link to the
source code.

10 years agoVersion 0.7 v0.7
Steve McIntyre [Wed, 3 Aug 2011 11:55:10 +0000 (12:55 +0100)]
Version 0.7

Add a field in the footer to say when the DB was last updated - useful
for status checking.

10 years agoVersion 0.6 v0.6
Steve McIntyre [Sat, 16 Apr 2011 21:53:12 +0000 (22:53 +0100)]
Version 0.6

10 years agoAdd an extra 'search again' link at the top of the results
Steve McIntyre [Sat, 16 Apr 2011 21:52:59 +0000 (22:52 +0100)]
Add an extra 'search again' link at the top of the results

10 years agoVersion 0.5 v0.5
Steve McIntyre [Sat, 16 Apr 2011 21:26:03 +0000 (22:26 +0100)]
Version 0.5

10 years agoAdd configurable debug
Steve McIntyre [Sat, 16 Apr 2011 21:23:09 +0000 (22:23 +0100)]
Add configurable debug

Add debug=1 in the config file to cause the script to dump config
variables and query settings.

10 years agoCode shuffle
Steve McIntyre [Sat, 16 Apr 2011 21:20:32 +0000 (22:20 +0100)]
Code shuffle

Move set_default_config() and read_config() to the top of the file.

10 years agoAdd support for simple substring searches
Steve McIntyre [Sat, 16 Apr 2011 21:16:13 +0000 (22:16 +0100)]
Add support for simple substring searches

Deal with simple substring searches, whitespace separated: add "*" at
beginning and end and in between each query term.

Add extra option for query type (defaulting to the simple substring)
to allow for old behaviour and new.

10 years agoAdd config file handling v0.4
Steve McIntyre [Sat, 16 Apr 2011 18:36:59 +0000 (19:36 +0100)]
Add config file handling

Version 0.4

Move config variables into the %conf hash.

Set default config values in set_default_config()

In read_config(), look for a config file called find_file.cfg in the
same dir as the script is run from. If it exists, use the
ConfigReader::Simple library to load and parse the config file,
looking for directives that match the keys already in the %conf hash.

Makes it much easier to run the script on multiple hosts directly from
git - now we can store config in a separate file and we don't have to
modify the script itself.

10 years agoadd missing paren
Steve McIntyre [Fri, 15 Apr 2011 10:39:25 +0000 (11:39 +0100)]
add missing paren

10 years agoreindent, lose tabs
Steve McIntyre [Fri, 15 Apr 2011 10:36:24 +0000 (11:36 +0100)]
reindent, lose tabs

10 years agoAdd 'search again' link after successful search
Steve McIntyre [Fri, 15 Apr 2011 10:29:25 +0000 (11:29 +0100)]
Add 'search again' link after successful search

10 years agoTrivial layout tweaks
Steve McIntyre [Fri, 15 Apr 2011 10:28:03 +0000 (11:28 +0100)]
Trivial layout tweaks

10 years agoMore wording / layout tweaks
Steve McIntyre [Fri, 15 Apr 2011 10:08:34 +0000 (11:08 +0100)]
More wording / layout tweaks

10 years agoTweak wording slightly
Steve McIntyre [Fri, 15 Apr 2011 10:02:53 +0000 (11:02 +0100)]
Tweak wording slightly

10 years agocron script for polling and pulling backend db from cdimage.d.o
Steve McIntyre [Thu, 14 Apr 2011 20:56:42 +0000 (21:56 +0100)]
cron script for polling and pulling backend db from cdimage.d.o

10 years agoAdd scraper to grab bits of text and style from www.d.o/CD/
Steve McIntyre [Thu, 14 Apr 2011 20:44:48 +0000 (21:44 +0100)]
Add scraper to grab bits of text and style from d.o/CD/

Grab http://www.debian.org/CD/index.$LANG.html, split up and
search/replace some of the text to make it useful for the search CGI.

10 years agoAdd prettiness so we look more like the CD pages on www.d.o v0.3
Steve McIntyre [Thu, 14 Apr 2011 20:41:30 +0000 (21:41 +0100)]
Add prettiness so we look more like the CD pages on d.o

Add support for reading in various lumps of html that we can scrape
from www.debian.org/CD/

Reference the standard debian.css stylesheet.

Refactor generation a little.

10 years agoAdd message to say exact lookups are faster
Steve McIntyre [Tue, 5 Apr 2011 18:15:11 +0000 (19:15 +0100)]
Add message to say exact lookups are faster

10 years agoCount the results on the direct lookup too
Steve McIntyre [Tue, 5 Apr 2011 18:12:23 +0000 (19:12 +0100)]
Count the results on the direct lookup too

10 years agoIf we're given an exact search term, shortcut
Steve McIntyre [Tue, 5 Apr 2011 18:04:36 +0000 (19:04 +0100)]
If we're given an exact search term, shortcut

If we're given an exact term containing no glob characters, then we
may as well save a lot of time and just do the direct key lookup in
the database!

Simplify the two query scripts: make the actual search code
common. Might split out into a separate module later, or even combine
the scripts.

10 years agoAdd copyright headers and boilerplate
Steve McIntyre [Tue, 5 Apr 2011 17:41:23 +0000 (18:41 +0100)]
Add copyright headers and boilerplate

10 years agoSimple tools to query the CD contents database v0.2
Steve McIntyre [Mon, 4 Apr 2011 13:10:09 +0000 (14:10 +0100)]
Simple tools to query the CD contents database

Two tools:

 * find_file_db.pl is a command-line interface
 * find_file.cgi is a simple web interface.

10 years agoInitial code for generating CD contents database
Steve McIntyre [Mon, 4 Apr 2011 12:57:36 +0000 (13:57 +0100)]
Initial code for generating CD contents database

Scan all the areas defined for .list.gz files, parse the contents and
build a hash database per area ready for users to work with.