Commit graph

8 commits

Author SHA1 Message Date
Donald Curtis
8acf077daf use sqlite3 for processing log files 2014-10-23 17:52:28 -04:00
Donald Curtis
71ccdd7959 Optimize processing logs.
Don't actually store the timestamp along with each IP when we parse logs. Only look at unique IP addresses. Duh.
2014-10-23 16:56:18 -04:00
Donald Curtis
49495e9b06 Allow for builds to run simultaneously.
By recording each package's archive-entry separately we are able to
build each recipe independently and then compile the archive contents
afterwards.
2013-11-25 16:52:09 +00:00
Steve Purcell
abe91ad56b Switch web pages to Angular 2013-08-24 11:08:09 +01:00
Donald Curtis
a535ed7f93 avoid some race conditions when processing dls
process_log.py now checks for other instances and makes sure to only run
once. previously this was corrupting the download_log.json.gz file.
2013-05-11 18:21:25 -05:00
Donald Curtis
e77648205e rename data files in process_log.py script 2013-04-24 21:11:53 -05:00
Donald Curtis
4098d7fcbe fix long string line 2013-04-24 13:48:29 -05:00
Donald Curtis
722d460914 add process_log.py script to maintain download counts 2013-04-24 13:39:37 -05:00