Ilya Kreymer 45c8fcddbd recorder: add max_idle_secs / close_idle_files() to close any open files that have not been modified longer than set threshold, in prep for webrecorder/webrecorder#92 ...

indexer: add 'full_warc_prefix' for setting full path prefix in add_warc_file() (eg. for http load) for webrecorder/webrecorder#95

2016-05-11 21:40:02 -07:00

..

test

recorder: add max_idle_secs / close_idle_files() to close any open files that have not been modified longer than set threshold, in prep for webrecorder/webrecorder#92

2016-05-11 21:40:02 -07:00

__init__.py

add recorder app, initial pass!

2016-03-09 14:33:36 -08:00

filters.py

recorder: SkipDupePolicy only skips if url is an exact match (not just by urlkey)

2016-04-07 10:44:05 -07:00

recorderapp.py

recorder warcwriter: allow skipping writing of only request or only response by overriding _is_write_req and _is_write_resp in subclass

2016-04-15 02:19:34 +00:00

redisindexer.py

recorder: add max_idle_secs / close_idle_files() to close any open files that have not been modified longer than set threshold, in prep for webrecorder/webrecorder#92

2016-05-11 21:40:02 -07:00

warcwriter.py

recorder: add max_idle_secs / close_idle_files() to close any open files that have not been modified longer than set threshold, in prep for webrecorder/webrecorder#92

2016-05-11 21:40:02 -07:00