4 Commits

Author	SHA1	Message	Date
Ilya Kreymer	c96e419341	recorder: ensure filename is also tracked by the indexer, add tests ... for redis file mapping	2016-03-19 10:24:28 -07:00
Ilya Kreymer	b64be0dff1	recorder: add tests for single file writer, including file locking ... dedup policy: support customizable dedup/skip/write policy plugins and add tests	2016-03-18 15:28:24 -07:00
Ilya Kreymer	9adb8da3b7	recorder: add support for filtering collections to record by regex (default: .*) ... add support for excluding certain headers when writing WARCs tests: add first batch of tests for recorder, using live upstream server	2016-03-11 11:12:25 -08:00
Ilya Kreymer	31fb2f926f	add recorder app, initial pass!	2016-03-09 14:33:36 -08:00