3 Commits

Author	SHA1	Message	Date
Ilya Kreymer	b64be0dff1	recorder: add tests for single file writer, including file locking ... dedup policy: support customizable dedup/skip/write policy plugins and add tests	2016-03-18 15:28:24 -07:00
Ilya Kreymer	cba8e4ee3a	filters: more functional filter impl for header exclusion	2016-03-17 18:22:26 -07:00
Ilya Kreymer	9adb8da3b7	recorder: add support for filtering collections to record by regex (default: .*) ... add support for excluding certain headers when writing WARCs tests: add first batch of tests for recorder, using live upstream server	2016-03-11 11:12:25 -08:00