Ilya Kreymer
|
c96e419341
|
recorder: ensure filename is also tracked by the indexer, add tests
for redis file mapping
|
2016-03-19 10:24:28 -07:00 |
|
Ilya Kreymer
|
3452cf39e0
|
recorder: use more general MultiFileWARCWriter, supporting both keeping file open
and one-warc-per record use cases
|
2016-03-18 21:40:41 -07:00 |
|
Ilya Kreymer
|
e81457df5f
|
rename WARCRecorder -> WARCWriter, add optional max_size to single warc recorder
per-record recorder combines http response/req into single file
|
2016-03-18 19:49:14 -07:00 |
|