Ilya Kreymer 28d65ce717 archiveindexer major refactoring using zlib only ...

supports warc.gz, arc.gz, warc, arc and optional sorting
outputs cdx 11 but possible to extend to other formats
(additional edge case testing needed)
DecompressingBufferedReader refactoring to support multi-member gzip
Unit tests for indexer, addtional unit tests for bufferedreaders and loaders,
and recordloaders

2014-03-30 23:47:33 -07:00

..

bad.arc

archiveindexer major refactoring using zlib only

2014-03-30 23:47:33 -07:00

dupes.warc.gz

move sample/test data to ./sample_archive/warcs and ./sample_archive/cdx

2014-01-28 22:03:01 -08:00

example-url-agnostic-orig.warc.gz

url-agnostic revisit testing!

2014-03-04 20:12:09 +00:00

example-url-agnostic-revisit.warc.gz

url-agnostic revisit testing!

2014-03-04 20:12:09 +00:00

example-wget-1-14.warc.gz

pywb 0.2!

2014-02-17 10:01:09 -08:00

example.arc

pywb 0.2!

2014-02-17 10:01:09 -08:00

example.arc.gz

pywb 0.2!

2014-02-17 10:01:09 -08:00

example.warc

add uncompressed warc

2014-02-19 00:14:23 -08:00

example.warc.gz

move sample/test data to ./sample_archive/warcs and ./sample_archive/cdx

2014-01-28 22:03:01 -08:00

iana.warc.gz

move sample/test data to ./sample_archive/warcs and ./sample_archive/cdx

2014-01-28 22:03:01 -08:00