6 Commits

Author	SHA1	Message	Date
Ilya Kreymer	922917a631	rename BufferedReader -> DecompressingBufferedReader ... remove max_len from DecompressingBufferedReader as it applied to the compressed size, not original size. Add integration test for verifying content length of larger file	2014-02-20 11:53:08 -08:00
Ilya Kreymer	ff428ed43e	exclusions: add AllAllowPerms and refactor exclusions interface ... add TestExclusionPerms and a sample exclusion integration test refactor cdx server init params into **kwargs convert all cdx params to use camelCase	2014-02-19 20:20:31 -08:00
Ilya Kreymer	a09dec4b3e	cdx: add domain-specific rules at cdx layer for custom canonicalization! ... and 'fuzzy' matching when not found handled via cdxdomainspecific.py BaseCDXServer contains a canonicalizer object and a fuzzy query canonicalizer abstracted to seperate class (in canonicalizer.py) clean up cdx related exceptions default rules read from cdx/rules.yaml filename configurable via 'domain_specific_rules' setting in config.yaml fix typo in pywb/rewrite	2014-02-18 14:56:13 -08:00
Ilya Kreymer	94f1dc3be5	cleanup wbexceptions, remove unused	2014-02-17 10:23:37 -08:00
Ilya Kreymer	5345459298	pywb 0.2! ... move to distinct packages: pywb.utils, pywb.cdx, pywb.warc, pywb.util, pywb.rewrite! each package will have its own README and tests shared sample_data and install	2014-02-17 10:01:09 -08:00
Ilya Kreymer	2528ee0a7c	refactoring of binsearch and cdxserver into seperate packages ... also move complicated doctests and integration tests to tests/	2014-02-12 13:16:07 -08:00