backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-21 19:12:10 +01:00
Code Issues Projects Releases Activity
1,893 Commits 56 Branches 63 Tags
Commit Graph

6 Commits

Author SHA1 Message Date
Ilya Kreymer
9eba59d8b4 warcserver: resource load: only read headers for self-redirect for response or revisit records 
tests: add test with resource record (new warc/cdxj) to ensure correct read of resource records
 2017-11-30 14:13:47 -08:00
Ilya Kreymer
3e9087df3c http OPTIONS and HEAD canonicalization: (#260) 
* http OPTIONS canonicalization:
- rename PostQueryExtractor to generic MethodQueryCanonicalizer, handles OPTIONS verb in addition to POST
- use more generic 'query' instead of 'post_query' for method-query canonicalization
- append '__pywb_method=options' to OPTIONS responses to distinguish from get in MethodQueryCanonicalizer

* method canon: also add HEAD to __pywb_method query canonicalization
 2017-10-23 17:15:06 -07:00
Sebastian Nagel
09295747b7 Extract WARC field "WARC-Identified-Payload-Type" (#251) 
and add it as field "mime-detected" to index entry
 2017-10-13 08:13:55 -07:00
Ilya Kreymer
d12f715d81 refactor: split warcserver.utils into utils package: 
- utils.io for stream/compression related utils
- utils.format for string formatting
- utils.memento for memento
- load_config -> utils.loaders.load_overlay_config
- also: use warcio.utils.to_native_str instead of utils.loaders.to_native_str
 2017-06-05 17:43:46 -07:00
Ilya Kreymer
2907ed01c8 refactor: 
- fix pywb.indexer, pywb.manager, pywb.recorder packages, tests pass
rename geventeventserver -> pywb.utils
move extract_post_query/append_post_query to inputrequest.PostQueryExtractor
remove to_native_str() in pywb.utils, redundant with warcio.utils version
remove obsolete readme, dockerfile
 2017-05-23 16:43:41 -07:00
Ilya Kreymer
ad33dc6728 refactor: webagg -> warcserver rename 
- ResAggApp -> BaseWarcServer
- AutoApp -> WarcServer
- move index related files to warcserver.index package, tests to warcserver.index.test
- move resource loading related files to warcserver.resource package, tests to warcserver.resource.test
- pywb.cdx -> pywb.warcserver.index
- split pywb.warc -> pywb.warcserver.resource or pywb.indexer (for cdx generation)
- bump to 0.51.0 for now!
- tests for pywb.warcserver should be working
 2017-05-23 09:21:43 -07:00