Ilya Kreymer
|
3fec766e39
|
webagg: redis lookup: if url contains wildcard, scan redis keys to check multiple keys until one is found
webagg tests: fix test to include mime in live cdx
|
2016-06-07 12:54:28 -04:00 |
|
Ilya Kreymer
|
d7c74b68de
|
video loader support: add VideoLoader, which uses youtube-dl to create a metadata record
of video info. Activated with explicit content_type param 'application/vnd.youtube-dl_formats+json'
|
2016-05-28 15:01:33 -07:00 |
|
Ilya Kreymer
|
30f9d0aca7
|
recorder put custom record: add support for put/post of a custom record. If put_record= param is included, the request body
is written to the specified record type.
move record creation functions to the warcwriter
add tests for custom record
|
2016-05-26 20:49:40 -07:00 |
|
Ilya Kreymer
|
c45f5cb749
|
webagg: use werkzeug routing instead of wrapping Bottle app
|
2016-05-10 16:31:44 -07:00 |
|
Ilya Kreymer
|
017e9802f8
|
tests: fix fakeredis patch not running on test_handlers,
use exc str instead of repr for error message for consistency
all tests pass on py2 and py3 again!
|
2016-03-26 22:32:21 -04:00 |
|
Ilya Kreymer
|
61921d6c4a
|
tests: add FakeRedisTests class mixin for patching in FakeRedis for tests
|
2016-03-24 10:45:48 -04:00 |
|
Ilya Kreymer
|
cbe7d1c981
|
webagg: add tests for RedisPathResolver and errors on missing warc, missing warc keys
|
2016-03-21 11:44:32 -07:00 |
|
Ilya Kreymer
|
f5ee3c7bca
|
inputreq: add reconstruct_request() to return a bytestring of the request, add test for inputreq
|
2016-03-19 20:32:37 -07:00 |
|
Ilya Kreymer
|
49b6ae78a8
|
live loader: remove liverec (doesn't work well with gevent), use regular requests
instead of overriden version.
reconstruct header block from httplib header pairs list
move ReadFullyStream to utils
|
2016-03-12 22:15:24 -08:00 |
|
Ilya Kreymer
|
7b847311d5
|
dir agg: include filename in dir source name
|
2016-03-10 15:51:01 -08:00 |
|
Ilya Kreymer
|
34386578a5
|
shared setup: move webagg test to webagg/test
|
2016-03-09 14:29:14 -08:00 |
|