backup/warcprox
1
0
Fork 0
mirror of https://github.com/internetarchive/warcprox.git synced 2025-01-18 13:22:09 +01:00
Code Issues Projects Releases Activity
653 Commits 22 Branches 10 Tags
Commit Graph

22 Commits

Author SHA1 Message Date
Barbara Miller
240b6da836
a minimal example 
a minimal example of a warcprox plu-i
 2018-03-05 20:22:22 -08:00
Noah Levitt
824c194142 make plugin api more flexible 2018-01-24 16:07:45 -08:00
Noah Levitt
eacf070a2a dropping claim of support for python 2.7 (not worth hacking around tempfile.TemporaryDirectory to make tests pass) 2017-12-21 15:45:39 -08:00
Vangelis Banos
fc5f39ffed Add CDX Server based deduplication 
Add ``--cdxserver-dedup URL`` option.
Create ``warcprox.dedup.CdxServerDedup`` class.
Add dummy unit test (TODO)
 2017-10-19 14:33:12 +00:00
Noah Levitt
2c95a1f2ee remove kafka feed code 2017-06-28 13:12:30 -07:00
Noah Levitt
95dfa54968 get rid of dbm, switch to sqlite, for easier portability, clarity around threading 2017-05-24 13:57:09 -07:00
Noah Levitt
629795d617 update readme with latest --help output 2017-01-31 10:56:18 -08:00
Noah Levitt
ff3c9f2b72 trying to make hte copyright lines look better in the readme 2016-11-21 15:19:02 -08:00
Noah Levitt
2918a73a3b warcprox runs in python 2.7 too 2016-11-21 15:16:35 -08:00
Noah Levitt
8001dd09b3 travis-ci svg badge looks nicer 2016-10-19 17:30:53 -07:00
Noah Levitt
504af2fb0f try to avoid ever blocking when sending messages to kafka 2016-09-07 13:01:11 -07:00
Noah Levitt
ad661dcead expand license info, update usage section, remove crufty todo section 2016-04-06 19:37:16 -07:00
Noah Levitt
6b3cd9de2e make note of extra packages needed on ubuntu 2016-01-26 18:47:08 -08:00
Noah Levitt
b34edf8fb1 split into multiple files 2014-11-15 03:20:05 -08:00
Noah Levitt
a0a5ef2355 fix formatting of Install section again so it looks right on pypi! (test with rst2html) 2014-08-08 12:53:16 -07:00
Noah Levitt
b2479d39f6 fix formatting of Install section so it looks right on github 2014-08-08 12:29:12 -07:00
Noah Levitt
9562338d01 add Install section to readme, update the --help dump 2014-08-08 12:22:33 -07:00
Noah Levitt
f07437f64d since we depend on warctools trunk now, update the readme, and update the version number, so we can push latest to pypi 2013-12-19 16:48:28 -08:00
Noah Levitt
c220084704 travis ci and pypi badge thingies 2013-12-09 18:47:50 -08:00
Noah Levitt
1f0a894eba restructuredtext requires blank line before nested list :-\ 2013-12-04 17:51:55 -08:00
Noah Levitt
235e0dce45 update readme (and trigger travis ci build?) 2013-12-04 17:44:08 -08:00
Noah Levitt
b0dc399392 switch readme to rst so pypi understands it 2013-11-28 01:24:30 -08:00