Noah Levitt 0031091d4f

Merge pull request #99 from vbanos/blackout_period ...

New --blackout-period option to skip writing redundant revisits to WARC

2018-08-03 17:27:42 -07:00

..

__init__.py

move tests out of installed package dir

2016-01-26 18:47:08 -08:00

conftest.py

change rethinkdb-related command line options to use "rethinkdb urls" (parser just added to doublethink) to reduce the proliferation of rethinkdb options, and add --rethinkdb-trough-db-url option

2017-10-11 12:06:19 -07:00

Dockerfile

fix trough deployment in Dockerfile

2018-05-16 13:48:04 -07:00

run-tests.sh

only run tests in py3

2018-05-16 14:21:18 -07:00

run-trough.sh

run trough with python 3.6 plus travis cleanup

2018-07-18 16:09:42 -05:00

single-threaded-proxy.py

fix payload digest by pulling calculation up one level where content has already been transfer-decoded

2017-11-10 17:18:22 -08:00

test_dedup.py

Update CdxServerDedup unit test

2018-01-15 20:58:36 +00:00

test_ensure_rethinkdb_tables.py

fix warcprox-ensure-rethinkdb-tables and add tests

2017-11-28 10:38:38 -08:00

test_queue.py

add seconds_behind to service registry and status api, which is the length of time the next url to be written to warc has been waiting in the queue

2017-03-30 15:54:19 -07:00

test_warcprox.py

test should expose trough dedup concurrency bug

2018-07-18 19:23:24 -05:00

test_writer.py

Apply blackout on when dedup URL equals request URL

2018-07-24 07:16:21 +00:00