Noah Levitt 269e9604c1 include warcprox host and port in filenames ...

when using --crawl-log-dir, to avoid collisions (outside of warcprox
itself, in most cases) with crawl logs written by other warcprox
instances

2018-09-19 12:10:29 -07:00

..

__init__.py

move tests out of installed package dir

2016-01-26 18:47:08 -08:00

conftest.py

change rethinkdb-related command line options to use "rethinkdb urls" (parser just added to doublethink) to reduce the proliferation of rethinkdb options, and add --rethinkdb-trough-db-url option

2017-10-11 12:06:19 -07:00

Dockerfile

fix trough deployment in Dockerfile

2018-05-16 13:48:04 -07:00

run-tests.sh

only run tests in py3

2018-05-16 14:21:18 -07:00

run-trough.sh

run trough with python 3.6 plus travis cleanup

2018-07-18 16:09:42 -05:00

single-threaded-proxy.py

fix payload digest by pulling calculation up one level where content has already been transfer-decoded

2017-11-10 17:18:22 -08:00

test_dedup.py

Update CdxServerDedup unit test

2018-01-15 20:58:36 +00:00

test_ensure_rethinkdb_tables.py

--quiet means NOTICE level logging

2018-08-20 11:14:38 -07:00

test_queue.py

add seconds_behind to service registry and status api, which is the length of time the next url to be written to warc has been waiting in the queue

2017-03-30 15:54:19 -07:00

test_warcprox.py

include warcprox host and port in filenames

2018-09-19 12:10:29 -07:00

test_writer.py

use SpooledTemporaryFile for WARCPROX_WRITE_RECORD

2018-08-16 11:08:36 -07:00