Noah Levitt 17a5fabb75 use SpooledTemporaryFile for WARCPROX_WRITE_RECORD ...

payloads. because as of https://github.com/internetarchive/brozzler/pull/115
brozzler will be sending big videos via WARCPROX_WRITE_RECORD

2018-08-16 11:08:36 -07:00

..

__init__.py

move tests out of installed package dir

2016-01-26 18:47:08 -08:00

conftest.py

change rethinkdb-related command line options to use "rethinkdb urls" (parser just added to doublethink) to reduce the proliferation of rethinkdb options, and add --rethinkdb-trough-db-url option

2017-10-11 12:06:19 -07:00

Dockerfile

fix trough deployment in Dockerfile

2018-05-16 13:48:04 -07:00

run-tests.sh

only run tests in py3

2018-05-16 14:21:18 -07:00

run-trough.sh

run trough with python 3.6 plus travis cleanup

2018-07-18 16:09:42 -05:00

single-threaded-proxy.py

fix payload digest by pulling calculation up one level where content has already been transfer-decoded

2017-11-10 17:18:22 -08:00

test_dedup.py

Update CdxServerDedup unit test

2018-01-15 20:58:36 +00:00

test_ensure_rethinkdb_tables.py

fix warcprox-ensure-rethinkdb-tables and add tests

2017-11-28 10:38:38 -08:00

test_queue.py

add seconds_behind to service registry and status api, which is the length of time the next url to be written to warc has been waiting in the queue

2017-03-30 15:54:19 -07:00

test_warcprox.py

test should expose trough dedup concurrency bug

2018-07-18 19:23:24 -05:00

test_writer.py

use SpooledTemporaryFile for WARCPROX_WRITE_RECORD

2018-08-16 11:08:36 -07:00