Noah Levitt eab9181129 Merge branch 'master' into qa ...

* master:
  bump version after merge
  include warcprox host and port in filenames
  replace pencil drawing with nice diagram by James
  fix bug
  readable stack traces, thanks py.test
  --quiet means NOTICE level logging
  tweak max threads option handling
  set socket timeout for tor .onion fetching
  WARCPROX_WRITE_RECORD respect buffer size setting
  --help-hidden for help on hidden args
  half-baked readme section on warcprox architecture
  bump dev version number after merge
  restore 80 column lines
  Copy edits updated
  Copy edits
  update cryptography dep version
  use SpooledTemporaryFile for WARCPROX_WRITE_RECORD
  Apply blackout on when dedup URL equals request URL
  New --blackout-period option to skip writing redundant revisits to WARC

2018-09-28 11:12:18 -07:00

..

__init__.py

move tests out of installed package dir

2016-01-26 18:47:08 -08:00

conftest.py

change rethinkdb-related command line options to use "rethinkdb urls" (parser just added to doublethink) to reduce the proliferation of rethinkdb options, and add --rethinkdb-trough-db-url option

2017-10-11 12:06:19 -07:00

Dockerfile

fix trough deployment in Dockerfile

2018-05-16 13:48:04 -07:00

run-tests.sh

only run tests in py3

2018-05-16 14:21:18 -07:00

run-trough.sh

run trough with python 3.6 plus travis cleanup

2018-07-18 16:09:42 -05:00

single-threaded-proxy.py

fix payload digest by pulling calculation up one level where content has already been transfer-decoded

2017-11-10 17:18:22 -08:00

test_dedup.py

Update CdxServerDedup unit test

2018-01-15 20:58:36 +00:00

test_ensure_rethinkdb_tables.py

--quiet means NOTICE level logging

2018-08-20 11:14:38 -07:00

test_queue.py

add seconds_behind to service registry and status api, which is the length of time the next url to be written to warc has been waiting in the queue

2017-03-30 15:54:19 -07:00

test_warcprox.py

Merge branch 'master' into qa

2018-09-28 11:12:18 -07:00

test_writer.py

use SpooledTemporaryFile for WARCPROX_WRITE_RECORD

2018-08-16 11:08:36 -07:00