Noah Levitt a3f5313850 Merge branch 'master' into qa ...

* master:
  log exception and continue 🤞 if schema reg fails
  log stack trace in case batch postprocessor raises
  bump dev version after merge
  more edits
  more little edits
  explain a bit about mitm
  little edits
  describe the last two remaining fields
  fixlets
  more progress on documenting "limits"
  add another "wait" to fix failing test
  fix bug in limits enforcement
  docs still in progress
  new checks exposing bug in limits enforcement
  working on "limits" and "soft-limits"
  explain warcprox-meta "blocks"
  starting to explain some warcprox-meta fields
  short sectioni on stats
  barely starting to flesh out warcprox-meta section
  explain deduplication
  starting to talk about warcprox-meta
  fix failure message in test_return_capture_timestamp
  double the backticks
  stubby api docs
  rename README.rst -> readme.rst
  add some debug logging in BatchTroughLoader
  just one should_dedup() for trough dedup
  only run tests in py3
  fix trough deployment in Dockerfile
  fix test_dedup_min_text_size failure?
  rewrite test_dedup_min_size() to account for
  we want to save all captures to the big "captures"
  default values for dedup_min_text_size et al

2018-06-01 15:49:24 -07:00

..

__init__.py

move tests out of installed package dir

2016-01-26 18:47:08 -08:00

conftest.py

change rethinkdb-related command line options to use "rethinkdb urls" (parser just added to doublethink) to reduce the proliferation of rethinkdb options, and add --rethinkdb-trough-db-url option

2017-10-11 12:06:19 -07:00

Dockerfile

fix trough deployment in Dockerfile

2018-05-16 13:48:04 -07:00

run-tests.sh

only run tests in py3

2018-05-16 14:21:18 -07:00

run-trough.sh

fix trough deployment in Dockerfile

2018-05-16 13:48:04 -07:00

single-threaded-proxy.py

fix payload digest by pulling calculation up one level where content has already been transfer-decoded

2017-11-10 17:18:22 -08:00

test_dedup.py

Update CdxServerDedup unit test

2018-01-15 20:58:36 +00:00

test_ensure_rethinkdb_tables.py

fix warcprox-ensure-rethinkdb-tables and add tests

2017-11-28 10:38:38 -08:00

test_queue.py

add seconds_behind to service registry and status api, which is the length of time the next url to be written to warc has been waiting in the queue

2017-03-30 15:54:19 -07:00

test_warcprox.py

Merge branch 'master' into qa

2018-06-01 15:49:24 -07:00

test_writer.py

add test_do_not_archive

2018-02-28 12:28:18 -08:00