Vangelis Banos 89041e83b4 Catch RemoteDisconnected case when starting downloading ...

A common error is to connect to the remote server successfully but raise a
`http_client.RemoteDisconnected` exception when trying to begin
downloading. Its caused by call `prox_rec_res.begin(...)` which calls
`http_client._read_status()`. In that case, we also add the target
`hostname:port` to the `bad_hostnames_ports` cache.

Modify 2 unit tests to clear the `bad_hostnames_ports` cache because
localhost is added from previous tests and this breaks them.

2019-05-10 07:32:42 +00:00

..

__init__.py

move tests out of installed package dir

2016-01-26 18:47:08 -08:00

conftest.py

change rethinkdb-related command line options to use "rethinkdb urls" (parser just added to doublethink) to reduce the proliferation of rethinkdb options, and add --rethinkdb-trough-db-url option

2017-10-11 12:06:19 -07:00

Dockerfile

new snakebite git url

2019-04-08 11:11:51 -07:00

run-tests.sh

only run tests in py3

2018-05-16 14:21:18 -07:00

run-trough.sh

new snakebite git url

2019-04-08 11:11:51 -07:00

single-threaded-proxy.py

fix payload digest by pulling calculation up one level where content has already been transfer-decoded

2017-11-10 17:18:22 -08:00

test_dedup.py

Update CdxServerDedup unit test

2018-01-15 20:58:36 +00:00

test_ensure_rethinkdb_tables.py

--quiet means NOTICE level logging

2018-08-20 11:14:38 -07:00

test_warcprox.py

Catch RemoteDisconnected case when starting downloading

2019-05-10 07:32:42 +00:00

test_writer.py

WarcWriterProcessor.close_for_prefix()

2019-01-08 11:27:11 -08:00