mirror of
https://github.com/internetarchive/warcprox.git
synced 2025-01-18 13:22:09 +01:00
* trough-dedup: update travis-ci trough deployment on error from trough read or write url, delete read/write url from cache, so next request will retrieve a fresh, hopefully working, url (n.b. not covered by automated tests at this point) cache trough read and write urls update trough dedup to use new segment manager api to register schema sql it finally works! another travis tweak though can we edit /etc/hosts in travis-ci? ugh fix docker command line arg docker container for trough needs a hostname that works from outside the container (since it registers itself in the service registry) trough logs are inside the docker container now need docker to publish the rethinkdb port for --rethinkdb-dedup-url and --rethinkdb-big-table-url tests apparently you can't use docker run options --rm and --detach together in travis-ci, run trough in another docker container, so that its version of python can be independent of the one used to run the warcprox tests remove some debugging from .travis.yml and importantly, deactivate the trough virtualenv before installing warcprox and running tests (otherwise it uses the wrong version of python) missed an ampersand bangin (is the problem that we didn't start trough-read? banging more banging on travis-ci cryptography 2.1.1 seems to be the problem banging on travis-ci first attempt to run trough on travis-ci get all the tests to pass with ./tests/run-tests.sh install and run trough in docker container for testing change rethinkdb-related command line options to use "rethinkdb urls" (parser just added to doublethink) to reduce the proliferation of rethinkdb options, and add --rethinkdb-trough-db-url option trough for deduplication initial proof-of-concept-ish code