Vangelis Banos ddcde36982 Increase urllib parse cache size ...

In python2/3, urllib parse caches in memory URL parsing results to
avoid repeating the process for the same URL. The problem is that the
default in memory cache size is just 20.
https://github.com/python/cpython/blob/3.7/Lib/urllib/parse.py#L80

Since we do a lot of URL parsing, it makes sense to increase cache size.

2019-05-02 07:29:27 +00:00

..

__init__.py

offer WarcproxController to plugin constructors

2019-01-09 22:47:04 +00:00

bigtable.py

appease some warnings

2019-03-21 14:17:24 -07:00

controller.py

handle graceful shutdown failure

2019-04-24 13:14:12 -07:00

crawl_log.py

include warcprox host and port in filenames

2018-09-19 12:10:29 -07:00

dedup.py

appease some warnings

2019-03-21 14:17:24 -07:00

main.py

appease some warnings

2019-03-21 14:17:24 -07:00

mitmproxy.py

Increase urllib parse cache size

2019-05-02 07:29:27 +00:00

playback.py

tests are passing

2018-01-15 14:49:13 -08:00

stats.py

appease some warnings

2019-03-21 14:17:24 -07:00

trough.py

appease some warnings

2019-03-21 14:17:24 -07:00

warc.py

make sure we always format WARC-Date properly

2018-11-06 11:21:12 -08:00

warcproxy.py

deal with bad content-type header

2019-04-24 10:40:22 -07:00

writer.py

omfg too many warcs

2019-02-12 14:59:54 -08:00

writerthread.py

fix idle rollover

2019-01-21 10:37:09 -08:00