backup/warcprox
1
0
Fork 0
mirror of https://github.com/internetarchive/warcprox.git synced 2025-01-18 13:22:09 +01:00
Code Issues Projects Releases Activity

Enable cdx dedup lru cache by default

Browse Source 
use default value 1024
This commit is contained in:
Vangelis Banos 2019-02-12 08:28:15 +00:00
parent 53f13d3536
commit 1133715331
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
warcprox/main.py
View File

@ -174,7 +174,7 @@ def _build_arg_parser(prog='warcprox', show_hidden=False):
'maximum number of cdx server dedup threads'))
hidden.add_argument(
'--cdxserver-dedup-lru-cache-size', dest='cdxserver_dedup_lru_cache_size',
type=int, help=suppress(
type=int, default=1024, help=suppress(
'enable in-memory LRU cache to reduce duplicate CDX server requests'))
arg_parser.add_argument('--dedup-min-text-size', dest='dedup_min_text_size',
type=int, default=0,