mirror of
https://github.com/internetarchive/warcprox.git
synced 2025-01-18 13:22:09 +01:00
fix link
This commit is contained in:
parent
c0fcf59c86
commit
48d96fbc79
@ -90,7 +90,7 @@ for deduplication works similarly to deduplication by `Heritrix
|
||||
|
||||
a. Write ``response`` record with full payload
|
||||
b. Store new entry in deduplication database (can be disabled, see
|
||||
`Warcprox-Meta HTTP request header <api.rst#warcprox-meta-http-request-header>`
|
||||
`Warcprox-Meta HTTP request header <api.rst#warcprox-meta-http-request-header>`_)
|
||||
|
||||
The deduplication database is partitioned into different "buckets". URLs are
|
||||
deduplicated only against other captures in the same bucket. If specified, the
|
||||
|
Loading…
x
Reference in New Issue
Block a user