backup/warcprox
1
0
Fork 0
mirror of https://github.com/internetarchive/warcprox.git synced 2025-01-18 13:22:09 +01:00
Code Issues Projects Releases Activity

more todo list updates

Browse Source
This commit is contained in:
Noah Levitt 2013-10-31 22:47:53 -07:00
parent c4d06b1564
commit dab8a956c2
1 changed files with 7 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
README.md
View File

@ -70,7 +70,7 @@ incorporated into warctools mainline.
###To do ###To do
- integration tests, unit tests - integration tests, unit tests
- url-agnostic deduplication - ~~url-agnostic deduplication~~
- unchunk and/or ungzip before storing payload, or alter request to discourage server from chunking/gzipping - unchunk and/or ungzip before storing payload, or alter request to discourage server from chunking/gzipping
- check certs from proxied website, like browser does, and present browser-like warning if appropriate - check certs from proxied website, like browser does, and present browser-like warning if appropriate
- keep statistics, produce reports - keep statistics, produce reports
@ -79,12 +79,17 @@ incorporated into warctools mainline.
- ~~base32 sha1 like heritrix?~~ - ~~base32 sha1 like heritrix?~~
- configurable timeouts and stuff - configurable timeouts and stuff
- evaluate ipv6 support - evaluate ipv6 support
- more explicit handling of connection closed exception during transfer? other error cases? - ~~more explicit handling of connection closed exception during transfer? other error cases?~~
- dns cache?? the system already does a fine job I'm thinking - dns cache?? the system already does a fine job I'm thinking
- keepalive with remote servers? - keepalive with remote servers?
- python3 - python3
- special handling for 304 not-modified (write nothing or write revisit - special handling for 304 not-modified (write nothing or write revisit
record... and/or modify request so server never responds with 304) record... and/or modify request so server never responds with 304)
- instant playback on a second proxy port
- browser plugin for warcprox mode
* accept warcprox CA cert only when in warcprox mode
* separate temporary cookie store, like incognito
* "careful! your activity is being archived" banner
#### To not do #### To not do