1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00

851 Commits

Author SHA1 Message Date
Ilya Kreymer
cfe11a5ad3 fix typo param ordering 2014-07-31 11:56:43 -07:00
Ilya Kreymer
522ea87637 proxy: timestamp selection support!
certauth: wildcard support, use *.host wildcard for proxy certs whenever possible
ui: add coll info/switch and calendar links to banner
2014-07-31 11:12:50 -07:00
Ilya Kreymer
eff5a74ec7 proxy: path fixup, using default magic name of 'pywb.proxy', default
selector 'select.pywb.proxy' stored in env['pywb_select'] and accessible
to head insert and error handler
2014-07-30 13:06:18 -07:00
Ilya Kreymer
527ad0d60e proxy mode: make banner replay and cookie resolver configurable via proxy_options 2014-07-30 10:47:24 -07:00
Ilya Kreymer
96d9f4dcad proxy mode: cookie based selector using session to coll
ui: add proxy_selector html, add switch link to error and banner
2014-07-30 10:38:13 -07:00
Ilya Kreymer
fc6ffc6c11 Merge branch 'develop' into https-proxy for 'bn_' modifier support 2014-07-29 12:26:50 -07:00
Ilya Kreymer
607ea1ccf0 proxy resolver: cookie resolver uses session cookies
proxy static handler: handled via proxy to support http/https
use 'pywb.proxy' prefix for custom env settings
2014-07-29 12:23:41 -07:00
Ilya Kreymer
b92eda77f6 rewrite: add 'bn_' banner only rewrite
cleanup rewrite_content/fetch_request api to take a full wb_url
add content-length to responses whenever possible (WbResponse) and static files
bump version to 0.5.2
2014-07-29 12:20:22 -07:00
Ilya Kreymer
9c96026904 proxy-cert-auth: add cli hook for 'proxy-cert-auth' for creating root certs, tweak help 2014-07-28 16:06:01 -07:00
Ilya Kreymer
ba61f23e40 proxy_resolvers: move resolvers to seperate file, default to ProxyAuthResolver (CookieResolver still work-in-progress) 2014-07-28 15:22:22 -07:00
Ilya Kreymer
6234d795dc proxy improvements: refactor coll selector into BaseCollSelector,
supporting either proxy auth or cookie-based selection (in progress)
https proxy: support POST requests, properly read http header and wrap remainder
in wsgi.input
https proxy: properly update wsgi for wrapped request
wbrequestresponse: add content-length 0 to redir_response
2014-07-28 14:28:00 -07:00
Ilya Kreymer
b6fb0e510e certauth: clean up CertificatAuthority, add cli interface for creating root cert and host certs
CertificateAuthority instance creates per-host certs, assume root cert exists
static method generate_ca_root() used to create root cert once
add proxy_options to enable https support
2014-07-27 19:35:16 -07:00
Ilya Kreymer
2a9197137e certauth: some cleanup for pep8, 2.6 compat 2014-07-26 21:06:28 -07:00
Ilya Kreymer
ae35d92dde fix typo in certauth 2014-07-26 15:27:02 -07:00
Ilya Kreymer
e58a63a9fe setup: add openssl as a req 2014-07-26 14:35:52 -07:00
Ilya Kreymer
5beb831ae9 wbrequestresponse: update doctest 2014-07-26 14:27:31 -07:00
Ilya Kreymer
1464e89c41 wbresponse: always include Content-Length for text_response 2014-07-26 14:24:28 -07:00
Ilya Kreymer
eca3cf5fbf https proxy: add ca generator!
support uwsgi, gunicorn and ref
better handling of 407, other error responses in response to CONNECT
2014-07-26 13:24:53 -07:00
Ilya Kreymer
739f23da9e https proxy support, CONNECT verb handling (uwsgi only) 2014-07-26 09:48:44 -07:00
Ilya Kreymer
fb29b6aad9 Merge branch 'develop' 2014-07-24 16:39:24 -07:00
Ilya Kreymer
bdf69ff1a9 tweak CHANGES.rst 2014-07-24 16:38:39 -07:00
Ilya Kreymer
22c210131a bump version to 0.5.1 2014-07-23 15:31:38 -07:00
Ilya Kreymer
8ea7f5d3a0 framed replay: don't use is_timegate to determine frame usage due to potential
ambiguity, memento will need to use the mp_ modifier
2014-07-23 15:31:38 -07:00
Ilya Kreymer
e513b3755c cdxindexing: encode unicode filenames using system encoding,
add test for unicode filenames
2014-07-23 15:31:38 -07:00
Ilya Kreymer
4d31c17d4c archivalrouter: make SCRIPT_NAME key lookup default to '', addresses #39 2014-07-23 15:31:30 -07:00
Ilya Kreymer
c3fecb6e0d Merge branch 'develop' for 0.5.0 release 0.5.0 2014-07-21 22:56:03 -07:00
Ilya Kreymer
0b8a8f0ae2 live rewrite: catch errors from live rewrite and raise a new LiveResourceError with a 400 error code,
indicating bad request for live resource. Add test for invalid live rewrite requests
2014-07-21 22:43:34 -07:00
Ilya Kreymer
2f50a3eafb a few more tweaks to CHANGES.rst 2014-07-21 21:43:40 -07:00
Ilya Kreymer
769ac0784a Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 21:30:05 -07:00
Ilya Kreymer
b8a17b7cab refactor webapp: RewriteLiveHandler and WBHandler share a common base class,
SearchPageWbUrlHandler which renders the search page when there is no wburl
move some inits from pywb_init to WBHandler itself
2014-07-21 21:25:10 -07:00
Ilya Kreymer
84e8365838 Update README.rst with usage examples 2014-07-21 17:10:13 -07:00
Ilya Kreymer
7c57345363 proxy: add 'unaltered_replay' option to proxy_options to replay
all content unaltered (no rewriting html, no banner, no wombat)
use 'proxy_options' instead of 'routing_options', add additional
tests for proxy mode
2014-07-21 16:42:14 -07:00
Ilya Kreymer
950673908d proxy: fix wombat.js to work in proxy mode! rewrite only https -> http 2014-07-21 14:41:49 -07:00
Ilya Kreymer
b8a9f429fb Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 14:03:53 -07:00
Ilya Kreymer
a2973b04e7 wbrequest: add options dictionary to store misc request options 2014-07-21 14:02:31 -07:00
Ilya Kreymer
221cf701f2 Fix spacing in CHANGES.rst 2014-07-20 19:07:56 -07:00
Ilya Kreymer
fa813bdd19 pep8 cleanup pass 2014-07-20 18:26:16 -07:00
Ilya Kreymer
e4297ddabe tests: add integration tests for $liveweb rewrite handler and replay
with fallback
2014-07-20 18:25:47 -07:00
Ilya Kreymer
49deb501a6 fallback: better way of setting fallbacks, check for 'resolve_refs' method on the handler
and pass handler_dict if one exists
2014-07-20 18:24:08 -07:00
Ilya Kreymer
ca405ef179 update version to 0.5.0, update CHANGELIST and README 2014-07-20 16:58:28 -07:00
Ilya Kreymer
fcbc2c2966 replay ui: improvements to framed replay messages.
'is_live' added to live rewrite to allow for different message for live replay
vs archived replay to be used.
When using framed replay, default initial message to 'Loading...'
default index.html: list non-replay access points in default home page
2014-07-20 16:46:30 -07:00
Ilya Kreymer
aa0bc86543 cdxindexer: when indexing entire dir, only look at files with ext .warc.gz, .warc, .arc.gz, .arc files
and skip the rest. (Files with other ext may be specified explicitly)
2014-07-20 16:45:44 -07:00
Ilya Kreymer
3be2763081 handlers: change 'redir_fallback' to 'fallback' as no redirect happens, fallback
called internally
2014-07-20 16:45:14 -07:00
Ilya Kreymer
6da27789eb live handler: allow live rewrite handler to be specified as one of the collections in pywb
by settings index_paths to '$liveweb'. When used, creates a RewriteHandler instead of WBHandler
Can also specify 'proxyhostport' to set the live rewrite to go through a proxy

fallback: allow fallback to a different handler (usually live rewrite) by specifying
'redir_fallback' with name of handler. Instead of 404, a not found response will
internally call the fallback handler to get a response
2014-07-20 16:42:00 -07:00
Ilya Kreymer
b785cd6f08 memento: use mp_ modifier to support memento with frame or non-frame replay
change memento test to use frame replay
2014-07-20 15:43:39 -07:00
Ilya Kreymer
96fcaab521 live-rewrite-server: add ability to specify http/https proxy for live fetching
(for example, for use with a recording proxy)
2014-07-19 14:43:28 -07:00
Ilya Kreymer
f80c27ec00 cookie: add test for 'document.cookie' rewriting 2014-07-15 12:57:02 -07:00
Ilya Kreymer
fa52e0126d cookies: support client side rewriting of document.cooke -> WB_wombat_cookie to rewrite cookie path, if present 2014-07-15 12:52:42 -07:00
Ilya Kreymer
e858b8faae rewrite: better fix for multiple ../ in urls, additional tests 2014-07-14 20:50:45 -07:00
Ilya Kreymer
7032160cf9 rewrite: fix rel url resolution to better handle parent rel path.
Explicitly resolve path when possible, remove only if at root level
2014-07-14 19:13:19 -07:00