backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00
Code Issues Projects Releases Activity
851 Commits 56 Branches 63 Tags
Commit Graph

851 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Kreymer
cfe11a5ad3 fix typo param ordering 2014-07-31 11:56:43 -07:00
Ilya Kreymer
522ea87637 proxy: timestamp selection support! 
certauth: wildcard support, use *.host wildcard for proxy certs whenever possible
ui: add coll info/switch and calendar links to banner
 2014-07-31 11:12:50 -07:00
Ilya Kreymer
eff5a74ec7 proxy: path fixup, using default magic name of 'pywb.proxy', default 
selector 'select.pywb.proxy' stored in env['pywb_select'] and accessible
to head insert and error handler
 2014-07-30 13:06:18 -07:00
Ilya Kreymer
527ad0d60e proxy mode: make banner replay and cookie resolver configurable via proxy_options 2014-07-30 10:47:24 -07:00
Ilya Kreymer
96d9f4dcad proxy mode: cookie based selector using session to coll 
ui: add proxy_selector html, add switch link to error and banner
 2014-07-30 10:38:13 -07:00
Ilya Kreymer
fc6ffc6c11 Merge branch 'develop' into https-proxy for 'bn_' modifier support 2014-07-29 12:26:50 -07:00
Ilya Kreymer
607ea1ccf0 proxy resolver: cookie resolver uses session cookies 
proxy static handler: handled via proxy to support http/https
use 'pywb.proxy' prefix for custom env settings
 2014-07-29 12:23:41 -07:00
Ilya Kreymer
b92eda77f6 rewrite: add 'bn_' banner only rewrite 
cleanup rewrite_content/fetch_request api to take a full wb_url
add content-length to responses whenever possible (WbResponse) and static files
bump version to 0.5.2
 2014-07-29 12:20:22 -07:00
Ilya Kreymer
9c96026904 proxy-cert-auth: add cli hook for 'proxy-cert-auth' for creating root certs, tweak help 2014-07-28 16:06:01 -07:00
Ilya Kreymer
ba61f23e40 proxy_resolvers: move resolvers to seperate file, default to ProxyAuthResolver (CookieResolver still work-in-progress) 2014-07-28 15:22:22 -07:00
Ilya Kreymer
6234d795dc proxy improvements: refactor coll selector into BaseCollSelector, 
supporting either proxy auth or cookie-based selection (in progress)
https proxy: support POST requests, properly read http header and wrap remainder
in wsgi.input
https proxy: properly update wsgi for wrapped request
wbrequestresponse: add content-length 0 to redir_response
 2014-07-28 14:28:00 -07:00
Ilya Kreymer
b6fb0e510e certauth: clean up CertificatAuthority, add cli interface for creating root cert and host certs 
CertificateAuthority instance creates per-host certs, assume root cert exists
static method generate_ca_root() used to create root cert once
add proxy_options to enable https support
 2014-07-27 19:35:16 -07:00
Ilya Kreymer
2a9197137e certauth: some cleanup for pep8, 2.6 compat 2014-07-26 21:06:28 -07:00
Ilya Kreymer
ae35d92dde fix typo in certauth 2014-07-26 15:27:02 -07:00
Ilya Kreymer
e58a63a9fe setup: add openssl as a req 2014-07-26 14:35:52 -07:00
Ilya Kreymer
5beb831ae9 wbrequestresponse: update doctest 2014-07-26 14:27:31 -07:00
Ilya Kreymer
1464e89c41 wbresponse: always include Content-Length for text_response 2014-07-26 14:24:28 -07:00
Ilya Kreymer
eca3cf5fbf https proxy: add ca generator! 
support uwsgi, gunicorn and ref
better handling of 407, other error responses in response to CONNECT
 2014-07-26 13:24:53 -07:00
Ilya Kreymer
739f23da9e https proxy support, CONNECT verb handling (uwsgi only) 2014-07-26 09:48:44 -07:00
Ilya Kreymer
fb29b6aad9 Merge branch 'develop' 2014-07-24 16:39:24 -07:00
Ilya Kreymer
bdf69ff1a9 tweak CHANGES.rst 2014-07-24 16:38:39 -07:00
Ilya Kreymer
22c210131a bump version to 0.5.1 2014-07-23 15:31:38 -07:00
Ilya Kreymer
8ea7f5d3a0 framed replay: don't use is_timegate to determine frame usage due to potential 
ambiguity, memento will need to use the mp_ modifier
 2014-07-23 15:31:38 -07:00
Ilya Kreymer
e513b3755c cdxindexing: encode unicode filenames using system encoding, 
add test for unicode filenames
 2014-07-23 15:31:38 -07:00
Ilya Kreymer
4d31c17d4c archivalrouter: make SCRIPT_NAME key lookup default to '', addresses #39 2014-07-23 15:31:30 -07:00
Ilya Kreymer
c3fecb6e0d Merge branch 'develop' for 0.5.0 release 0.5.0 2014-07-21 22:56:03 -07:00
Ilya Kreymer
0b8a8f0ae2 live rewrite: catch errors from live rewrite and raise a new LiveResourceError with a 400 error code, 
indicating bad request for live resource. Add test for invalid live rewrite requests
 2014-07-21 22:43:34 -07:00
Ilya Kreymer
2f50a3eafb a few more tweaks to CHANGES.rst 2014-07-21 21:43:40 -07:00
Ilya Kreymer
769ac0784a Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 21:30:05 -07:00
Ilya Kreymer
b8a17b7cab refactor webapp: RewriteLiveHandler and WBHandler share a common base class, 
SearchPageWbUrlHandler which renders the search page when there is no wburl
move some inits from pywb_init to WBHandler itself
 2014-07-21 21:25:10 -07:00
Ilya Kreymer
84e8365838 Update README.rst with usage examples 2014-07-21 17:10:13 -07:00
Ilya Kreymer
7c57345363 proxy: add 'unaltered_replay' option to proxy_options to replay 
all content unaltered (no rewriting html, no banner, no wombat)
use 'proxy_options' instead of 'routing_options', add additional
tests for proxy mode
 2014-07-21 16:42:14 -07:00
Ilya Kreymer
950673908d proxy: fix wombat.js to work in proxy mode! rewrite only https -> http 2014-07-21 14:41:49 -07:00
Ilya Kreymer
b8a9f429fb Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 14:03:53 -07:00
Ilya Kreymer
a2973b04e7 wbrequest: add options dictionary to store misc request options 2014-07-21 14:02:31 -07:00
Ilya Kreymer
221cf701f2 Fix spacing in CHANGES.rst 2014-07-20 19:07:56 -07:00
Ilya Kreymer
fa813bdd19 pep8 cleanup pass 2014-07-20 18:26:16 -07:00
Ilya Kreymer
e4297ddabe tests: add integration tests for $liveweb rewrite handler and replay 
with fallback
 2014-07-20 18:25:47 -07:00
Ilya Kreymer
49deb501a6 fallback: better way of setting fallbacks, check for 'resolve_refs' method on the handler 
and pass handler_dict if one exists
 2014-07-20 18:24:08 -07:00
Ilya Kreymer
ca405ef179 update version to 0.5.0, update CHANGELIST and README 2014-07-20 16:58:28 -07:00
Ilya Kreymer
fcbc2c2966 replay ui: improvements to framed replay messages. 
'is_live' added to live rewrite to allow for different message for live replay
vs archived replay to be used.
When using framed replay, default initial message to 'Loading...'
default index.html: list non-replay access points in default home page
 2014-07-20 16:46:30 -07:00
Ilya Kreymer
aa0bc86543 cdxindexer: when indexing entire dir, only look at files with ext .warc.gz, .warc, .arc.gz, .arc files 
and skip the rest. (Files with other ext may be specified explicitly)
 2014-07-20 16:45:44 -07:00
Ilya Kreymer
3be2763081 handlers: change 'redir_fallback' to 'fallback' as no redirect happens, fallback 
called internally
 2014-07-20 16:45:14 -07:00
Ilya Kreymer
6da27789eb live handler: allow live rewrite handler to be specified as one of the collections in pywb 
by settings index_paths to '$liveweb'. When used, creates a RewriteHandler instead of WBHandler
Can also specify 'proxyhostport' to set the live rewrite to go through a proxy

fallback: allow fallback to a different handler (usually live rewrite) by specifying
'redir_fallback' with name of handler. Instead of 404, a not found response will
internally call the fallback handler to get a response
 2014-07-20 16:42:00 -07:00
Ilya Kreymer
b785cd6f08 memento: use mp_ modifier to support memento with frame or non-frame replay 
change memento test to use frame replay
 2014-07-20 15:43:39 -07:00
Ilya Kreymer
96fcaab521 live-rewrite-server: add ability to specify http/https proxy for live fetching 
(for example, for use with a recording proxy)
 2014-07-19 14:43:28 -07:00
Ilya Kreymer
f80c27ec00 cookie: add test for 'document.cookie' rewriting 2014-07-15 12:57:02 -07:00
Ilya Kreymer
fa52e0126d cookies: support client side rewriting of document.cooke -> WB_wombat_cookie to rewrite cookie path, if present 2014-07-15 12:52:42 -07:00
Ilya Kreymer
e858b8faae rewrite: better fix for multiple ../ in urls, additional tests 2014-07-14 20:50:45 -07:00
Ilya Kreymer
7032160cf9 rewrite: fix rel url resolution to better handle parent rel path. 
Explicitly resolve path when possible, remove only if at root level
 2014-07-14 19:13:19 -07:00