backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00
Code Issues Projects Releases Activity
494 Commits 56 Branches 63 Tags
Commit Graph

494 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Kreymer
b92eda77f6 rewrite: add 'bn_' banner only rewrite 
cleanup rewrite_content/fetch_request api to take a full wb_url
add content-length to responses whenever possible (WbResponse) and static files
bump version to 0.5.2
 2014-07-29 12:20:22 -07:00
Ilya Kreymer
9c96026904 proxy-cert-auth: add cli hook for 'proxy-cert-auth' for creating root certs, tweak help 2014-07-28 16:06:01 -07:00
Ilya Kreymer
ba61f23e40 proxy_resolvers: move resolvers to seperate file, default to ProxyAuthResolver (CookieResolver still work-in-progress) 2014-07-28 15:22:22 -07:00
Ilya Kreymer
6234d795dc proxy improvements: refactor coll selector into BaseCollSelector, 
supporting either proxy auth or cookie-based selection (in progress)
https proxy: support POST requests, properly read http header and wrap remainder
in wsgi.input
https proxy: properly update wsgi for wrapped request
wbrequestresponse: add content-length 0 to redir_response
 2014-07-28 14:28:00 -07:00
Ilya Kreymer
b6fb0e510e certauth: clean up CertificatAuthority, add cli interface for creating root cert and host certs 
CertificateAuthority instance creates per-host certs, assume root cert exists
static method generate_ca_root() used to create root cert once
add proxy_options to enable https support
 2014-07-27 19:35:16 -07:00
Ilya Kreymer
2a9197137e certauth: some cleanup for pep8, 2.6 compat 2014-07-26 21:06:28 -07:00
Ilya Kreymer
ae35d92dde fix typo in certauth 2014-07-26 15:27:02 -07:00
Ilya Kreymer
e58a63a9fe setup: add openssl as a req 2014-07-26 14:35:52 -07:00
Ilya Kreymer
5beb831ae9 wbrequestresponse: update doctest 2014-07-26 14:27:31 -07:00
Ilya Kreymer
1464e89c41 wbresponse: always include Content-Length for text_response 2014-07-26 14:24:28 -07:00
Ilya Kreymer
eca3cf5fbf https proxy: add ca generator! 
support uwsgi, gunicorn and ref
better handling of 407, other error responses in response to CONNECT
 2014-07-26 13:24:53 -07:00
Ilya Kreymer
739f23da9e https proxy support, CONNECT verb handling (uwsgi only) 2014-07-26 09:48:44 -07:00
Ilya Kreymer
fb29b6aad9 Merge branch 'develop' 2014-07-24 16:39:24 -07:00
Ilya Kreymer
bdf69ff1a9 tweak CHANGES.rst 2014-07-24 16:38:39 -07:00
Ilya Kreymer
22c210131a bump version to 0.5.1 2014-07-23 15:31:38 -07:00
Ilya Kreymer
8ea7f5d3a0 framed replay: don't use is_timegate to determine frame usage due to potential 
ambiguity, memento will need to use the mp_ modifier
 2014-07-23 15:31:38 -07:00
Ilya Kreymer
e513b3755c cdxindexing: encode unicode filenames using system encoding, 
add test for unicode filenames
 2014-07-23 15:31:38 -07:00
Ilya Kreymer
4d31c17d4c archivalrouter: make SCRIPT_NAME key lookup default to '', addresses #39 2014-07-23 15:31:30 -07:00
Ilya Kreymer
c3fecb6e0d Merge branch 'develop' for 0.5.0 release 0.5.0 2014-07-21 22:56:03 -07:00
Ilya Kreymer
0b8a8f0ae2 live rewrite: catch errors from live rewrite and raise a new LiveResourceError with a 400 error code, 
indicating bad request for live resource. Add test for invalid live rewrite requests
 2014-07-21 22:43:34 -07:00
Ilya Kreymer
2f50a3eafb a few more tweaks to CHANGES.rst 2014-07-21 21:43:40 -07:00
Ilya Kreymer
769ac0784a Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 21:30:05 -07:00
Ilya Kreymer
b8a17b7cab refactor webapp: RewriteLiveHandler and WBHandler share a common base class, 
SearchPageWbUrlHandler which renders the search page when there is no wburl
move some inits from pywb_init to WBHandler itself
 2014-07-21 21:25:10 -07:00
Ilya Kreymer
84e8365838 Update README.rst with usage examples 2014-07-21 17:10:13 -07:00
Ilya Kreymer
7c57345363 proxy: add 'unaltered_replay' option to proxy_options to replay 
all content unaltered (no rewriting html, no banner, no wombat)
use 'proxy_options' instead of 'routing_options', add additional
tests for proxy mode
 2014-07-21 16:42:14 -07:00
Ilya Kreymer
950673908d proxy: fix wombat.js to work in proxy mode! rewrite only https -> http 2014-07-21 14:41:49 -07:00
Ilya Kreymer
b8a9f429fb Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 14:03:53 -07:00
Ilya Kreymer
a2973b04e7 wbrequest: add options dictionary to store misc request options 2014-07-21 14:02:31 -07:00
Ilya Kreymer
221cf701f2 Fix spacing in CHANGES.rst 2014-07-20 19:07:56 -07:00
Ilya Kreymer
fa813bdd19 pep8 cleanup pass 2014-07-20 18:26:16 -07:00
Ilya Kreymer
e4297ddabe tests: add integration tests for $liveweb rewrite handler and replay 
with fallback
 2014-07-20 18:25:47 -07:00
Ilya Kreymer
49deb501a6 fallback: better way of setting fallbacks, check for 'resolve_refs' method on the handler 
and pass handler_dict if one exists
 2014-07-20 18:24:08 -07:00
Ilya Kreymer
ca405ef179 update version to 0.5.0, update CHANGELIST and README 2014-07-20 16:58:28 -07:00
Ilya Kreymer
fcbc2c2966 replay ui: improvements to framed replay messages. 
'is_live' added to live rewrite to allow for different message for live replay
vs archived replay to be used.
When using framed replay, default initial message to 'Loading...'
default index.html: list non-replay access points in default home page
 2014-07-20 16:46:30 -07:00
Ilya Kreymer
aa0bc86543 cdxindexer: when indexing entire dir, only look at files with ext .warc.gz, .warc, .arc.gz, .arc files 
and skip the rest. (Files with other ext may be specified explicitly)
 2014-07-20 16:45:44 -07:00
Ilya Kreymer
3be2763081 handlers: change 'redir_fallback' to 'fallback' as no redirect happens, fallback 
called internally
 2014-07-20 16:45:14 -07:00
Ilya Kreymer
6da27789eb live handler: allow live rewrite handler to be specified as one of the collections in pywb 
by settings index_paths to '$liveweb'. When used, creates a RewriteHandler instead of WBHandler
Can also specify 'proxyhostport' to set the live rewrite to go through a proxy

fallback: allow fallback to a different handler (usually live rewrite) by specifying
'redir_fallback' with name of handler. Instead of 404, a not found response will
internally call the fallback handler to get a response
 2014-07-20 16:42:00 -07:00
Ilya Kreymer
b785cd6f08 memento: use mp_ modifier to support memento with frame or non-frame replay 
change memento test to use frame replay
 2014-07-20 15:43:39 -07:00
Ilya Kreymer
96fcaab521 live-rewrite-server: add ability to specify http/https proxy for live fetching 
(for example, for use with a recording proxy)
 2014-07-19 14:43:28 -07:00
Ilya Kreymer
f80c27ec00 cookie: add test for 'document.cookie' rewriting 2014-07-15 12:57:02 -07:00
Ilya Kreymer
fa52e0126d cookies: support client side rewriting of document.cooke -> WB_wombat_cookie to rewrite cookie path, if present 2014-07-15 12:52:42 -07:00
Ilya Kreymer
e858b8faae rewrite: better fix for multiple ../ in urls, additional tests 2014-07-14 20:50:45 -07:00
Ilya Kreymer
7032160cf9 rewrite: fix rel url resolution to better handle parent rel path. 
Explicitly resolve path when possible, remove only if at root level
 2014-07-14 19:13:19 -07:00
Ilya Kreymer
1b1a1f8115 proxy: add 'proxy_coll_select' config which will require a proxy-auth to select a collection for proxy mode. 
Otherwise, defaults to first available collection, though proxy-auth can still be sent to specify different collection
 2014-07-14 19:12:30 -07:00
Ilya Kreymer
1317b2b10f route selection via proxy auth! 
refactor poute request parsing to happen in the actual router class instead of in the route
in proxy mode, add support for picking a route via proxy-auth
improve test for 'top' rewriting
 2014-07-10 21:54:23 -07:00
Ilya Kreymer
daffc7ff5d header rewrite: pass through 'content-range' header 2014-07-07 17:02:44 -07:00
Ilya Kreymer
02326a2b12 bump dev version to 0.4.8 2014-07-07 17:02:28 -07:00
Ilya Kreymer
7694bf0678 update README.rst for master 0.4.7 2014-07-01 16:22:38 -07:00
Ilya Kreymer
46b16c61d5 update changelist, version to 0.4.7 2014-07-01 16:15:25 -07:00
Ilya Kreymer
2a2240a23a fix 'bad.cdx' sorting order 2014-07-01 15:36:13 -07:00