backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00
Code Issues Projects Releases Activity
436 Commits 56 Branches 63 Tags
Commit Graph

436 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Kreymer
ef8d910d01 banner: remove client side 'capture_str' formatting, just output wbinfo.timestamp, 
allow js to format as needed, also helps with #41
update tests to only look at timestamp
 2014-08-04 22:51:42 -07:00
Ilya Kreymer
103a1c6455 client js: use iframe onload event to detect when iframe changes, allows 
setting banner even for non-html captures, instead of frame notifying parent
will fix issue mentioned in #41
move script from frame_insert.html -> wb_frame.js
 2014-08-04 22:51:42 -07:00
Ilya Kreymer
8d54153326 refactoring for better extensibility: 
remove BaseContentView, move top-frame functionality to SearchPageWbUrlHandler
remove RewriteLiveView, fold functionality into the handler
move default mod setting into RewriteContent
 2014-08-04 22:51:42 -07:00
Ilya Kreymer
160182ec48 rewrite: add 'bn_' banner only rewrite 
cleanup rewrite_content/fetch_request api to take a full wb_url
add content-length to responses whenever possible (WbResponse) and static files
bump version to 0.5.2
 2014-08-04 22:51:42 -07:00
Ilya Kreymer
fb29b6aad9 Merge branch 'develop' 2014-07-24 16:39:24 -07:00
Ilya Kreymer
bdf69ff1a9 tweak CHANGES.rst 2014-07-24 16:38:39 -07:00
Ilya Kreymer
22c210131a bump version to 0.5.1 2014-07-23 15:31:38 -07:00
Ilya Kreymer
8ea7f5d3a0 framed replay: don't use is_timegate to determine frame usage due to potential 
ambiguity, memento will need to use the mp_ modifier
 2014-07-23 15:31:38 -07:00
Ilya Kreymer
e513b3755c cdxindexing: encode unicode filenames using system encoding, 
add test for unicode filenames
 2014-07-23 15:31:38 -07:00
Ilya Kreymer
4d31c17d4c archivalrouter: make SCRIPT_NAME key lookup default to '', addresses #39 2014-07-23 15:31:30 -07:00
Ilya Kreymer
c3fecb6e0d Merge branch 'develop' for 0.5.0 release 0.5.0 2014-07-21 22:56:03 -07:00
Ilya Kreymer
0b8a8f0ae2 live rewrite: catch errors from live rewrite and raise a new LiveResourceError with a 400 error code, 
indicating bad request for live resource. Add test for invalid live rewrite requests
 2014-07-21 22:43:34 -07:00
Ilya Kreymer
2f50a3eafb a few more tweaks to CHANGES.rst 2014-07-21 21:43:40 -07:00
Ilya Kreymer
769ac0784a Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 21:30:05 -07:00
Ilya Kreymer
b8a17b7cab refactor webapp: RewriteLiveHandler and WBHandler share a common base class, 
SearchPageWbUrlHandler which renders the search page when there is no wburl
move some inits from pywb_init to WBHandler itself
 2014-07-21 21:25:10 -07:00
Ilya Kreymer
84e8365838 Update README.rst with usage examples 2014-07-21 17:10:13 -07:00
Ilya Kreymer
7c57345363 proxy: add 'unaltered_replay' option to proxy_options to replay 
all content unaltered (no rewriting html, no banner, no wombat)
use 'proxy_options' instead of 'routing_options', add additional
tests for proxy mode
 2014-07-21 16:42:14 -07:00
Ilya Kreymer
950673908d proxy: fix wombat.js to work in proxy mode! rewrite only https -> http 2014-07-21 14:41:49 -07:00
Ilya Kreymer
b8a9f429fb Merge branch 'develop' of https://github.com/ikreymer/pywb into develop 2014-07-21 14:03:53 -07:00
Ilya Kreymer
a2973b04e7 wbrequest: add options dictionary to store misc request options 2014-07-21 14:02:31 -07:00
Ilya Kreymer
221cf701f2 Fix spacing in CHANGES.rst 2014-07-20 19:07:56 -07:00
Ilya Kreymer
fa813bdd19 pep8 cleanup pass 2014-07-20 18:26:16 -07:00
Ilya Kreymer
e4297ddabe tests: add integration tests for $liveweb rewrite handler and replay 
with fallback
 2014-07-20 18:25:47 -07:00
Ilya Kreymer
49deb501a6 fallback: better way of setting fallbacks, check for 'resolve_refs' method on the handler 
and pass handler_dict if one exists
 2014-07-20 18:24:08 -07:00
Ilya Kreymer
ca405ef179 update version to 0.5.0, update CHANGELIST and README 2014-07-20 16:58:28 -07:00
Ilya Kreymer
fcbc2c2966 replay ui: improvements to framed replay messages. 
'is_live' added to live rewrite to allow for different message for live replay
vs archived replay to be used.
When using framed replay, default initial message to 'Loading...'
default index.html: list non-replay access points in default home page
 2014-07-20 16:46:30 -07:00
Ilya Kreymer
aa0bc86543 cdxindexer: when indexing entire dir, only look at files with ext .warc.gz, .warc, .arc.gz, .arc files 
and skip the rest. (Files with other ext may be specified explicitly)
 2014-07-20 16:45:44 -07:00
Ilya Kreymer
3be2763081 handlers: change 'redir_fallback' to 'fallback' as no redirect happens, fallback 
called internally
 2014-07-20 16:45:14 -07:00
Ilya Kreymer
6da27789eb live handler: allow live rewrite handler to be specified as one of the collections in pywb 
by settings index_paths to '$liveweb'. When used, creates a RewriteHandler instead of WBHandler
Can also specify 'proxyhostport' to set the live rewrite to go through a proxy

fallback: allow fallback to a different handler (usually live rewrite) by specifying
'redir_fallback' with name of handler. Instead of 404, a not found response will
internally call the fallback handler to get a response
 2014-07-20 16:42:00 -07:00
Ilya Kreymer
b785cd6f08 memento: use mp_ modifier to support memento with frame or non-frame replay 
change memento test to use frame replay
 2014-07-20 15:43:39 -07:00
Ilya Kreymer
96fcaab521 live-rewrite-server: add ability to specify http/https proxy for live fetching 
(for example, for use with a recording proxy)
 2014-07-19 14:43:28 -07:00
Ilya Kreymer
f80c27ec00 cookie: add test for 'document.cookie' rewriting 2014-07-15 12:57:02 -07:00
Ilya Kreymer
fa52e0126d cookies: support client side rewriting of document.cooke -> WB_wombat_cookie to rewrite cookie path, if present 2014-07-15 12:52:42 -07:00
Ilya Kreymer
e858b8faae rewrite: better fix for multiple ../ in urls, additional tests 2014-07-14 20:50:45 -07:00
Ilya Kreymer
7032160cf9 rewrite: fix rel url resolution to better handle parent rel path. 
Explicitly resolve path when possible, remove only if at root level
 2014-07-14 19:13:19 -07:00
Ilya Kreymer
1b1a1f8115 proxy: add 'proxy_coll_select' config which will require a proxy-auth to select a collection for proxy mode. 
Otherwise, defaults to first available collection, though proxy-auth can still be sent to specify different collection
 2014-07-14 19:12:30 -07:00
Ilya Kreymer
1317b2b10f route selection via proxy auth! 
refactor poute request parsing to happen in the actual router class instead of in the route
in proxy mode, add support for picking a route via proxy-auth
improve test for 'top' rewriting
 2014-07-10 21:54:23 -07:00
Ilya Kreymer
daffc7ff5d header rewrite: pass through 'content-range' header 2014-07-07 17:02:44 -07:00
Ilya Kreymer
02326a2b12 bump dev version to 0.4.8 2014-07-07 17:02:28 -07:00
Ilya Kreymer
7694bf0678 update README.rst for master 0.4.7 2014-07-01 16:22:38 -07:00
Ilya Kreymer
46b16c61d5 update changelist, version to 0.4.7 2014-07-01 16:15:25 -07:00
Ilya Kreymer
2a2240a23a fix 'bad.cdx' sorting order 2014-07-01 15:36:13 -07:00
Ilya Kreymer
1a42331e69 Merge branch 'develop' into binary-parse 2014-07-01 10:00:05 -07:00
Ilya Kreymer
1980b66127 warc indexing: in include_all mode, pass 'warcinfo' records to writer, allowing it to option to handle or ignore 2014-07-01 09:59:16 -07:00
Ilya Kreymer
57a38dedce Merge branch 'develop' into binary-parse 2014-06-28 11:53:50 -07:00
Ilya Kreymer
377ea33bc8 tests: add test for wombat top 2014-06-28 11:53:23 -07:00
Ilya Kreymer
b0f7fdbed8 regexrewrite: fix rewrite for 'top' 2014-06-28 11:50:11 -07:00
Ilya Kreymer
f2bfc96002 Merge branch 'develop' into binary-parse 2014-06-28 11:04:43 -07:00
Ilya Kreymer
83b69e8447 indexing: don't include records of type 'application/warc-fields' unless all records are being included 2014-06-28 11:03:44 -07:00
Ilya Kreymer
70b7e29b36 pass raw bytes to htmlparser, assuming ascii-compatibility 
(todo: add tests for non-ascii compatible encodings)
improved rendering of certain pages, needs more testing

lxml: remove lxml and complexity associated with having the parser,
as its too unpredictable for older html, does its own decoding.
 2014-06-27 19:03:06 -07:00