Ilya Kreymer
ef8d910d01
banner: remove client side 'capture_str' formatting, just output wbinfo.timestamp,
...
allow js to format as needed, also helps with #41
update tests to only look at timestamp
2014-08-04 22:51:42 -07:00
Ilya Kreymer
103a1c6455
client js: use iframe onload event to detect when iframe changes, allows
...
setting banner even for non-html captures, instead of frame notifying parent
will fix issue mentioned in #41
move script from frame_insert.html -> wb_frame.js
2014-08-04 22:51:42 -07:00
Ilya Kreymer
8d54153326
refactoring for better extensibility:
...
remove BaseContentView, move top-frame functionality to SearchPageWbUrlHandler
remove RewriteLiveView, fold functionality into the handler
move default mod setting into RewriteContent
2014-08-04 22:51:42 -07:00
Ilya Kreymer
160182ec48
rewrite: add 'bn_' banner only rewrite
...
cleanup rewrite_content/fetch_request api to take a full wb_url
add content-length to responses whenever possible (WbResponse) and static files
bump version to 0.5.2
2014-08-04 22:51:42 -07:00
Ilya Kreymer
fb29b6aad9
Merge branch 'develop'
2014-07-24 16:39:24 -07:00
Ilya Kreymer
bdf69ff1a9
tweak CHANGES.rst
2014-07-24 16:38:39 -07:00
Ilya Kreymer
22c210131a
bump version to 0.5.1
2014-07-23 15:31:38 -07:00
Ilya Kreymer
8ea7f5d3a0
framed replay: don't use is_timegate to determine frame usage due to potential
...
ambiguity, memento will need to use the mp_ modifier
2014-07-23 15:31:38 -07:00
Ilya Kreymer
e513b3755c
cdxindexing: encode unicode filenames using system encoding,
...
add test for unicode filenames
2014-07-23 15:31:38 -07:00
Ilya Kreymer
4d31c17d4c
archivalrouter: make SCRIPT_NAME key lookup default to '', addresses #39
2014-07-23 15:31:30 -07:00
Ilya Kreymer
c3fecb6e0d
Merge branch 'develop' for 0.5.0 release
0.5.0
2014-07-21 22:56:03 -07:00
Ilya Kreymer
0b8a8f0ae2
live rewrite: catch errors from live rewrite and raise a new LiveResourceError with a 400 error code,
...
indicating bad request for live resource. Add test for invalid live rewrite requests
2014-07-21 22:43:34 -07:00
Ilya Kreymer
2f50a3eafb
a few more tweaks to CHANGES.rst
2014-07-21 21:43:40 -07:00
Ilya Kreymer
769ac0784a
Merge branch 'develop' of https://github.com/ikreymer/pywb into develop
2014-07-21 21:30:05 -07:00
Ilya Kreymer
b8a17b7cab
refactor webapp: RewriteLiveHandler and WBHandler share a common base class,
...
SearchPageWbUrlHandler which renders the search page when there is no wburl
move some inits from pywb_init to WBHandler itself
2014-07-21 21:25:10 -07:00
Ilya Kreymer
84e8365838
Update README.rst with usage examples
2014-07-21 17:10:13 -07:00
Ilya Kreymer
7c57345363
proxy: add 'unaltered_replay' option to proxy_options to replay
...
all content unaltered (no rewriting html, no banner, no wombat)
use 'proxy_options' instead of 'routing_options', add additional
tests for proxy mode
2014-07-21 16:42:14 -07:00
Ilya Kreymer
950673908d
proxy: fix wombat.js to work in proxy mode! rewrite only https -> http
2014-07-21 14:41:49 -07:00
Ilya Kreymer
b8a9f429fb
Merge branch 'develop' of https://github.com/ikreymer/pywb into develop
2014-07-21 14:03:53 -07:00
Ilya Kreymer
a2973b04e7
wbrequest: add options dictionary to store misc request options
2014-07-21 14:02:31 -07:00
Ilya Kreymer
221cf701f2
Fix spacing in CHANGES.rst
2014-07-20 19:07:56 -07:00
Ilya Kreymer
fa813bdd19
pep8 cleanup pass
2014-07-20 18:26:16 -07:00
Ilya Kreymer
e4297ddabe
tests: add integration tests for $liveweb rewrite handler and replay
...
with fallback
2014-07-20 18:25:47 -07:00
Ilya Kreymer
49deb501a6
fallback: better way of setting fallbacks, check for 'resolve_refs' method on the handler
...
and pass handler_dict if one exists
2014-07-20 18:24:08 -07:00
Ilya Kreymer
ca405ef179
update version to 0.5.0, update CHANGELIST and README
2014-07-20 16:58:28 -07:00
Ilya Kreymer
fcbc2c2966
replay ui: improvements to framed replay messages.
...
'is_live' added to live rewrite to allow for different message for live replay
vs archived replay to be used.
When using framed replay, default initial message to 'Loading...'
default index.html: list non-replay access points in default home page
2014-07-20 16:46:30 -07:00
Ilya Kreymer
aa0bc86543
cdxindexer: when indexing entire dir, only look at files with ext .warc.gz, .warc, .arc.gz, .arc files
...
and skip the rest. (Files with other ext may be specified explicitly)
2014-07-20 16:45:44 -07:00
Ilya Kreymer
3be2763081
handlers: change 'redir_fallback' to 'fallback' as no redirect happens, fallback
...
called internally
2014-07-20 16:45:14 -07:00
Ilya Kreymer
6da27789eb
live handler: allow live rewrite handler to be specified as one of the collections in pywb
...
by settings index_paths to '$liveweb'. When used, creates a RewriteHandler instead of WBHandler
Can also specify 'proxyhostport' to set the live rewrite to go through a proxy
fallback: allow fallback to a different handler (usually live rewrite) by specifying
'redir_fallback' with name of handler. Instead of 404, a not found response will
internally call the fallback handler to get a response
2014-07-20 16:42:00 -07:00
Ilya Kreymer
b785cd6f08
memento: use mp_ modifier to support memento with frame or non-frame replay
...
change memento test to use frame replay
2014-07-20 15:43:39 -07:00
Ilya Kreymer
96fcaab521
live-rewrite-server: add ability to specify http/https proxy for live fetching
...
(for example, for use with a recording proxy)
2014-07-19 14:43:28 -07:00
Ilya Kreymer
f80c27ec00
cookie: add test for 'document.cookie' rewriting
2014-07-15 12:57:02 -07:00
Ilya Kreymer
fa52e0126d
cookies: support client side rewriting of document.cooke -> WB_wombat_cookie to rewrite cookie path, if present
2014-07-15 12:52:42 -07:00
Ilya Kreymer
e858b8faae
rewrite: better fix for multiple ../ in urls, additional tests
2014-07-14 20:50:45 -07:00
Ilya Kreymer
7032160cf9
rewrite: fix rel url resolution to better handle parent rel path.
...
Explicitly resolve path when possible, remove only if at root level
2014-07-14 19:13:19 -07:00
Ilya Kreymer
1b1a1f8115
proxy: add 'proxy_coll_select' config which will require a proxy-auth to select a collection for proxy mode.
...
Otherwise, defaults to first available collection, though proxy-auth can still be sent to specify different collection
2014-07-14 19:12:30 -07:00
Ilya Kreymer
1317b2b10f
route selection via proxy auth!
...
refactor poute request parsing to happen in the actual router class instead of in the route
in proxy mode, add support for picking a route via proxy-auth
improve test for 'top' rewriting
2014-07-10 21:54:23 -07:00
Ilya Kreymer
daffc7ff5d
header rewrite: pass through 'content-range' header
2014-07-07 17:02:44 -07:00
Ilya Kreymer
02326a2b12
bump dev version to 0.4.8
2014-07-07 17:02:28 -07:00
Ilya Kreymer
7694bf0678
update README.rst for master 0.4.7
2014-07-01 16:22:38 -07:00
Ilya Kreymer
46b16c61d5
update changelist, version to 0.4.7
2014-07-01 16:15:25 -07:00
Ilya Kreymer
2a2240a23a
fix 'bad.cdx' sorting order
2014-07-01 15:36:13 -07:00
Ilya Kreymer
1a42331e69
Merge branch 'develop' into binary-parse
2014-07-01 10:00:05 -07:00
Ilya Kreymer
1980b66127
warc indexing: in include_all mode, pass 'warcinfo' records to writer, allowing it to option to handle or ignore
2014-07-01 09:59:16 -07:00
Ilya Kreymer
57a38dedce
Merge branch 'develop' into binary-parse
2014-06-28 11:53:50 -07:00
Ilya Kreymer
377ea33bc8
tests: add test for wombat top
2014-06-28 11:53:23 -07:00
Ilya Kreymer
b0f7fdbed8
regexrewrite: fix rewrite for 'top'
2014-06-28 11:50:11 -07:00
Ilya Kreymer
f2bfc96002
Merge branch 'develop' into binary-parse
2014-06-28 11:04:43 -07:00
Ilya Kreymer
83b69e8447
indexing: don't include records of type 'application/warc-fields' unless all records are being included
2014-06-28 11:03:44 -07:00
Ilya Kreymer
70b7e29b36
pass raw bytes to htmlparser, assuming ascii-compatibility
...
(todo: add tests for non-ascii compatible encodings)
improved rendering of certain pages, needs more testing
lxml: remove lxml and complexity associated with having the parser,
as its too unpredictable for older html, does its own decoding.
2014-06-27 19:03:06 -07:00