Ilya Kreymer
d8b11db1e7
wombat:
...
ajax: always explicitly add X-Requested-With: XMLHttpRequest to ajax requests
mutation obs: don't rewrite <link rel=canonical> with node added observer
2015-05-14 22:32:09 -07:00
Ilya Kreymer
e94b239d84
rewrite: when rewriting scheme-relative urls, if adding an absolute prefix, use the scheme of the prefix
...
otherwise, keep relative scheme #101
2015-05-14 22:32:09 -07:00
Ilya Kreymer
fd4a0cc9b1
wombat: add extra mutation observer for any nodes added
2015-05-14 22:32:09 -07:00
Ilya Kreymer
1b9ef4e325
html_rewriter: handle parse_comments by rewriting as html, not as js, should address ikreymer/pywb-webrecorder#7
2015-05-14 22:32:09 -07:00
Ilya Kreymer
40f15cf6ea
rules: add location rewrite only rule for disqus
...
wombat: ensure _orig_setAttribute is still set even if setAttribute rewriting disabled!
2015-05-14 22:32:09 -07:00
Ilya Kreymer
86be72b30a
query_handler: specify matchType exact for all queries, in case url ends in *
2015-05-14 22:32:09 -07:00
Ilya Kreymer
b2e26eeb27
wombat: remove timezone offset, as Date.now() already UTC
2015-05-14 22:32:09 -07:00
Ilya Kreymer
7cbf43872f
wombat: obey _no_rewrite for rewrite_elem()
2015-05-14 22:32:08 -07:00
Ilya Kreymer
15ac7ea1f8
vidrw: just check 'ustream' in url
2015-05-14 22:32:08 -07:00
Ilya Kreymer
7a0ab76a07
vidrw work: limit flashvar parsing to ustream (for now)
2015-05-14 22:32:08 -07:00
Ilya Kreymer
9a90af595c
views: don't add head_insert for ajax requests!
2015-05-14 22:32:08 -07:00
Ilya Kreymer
d657a65469
wombat: fix rewrite_attr not actually being rewritten due to incomplete refactor
...
when is_live, don't add timestamp to rewritten urls (hypothesis/via#11 )
2015-05-14 22:32:08 -07:00
Ilya Kreymer
99ff29e283
js regex rewrite: scheme-rel rewrite must be preceded by a quote no semicolon, to avoid rewriting ;//comment; as url
...
add rewrite tests
2015-05-14 22:32:08 -07:00
Ilya Kreymer
838853e52d
vidrw work: parse first url from flashvars (experimental), add special case for ustream!
2015-05-14 22:32:08 -07:00
Ilya Kreymer
33f247582f
rewrite: HTMLRewriter should insert head_insert at end of stream, if it hasn't
...
been inserted by the end (and if there was some content written -- don't insert for 0-length responses)
Addresses missing head insert if only head tags are present and no head, as per hypothesis/via#9
2015-05-14 22:32:08 -07:00
Ilya Kreymer
48aa73df38
live_rewrite_handler: add _ignore_proxies() callback to allow ignoring proxy settings by derived class
2015-05-14 22:32:08 -07:00
Ilya Kreymer
5072ed568c
fix typos: wombat: fix rewrite not being called on setter
...
frame_insert: ensure <iframe> has separate close tag
recordloader: ensure length used as string
2015-05-14 22:32:07 -07:00
Ilya Kreymer
3a0a18b4e4
rules: update rules for yt
2015-05-14 22:32:07 -07:00
Ilya Kreymer
72982829bd
postMessage: check for rewitten message
2015-05-14 22:32:07 -07:00
Ilya Kreymer
1c61bdcdd7
bump version to 0.9.8-dev
...
fix vidrw to work with mp_ / inverse framed replay!
2015-05-14 22:32:07 -07:00
Ilya Kreymer
733de9bffe
update version to 0.9.7 for release!
2015-04-27 01:01:25 -07:00
Ilya Kreymer
026873e308
rules: add extra fb rule
2015-04-27 00:44:24 -07:00
Ilya Kreymer
160794e4ec
wombat: add options to disable worker override, use mutation observers instead of setAttribute() override
2015-04-27 00:43:10 -07:00
Ilya Kreymer
904b4265e9
wombat typo fix
2015-04-26 18:28:05 -07:00
Ilya Kreymer
a88acb7476
wombat work: add option to use MutationObserver instead of setAttribute override
...
use original setAttribute when calling internally
use querySelectorAll for child element rewrite selection
add check for ':port' being dropped from host url and attempt to add back in
2015-04-24 22:09:08 -07:00
Ilya Kreymer
a91640e464
auto init fix: autoadd collection paths only if archive path is relative and not a url
2015-04-20 18:12:35 -07:00
Ilya Kreymer
d9bd47ea77
wombat: disable always remove slash in extract_orig, as this may break urls that depend
...
on it (and they are different urls anyway)
2015-04-20 17:46:03 -07:00
Ilya Kreymer
5028901a17
tests: add tests for indexing http custom status/verbs with and without verify #99
2015-04-20 08:58:51 -07:00
Ilya Kreymer
08064f3806
warc load: make http response/request protocol/verb validation optional
...
enabled for replay, disabled by default for cdx-indexing, though can
be enabled with -v option #99
2015-04-20 08:29:18 -07:00
Ilya Kreymer
28e3cd791b
bump version to 0.9.7-dev
2015-04-19 22:47:20 -07:00
Ilya Kreymer
a992909cb5
update README and version for 0.9.6
2015-04-17 22:02:28 -07:00
Ilya Kreymer
186acae46c
query_handler: only split scheme once in vi_ mode query
2015-04-17 22:01:05 -07:00
Ilya Kreymer
8bd8485b5a
framed replay fixes: don't use 'window.frames[0]' but get framed by 'replay_iframe' id to allow
...
for custom placement, multiple frames, etc...
ensure outer frame url is updated to canonical (no mod) form for inverse setup as well.
2015-04-17 22:01:04 -07:00
Ilya Kreymer
578323da8a
bump version to 0.9.6-dev
2015-04-17 22:01:04 -07:00
Randall Leeds
2776d5d0b4
Fix typo in handling of no_rewrite_prefixes
2015-04-17 20:03:36 -07:00
Ilya Kreymer
c4ca4b4cb2
update version to 0.9.5!
2015-04-17 12:30:21 -07:00
Ilya Kreymer
8485a8dd80
pywb_init: ensure root route works with liveweb and custom handlers also
2015-04-17 12:20:49 -07:00
Ilya Kreymer
1d49a9fd3b
tests: improved tests for loaders module
2015-04-17 11:02:57 -07:00
Ilya Kreymer
52a7dd87c6
loaders: s3: import boto just once, store s3_avail flag
2015-04-17 11:02:57 -07:00
Ilya Kreymer
c8a9a3ddd4
loaders: add support for loading from s3:// using boto
...
if auth connection fails, attempt anon connection, #97
2015-04-17 11:02:57 -07:00
Ilya Kreymer
74c6b60d5e
wombat customization: pass custom options from config.yaml 'rewrite_opts.client' as a json obj
...
to wombat.js #96
currently supporting no_rewrite_prefixes, and skipping dom, setAttribute and postmessage overrides
(used by via.hypothes.is) -- other options to be added later
2015-04-16 12:24:01 -07:00
Ilya Kreymer
2e4427100c
wombat init refactor: init wbinfo first, then pass wbinfo to wombat
...
to allow for additional options for wombat, in prep for #96
2015-04-16 11:51:25 -07:00
Ilya Kreymer
fbb9de264a
rewrite: cookie: add 'removeall' cookie rewriter which removes all the cookies!
2015-04-14 18:04:51 -07:00
Ilya Kreymer
dcc2139fc8
fuzzy: add fuzzy match for vine
2015-04-13 13:02:55 -07:00
Ilya Kreymer
307809bbe9
live-rewrite-server: switch to 'inverse' frame mode by default,
...
switch from /rewrite/ to /live/ path, update tests
2015-04-13 13:00:06 -07:00
Ilya Kreymer
756b80cac4
rewrite: remove urlrewriter optimization which uses wburl.original_url, as its
...
not realiable (%-encoding, no trailing slash issues) and not really needed.. rename original_url -> _original_url, should not be used
directly.
add test for rewriting when base url has no trailing slash
2015-04-13 12:51:38 -07:00
Ilya Kreymer
9f1ae42d1c
rewrite: security: by default, disable file:// and local access unless explicitly allowed!
...
enable for tests with remote_only=False param
2015-04-13 09:51:12 -07:00
Ilya Kreymer
0aae4264f7
pywb_init: use custom route class for cdx api as well as main handler
2015-04-13 09:48:47 -07:00
Ilya Kreymer
5aee4a193b
cdx fuzzy match: fix when fuzzy replace string is >1 char, keep full replace string (to be examined further)
2015-04-13 09:45:02 -07:00
Ilya Kreymer
b21e288063
wburl to_uri: when parsing scheme, also for first '?' in addition to '/' to catch any irregular urls (to be ignored)
2015-04-11 10:21:52 -07:00