1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00

1205 Commits

Author SHA1 Message Date
Mat Kelly
7c5bf68c6b Added change directory command to samples and tests
Without this additional command, the subsequent commands won't run for the naive user.
2015-05-14 13:32:00 -04:00
Ilya Kreymer
97df6300eb rewrite: when rewriting scheme-relative urls, if adding an absolute prefix, use the scheme of the prefix
otherwise, keep relative scheme #101
2015-05-14 00:46:31 -07:00
Ilya Kreymer
a734ace28f wombat: add extra mutation observer for any nodes added 2015-05-13 23:37:04 -07:00
Ilya Kreymer
11664c8277 html_rewriter: handle parse_comments by rewriting as html, not as js, should address ikreymer/pywb-webrecorder#7 2015-05-13 19:26:03 -07:00
Ilya Kreymer
f276eeba54 rules: add location rewrite only rule for disqus
wombat: ensure _orig_setAttribute is still set even if setAttribute rewriting disabled!
2015-05-13 13:48:08 -07:00
Ilya Kreymer
c9fc8843f0 query_handler: specify matchType exact for all queries, in case url ends in * 2015-05-10 23:06:18 -07:00
Ilya Kreymer
fe6335cf16 wombat: remove timezone offset, as Date.now() already UTC 2015-05-10 20:00:57 -07:00
Ilya Kreymer
52ccf81711 wombat: obey _no_rewrite for rewrite_elem() 2015-05-10 18:15:36 -07:00
Ilya Kreymer
489aaadb8b vidrw: just check 'ustream' in url 2015-05-09 18:31:23 -07:00
Ilya Kreymer
96c5600708 vidrw work: limit flashvar parsing to ustream (for now) 2015-05-09 18:03:55 -07:00
Ilya Kreymer
3cb50f9823 views: don't add head_insert for ajax requests! 2015-05-09 18:03:41 -07:00
Ilya Kreymer
a6eb604273 wombat: fix rewrite_attr not actually being rewritten due to incomplete refactor
when is_live, don't add timestamp to rewritten urls (hypothesis/via#11)
2015-05-09 18:00:53 -07:00
Ilya Kreymer
0f5d32e80e js regex rewrite: scheme-rel rewrite must be preceded by a quote no semicolon, to avoid rewriting ;//comment; as url
add rewrite tests
2015-05-09 17:58:04 -07:00
Ilya Kreymer
8eee469c93 vidrw work: parse first url from flashvars (experimental), add special case for ustream! 2015-05-07 14:43:46 -07:00
Ilya Kreymer
a0b53344f4 rewrite: HTMLRewriter should insert head_insert at end of stream, if it hasn't
been inserted by the end (and if there was some content written -- don't insert for 0-length responses)
Addresses missing head insert if only head tags are present and no head, as per hypothesis/via#9
2015-05-05 22:49:42 -07:00
Ilya Kreymer
00e6d44652 live_rewrite_handler: add _ignore_proxies() callback to allow ignoring proxy settings by derived class 2015-05-03 22:11:29 -07:00
Ilya Kreymer
51f8a585b4 fix typos: wombat: fix rewrite not being called on setter
frame_insert: ensure <iframe> has separate close tag
recordloader: ensure length used as string
2015-05-03 22:10:02 -07:00
Ilya Kreymer
a0a9e0bd01 rules: update rules for yt 2015-05-03 22:09:33 -07:00
Ilya Kreymer
68a19cbdf6 postMessage: check for rewitten message 2015-04-28 10:25:22 -07:00
Ilya Kreymer
af8d775f7c bump version to 0.9.8-dev
fix vidrw to work with mp_ / inverse framed replay!
2015-04-27 16:18:07 -07:00
Ilya Kreymer
733de9bffe update version to 0.9.7 for release! 2015-04-27 01:01:25 -07:00
Ilya Kreymer
360d2342aa CHANGES typo fix 2015-04-27 00:58:09 -07:00
Ilya Kreymer
3364d5f7e2 Update CHANGES.rst for 0.9.7 2015-04-27 00:57:10 -07:00
Ilya Kreymer
026873e308 rules: add extra fb rule 2015-04-27 00:44:24 -07:00
Ilya Kreymer
160794e4ec wombat: add options to disable worker override, use mutation observers instead of setAttribute() override 2015-04-27 00:43:10 -07:00
Ilya Kreymer
904b4265e9 wombat typo fix 2015-04-26 18:28:05 -07:00
Ilya Kreymer
a88acb7476 wombat work: add option to use MutationObserver instead of setAttribute override
use original setAttribute when calling internally
use querySelectorAll for child element rewrite selection
add check for ':port' being dropped from host url and attempt to add back in
2015-04-24 22:09:08 -07:00
Ilya Kreymer
a91640e464 auto init fix: autoadd collection paths only if archive path is relative and not a url 2015-04-20 18:12:35 -07:00
Ilya Kreymer
d9bd47ea77 wombat: disable always remove slash in extract_orig, as this may break urls that depend
on it (and they are different urls anyway)
2015-04-20 17:46:03 -07:00
Ilya Kreymer
5028901a17 tests: add tests for indexing http custom status/verbs with and without verify #99 2015-04-20 08:58:51 -07:00
Ilya Kreymer
08064f3806 warc load: make http response/request protocol/verb validation optional
enabled for replay, disabled by default for cdx-indexing, though can
be enabled with -v option #99
2015-04-20 08:29:18 -07:00
Ilya Kreymer
28e3cd791b bump version to 0.9.7-dev 2015-04-19 22:47:20 -07:00
Ilya Kreymer
a992909cb5 update README and version for 0.9.6 2015-04-17 22:02:28 -07:00
Ilya Kreymer
8aa4a9abdc update changes for 0.9.6 bugfix 2015-04-17 22:01:05 -07:00
Ilya Kreymer
186acae46c query_handler: only split scheme once in vi_ mode query 2015-04-17 22:01:05 -07:00
Ilya Kreymer
8bd8485b5a framed replay fixes: don't use 'window.frames[0]' but get framed by 'replay_iframe' id to allow
for custom placement, multiple frames, etc...

ensure outer frame url is updated to canonical (no mod) form for inverse setup as well.
2015-04-17 22:01:04 -07:00
Ilya Kreymer
578323da8a bump version to 0.9.6-dev 2015-04-17 22:01:04 -07:00
Ilya Kreymer
0ad12a6651 Merge pull request #98 from tilgovi/no-rewrite-typo
Fix typo in handling of no_rewrite_prefixes
2015-04-17 20:20:32 -07:00
Randall Leeds
2776d5d0b4 Fix typo in handling of no_rewrite_prefixes 2015-04-17 20:03:36 -07:00
Ilya Kreymer
206df4ecaf More 0.9.5 changelist tweaks, elaborate on wombat options. 0.9.5 2015-04-17 12:42:51 -07:00
Ilya Kreymer
c4ca4b4cb2 update version to 0.9.5! 2015-04-17 12:30:21 -07:00
Ilya Kreymer
497ba4fd98 tweak CHANGES for 0.9.5 2015-04-17 12:27:07 -07:00
Ilya Kreymer
8485a8dd80 pywb_init: ensure root route works with liveweb and custom handlers also 2015-04-17 12:20:49 -07:00
Ilya Kreymer
7bf8b97cb0 tests: add tests for root collection access, and also a custom handler passed to pywb_init
(a simple redirect handler)
2015-04-17 11:48:50 -07:00
Ilya Kreymer
1d49a9fd3b tests: improved tests for loaders module 2015-04-17 11:02:57 -07:00
Ilya Kreymer
52a7dd87c6 loaders: s3: import boto just once, store s3_avail flag 2015-04-17 11:02:57 -07:00
Ilya Kreymer
c35fd86c76 add boto to .travis.yml for testing s3 2015-04-17 11:02:57 -07:00
Ilya Kreymer
c8a9a3ddd4 loaders: add support for loading from s3:// using boto
if auth connection fails, attempt anon connection, #97
2015-04-17 11:02:57 -07:00
Ilya Kreymer
4db661a09e update README and CHANGES for 0.9.5! 2015-04-17 11:01:54 -07:00
Ilya Kreymer
74c6b60d5e wombat customization: pass custom options from config.yaml 'rewrite_opts.client' as a json obj
to wombat.js #96
currently supporting no_rewrite_prefixes, and skipping dom, setAttribute and postmessage overrides
(used by via.hypothes.is) -- other options to be added later
2015-04-16 12:24:01 -07:00