backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 08:04:49 +01:00
Code Issues Projects Releases Activity
959 Commits 56 Branches 63 Tags
Commit Graph

959 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Kreymer
557f26b852 config: allow custom config.yaml settings for automatic collections. 
settings in config.yaml are merged with collection-specific settings, which take precedence
(before, the config.yaml settings were being overwritten) #103
 2015-05-14 22:32:09 -07:00
Ilya Kreymer
d2763004dd wombat: for now, disable node observers by default 2015-05-14 22:32:09 -07:00
Ilya Kreymer
d8b11db1e7 wombat: 
ajax: always explicitly add X-Requested-With: XMLHttpRequest to ajax requests
mutation obs: don't rewrite <link rel=canonical> with node added observer
 2015-05-14 22:32:09 -07:00
Ilya Kreymer
e94b239d84 rewrite: when rewriting scheme-relative urls, if adding an absolute prefix, use the scheme of the prefix 
otherwise, keep relative scheme #101
 2015-05-14 22:32:09 -07:00
Ilya Kreymer
fd4a0cc9b1 wombat: add extra mutation observer for any nodes added 2015-05-14 22:32:09 -07:00
Ilya Kreymer
1b9ef4e325 html_rewriter: handle parse_comments by rewriting as html, not as js, should address ikreymer/pywb-webrecorder#7 2015-05-14 22:32:09 -07:00
Ilya Kreymer
40f15cf6ea rules: add location rewrite only rule for disqus 
wombat: ensure _orig_setAttribute is still set even if setAttribute rewriting disabled!
 2015-05-14 22:32:09 -07:00
Ilya Kreymer
86be72b30a query_handler: specify matchType exact for all queries, in case url ends in * 2015-05-14 22:32:09 -07:00
Ilya Kreymer
b2e26eeb27 wombat: remove timezone offset, as Date.now() already UTC 2015-05-14 22:32:09 -07:00
Ilya Kreymer
7cbf43872f wombat: obey _no_rewrite for rewrite_elem() 2015-05-14 22:32:08 -07:00
Ilya Kreymer
15ac7ea1f8 vidrw: just check 'ustream' in url 2015-05-14 22:32:08 -07:00
Ilya Kreymer
7a0ab76a07 vidrw work: limit flashvar parsing to ustream (for now) 2015-05-14 22:32:08 -07:00
Ilya Kreymer
9a90af595c views: don't add head_insert for ajax requests! 2015-05-14 22:32:08 -07:00
Ilya Kreymer
d657a65469 wombat: fix rewrite_attr not actually being rewritten due to incomplete refactor 
when is_live, don't add timestamp to rewritten urls (hypothesis/via#11)
 2015-05-14 22:32:08 -07:00
Ilya Kreymer
99ff29e283 js regex rewrite: scheme-rel rewrite must be preceded by a quote no semicolon, to avoid rewriting ;//comment; as url 
add rewrite tests
 2015-05-14 22:32:08 -07:00
Ilya Kreymer
838853e52d vidrw work: parse first url from flashvars (experimental), add special case for ustream! 2015-05-14 22:32:08 -07:00
Ilya Kreymer
33f247582f rewrite: HTMLRewriter should insert head_insert at end of stream, if it hasn't 
been inserted by the end (and if there was some content written -- don't insert for 0-length responses)
Addresses missing head insert if only head tags are present and no head, as per hypothesis/via#9
 2015-05-14 22:32:08 -07:00
Ilya Kreymer
48aa73df38 live_rewrite_handler: add _ignore_proxies() callback to allow ignoring proxy settings by derived class 2015-05-14 22:32:08 -07:00
Ilya Kreymer
5072ed568c fix typos: wombat: fix rewrite not being called on setter 
frame_insert: ensure <iframe> has separate close tag
recordloader: ensure length used as string
 2015-05-14 22:32:07 -07:00
Ilya Kreymer
3a0a18b4e4 rules: update rules for yt 2015-05-14 22:32:07 -07:00
Ilya Kreymer
72982829bd postMessage: check for rewitten message 2015-05-14 22:32:07 -07:00
Ilya Kreymer
1c61bdcdd7 bump version to 0.9.8-dev 
fix vidrw to work with mp_ / inverse framed replay!
 2015-05-14 22:32:07 -07:00
Ilya Kreymer
5302d56492 Merge pull request #102 from machawk1/master 
Added change directory command to samples and tests
 2015-05-14 11:32:12 -07:00
Mat Kelly
7c5bf68c6b Added change directory command to samples and tests 
Without this additional command, the subsequent commands won't run for the naive user.
 2015-05-14 13:32:00 -04:00
Ilya Kreymer
733de9bffe update version to 0.9.7 for release! 2015-04-27 01:01:25 -07:00
Ilya Kreymer
360d2342aa CHANGES typo fix 2015-04-27 00:58:09 -07:00
Ilya Kreymer
3364d5f7e2 Update CHANGES.rst for 0.9.7 2015-04-27 00:57:10 -07:00
Ilya Kreymer
026873e308 rules: add extra fb rule 2015-04-27 00:44:24 -07:00
Ilya Kreymer
160794e4ec wombat: add options to disable worker override, use mutation observers instead of setAttribute() override 2015-04-27 00:43:10 -07:00
Ilya Kreymer
904b4265e9 wombat typo fix 2015-04-26 18:28:05 -07:00
Ilya Kreymer
a88acb7476 wombat work: add option to use MutationObserver instead of setAttribute override 
use original setAttribute when calling internally
use querySelectorAll for child element rewrite selection
add check for ':port' being dropped from host url and attempt to add back in
 2015-04-24 22:09:08 -07:00
Ilya Kreymer
a91640e464 auto init fix: autoadd collection paths only if archive path is relative and not a url 2015-04-20 18:12:35 -07:00
Ilya Kreymer
d9bd47ea77 wombat: disable always remove slash in extract_orig, as this may break urls that depend 
on it (and they are different urls anyway)
 2015-04-20 17:46:03 -07:00
Ilya Kreymer
5028901a17 tests: add tests for indexing http custom status/verbs with and without verify #99 2015-04-20 08:58:51 -07:00
Ilya Kreymer
08064f3806 warc load: make http response/request protocol/verb validation optional 
enabled for replay, disabled by default for cdx-indexing, though can
be enabled with -v option #99
 2015-04-20 08:29:18 -07:00
Ilya Kreymer
28e3cd791b bump version to 0.9.7-dev 2015-04-19 22:47:20 -07:00
Ilya Kreymer
a992909cb5 update README and version for 0.9.6 2015-04-17 22:02:28 -07:00
Ilya Kreymer
8aa4a9abdc update changes for 0.9.6 bugfix 2015-04-17 22:01:05 -07:00
Ilya Kreymer
186acae46c query_handler: only split scheme once in vi_ mode query 2015-04-17 22:01:05 -07:00
Ilya Kreymer
8bd8485b5a framed replay fixes: don't use 'window.frames[0]' but get framed by 'replay_iframe' id to allow 
for custom placement, multiple frames, etc...

ensure outer frame url is updated to canonical (no mod) form for inverse setup as well.
 2015-04-17 22:01:04 -07:00
Ilya Kreymer
578323da8a bump version to 0.9.6-dev 2015-04-17 22:01:04 -07:00
Ilya Kreymer
0ad12a6651 Merge pull request #98 from tilgovi/no-rewrite-typo 
Fix typo in handling of no_rewrite_prefixes
 2015-04-17 20:20:32 -07:00
Randall Leeds
2776d5d0b4 Fix typo in handling of no_rewrite_prefixes 2015-04-17 20:03:36 -07:00
Ilya Kreymer
206df4ecaf More 0.9.5 changelist tweaks, elaborate on wombat options. 0.9.5 2015-04-17 12:42:51 -07:00
Ilya Kreymer
c4ca4b4cb2 update version to 0.9.5! 2015-04-17 12:30:21 -07:00
Ilya Kreymer
497ba4fd98 tweak CHANGES for 0.9.5 2015-04-17 12:27:07 -07:00
Ilya Kreymer
8485a8dd80 pywb_init: ensure root route works with liveweb and custom handlers also 2015-04-17 12:20:49 -07:00
Ilya Kreymer
7bf8b97cb0 tests: add tests for root collection access, and also a custom handler passed to pywb_init 
(a simple redirect handler)
 2015-04-17 11:48:50 -07:00
Ilya Kreymer
1d49a9fd3b tests: improved tests for loaders module 2015-04-17 11:02:57 -07:00
Ilya Kreymer
52a7dd87c6 loaders: s3: import boto just once, store s3_avail flag 2015-04-17 11:02:57 -07:00