1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00

936 Commits

Author SHA1 Message Date
Mat Kelly
7c5bf68c6b Added change directory command to samples and tests
Without this additional command, the subsequent commands won't run for the naive user.
2015-05-14 13:32:00 -04:00
Ilya Kreymer
733de9bffe update version to 0.9.7 for release! 2015-04-27 01:01:25 -07:00
Ilya Kreymer
360d2342aa CHANGES typo fix 2015-04-27 00:58:09 -07:00
Ilya Kreymer
3364d5f7e2 Update CHANGES.rst for 0.9.7 2015-04-27 00:57:10 -07:00
Ilya Kreymer
026873e308 rules: add extra fb rule 2015-04-27 00:44:24 -07:00
Ilya Kreymer
160794e4ec wombat: add options to disable worker override, use mutation observers instead of setAttribute() override 2015-04-27 00:43:10 -07:00
Ilya Kreymer
904b4265e9 wombat typo fix 2015-04-26 18:28:05 -07:00
Ilya Kreymer
a88acb7476 wombat work: add option to use MutationObserver instead of setAttribute override
use original setAttribute when calling internally
use querySelectorAll for child element rewrite selection
add check for ':port' being dropped from host url and attempt to add back in
2015-04-24 22:09:08 -07:00
Ilya Kreymer
a91640e464 auto init fix: autoadd collection paths only if archive path is relative and not a url 2015-04-20 18:12:35 -07:00
Ilya Kreymer
d9bd47ea77 wombat: disable always remove slash in extract_orig, as this may break urls that depend
on it (and they are different urls anyway)
2015-04-20 17:46:03 -07:00
Ilya Kreymer
5028901a17 tests: add tests for indexing http custom status/verbs with and without verify #99 2015-04-20 08:58:51 -07:00
Ilya Kreymer
08064f3806 warc load: make http response/request protocol/verb validation optional
enabled for replay, disabled by default for cdx-indexing, though can
be enabled with -v option #99
2015-04-20 08:29:18 -07:00
Ilya Kreymer
28e3cd791b bump version to 0.9.7-dev 2015-04-19 22:47:20 -07:00
Ilya Kreymer
a992909cb5 update README and version for 0.9.6 2015-04-17 22:02:28 -07:00
Ilya Kreymer
8aa4a9abdc update changes for 0.9.6 bugfix 2015-04-17 22:01:05 -07:00
Ilya Kreymer
186acae46c query_handler: only split scheme once in vi_ mode query 2015-04-17 22:01:05 -07:00
Ilya Kreymer
8bd8485b5a framed replay fixes: don't use 'window.frames[0]' but get framed by 'replay_iframe' id to allow
for custom placement, multiple frames, etc...

ensure outer frame url is updated to canonical (no mod) form for inverse setup as well.
2015-04-17 22:01:04 -07:00
Ilya Kreymer
578323da8a bump version to 0.9.6-dev 2015-04-17 22:01:04 -07:00
Ilya Kreymer
0ad12a6651 Merge pull request #98 from tilgovi/no-rewrite-typo
Fix typo in handling of no_rewrite_prefixes
2015-04-17 20:20:32 -07:00
Randall Leeds
2776d5d0b4 Fix typo in handling of no_rewrite_prefixes 2015-04-17 20:03:36 -07:00
Ilya Kreymer
206df4ecaf More 0.9.5 changelist tweaks, elaborate on wombat options. 0.9.5 2015-04-17 12:42:51 -07:00
Ilya Kreymer
c4ca4b4cb2 update version to 0.9.5! 2015-04-17 12:30:21 -07:00
Ilya Kreymer
497ba4fd98 tweak CHANGES for 0.9.5 2015-04-17 12:27:07 -07:00
Ilya Kreymer
8485a8dd80 pywb_init: ensure root route works with liveweb and custom handlers also 2015-04-17 12:20:49 -07:00
Ilya Kreymer
7bf8b97cb0 tests: add tests for root collection access, and also a custom handler passed to pywb_init
(a simple redirect handler)
2015-04-17 11:48:50 -07:00
Ilya Kreymer
1d49a9fd3b tests: improved tests for loaders module 2015-04-17 11:02:57 -07:00
Ilya Kreymer
52a7dd87c6 loaders: s3: import boto just once, store s3_avail flag 2015-04-17 11:02:57 -07:00
Ilya Kreymer
c35fd86c76 add boto to .travis.yml for testing s3 2015-04-17 11:02:57 -07:00
Ilya Kreymer
c8a9a3ddd4 loaders: add support for loading from s3:// using boto
if auth connection fails, attempt anon connection, #97
2015-04-17 11:02:57 -07:00
Ilya Kreymer
4db661a09e update README and CHANGES for 0.9.5! 2015-04-17 11:01:54 -07:00
Ilya Kreymer
74c6b60d5e wombat customization: pass custom options from config.yaml 'rewrite_opts.client' as a json obj
to wombat.js #96
currently supporting no_rewrite_prefixes, and skipping dom, setAttribute and postmessage overrides
(used by via.hypothes.is) -- other options to be added later
2015-04-16 12:24:01 -07:00
Ilya Kreymer
2e4427100c wombat init refactor: init wbinfo first, then pass wbinfo to wombat
to allow for additional options for wombat, in prep for #96
2015-04-16 11:51:25 -07:00
Ilya Kreymer
fbb9de264a rewrite: cookie: add 'removeall' cookie rewriter which removes all the cookies! 2015-04-14 18:04:51 -07:00
Ilya Kreymer
dcc2139fc8 fuzzy: add fuzzy match for vine 2015-04-13 13:02:55 -07:00
Ilya Kreymer
307809bbe9 live-rewrite-server: switch to 'inverse' frame mode by default,
switch from /rewrite/ to /live/ path, update tests
2015-04-13 13:00:06 -07:00
Ilya Kreymer
756b80cac4 rewrite: remove urlrewriter optimization which uses wburl.original_url, as its
not realiable (%-encoding, no trailing slash issues) and not really needed.. rename original_url -> _original_url, should not be used
directly.
add test for rewriting when base url has no trailing slash
2015-04-13 12:51:38 -07:00
Ilya Kreymer
9f1ae42d1c rewrite: security: by default, disable file:// and local access unless explicitly allowed!
enable for tests with remote_only=False param
2015-04-13 09:51:12 -07:00
Ilya Kreymer
0aae4264f7 pywb_init: use custom route class for cdx api as well as main handler 2015-04-13 09:48:47 -07:00
Ilya Kreymer
5aee4a193b cdx fuzzy match: fix when fuzzy replace string is >1 char, keep full replace string (to be examined further) 2015-04-13 09:45:02 -07:00
Ilya Kreymer
b21e288063 wburl to_uri: when parsing scheme, also for first '?' in addition to '/' to catch any irregular urls (to be ignored) 2015-04-11 10:21:52 -07:00
Ilya Kreymer
d39f26872d error handling: pass in wbrequest to not_found error handler 2015-04-11 00:25:59 -07:00
Ilya Kreymer
4469754a5a routing: improved support for root collection via empty route. If '' route present,
add it last to avoid conflicting w/ other routes (#94)
templates: pass in custom params to jinja2 template via env 'pywb.template_params' dictionary.
If present, dictionary contents will be added directly to jinja context for the request (#95)
2015-04-10 14:47:02 -07:00
Ilya Kreymer
4bf1dd4cad urlrewriter: simply startswith check by using tuple 2015-04-10 14:46:46 -07:00
Ilya Kreymer
8513575dea cdx: small refactor to CDXFile and RedisCDXSource to facilitate better extensions,
move generic methods to statics, add overridable params
2015-04-10 14:36:19 -07:00
Ilya Kreymer
ddfb48ba53 rangecache: if digest is not set, use the urlkey for cache key 2015-04-06 20:29:59 -07:00
Ilya Kreymer
088a316b44 wb.js fix: check for possible null __orig_parent 2015-04-06 20:29:15 -07:00
Ilya Kreymer
f12af3410c framed replay fix for chrome: set -webkit-transform: none in framed mode on all elements, as otherwise it messes up iframe scrolling #93 2015-04-06 20:14:45 -07:00
Ilya Kreymer
ac06a49d4a fixes: add correct path for frame_mod and replay_mod
wombat: copy Date prototype to appeace 'instanceof Date' check
2015-04-04 17:31:51 -07:00
Ilya Kreymer
1286e9da4c wburl test: better test for bad domain 2015-04-04 17:31:38 -07:00
Ilya Kreymer
97b4081d89 cdx redis: for empty, use iter instead of list for consistency 2015-04-04 12:56:15 -07:00