backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00
Code Issues Projects Releases Activity
1,126 Commits 56 Branches 63 Tags
Commit Graph

1126 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Kreymer
5028901a17 tests: add tests for indexing http custom status/verbs with and without verify #99 2015-04-20 08:58:51 -07:00
Ilya Kreymer
08064f3806 warc load: make http response/request protocol/verb validation optional 
enabled for replay, disabled by default for cdx-indexing, though can
be enabled with -v option #99
 2015-04-20 08:29:18 -07:00
Ilya Kreymer
28e3cd791b bump version to 0.9.7-dev 2015-04-19 22:47:20 -07:00
Ilya Kreymer
a992909cb5 update README and version for 0.9.6 2015-04-17 22:02:28 -07:00
Ilya Kreymer
8aa4a9abdc update changes for 0.9.6 bugfix 2015-04-17 22:01:05 -07:00
Ilya Kreymer
186acae46c query_handler: only split scheme once in vi_ mode query 2015-04-17 22:01:05 -07:00
Ilya Kreymer
8bd8485b5a framed replay fixes: don't use 'window.frames[0]' but get framed by 'replay_iframe' id to allow 
for custom placement, multiple frames, etc...

ensure outer frame url is updated to canonical (no mod) form for inverse setup as well.
 2015-04-17 22:01:04 -07:00
Ilya Kreymer
578323da8a bump version to 0.9.6-dev 2015-04-17 22:01:04 -07:00
Ilya Kreymer
0ad12a6651 Merge pull request #98 from tilgovi/no-rewrite-typo 
Fix typo in handling of no_rewrite_prefixes
 2015-04-17 20:20:32 -07:00
Randall Leeds
2776d5d0b4 Fix typo in handling of no_rewrite_prefixes 2015-04-17 20:03:36 -07:00
Ilya Kreymer
206df4ecaf More 0.9.5 changelist tweaks, elaborate on wombat options. 0.9.5 2015-04-17 12:42:51 -07:00
Ilya Kreymer
c4ca4b4cb2 update version to 0.9.5! 2015-04-17 12:30:21 -07:00
Ilya Kreymer
497ba4fd98 tweak CHANGES for 0.9.5 2015-04-17 12:27:07 -07:00
Ilya Kreymer
8485a8dd80 pywb_init: ensure root route works with liveweb and custom handlers also 2015-04-17 12:20:49 -07:00
Ilya Kreymer
7bf8b97cb0 tests: add tests for root collection access, and also a custom handler passed to pywb_init 
(a simple redirect handler)
 2015-04-17 11:48:50 -07:00
Ilya Kreymer
1d49a9fd3b tests: improved tests for loaders module 2015-04-17 11:02:57 -07:00
Ilya Kreymer
52a7dd87c6 loaders: s3: import boto just once, store s3_avail flag 2015-04-17 11:02:57 -07:00
Ilya Kreymer
c35fd86c76 add boto to .travis.yml for testing s3 2015-04-17 11:02:57 -07:00
Ilya Kreymer
c8a9a3ddd4 loaders: add support for loading from s3:// using boto 
if auth connection fails, attempt anon connection, #97
 2015-04-17 11:02:57 -07:00
Ilya Kreymer
4db661a09e update README and CHANGES for 0.9.5! 2015-04-17 11:01:54 -07:00
Ilya Kreymer
74c6b60d5e wombat customization: pass custom options from config.yaml 'rewrite_opts.client' as a json obj 
to wombat.js #96
currently supporting no_rewrite_prefixes, and skipping dom, setAttribute and postmessage overrides
(used by via.hypothes.is) -- other options to be added later
 2015-04-16 12:24:01 -07:00
Ilya Kreymer
2e4427100c wombat init refactor: init wbinfo first, then pass wbinfo to wombat 
to allow for additional options for wombat, in prep for #96
 2015-04-16 11:51:25 -07:00
Ilya Kreymer
fbb9de264a rewrite: cookie: add 'removeall' cookie rewriter which removes all the cookies! 2015-04-14 18:04:51 -07:00
Ilya Kreymer
dcc2139fc8 fuzzy: add fuzzy match for vine 2015-04-13 13:02:55 -07:00
Ilya Kreymer
307809bbe9 live-rewrite-server: switch to 'inverse' frame mode by default, 
switch from /rewrite/ to /live/ path, update tests
 2015-04-13 13:00:06 -07:00
Ilya Kreymer
756b80cac4 rewrite: remove urlrewriter optimization which uses wburl.original_url, as its 
not realiable (%-encoding, no trailing slash issues) and not really needed.. rename original_url -> _original_url, should not be used
directly.
add test for rewriting when base url has no trailing slash
 2015-04-13 12:51:38 -07:00
Ilya Kreymer
9f1ae42d1c rewrite: security: by default, disable file:// and local access unless explicitly allowed! 
enable for tests with remote_only=False param
 2015-04-13 09:51:12 -07:00
Ilya Kreymer
0aae4264f7 pywb_init: use custom route class for cdx api as well as main handler 2015-04-13 09:48:47 -07:00
Ilya Kreymer
5aee4a193b cdx fuzzy match: fix when fuzzy replace string is >1 char, keep full replace string (to be examined further) 2015-04-13 09:45:02 -07:00
Ilya Kreymer
b21e288063 wburl to_uri: when parsing scheme, also for first '?' in addition to '/' to catch any irregular urls (to be ignored) 2015-04-11 10:21:52 -07:00
Ilya Kreymer
d39f26872d error handling: pass in wbrequest to not_found error handler 2015-04-11 00:25:59 -07:00
Ilya Kreymer
4469754a5a routing: improved support for root collection via empty route. If '' route present, 
add it last to avoid conflicting w/ other routes (#94)
templates: pass in custom params to jinja2 template via env 'pywb.template_params' dictionary.
If present, dictionary contents will be added directly to jinja context for the request (#95)
 2015-04-10 14:47:02 -07:00
Ilya Kreymer
4bf1dd4cad urlrewriter: simply startswith check by using tuple 2015-04-10 14:46:46 -07:00
Ilya Kreymer
8513575dea cdx: small refactor to CDXFile and RedisCDXSource to facilitate better extensions, 
move generic methods to statics, add overridable params
 2015-04-10 14:36:19 -07:00
Ilya Kreymer
ddfb48ba53 rangecache: if digest is not set, use the urlkey for cache key 2015-04-06 20:29:59 -07:00
Ilya Kreymer
088a316b44 wb.js fix: check for possible null __orig_parent 2015-04-06 20:29:15 -07:00
Ilya Kreymer
f12af3410c framed replay fix for chrome: set -webkit-transform: none in framed mode on all elements, as otherwise it messes up iframe scrolling #93 2015-04-06 20:14:45 -07:00
Ilya Kreymer
ac06a49d4a fixes: add correct path for frame_mod and replay_mod 
wombat: copy Date prototype to appeace 'instanceof Date' check
 2015-04-04 17:31:51 -07:00
Ilya Kreymer
1286e9da4c wburl test: better test for bad domain 2015-04-04 17:31:38 -07:00
Ilya Kreymer
97b4081d89 cdx redis: for empty, use iter instead of list for consistency 2015-04-04 12:56:15 -07:00
Ilya Kreymer
c089ba35bc proxy init: instead of using first route, find first valid route (eg. not static) 
move static paths to be checked first
 2015-04-04 12:54:32 -07:00
Ilya Kreymer
10d9a6ac9a jinja templates: add 'templates' as default lookup dir, allow specifying 
custom dir via config. when specifiying custom paths, need not use full dir
as per usual paradigm
 2015-04-04 12:53:07 -07:00
Ilya Kreymer
1844597889 wburl to_uri: catch error on idna encode with very invalid urls 2015-04-04 12:51:49 -07:00
Ilya Kreymer
f9bd2ba55a jinja template: use shared template in J2Template, init on first use 2015-04-03 10:43:39 -07:00
Ilya Kreymer
4a85869427 cli refactor: use classes in cli to allow custom options 
get rid of custom init for live_rewrite_handler, just use create_wb_router()
with custom config for consistent init
 2015-04-03 10:43:39 -07:00
Ilya Kreymer
6ba5163e72 jinja template: refactor jinja template setup, use a shared jinja env instead of a new env for every template 
can pass in an existing env via the config
 2015-04-03 10:03:12 -07:00
Ilya Kreymer
fcb6e94736 framework refactor: move rel_request_uri() call down to the routers, for easier reuse 
each router now calls ensure_rel_uri_set() to ensure that REL_REQUEST_URI field is set before
use. allows router to be called directly without setup.
add optional fallback_app to allow acting as middleware
 2015-04-03 08:45:18 -07:00
Ilya Kreymer
a34607764e manager: validate name on collection init: must start with wordchar and can contain wordchar or - 2015-04-03 01:18:35 -07:00
Ilya Kreymer
134b90eca5 bump version to 0.9.4-dev 2015-04-03 00:45:12 -07:00
Ilya Kreymer
b379d15066 changelist fixes 2015-04-01 17:07:27 -07:00