backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00
Code Issues Projects Releases Activity
1,195 Commits 56 Branches 63 Tags
Commit Graph

1195 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Robert Knight
a4d05d469f Add configuration for running client tests using Sauce Labs 
This gives us the capability to test the client-side JS
rewriting against a suite of different browsers on different
platforms.

Note that getting Karma running on Travis CI requires some
additional configuration documented at
github.com/karma-runner/karma-sauce-launcher/issues/73
which is not made clear in the original documentation.

In order to run the Karma tests, the Sauce Labs username
and access keys need to be passed in via the SAUCE_USERNAME
and SAUCE_ACCESS_KEYS env vars.
 2015-11-25 14:57:20 +00:00
Robert Knight
f4a43a14f5 Add tests for the client-side part of pywb using Karma 
* Add a Karma configuration for unit/integration tests
   for the client-side pywb code.

 * Add an integration test suite which creates an <iframe> loads
   the client-side rewriting code (wombat.js) in it and
   then executes a test script.

   Since wombat.js monkey-patches the DOM and the exact behavior
   of DOM objects varies between browsers, which we want to test,
   the suite does not mock the DOM but instead runs
   a set of tests in an isolated environment against
   the DOM.

 * Add Travis config to run the Karma tests
 2015-11-25 11:53:40 +00:00
Ilya Kreymer
6035a9dc82 Update CHANGES for 0.10.10 0.10.10 2015-10-21 17:50:26 -07:00
Ilya Kreymer
b8b473bf19 cdxindexer: use ujson if it is available 2015-10-21 15:28:26 -07:00
Ilya Kreymer
f3c87c1786 wombat: additional checks for cross-frame top frame access, #137 2015-10-21 10:54:48 -07:00
Ilya Kreymer
9e1447c448 rewrite: strip spaces when rewriting urls in html, closes #134 2015-10-20 12:59:07 -07:00
Ilya Kreymer
75085ad91b loaders: fix loader inits, don't inherit from BlockLoader #135 2015-10-20 10:33:24 -07:00
Ilya Kreymer
94095e452a loaders: refactor BlockLoader to use an extensible dict of loaders 
individual HttpLoader, LocalFileLoader and S3Loader supported by default
Loaders created via BlockLoader also cached for reuse, closes #135
 2015-10-19 11:59:35 -07:00
Ilya Kreymer
4ea8e5d535 rewrite: Make LiveRewriter class overridable in config, request method extensible in LiveRewriter, closes #136 2015-10-19 11:46:27 -07:00
Ilya Kreymer
8b68119994 wombat: use wb_rel_prefix instead of wbinfo.coll for rel prefix path 2015-10-17 08:53:01 -07:00
Ilya Kreymer
93045fb39f rules: fuzzy rule for fastly.. 2015-10-16 09:43:22 -07:00
Ilya Kreymer
06999791de warc: when iterating over WARC, don't stop after first empty gzip records, unless really at the end.. 
add test for post + minimal error
 2015-10-16 08:48:59 -07:00
Ilya Kreymer
925b23f8a8 rewrite: guard against invalid encoding in html charset= and default to utf-8 if specified encoding fails, related to hypothesis/via#53 2015-10-15 13:58:15 -07:00
Ilya Kreymer
e249f300e3 tests refactor! init pywb once per module, instead of once per test 
refactor common init pattern to server_mock for now (can add fixtures also)
 2015-10-14 20:34:46 -07:00
Ilya Kreymer
31dd946114 live rewrite: redir query requests to latest replay in live rewrite handler 2015-10-14 20:33:59 -07:00
Ilya Kreymer
42091fd36e wombat: fix typo which caused rewrite_style() to be skipped unless style started with url prefix! 2015-10-14 17:36:33 -07:00
Ilya Kreymer
e2b0f5c9cb bump version to 0.10.10 2015-10-14 17:35:17 -07:00
Ilya Kreymer
b612c584de tests: test fixes for windows 2015-10-13 21:36:27 -07:00
Ilya Kreymer
d39ac71531 bump version to 0.10.9.1 for wombat scheme-rel url fix 0.10.9.1 2015-10-12 22:18:19 -07:00
Ilya Kreymer
edbfd500a4 wombat: fix rel '/' rewrite which incorrectly handles rel scheme '//' urls 2015-10-12 22:13:26 -07:00
Ilya Kreymer
4c2e7b89b6 More 0.10.9 CHANGES update 0.10.9 2015-10-12 00:31:34 -07:00
Ilya Kreymer
fd90857dc2 README tweaks 2015-10-12 00:11:18 -07:00
Ilya Kreymer
c4ba08d3c1 Update README with more info about proxy collection and timestamp selection 2015-10-12 00:09:02 -07:00
Ilya Kreymer
78788fa744 Fixes in CHANGES for 0.10.9 2015-10-11 23:55:28 -07:00
Ilya Kreymer
57a35347c1 Update CHANGES for 0.10.9 2015-10-11 23:52:03 -07:00
Ilya Kreymer
6efff4cd8f rules: cleanup, remove obsolete rules 2015-10-11 23:50:38 -07:00
Ilya Kreymer
8b7516708d wombat: improved rewrite when running at root: fixes for extract_orig and /-rel rewrite 
move init to be before proxy check
 2015-10-11 23:16:15 -07:00
Ilya Kreymer
bd664ac79d Update README to 0.10.9, remove gratipay links 2015-10-11 21:13:48 -07:00
Ilya Kreymer
4dfe187174 proxy improvements: 
use proxy_magic path to get video info to ensure video info, addresses #106
video info: ensure vi_ replay has CORS support to support serving from magic path
proxy & wombat improvements: set replay_top to window.top and avoid causing cross-domain errors
 2015-10-11 21:03:30 -07:00
Ilya Kreymer
db4fbe79ec tests: add test for BufferedReader 'deflate' (w/o gzip header) 2015-10-11 17:47:19 -07:00
Ilya Kreymer
6f7bd8c291 proxy resolvers: add tests for ip-based resolver 
cache: default cache returns empty instead of raise KeyError on invalid key, to be consistent with uwsgi
 2015-10-11 17:46:12 -07:00
Ilya Kreymer
a3a8b777d2 cdx: don't warn on .loc files, zipnum: add newline to page info response 2015-10-07 17:16:39 -07:00
Ilya Kreymer
a0878e6998 tests: fix regex for 2.6, fix live example 2015-10-07 11:59:31 -07:00
Ilya Kreymer
c3aab1514c query/cdx: support from and to cdx query arguments, support ranged calendar query, 
eg. /[from]*[to]/[url] or /[from]-[to]/[url], with both from and to optional, closes #130
exposes lower and upper bound timestamps in timeutils, pad_timestamp
 2015-10-07 10:44:12 -07:00
Ilya Kreymer
84f49e3291 rule customization: add calendar search fuzzy match for all blogspot.com 2015-10-06 00:05:20 -07:00
Ilya Kreymer
78ba91ff63 rewrite: fixes for attr override, add test for 'integrity' override 2015-10-05 23:26:47 -07:00
Ilya Kreymer
9a19265786 rewrite: disable 'integrity' (as well as crossorigin) attr due to rewriting, which modifies the resource 2015-10-05 23:04:56 -07:00
Ilya Kreymer
cb67c172ed rewrite: html rewriter can accept optional url for initial base url of page 2015-10-02 14:01:33 -07:00
Ilya Kreymer
46a8cb5132 wombat: fix typo! 2015-10-02 12:22:42 -07:00
Ilya Kreymer
3d7a3fb9ef wombat: fix change test bool logic typos 2015-09-24 21:33:13 -07:00
Ilya Kreymer
87d7fb11ca wombat improvements: 
* detect if anything actually rewritten in rewrite_html(), skip write()/writeln() override if no changes
* for relative ./ or ../ rewrite, find trailing slash
* better window detection instead of instanceof Window (using constructor and window prop check)
* bump to wombat 2.9
 2015-09-24 21:10:06 -07:00
Ilya Kreymer
a45464cc61 wombat: fix form action overrides 2015-09-20 11:49:04 -07:00
Ilya Kreymer
e464de66b7 Merge branch 'proxy-ip-resolver' into develop 2015-09-14 19:27:19 -07:00
Ilya Kreymer
efc690ec97 rules: improve yt rules! disable dash directly html5player 2015-09-14 19:25:32 -07:00
Ilya Kreymer
589eb6513c wombat: related to #129, resolve any dynamic urls with a "." or ".." relative to original url, avoiding break rewrite url 2015-09-14 19:23:44 -07:00
Ilya Kreymer
e9c4c2d4db rewrite: add an explicit <base> if trailing slash missing after host. Ensure when existing <base> is rewritten, 
a trailing slash is added (before query or anchor) closes #129
 2015-09-14 19:22:49 -07:00
Ilya Kreymer
82fb892eaa bump to 0.10.9-dev 2015-09-14 19:22:37 -07:00
Ilya Kreymer
a0f224d583 README typo fix 
(from @machawk1)
 2015-09-10 17:28:30 -07:00
Ilya Kreymer
0e49393b18 Update CHANGES for 0.10.8 2015-09-10 17:26:48 -07:00
Ilya Kreymer
c96082cf83 wobmat rewrite: support "a.href = '.'" properly even if trailing / missing 0.10.8 2015-09-10 17:18:30 -07:00