1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00

1349 Commits

Author SHA1 Message Date
Ilya Kreymer
c7224ecceb tests: use proxy str directly (imrpove test cov) 2015-10-23 11:54:16 -07:00
Ilya Kreymer
4ba4521b56 tests: use random port instead of 8080 for cli test to avoid conflicts with running services 2015-10-23 11:53:28 -07:00
Ilya Kreymer
e37636de84 cdxindexer: if latest ujson (with forward slash not-escaping) is available, use that when indexing, closes #140
tests: update indexer CDXJ tests to be order-independent
travis: install ujson for testing
2015-10-22 17:46:05 -07:00
Ilya Kreymer
c003a96618 Merge pull request #139 from jcushman/webencodings
Use webencodings to encode head_insert_str.
2015-10-22 16:23:47 -07:00
Ilya Kreymer
3318402fc3 bump version to 0.11.0 2015-10-22 15:40:36 -07:00
Jack Cushman
633eb31f57 Use webencodings to encode head_insert_str. 2015-10-22 16:40:59 -04:00
Ilya Kreymer
6035a9dc82 Update CHANGES for 0.10.10 0.10.10 2015-10-21 17:50:26 -07:00
Ilya Kreymer
b8b473bf19 cdxindexer: use ujson if it is available 2015-10-21 15:28:26 -07:00
Ilya Kreymer
f3c87c1786 wombat: additional checks for cross-frame top frame access, #137 2015-10-21 10:54:48 -07:00
Ilya Kreymer
9e1447c448 rewrite: strip spaces when rewriting urls in html, closes #134 2015-10-20 12:59:07 -07:00
Ilya Kreymer
75085ad91b loaders: fix loader inits, don't inherit from BlockLoader #135 2015-10-20 10:33:24 -07:00
Ilya Kreymer
94095e452a loaders: refactor BlockLoader to use an extensible dict of loaders
individual HttpLoader, LocalFileLoader and S3Loader supported by default
Loaders created via BlockLoader also cached for reuse, closes #135
2015-10-19 11:59:35 -07:00
Ilya Kreymer
4ea8e5d535 rewrite: Make LiveRewriter class overridable in config, request method extensible in LiveRewriter, closes #136 2015-10-19 11:46:27 -07:00
Ilya Kreymer
8b68119994 wombat: use wb_rel_prefix instead of wbinfo.coll for rel prefix path 2015-10-17 08:53:01 -07:00
Ilya Kreymer
93045fb39f rules: fuzzy rule for fastly.. 2015-10-16 09:43:22 -07:00
Ilya Kreymer
06999791de warc: when iterating over WARC, don't stop after first empty gzip records, unless really at the end..
add test for post + minimal error
2015-10-16 08:48:59 -07:00
Ilya Kreymer
925b23f8a8 rewrite: guard against invalid encoding in html charset= and default to utf-8 if specified encoding fails, related to hypothesis/via#53 2015-10-15 13:58:15 -07:00
Ilya Kreymer
e249f300e3 tests refactor! init pywb once per module, instead of once per test
refactor common init pattern to server_mock for now (can add fixtures also)
2015-10-14 20:34:46 -07:00
Ilya Kreymer
31dd946114 live rewrite: redir query requests to latest replay in live rewrite handler 2015-10-14 20:33:59 -07:00
Ilya Kreymer
42091fd36e wombat: fix typo which caused rewrite_style() to be skipped unless style started with url prefix! 2015-10-14 17:36:33 -07:00
Ilya Kreymer
e2b0f5c9cb bump version to 0.10.10 2015-10-14 17:35:17 -07:00
Ilya Kreymer
b612c584de tests: test fixes for windows 2015-10-13 21:36:27 -07:00
Ilya Kreymer
d39ac71531 bump version to 0.10.9.1 for wombat scheme-rel url fix 0.10.9.1 2015-10-12 22:18:19 -07:00
Ilya Kreymer
edbfd500a4 wombat: fix rel '/' rewrite which incorrectly handles rel scheme '//' urls 2015-10-12 22:13:26 -07:00
Ilya Kreymer
4c2e7b89b6 More 0.10.9 CHANGES update 0.10.9 2015-10-12 00:31:34 -07:00
Ilya Kreymer
fd90857dc2 README tweaks 2015-10-12 00:11:18 -07:00
Ilya Kreymer
c4ba08d3c1 Update README with more info about proxy collection and timestamp selection 2015-10-12 00:09:02 -07:00
Ilya Kreymer
78788fa744 Fixes in CHANGES for 0.10.9 2015-10-11 23:55:28 -07:00
Ilya Kreymer
57a35347c1 Update CHANGES for 0.10.9 2015-10-11 23:52:03 -07:00
Ilya Kreymer
6efff4cd8f rules: cleanup, remove obsolete rules 2015-10-11 23:50:38 -07:00
Ilya Kreymer
8b7516708d wombat: improved rewrite when running at root: fixes for extract_orig and /-rel rewrite
move init to be before proxy check
2015-10-11 23:16:15 -07:00
Ilya Kreymer
bd664ac79d Update README to 0.10.9, remove gratipay links 2015-10-11 21:13:48 -07:00
Ilya Kreymer
4dfe187174 proxy improvements:
use proxy_magic path to get video info to ensure video info, addresses #106
video info: ensure vi_ replay has CORS support to support serving from magic path
proxy & wombat improvements: set replay_top to window.top and avoid causing cross-domain errors
2015-10-11 21:03:30 -07:00
Ilya Kreymer
db4fbe79ec tests: add test for BufferedReader 'deflate' (w/o gzip header) 2015-10-11 17:47:19 -07:00
Ilya Kreymer
6f7bd8c291 proxy resolvers: add tests for ip-based resolver
cache: default cache returns empty instead of raise KeyError on invalid key, to be consistent with uwsgi
2015-10-11 17:46:12 -07:00
Ilya Kreymer
a3a8b777d2 cdx: don't warn on .loc files, zipnum: add newline to page info response 2015-10-07 17:16:39 -07:00
Ilya Kreymer
a0878e6998 tests: fix regex for 2.6, fix live example 2015-10-07 11:59:31 -07:00
Ilya Kreymer
c3aab1514c query/cdx: support from and to cdx query arguments, support ranged calendar query,
eg. /[from]*[to]/[url] or /[from]-[to]/[url], with both from and to optional, closes #130
exposes lower and upper bound timestamps in timeutils, pad_timestamp
2015-10-07 10:44:12 -07:00
Ilya Kreymer
84f49e3291 rule customization: add calendar search fuzzy match for all blogspot.com 2015-10-06 00:05:20 -07:00
Ilya Kreymer
78ba91ff63 rewrite: fixes for attr override, add test for 'integrity' override 2015-10-05 23:26:47 -07:00
Ilya Kreymer
9a19265786 rewrite: disable 'integrity' (as well as crossorigin) attr due to rewriting, which modifies the resource 2015-10-05 23:04:56 -07:00
Ilya Kreymer
cb67c172ed rewrite: html rewriter can accept optional url for initial base url of page 2015-10-02 14:01:33 -07:00
Ilya Kreymer
46a8cb5132 wombat: fix typo! 2015-10-02 12:22:42 -07:00
Ilya Kreymer
3d7a3fb9ef wombat: fix change test bool logic typos 2015-09-24 21:33:13 -07:00
Ilya Kreymer
87d7fb11ca wombat improvements:
* detect if anything actually rewritten in rewrite_html(), skip write()/writeln() override if no changes
* for relative ./ or ../ rewrite, find trailing slash
* better window detection instead of instanceof Window (using constructor and window prop check)
* bump to wombat 2.9
2015-09-24 21:10:06 -07:00
Ilya Kreymer
a45464cc61 wombat: fix form action overrides 2015-09-20 11:49:04 -07:00
Ilya Kreymer
e464de66b7 Merge branch 'proxy-ip-resolver' into develop 2015-09-14 19:27:19 -07:00
Ilya Kreymer
efc690ec97 rules: improve yt rules! disable dash directly html5player 2015-09-14 19:25:32 -07:00
Ilya Kreymer
589eb6513c wombat: related to #129, resolve any dynamic urls with a "." or ".." relative to original url, avoiding break rewrite url 2015-09-14 19:23:44 -07:00
Ilya Kreymer
e9c4c2d4db rewrite: add an explicit <base> if trailing slash missing after host. Ensure when existing <base> is rewritten,
a trailing slash is added (before query or anchor) closes #129
2015-09-14 19:22:49 -07:00