Ilya Kreymer
0c96591c49
proxy: change HttpsUrlRewriter to SchemeOnlyUrlRewriter, which fixes http->https or https->http to match
...
the scheme of the current page.
url-rewrite-only mode: add uo_ mod and use that to rewrite only urls (no banner, no client side rewrite)
addresses #142
2015-10-24 15:10:30 -07:00
Ilya Kreymer
979fcaeda3
tests: fix mock YoutubeDLWrapper after refactor, #141
2015-10-23 12:19:15 -07:00
Ilya Kreymer
39e824cb3a
live rewite proxy: decouple having http/https proxy from recording,
...
move youtubedl wrapper calls, metadata add calls to live rewrite proxy class for easier extension
closes #141 also improves #136
2015-10-23 11:57:12 -07:00
Ilya Kreymer
c7224ecceb
tests: use proxy str directly (imrpove test cov)
2015-10-23 11:54:16 -07:00
Ilya Kreymer
4ba4521b56
tests: use random port instead of 8080 for cli test to avoid conflicts with running services
2015-10-23 11:53:28 -07:00
Ilya Kreymer
e37636de84
cdxindexer: if latest ujson (with forward slash not-escaping) is available, use that when indexing, closes #140
...
tests: update indexer CDXJ tests to be order-independent
travis: install ujson for testing
2015-10-22 17:46:05 -07:00
Ilya Kreymer
c003a96618
Merge pull request #139 from jcushman/webencodings
...
Use webencodings to encode head_insert_str.
2015-10-22 16:23:47 -07:00
Ilya Kreymer
3318402fc3
bump version to 0.11.0
2015-10-22 15:40:36 -07:00
Jack Cushman
633eb31f57
Use webencodings to encode head_insert_str.
2015-10-22 16:40:59 -04:00
Ilya Kreymer
6035a9dc82
Update CHANGES for 0.10.10
0.10.10
2015-10-21 17:50:26 -07:00
Ilya Kreymer
b8b473bf19
cdxindexer: use ujson if it is available
2015-10-21 15:28:26 -07:00
Ilya Kreymer
f3c87c1786
wombat: additional checks for cross-frame top frame access, #137
2015-10-21 10:54:48 -07:00
Ilya Kreymer
9e1447c448
rewrite: strip spaces when rewriting urls in html, closes #134
2015-10-20 12:59:07 -07:00
Ilya Kreymer
75085ad91b
loaders: fix loader inits, don't inherit from BlockLoader #135
2015-10-20 10:33:24 -07:00
Ilya Kreymer
94095e452a
loaders: refactor BlockLoader to use an extensible dict of loaders
...
individual HttpLoader, LocalFileLoader and S3Loader supported by default
Loaders created via BlockLoader also cached for reuse, closes #135
2015-10-19 11:59:35 -07:00
Ilya Kreymer
4ea8e5d535
rewrite: Make LiveRewriter class overridable in config, request method extensible in LiveRewriter, closes #136
2015-10-19 11:46:27 -07:00
Ilya Kreymer
8b68119994
wombat: use wb_rel_prefix instead of wbinfo.coll for rel prefix path
2015-10-17 08:53:01 -07:00
Ilya Kreymer
93045fb39f
rules: fuzzy rule for fastly..
2015-10-16 09:43:22 -07:00
Ilya Kreymer
06999791de
warc: when iterating over WARC, don't stop after first empty gzip records, unless really at the end..
...
add test for post + minimal error
2015-10-16 08:48:59 -07:00
Ilya Kreymer
925b23f8a8
rewrite: guard against invalid encoding in html charset= and default to utf-8 if specified encoding fails, related to hypothesis/via#53
2015-10-15 13:58:15 -07:00
Ilya Kreymer
e249f300e3
tests refactor! init pywb once per module, instead of once per test
...
refactor common init pattern to server_mock for now (can add fixtures also)
2015-10-14 20:34:46 -07:00
Ilya Kreymer
31dd946114
live rewrite: redir query requests to latest replay in live rewrite handler
2015-10-14 20:33:59 -07:00
Ilya Kreymer
42091fd36e
wombat: fix typo which caused rewrite_style() to be skipped unless style started with url prefix!
2015-10-14 17:36:33 -07:00
Ilya Kreymer
e2b0f5c9cb
bump version to 0.10.10
2015-10-14 17:35:17 -07:00
Ilya Kreymer
b612c584de
tests: test fixes for windows
2015-10-13 21:36:27 -07:00
Ilya Kreymer
d39ac71531
bump version to 0.10.9.1 for wombat scheme-rel url fix
0.10.9.1
2015-10-12 22:18:19 -07:00
Ilya Kreymer
edbfd500a4
wombat: fix rel '/' rewrite which incorrectly handles rel scheme '//' urls
2015-10-12 22:13:26 -07:00
Ilya Kreymer
4c2e7b89b6
More 0.10.9 CHANGES update
0.10.9
2015-10-12 00:31:34 -07:00
Ilya Kreymer
fd90857dc2
README tweaks
2015-10-12 00:11:18 -07:00
Ilya Kreymer
c4ba08d3c1
Update README with more info about proxy collection and timestamp selection
2015-10-12 00:09:02 -07:00
Ilya Kreymer
78788fa744
Fixes in CHANGES for 0.10.9
2015-10-11 23:55:28 -07:00
Ilya Kreymer
57a35347c1
Update CHANGES for 0.10.9
2015-10-11 23:52:03 -07:00
Ilya Kreymer
6efff4cd8f
rules: cleanup, remove obsolete rules
2015-10-11 23:50:38 -07:00
Ilya Kreymer
8b7516708d
wombat: improved rewrite when running at root: fixes for extract_orig and /-rel rewrite
...
move init to be before proxy check
2015-10-11 23:16:15 -07:00
Ilya Kreymer
bd664ac79d
Update README to 0.10.9, remove gratipay links
2015-10-11 21:13:48 -07:00
Ilya Kreymer
4dfe187174
proxy improvements:
...
use proxy_magic path to get video info to ensure video info, addresses #106
video info: ensure vi_ replay has CORS support to support serving from magic path
proxy & wombat improvements: set replay_top to window.top and avoid causing cross-domain errors
2015-10-11 21:03:30 -07:00
Ilya Kreymer
db4fbe79ec
tests: add test for BufferedReader 'deflate' (w/o gzip header)
2015-10-11 17:47:19 -07:00
Ilya Kreymer
6f7bd8c291
proxy resolvers: add tests for ip-based resolver
...
cache: default cache returns empty instead of raise KeyError on invalid key, to be consistent with uwsgi
2015-10-11 17:46:12 -07:00
Ilya Kreymer
a3a8b777d2
cdx: don't warn on .loc files, zipnum: add newline to page info response
2015-10-07 17:16:39 -07:00
Ilya Kreymer
a0878e6998
tests: fix regex for 2.6, fix live example
2015-10-07 11:59:31 -07:00
Ilya Kreymer
c3aab1514c
query/cdx: support from
and to
cdx query arguments, support ranged calendar query,
...
eg. /[from]*[to]/[url] or /[from]-[to]/[url], with both from and to optional, closes #130
exposes lower and upper bound timestamps in timeutils, pad_timestamp
2015-10-07 10:44:12 -07:00
Ilya Kreymer
84f49e3291
rule customization: add calendar search fuzzy match for all blogspot.com
2015-10-06 00:05:20 -07:00
Ilya Kreymer
78ba91ff63
rewrite: fixes for attr override, add test for 'integrity' override
2015-10-05 23:26:47 -07:00
Ilya Kreymer
9a19265786
rewrite: disable 'integrity' (as well as crossorigin) attr due to rewriting, which modifies the resource
2015-10-05 23:04:56 -07:00
Ilya Kreymer
cb67c172ed
rewrite: html rewriter can accept optional url for initial base url of page
2015-10-02 14:01:33 -07:00
Ilya Kreymer
46a8cb5132
wombat: fix typo!
2015-10-02 12:22:42 -07:00
Ilya Kreymer
3d7a3fb9ef
wombat: fix change test bool logic typos
2015-09-24 21:33:13 -07:00
Ilya Kreymer
87d7fb11ca
wombat improvements:
...
* detect if anything actually rewritten in rewrite_html(), skip write()/writeln() override if no changes
* for relative ./ or ../ rewrite, find trailing slash
* better window detection instead of instanceof Window (using constructor and window prop check)
* bump to wombat 2.9
2015-09-24 21:10:06 -07:00
Ilya Kreymer
a45464cc61
wombat: fix form action overrides
2015-09-20 11:49:04 -07:00
Ilya Kreymer
e464de66b7
Merge branch 'proxy-ip-resolver' into develop
2015-09-14 19:27:19 -07:00