backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00
Code Issues Projects Releases Activity
1,202 Commits 56 Branches 63 Tags
Commit Graph

1202 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Kreymer
0c96591c49 proxy: change HttpsUrlRewriter to SchemeOnlyUrlRewriter, which fixes http->https or https->http to match 
the scheme of the current page.
url-rewrite-only mode: add uo_ mod and use that to rewrite only urls (no banner, no client side rewrite)
addresses #142
 2015-10-24 15:10:30 -07:00
Ilya Kreymer
979fcaeda3 tests: fix mock YoutubeDLWrapper after refactor, #141 2015-10-23 12:19:15 -07:00
Ilya Kreymer
39e824cb3a live rewite proxy: decouple having http/https proxy from recording, 
move youtubedl wrapper calls, metadata add calls to live rewrite proxy class for easier extension
closes #141 also improves #136
 2015-10-23 11:57:12 -07:00
Ilya Kreymer
c7224ecceb tests: use proxy str directly (imrpove test cov) 2015-10-23 11:54:16 -07:00
Ilya Kreymer
4ba4521b56 tests: use random port instead of 8080 for cli test to avoid conflicts with running services 2015-10-23 11:53:28 -07:00
Ilya Kreymer
e37636de84 cdxindexer: if latest ujson (with forward slash not-escaping) is available, use that when indexing, closes #140 
tests: update indexer CDXJ tests to be order-independent
travis: install ujson for testing
 2015-10-22 17:46:05 -07:00
Ilya Kreymer
c003a96618 Merge pull request #139 from jcushman/webencodings 
Use webencodings to encode head_insert_str.
 2015-10-22 16:23:47 -07:00
Ilya Kreymer
3318402fc3 bump version to 0.11.0 2015-10-22 15:40:36 -07:00
Jack Cushman
633eb31f57 Use webencodings to encode head_insert_str. 2015-10-22 16:40:59 -04:00
Ilya Kreymer
6035a9dc82 Update CHANGES for 0.10.10 0.10.10 2015-10-21 17:50:26 -07:00
Ilya Kreymer
b8b473bf19 cdxindexer: use ujson if it is available 2015-10-21 15:28:26 -07:00
Ilya Kreymer
f3c87c1786 wombat: additional checks for cross-frame top frame access, #137 2015-10-21 10:54:48 -07:00
Ilya Kreymer
9e1447c448 rewrite: strip spaces when rewriting urls in html, closes #134 2015-10-20 12:59:07 -07:00
Ilya Kreymer
75085ad91b loaders: fix loader inits, don't inherit from BlockLoader #135 2015-10-20 10:33:24 -07:00
Ilya Kreymer
94095e452a loaders: refactor BlockLoader to use an extensible dict of loaders 
individual HttpLoader, LocalFileLoader and S3Loader supported by default
Loaders created via BlockLoader also cached for reuse, closes #135
 2015-10-19 11:59:35 -07:00
Ilya Kreymer
4ea8e5d535 rewrite: Make LiveRewriter class overridable in config, request method extensible in LiveRewriter, closes #136 2015-10-19 11:46:27 -07:00
Ilya Kreymer
8b68119994 wombat: use wb_rel_prefix instead of wbinfo.coll for rel prefix path 2015-10-17 08:53:01 -07:00
Ilya Kreymer
93045fb39f rules: fuzzy rule for fastly.. 2015-10-16 09:43:22 -07:00
Ilya Kreymer
06999791de warc: when iterating over WARC, don't stop after first empty gzip records, unless really at the end.. 
add test for post + minimal error
 2015-10-16 08:48:59 -07:00
Ilya Kreymer
925b23f8a8 rewrite: guard against invalid encoding in html charset= and default to utf-8 if specified encoding fails, related to hypothesis/via#53 2015-10-15 13:58:15 -07:00
Ilya Kreymer
e249f300e3 tests refactor! init pywb once per module, instead of once per test 
refactor common init pattern to server_mock for now (can add fixtures also)
 2015-10-14 20:34:46 -07:00
Ilya Kreymer
31dd946114 live rewrite: redir query requests to latest replay in live rewrite handler 2015-10-14 20:33:59 -07:00
Ilya Kreymer
42091fd36e wombat: fix typo which caused rewrite_style() to be skipped unless style started with url prefix! 2015-10-14 17:36:33 -07:00
Ilya Kreymer
e2b0f5c9cb bump version to 0.10.10 2015-10-14 17:35:17 -07:00
Ilya Kreymer
b612c584de tests: test fixes for windows 2015-10-13 21:36:27 -07:00
Ilya Kreymer
d39ac71531 bump version to 0.10.9.1 for wombat scheme-rel url fix 0.10.9.1 2015-10-12 22:18:19 -07:00
Ilya Kreymer
edbfd500a4 wombat: fix rel '/' rewrite which incorrectly handles rel scheme '//' urls 2015-10-12 22:13:26 -07:00
Ilya Kreymer
4c2e7b89b6 More 0.10.9 CHANGES update 0.10.9 2015-10-12 00:31:34 -07:00
Ilya Kreymer
fd90857dc2 README tweaks 2015-10-12 00:11:18 -07:00
Ilya Kreymer
c4ba08d3c1 Update README with more info about proxy collection and timestamp selection 2015-10-12 00:09:02 -07:00
Ilya Kreymer
78788fa744 Fixes in CHANGES for 0.10.9 2015-10-11 23:55:28 -07:00
Ilya Kreymer
57a35347c1 Update CHANGES for 0.10.9 2015-10-11 23:52:03 -07:00
Ilya Kreymer
6efff4cd8f rules: cleanup, remove obsolete rules 2015-10-11 23:50:38 -07:00
Ilya Kreymer
8b7516708d wombat: improved rewrite when running at root: fixes for extract_orig and /-rel rewrite 
move init to be before proxy check
 2015-10-11 23:16:15 -07:00
Ilya Kreymer
bd664ac79d Update README to 0.10.9, remove gratipay links 2015-10-11 21:13:48 -07:00
Ilya Kreymer
4dfe187174 proxy improvements: 
use proxy_magic path to get video info to ensure video info, addresses #106
video info: ensure vi_ replay has CORS support to support serving from magic path
proxy & wombat improvements: set replay_top to window.top and avoid causing cross-domain errors
 2015-10-11 21:03:30 -07:00
Ilya Kreymer
db4fbe79ec tests: add test for BufferedReader 'deflate' (w/o gzip header) 2015-10-11 17:47:19 -07:00
Ilya Kreymer
6f7bd8c291 proxy resolvers: add tests for ip-based resolver 
cache: default cache returns empty instead of raise KeyError on invalid key, to be consistent with uwsgi
 2015-10-11 17:46:12 -07:00
Ilya Kreymer
a3a8b777d2 cdx: don't warn on .loc files, zipnum: add newline to page info response 2015-10-07 17:16:39 -07:00
Ilya Kreymer
a0878e6998 tests: fix regex for 2.6, fix live example 2015-10-07 11:59:31 -07:00
Ilya Kreymer
c3aab1514c query/cdx: support from and to cdx query arguments, support ranged calendar query, 
eg. /[from]*[to]/[url] or /[from]-[to]/[url], with both from and to optional, closes #130
exposes lower and upper bound timestamps in timeutils, pad_timestamp
 2015-10-07 10:44:12 -07:00
Ilya Kreymer
84f49e3291 rule customization: add calendar search fuzzy match for all blogspot.com 2015-10-06 00:05:20 -07:00
Ilya Kreymer
78ba91ff63 rewrite: fixes for attr override, add test for 'integrity' override 2015-10-05 23:26:47 -07:00
Ilya Kreymer
9a19265786 rewrite: disable 'integrity' (as well as crossorigin) attr due to rewriting, which modifies the resource 2015-10-05 23:04:56 -07:00
Ilya Kreymer
cb67c172ed rewrite: html rewriter can accept optional url for initial base url of page 2015-10-02 14:01:33 -07:00
Ilya Kreymer
46a8cb5132 wombat: fix typo! 2015-10-02 12:22:42 -07:00
Ilya Kreymer
3d7a3fb9ef wombat: fix change test bool logic typos 2015-09-24 21:33:13 -07:00
Ilya Kreymer
87d7fb11ca wombat improvements: 
* detect if anything actually rewritten in rewrite_html(), skip write()/writeln() override if no changes
* for relative ./ or ../ rewrite, find trailing slash
* better window detection instead of instanceof Window (using constructor and window prop check)
* bump to wombat 2.9
 2015-09-24 21:10:06 -07:00
Ilya Kreymer
a45464cc61 wombat: fix form action overrides 2015-09-20 11:49:04 -07:00
Ilya Kreymer
e464de66b7 Merge branch 'proxy-ip-resolver' into develop 2015-09-14 19:27:19 -07:00