backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00
Code Issues Projects Releases Activity
1,070 Commits 56 Branches 63 Tags
Commit Graph

1070 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Kreymer
f2a2c86552 tests: proxy check to ensure content-length header is always present in proxy mode 2015-07-30 11:06:44 -07:00
Ilya Kreymer
e9d04c71d3 uwsgi.ini: check if VIRTUAL_ENV actually set 
remove debug print for fuzzy matching
 2015-07-28 14:25:45 -07:00
Ilya Kreymer
0b4ceb9cde rewrite: if removing content-encoding, also remove the content-length as it will need to be recomputed! 
proxy: for proxy mode, must buffer fully so that content-length can be added (may add chunked encoding later)
 2015-07-28 14:23:50 -07:00
Ilya Kreymer
1b9161a69b head_insert: fix typo, comment out 2015-07-21 11:47:28 -07:00
Ilya Kreymer
dcbe32b742 regex rewrite: don't match quoted location for rewrite 2015-07-21 11:46:19 -07:00
Ilya Kreymer
bbd987060e wombat: improved WombatLocation, changes to any location property propagate to location object. 
all properties overriden to check if location changed with pushState/replaceState
 2015-07-21 11:41:52 -07:00
Ilya Kreymer
c2f99d6cfd replay/memento: always include 'Content-Location' for in no-redir mode replay (not just for memento timegate), #122 2015-07-19 00:11:25 -07:00
Ilya Kreymer
66f5ad62b3 memento: when redir_to_exact is false, don't redirect latest replay/timegate to current timestamp, but return directly latest capture. 
when memento enabled, the timegate now follows memento pattern 2.2  (http://tools.ietf.org/html/rfc7089#section-4.2.2)
also return content-location instead of location, update memento no-redirect tests to match new behavior. closes #122
 2015-07-18 23:30:31 -07:00
Ilya Kreymer
3b94f32a7f head_insert: remove chrome scroll hack, causing other issues, doesn't really solve frame/scroll issues #93 2015-07-18 23:26:51 -07:00
Ilya Kreymer
0f4d779b00 html rewrite: add 'force_html_decl' option, which if set in rewrite_opts, can be used to force an HTML decl, eg. <!DOCTYPE html> if a default one was not provided 2015-07-18 18:23:57 -07:00
Ilya Kreymer
9b08ca9005 vidrw: ensure iframe replacement does get rewritten! 
regex rewrite: include '==top?' for wombat rewrite
rewrite css: if js_ modifier on text/css, treat as css
 2015-07-18 12:59:20 -07:00
Ilya Kreymer
a7e1d310dc bump version to 0.10.3-dev 2015-07-18 12:57:58 -07:00
Ilya Kreymer
65fa6f864b additional changelist tweak for 0.10.2 2015-07-17 19:55:06 -07:00
Ilya Kreymer
cc46e0de55 update version for release, 0.10.2 2015-07-17 19:34:28 -07:00
Ilya Kreymer
e0e1d34c5b Update CHANGES for 0.10.2 2015-07-17 19:32:04 -07:00
Ilya Kreymer
55ddce57f8 vidrw: on fallback, don't replace generic 'swf' files with flowplayer! 2015-07-17 19:16:10 -07:00
Ilya Kreymer
e435242d38 wombat: Date: fixes to Date override, guard against double override 
document.write: use shared rewrite_html() method, issue single write call
loaders: read_http() don't use range request if no range is set
 2015-07-17 18:40:25 -07:00
Ilya Kreymer
b92d75ff9b wombat: fix Date overrides, ensure use of overriden functions 2015-07-16 12:24:44 -07:00
Ilya Kreymer
3808609fbc wombat: improved client side cookie rewriting, addressing path, domain, expires and secure attributes, #121 2015-07-13 20:35:06 -07:00
Ilya Kreymer
1911347f04 wombat cookie: remove domain for now (needs further rewriting to be added) 2015-07-13 12:23:18 -07:00
Ilya Kreymer
6e929aabdf wb_frame: set inner frame hash on init, and notify the other when inner or outer frame hashes change 2015-07-07 22:39:48 -07:00
Ilya Kreymer
53b86798c7 url_rewrite: don't rewrite urls starting with '{' 2015-07-07 22:39:24 -07:00
Ilya Kreymer
fb0962189c wombat 2.5: more improvements: 
- WB_wombat_location.href proxies to actual location, responsive to pushState/replaceState location changes
- pushState/replaceState notifies parent, if in framed mode
- cleanup def_prop(), use as wrapper for all Object.defineProperty()
- don't rewrite urls starting with '{'
 2015-07-07 22:35:42 -07:00
Ilya Kreymer
c38d0c2aaf html attr rewrite: rewrite any " -> &quot; in html attributes 2015-07-07 14:43:15 -07:00
Ilya Kreymer
93d49ae24b rewrite deprefix: improve query deprefix to also test url-encoded params, closes #119 2015-07-06 18:19:01 -07:00
Ilya Kreymer
d2e17bf505 vidrw: formatting, special case for ustream flash 2015-07-04 00:41:00 -07:00
Ilya Kreymer
9333ebc843 rules: tweak better twitter rules, more limited custom rules, hopefully fix inline video 2015-07-03 11:53:45 -07:00
Ilya Kreymer
76ebabd3f2 rewrite rules: none or location-only rule should apply to json as well 2015-07-03 11:53:29 -07:00
Ilya Kreymer
a71e3209ae wombat 2.5! use more protoype property overrides 
- WB_wombat_location now a property, defaults to _WB_wombat_location or location on base object
- Use base lookupGetter/lookupSetter when overriding properties
- Added Element.prototype.baseURI and document.baseURI override, href and src attribute overrides
- Added insertAdjacentHTML() override
- Refactored seperate iframe_init_wombat() for all wombat setup on new iframes
- Added contentWindow and contentDocument access overrides for ensuring iframe_init_wombat() is called on iframe
 2015-07-03 11:51:11 -07:00
Ilya Kreymer
5d1c7a0430 bump version to 0.10.2-dev 2015-07-03 11:46:20 -07:00
Ilya Kreymer
4d7d40454d youtube-dl: adjust coverage as using mock youtube-dl wrapper #118 0.10.1 2015-06-27 23:18:05 -07:00
Ilya Kreymer
080587516b youtube-dl tests: use mock youtube-dl info for tests 2015-06-27 20:46:55 -07:00
Ilya Kreymer
4e37bf0a4a update changes for 0.10.1 2015-06-27 18:31:16 -07:00
Ilya Kreymer
a0b5189c67 youtube-dl: set no cover on youtube-dl import error paths #118 2015-06-27 16:34:41 -07:00
Ilya Kreymer
f0359877f0 youtube-dl: remove from dependency, installation is optional. Return 404 if attempting live 
proxy of videos and youtube-dl is not available (the only use case).
HTTPParser wrapping logic no longer needed in latest versions
Modify tests to only run if youtube-dl is installed in cases where it is not available #118
 2015-06-27 16:11:59 -07:00
Ilya Kreymer
2d0c526053 post handling: when reading post data in extract_post_query(), add optional buffer_stream which would hold the original POST 
data. This is necessary to override the `wsgi.input` to allow the post data to be read again via a fallback handler, even
after reading POST query data in replay handler, addresses #117
 2015-06-25 15:58:58 -07:00
Ilya Kreymer
06fcc89de6 readers: support 'content-encoding: deflate' using different zlib decompression options 
support default and alt settings for attempting to decompress deflate stream
tests: add tests with httpbin.org/deflate Fixes #115
 2015-06-24 13:11:33 -07:00
Ilya Kreymer
69f6354934 fix typo in rules 2015-06-18 02:49:26 -04:00
Ilya Kreymer
aa80532987 rules: actual disqus fixes.. 2015-06-18 02:40:11 -04:00
Ilya Kreymer
07c2093020 rules: disqus comments work 2015-06-18 02:33:03 -04:00
Ilya Kreymer
dea1917932 bump version to 0.10.1 2015-06-18 02:25:58 -04:00
Ilya Kreymer
f616a57e9e bump version to 0.10.0 for release! 2015-06-05 20:14:48 -07:00
Ilya Kreymer
4714f4ad31 wombat: added extra null check for contentWindow 2015-06-05 19:49:05 -07:00
Ilya Kreymer
d25572da86 Update CHANGES for 0.10.0 2015-06-05 19:16:55 -07:00
Ilya Kreymer
20b42afa4e jinja2 include: use custom RelEnvironment overriding join_path() to make includes relative to current file, to allow 
for per-collection includes to be used more easily #108
 2015-06-05 18:38:08 -07:00
Ilya Kreymer
dfeccbe62d tests: header rewriter tests for custom cache header settings, #110 2015-06-05 17:48:05 -07:00
Ilya Kreymer
27212488e3 tests: zipnum: better test coverage for incorrect idx or loc files, add invalid sample files zipnum-bad{.idx, .loc}, #112 2015-06-05 17:46:45 -07:00
Ilya Kreymer
2b9e1b97c3 rules: disable tw rewrite rule as it was page reloads 2015-06-04 17:31:16 -07:00
Ilya Kreymer
f80be17392 buffering: when buffered_replay is enabled, only buffer responses that do not have a content-length 
(eg. rewritten text content) and only buffer up to buffer_max_size (default 16384), and stream the remainder.
if the response has a content-length already, no buffering is performed #111
 2015-05-29 19:40:25 -07:00
Ilya Kreymer
15c2ddbfcf header rewriter: cache options: use 'rewrite_opts.http_cache' to set caching headers options, #110 
'pass': passthrough original cache headers unrewritten
None (default): rewrite cache headers and don't add anything else
N: set cache-control max-age: N and corresponding expires
N=0: set cache-control: no-cache; no-store
 2015-05-29 12:53:29 -07:00