backup/pywb
1
0
Fork 0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-28 08:32:29 +01:00
Code Issues Projects Releases Activity
1,861 Commits 57 Branches 63 Tags
Commit Graph

1347 Commits

Author SHA1 Message Date
Ilya Kreymer
d9c5345d3c rewrite: add support for Cookie request header rewrite to support sites 
which require a cookie to be set. req_cookie_rewrite directive can be
set in rules.yaml per url prefix with a list of match/replace regexs
 2015-01-03 12:51:09 -08:00
Ilya Kreymer
df94e17305 video: yt: switch on timeout only if not started.. 2014-12-28 23:29:13 -08:00
Ilya Kreymer
1684c14cda bump version to 0.7.2 
video: disable yt DASH for better proxy and replay (experiment)
 2014-12-28 16:34:48 -08:00
Ilya Kreymer
a76bf79b83 html_rewriter: add explicit <video>, <audio> tags to html_rewriter tag 
list
 2014-12-26 18:15:49 -08:00
Ilya Kreymer
8d6845a552 fuzzy match: add support for specifying regex and args seperately for 
fuzzy_lookup match
 2014-12-26 14:29:51 -08:00
Ilya Kreymer
ffb702ce03 rewrite: content detection for specific case: if content type is html and mod type is css 
or js, peek stream to determine actual type. Addresses #31 in part.
Fix typo in wb_frame.js
 2014-12-26 13:08:35 -08:00
Ilya Kreymer
8f57ce622d Improved top rewriting, addressing #54 2014-12-26 13:06:33 -08:00
Ilya Kreymer
4c08a6a064 video work: improved yt handling: 
- disable yt using yt api, for forced html/flash, diable on load
- use yt error event to detect error
- better fallback on recorded video
use seperate cache for range and video info tracking
fix yt rules query to account for & and ?
 2014-12-26 13:02:47 -08:00
Ilya Kreymer
ca17410056 video: better extension extraction for explicit video info (use format 
if ext is unknown)
improved support for _pywbvid=html, forces generic html player over yt
player, better deletion of ytplayer
 2014-12-24 18:13:12 -08:00
Ilya Kreymer
ad5a43db76 replay redirect: ensure no timestamp redirect when range request is 
present, alter test to include inexact timestamp
 2014-12-23 21:19:39 -08:00
Ilya Kreymer
181c18a1b8 pep8 pass: fix spacing, line length, issues 
also remove references to obsolete cached_replay, hostnames in pywb_init
 2014-12-23 15:14:03 -08:00
Ilya Kreymer
51919ed1e7 replay: make range cache available by default in replay_views since its 
inited on first use. remove
separate subclass. 'enable_ranges' can be set to false to disable range
cache altogether
improve tests
 2014-12-23 14:34:59 -08:00
Ilya Kreymer
c28304fd90 tests rangecache: added integration tests for range support via range 
cache, using enable_cache option
 2014-12-23 11:09:19 -08:00
Ilya Kreymer
a9892f531f proxy testing: refactored test server thread into ServerThreadRunner 
class which runs a server in a seperate thread.. used by http/s proxies
as well, as mock live server proxy
add test for live rewrite with proxy, covering simple case as well as
video
 2014-12-23 11:07:47 -08:00
Ilya Kreymer
a8b4041716 live rewrite: proxy setup refactor: ignore_proxy flag, pass proxy during constructor only 2014-12-22 21:58:07 -08:00
Ilya Kreymer
b54e4c1c06 tests: add more tests for cookie, html and rewrite_live crsf 2014-12-22 20:34:18 -08:00
Ilya Kreymer
0f2c96879c refactor: split out optional cached replay components into cached_replay, 
toggleable via 'enable_cache' in config -- regular replayview does not
need any cache info
move add_range() components to statusandheaders from wbrequestresponse
add x-pywb-noredirect' header which disables date related redirect
video replay works w/o cache if supported by frontend (nginx)
 2014-12-19 18:40:45 -08:00
Ilya Kreymer
b86517b246 rangecache: remove range extractions functions which are now part of 
wbrequest/response
 2014-12-18 13:23:45 -08:00
Ilya Kreymer
4aabba559c vidrw: refactor object/embed adding code into seperate functions for 
iterating over tags, allows for reuse with setInterval (not yet added)
 2014-12-18 13:22:03 -08:00
Ilya Kreymer
68e7a70777 refactor: live rewrite handler uses new range functions in 
wbrequest/response, also add 'remove range' for 0- unbounded requests..
 2014-12-18 13:20:16 -08:00
Ilya Kreymer
07e46f4b6c request/response: add range extraction and settings functions to 
wbrequest/response (with tests)
 2014-12-18 13:19:38 -08:00
Ilya Kreymer
f3dc256503 wombat: also rewrite src= in video and audio tags 2014-12-18 13:18:22 -08:00
Ilya Kreymer
0de76189a7 Merge branch 0.6.6 into video 2014-12-14 15:36:37 -08:00
Ilya Kreymer
09861ada2c wb.js: preserve anchor in location redirect 
update CHANGELIST
 2014-12-13 23:19:04 -08:00
Ilya Kreymer
80c5b45178 wb.js: don't include anchor when comparing current url with expected top 
url
 2014-12-13 23:12:42 -08:00
Ilya Kreymer
3b14e1ad40 video: add support for experimental 'pywbvid=' selector to force video 
type
add optional YT original player rewrite
fix non-local vars in flash player
wb.js: remove hash when doing location check
 2014-12-12 09:07:58 -08:00
Ilya Kreymer
e68c0413d1 video rules: update rules for vimeo 2014-12-11 00:20:43 -08:00
Ilya Kreymer
8090bf9a9a video: skip videoinfo responses that have no formats, and fallback to 
retry handler
remove extra log
 2014-12-09 10:48:08 -08:00
Ilya Kreymer
336289b337 Merge branch 'develop' into video, merge wb.js 
Add double init check for wombat
 2014-12-07 23:54:20 -08:00
Ilya Kreymer
6d5592f890 wb js: add guard around wb js to prevent double-inits (such as from 
fragments!)
 2014-12-07 23:33:21 -08:00
Ilya Kreymer
87d7635f6f video: update rules to use new location-only rewriter for YT comments 
support
 2014-12-07 21:21:51 -08:00
Ilya Kreymer
0a6838ac2b rewrite: refactor JS rewriters into seperate mixins, allowing for 
link only, location only, and link + location JS rewriters.
location-only rewriter is new
js_rewrite_location options: all, location, urls (for now)
 2014-12-07 21:13:19 -08:00
Ilya Kreymer
ab087afa4e Merge branch 'develop' into video, JS rewriter refactoring 2014-12-07 21:11:20 -08:00
Ilya Kreymer
5a11714b41 rewrite: refactor JS rewriters into seperate mixins, allowing for 
link only, location only, and link + location JS rewriters.
location-only rewriter is new
js_rewrite_location options: all, location, urls (for now)
 2014-12-07 21:09:37 -08:00
Ilya Kreymer
d45a23e07b vidrw: client rewrite: use client width/height if available, otherwise 
use 100% to allow replacement in dynamic containers
 2014-12-07 19:59:42 -08:00
Ilya Kreymer
00c4e189ef live rewrite video: add explicit generation of video info file, if 
referrer and non-206 request (eg YT)
 2014-12-07 19:56:29 -08:00
Ilya Kreymer
80d4fa6e29 rangecache: Add check for X-Ignore-Range-Arg header to force ignoring 
range= and serving full request. (For use with nginx range cache
handling)
 2014-12-07 19:55:24 -08:00
Ilya Kreymer
7e36ad29e7 Merge branch 'develop' 0.6.6 into video 2014-12-06 19:19:12 -08:00
Ilya Kreymer
0495423e86 rewrite: add per-collection rewrite options, settable in 'rewrite_opts' 
block in each collection. Added rewrite_base to disable rewriting <base>
tag and rewrite_rel_canon to disable rewriting link rel=canon.

Disabling <base> tag rewrite fixex #51 and new system addresses #50 as
well.
 2014-12-06 17:16:35 -08:00
Ilya Kreymer
ea89702701 static handler: add default 'application/octet-stream' and only set 
guessed mime if not none
 2014-12-04 23:02:30 -08:00
Ilya Kreymer
7251c37c08 video: load flashembed dynamically only when there are videos 2014-12-04 10:48:50 -08:00
Ilya Kreymer
8a87966ebd video fixes: disable adding a fixed buffer on unbounded range requests, 
as that messes up FF html5 player.. (it assumes a full stream)
video response: ensure Accept-Ranges: bytes is being added on 206
responses
 2014-12-03 21:59:03 -08:00
Ilya Kreymer
7f93e858ee video: skip all DASH format sources, also sort sources from highest 
preference to lowest (if available)
 2014-12-03 12:55:18 -08:00
Ilya Kreymer
f59cd6c6b4 video: add special case iframe, fix flash insert missing prefix 2014-12-02 12:39:54 -08:00
Ilya Kreymer
f21f4fb1ba Merge branch 'develop' into video 2014-12-01 09:10:08 -08:00
Ilya Kreymer
dffa0bcbad video work: vidrw fixes to support object, fallback to flash 
rangecache: create dir on first use only
 2014-12-01 09:09:23 -08:00
Ilya Kreymer
c996e70a6e wburl: detect and decode partially encoded schemes in url, such as http%3A//, 
https%A2F2F// before handling further
add additional tests for wburl
 2014-11-29 11:13:57 -08:00
Ilya Kreymer
2f5be9ed9f video: work on extracting video from <object> tags, fallback to 
flowplayer if html5 player fails
 2014-11-29 11:04:18 -08:00
Ilya Kreymer
7a14e167e1 replay: vi_ handling: properly replace any protocol with metadata:// for 
video info lookup
 2014-11-29 11:03:40 -08:00
Ilya Kreymer
87d791eba8 html rewrite: rewrite param value only if start with http 2014-11-29 11:03:09 -08:00