1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 00:03:28 +01:00

Commit Graph

  • 044792f99f bump version to 0.6.5! Ilya Kreymer 2014-11-06 01:28:56 -08:00
  • cc776b65bd update README.rst 0.6.4 Ilya Kreymer 2014-11-06 00:35:36 -08:00
  • 71a8abe9c3 Merge branch 'develop' for 0.6.4 Ilya Kreymer 2014-11-06 00:34:32 -08:00
  • f6053a977b Update changes for 0.6.4 Ilya Kreymer 2014-11-05 21:59:54 -08:00
  • 00121aa165 statusandheaders parsing: properly skip multiline bad headers (missing header name and ':'), fixes #49 Ilya Kreymer 2014-11-05 20:26:23 -08:00
  • c6a2c83b66 rangecache: always bound range, set default bound of 16384 wombat: work on date override, disable for now head_insert: check for wombat not being inited to avoid undef error Ilya Kreymer 2014-11-05 10:55:46 -08:00
  • 88f553dce7 video work: live rewrite pings proxy with full rewrite, proxies direct range request reorg rangecache to support is_range() check, yt-specific logic (experimental) wombat: add date override (experimental) bump tentative version to 0.7.0! yt replays work with native player! (though still issues remain) Ilya Kreymer 2014-11-04 22:11:25 -08:00
  • fea48fd27a Merge branch 'develop' into video Ilya Kreymer 2014-11-04 12:19:58 -08:00
  • e4bcef1c8b rewrite: default HTMLParser entityref and charref are treated as plain data for HTMLRewriter, since they are never rewritten, and to avoid semicolon ambiguity, since no way to determine if there is a ; or not at end. Addresses #43 Ilya Kreymer 2014-11-04 12:12:32 -08:00
  • 5e4b830fa7 cdx: ensure cdx file is closed when iterator is done, since cdx files are opened per-lookup, related to #45 Ilya Kreymer 2014-11-04 09:42:53 -08:00
  • 72aa921ce5 video: work on domain-specific range cache rewrites Ilya Kreymer 2014-11-04 08:44:45 -08:00
  • 703ec0eb5e banner insert: extra check for document.body before adding banner Ilya Kreymer 2014-11-02 16:11:03 -08:00
  • 7aac3aa2dd rewrite: add support for srcset rewriting for img tag Ilya Kreymer 2014-11-02 16:10:38 -08:00
  • ced94d289d wombat: add generic setAttribute override for href and src, Image object override, src prop rewrite Ilya Kreymer 2014-11-02 16:09:56 -08:00
  • 09e461c58c Merge branch 'video' of https://github.com/ikreymer/pywb into video Ilya Kreymer 2014-11-01 18:24:52 -07:00
  • 1aac5a9f15 cache: move cache wrappers to seperate cache.py in framework from proxy_resolvers range cache: and buffering cache for serving range requests, intended for videos but not only. full response cached in temp file and range requests served from cache, still experimental need to add deletion. youtube_dl: wrap youtube-dl import due to youtube-dl HTMLParser regex bug tests: add test for vi_ handler Ilya Kreymer 2014-11-01 13:22:54 -07:00
  • 07bcf9fbfe vidrw: work on yt rewrite Ilya Kreymer 2014-10-29 09:45:32 -07:00
  • 50cae15663 wombat: add wombat class to window Ilya Kreymer 2014-10-28 11:46:16 -07:00
  • 2396d80dc4 setup: add youtube_dl as dependency rewrite: add call to _live_rewrite_headers to get correct headers for proxy on video info Ilya Kreymer 2014-10-28 11:11:15 -07:00
  • 5b9dcba15f video: add video rewriting use vidrw client side and youtube-dl on the server Ilya Kreymer 2014-10-28 10:36:48 -07:00
  • a3b931b45e regex rewrite: fix js regex (dashes), add additional test case Ilya Kreymer 2014-11-01 15:39:51 -07:00
  • 841fd3f7b4 warc: add ability to set read block size (def 16384) in archiveiterator Ilya Kreymer 2014-11-01 13:29:37 -07:00
  • 5be65f2945 rules: better rule def, cleanup spacing Ilya Kreymer 2014-10-30 00:10:39 -07:00
  • f14f37d5b1 tests: use httpbin for redirect tests Ilya Kreymer 2014-10-29 09:47:32 -07:00
  • 3d4526f994 wombat: add wombat class to window Ilya Kreymer 2014-10-28 11:46:16 -07:00
  • d7b1bc8151 setup: add youtube_dl as dependency rewrite: add call to _live_rewrite_headers to get correct headers for proxy on video info Ilya Kreymer 2014-10-28 11:11:15 -07:00
  • fb85570974 video: add video rewriting use vidrw client side and youtube-dl on the server Ilya Kreymer 2014-10-28 10:36:48 -07:00
  • 61ce53a0e0 warc/cdx: include metadata and resource records in default cdx index emit 200 and 204 responses for metadata and resource, though write '-' to cdx (for compatibility for now) include content-length in resource/metadata records Ilya Kreymer 2014-10-28 10:29:50 -07:00
  • c9273ee5ed rewrite: add 'deprefix' support to remove wburl prefix from any query params Ilya Kreymer 2014-10-26 12:12:37 -07:00
  • 037cf35eb8 wsgi_wrapper: check for str before decoding err msg Ilya Kreymer 2014-10-25 11:42:44 -07:00
  • 8441b54192 head_insert: add mod to wombat Ilya Kreymer 2014-10-24 14:13:59 -07:00
  • 67e94d13f4 handlers/wombat: pass in mod to wombat, ability to customize modifier for embeds Ilya Kreymer 2014-10-24 12:45:41 -07:00
  • 9b64194342 bump version to 0.6.4 Ilya Kreymer 2014-10-24 12:44:52 -07:00
  • a4f9138cb4 update README link Ilya Kreymer 2014-10-21 19:29:27 -07:00
  • f394e26cf1 update CHANGES.rst Ilya Kreymer 2014-10-21 19:21:15 -07:00
  • 05995ad9cf Merge branch 'master' into develop, just README changes Ilya Kreymer 2014-10-21 19:08:57 -07:00
  • e8d3965269 pep8 style fixes, remove unused methods Ilya Kreymer 2014-10-21 19:06:16 -07:00
  • 0a1c053507 Add badge Ilya Kreymer 2014-10-19 08:33:26 -07:00
  • dfae25da01 Update README with News! Ilya Kreymer 2014-10-19 08:32:11 -07:00
  • 1a78fffa22 refactor handlers: simplify handling methods: handle_request() called for all requests, handle_query() only for url query/calendar, and handle_replay() only for replay. Improves extensibility of the handling path Ilya Kreymer 2014-10-19 00:33:32 -07:00
  • d99f7f996c urlrewriter refactor: replace get_abs_url and get_timestamp_url with get_new_ur() which just calls wburl.to_str and applies rewriter prefix allows creating a new wburl with any component(s) changed Ilya Kreymer 2014-10-19 00:24:00 -07:00
  • d01275335b bump version to 0.6.3 Ilya Kreymer 2014-10-19 00:19:07 -07:00
  • c9c9e9d7ed Add Gratipay link Ilya Kreymer 2014-10-18 17:00:33 -07:00
  • e4befd0d85 update README.rst 0.6.2 Ilya Kreymer 2014-10-18 15:27:58 -07:00
  • 729320393a update license statement in js files with github link Ilya Kreymer 2014-10-18 15:18:40 -07:00
  • 268861b2ea Update README with UI Customization info Ilya Kreymer 2014-10-18 15:14:43 -07:00
  • b7d23e4736 Update CHANGES.rst with latest Ilya Kreymer 2014-10-18 14:51:21 -07:00
  • 7f378c9aab move wb.css include into banner.html for easier overridability Ilya Kreymer 2014-10-18 12:40:02 -07:00
  • 4a1cc46fa3 framed replay: invert framed replay paradigm, replay always uses canonical, no-modifier archival url (instead of mp_). When using frames, the page redirects to a 'tf_' page, which then uses replaceHistory() to change url back to canonical form. memento: support for framed replay, include memento headers in top frame bump version to 0.6.2 Ilya Kreymer 2014-10-18 11:21:07 -07:00
  • b99dcb41f0 banner: support rel and abs paths for banner_html, relative to current dir or system absolute Ilya Kreymer 2014-10-17 09:24:16 -07:00
  • cede54f0c1 self-redir: remove referrer-based self-redirect check, as it may be triggered incorrectly during refresh.. (will need to investigate more if there's an edge-case to test against) Ilya Kreymer 2014-10-17 08:54:03 -07:00
  • 1c23e12c06 banner: fixes for framed replay with new default banner Ilya Kreymer 2014-10-17 08:40:57 -07:00
  • 0efa2dc0ad rewrite/banner: add a seperate 'banner_html' setting which allows overriding just the banner (and not the entire head_insert). Setting banner_html: False will disable the banner, or setting to a custom template will insert that template. Default template loads default_banner.js which does the actual initialization. Ilya Kreymer 2014-10-17 08:28:06 -07:00
  • b7a098a9a7 update rules for additional sites Ilya Kreymer 2014-10-17 08:27:56 -07:00
  • 614938479b jinaj2 replay: use ChoiceLoader to properly load either local file system or package templates Ilya Kreymer 2014-10-16 20:33:17 -07:00
  • aecc847ec1 rewrite: seperate stream_to_gen and text_rewriting_stream_to_gen The regular stream_to_gen is much simpler and specifically for binary/unrewritten content. text_rewriting_stream_to_gen() performs rewriting. Use fixed buffer of 16384 for read size, allows for better steaming when using live rewrite Ilya Kreymer 2014-10-16 20:13:53 -07:00
  • 50bf7d2634 rewrite: move extract_client_cookie to utils for access at rewrite root cookie_rewriter: keep max-age add csrf token copying (experimental) update tests Ilya Kreymer 2014-10-12 03:07:54 -07:00
  • 498a864441 rewriting: support setting cookie_scope at collection level js rewriting: add custom url rewrite option to per-url rewrite rules Ilya Kreymer 2014-10-06 10:14:45 -07:00
  • f1b3f8c76f cookie rewriter work: ability to set a custom 'root scope' rewriter, which sets the path of all cookies to pywb root. Option to enable per url-prefix in rules, still more testing, other options needed Ilya Kreymer 2014-09-30 12:42:11 -07:00
  • 7feb0893eb rewrite: add 'application/json' to a seperate 'json' regex rewriter type (rewrite links only, no http), can be customized via rules wombat: add rewrite_style for rewriting style attrs query: don't include any filter in latest, custom filter can be used without any other filters tests: fix typos in tests Ilya Kreymer 2014-09-30 10:57:25 -07:00
  • 00efe33870 Merge branch 'master' into develop Ilya Kreymer 2014-09-22 21:15:18 -07:00
  • 319b8124be cdxobject: add ability to create empty CDXObject(), add tests for CDXObject/IDXObject checking for supported and unsupported number of fields Ilya Kreymer 2014-09-22 21:12:25 -07:00
  • 3aa70985a7 README: memento line tweak Ilya Kreymer 2014-09-22 21:11:43 -07:00
  • eef1f1042a update README to mention memento protocol support Ilya Kreymer 2014-09-22 21:10:10 -07:00
  • e2f8594ea7 rules: add [?&] prefix to query match, use {0} instead of {} for 2.6 compatibility Ilya Kreymer 2014-09-21 20:04:51 -07:00
  • 4c5a7d6bcd rules: use yaml lists in fuzzy rules, update CHANGES.rst Ilya Kreymer 2014-09-21 19:48:14 -07:00
  • ec27ccfbb6 fuzzy match rules: to simplify custom fuzzy match use cases, add support for matching fuzzy match query params as a list Ilya Kreymer 2014-09-21 14:46:10 -07:00
  • 7ac98fbfe2 cookie rewriter: use relative path for cookie path rewriting, pass relative path to urlrewriter rules: add more rules Ilya Kreymer 2014-09-21 13:23:19 -07:00
  • 9be7074183 bump version to 0.6.1 fix small typo in cert_download for not-available message, spacing in config.yaml Ilya Kreymer 2014-09-07 11:58:03 -07:00
  • fced269bca Update README.rst with info about pywb-proxy-demo project 0.6.0 0.6.0 Ilya Kreymer 2014-09-07 11:19:58 -07:00
  • 5849c729a5 fix master README.rst Ilya Kreymer 2014-09-07 11:11:56 -07:00
  • fb12bf60d9 rename test_config_proxy http and https config files to end in '_cookie' to be clearer about the test and config correspondence Ilya Kreymer 2014-09-07 11:06:44 -07:00
  • 5a536d75e4 proxy tests: refactor tests and add cookie resolver http-only test rename tests to test_proxy_https_cookie, test_proxy_http_cookie, test_proxy_http_auth to allow for testing, http proxy, cookie resolver, proxy auth and https support in a more orthogonal way rename configs to test_config_proxy_http and test_config_proxy_https Ilya Kreymer 2014-09-07 11:02:43 -07:00
  • aeb247939d errors: ensure err msgs are properly encoded for jinja2 or raw text response Ilya Kreymer 2014-09-07 01:07:58 -07:00
  • a95e74dc7d Fix CHANGES.rst Ilya Kreymer 2014-09-06 18:38:38 -07:00
  • 45628f7963 wsgi_wrapper: ensure error handling doesn't throw decoding errors Ilya Kreymer 2014-09-06 18:35:30 -07:00
  • 751084b097 update CHANGES, config.yaml docs for proxy mode ensure proxy_options match defaults in config.yaml default cookie_resolver to true Ilya Kreymer 2014-09-06 17:03:04 -07:00
  • 3a0b6fcb0a Update README.rst with proxy mode info Ilya Kreymer 2014-09-06 16:30:38 -07:00
  • da7e6f31ac tests: pep8 and coverage pass, getting ready for release Ilya Kreymer 2014-09-06 15:19:28 -07:00
  • f82afbc977 openssl: make openssl install optional, remove from dependency https proxy support contingest on openssl installation if not installed and https use is enabled, a warning is printed tests: updated tests to skip if openssl not installed (make https post to only run in 2.7, as there are issues with in 2.6) Ilya Kreymer 2014-09-06 14:43:48 -07:00
  • c7228bf887 test coverage: proxy certauth: add unit tests for certauth cert creation (though not verifying validity yet) add https proxy post test Ilya Kreymer 2014-09-06 13:31:10 -07:00
  • eaaefbfd24 * config cleanup: remove 'hostpaths' setting entirely, avoiding the need to specify host on which pywb will run (this was cumbersome to maintain and not really useful) ReferRedirect just checks that the current request host header, if present, matches that of the referrer and checks that the coll and script name match. * removed proxy_pac as it was also unneeded/unused and required use of the hostpaths * added test for invalid CONNECT usage (405 response) Ilya Kreymer 2014-08-20 02:02:47 -04:00
  • 6b476d83de proxy: extensive https and cookie resolver testing move extract_cookie utility to wbrequest fix head_insert 'wbinfo.proxy_magic' entry Ilya Kreymer 2014-08-19 23:25:43 -04:00
  • 5381c00c2a proxy: remove ciphers param to support 2.6 Ilya Kreymer 2014-08-19 03:30:08 -04:00
  • 7ab398eba5 proxy tests: test download page Ilya Kreymer 2014-08-19 03:15:42 -04:00
  • 822a1c03e4 proxy tests: verify ssl, add a no-wildcard option (issues with requests and wildcard cert) Ilya Kreymer 2014-08-18 20:57:21 -07:00
  • bfaad224fa proxy tests: add test for https proxy, using requests and wsgiref server! testing one https replay and static https handling fix bug in certauth params Ilya Kreymer 2014-08-18 19:58:53 -07:00
  • 01e8718640 add new test proxy config Ilya Kreymer 2014-08-18 18:03:02 -07:00
  • 1d1465f320 proxy tests: work on cookie selector tests Ilya Kreymer 2014-08-18 13:34:47 -07:00
  • ba1e276e2f misc fixes: ensure buffered response is an iterator (no need to explicitly check, check doesn't work in jython) query_handler: include check for '-' status code for revisits Ilya Kreymer 2014-08-15 14:23:25 -07:00
  • 61a9cd0dfa cleanup .travis.yml, remove lxml Ilya Kreymer 2014-08-06 14:01:59 -07:00
  • 394197411b fix readme Ilya Kreymer 2014-08-06 13:36:59 -07:00
  • f7034a46b9 Merge branch '0.5.4-work' into develop Ilya Kreymer 2014-08-06 13:35:32 -07:00
  • d02de63cbc update for 0.5.4 release 0.5.4 Ilya Kreymer 2014-08-06 13:33:08 -07:00
  • c3c7935546 Merge branch '0.5.4-work' into develop Ilya Kreymer 2014-08-06 13:22:08 -07:00
  • 501c942a6f tests: add test for rel self-redirect Ilya Kreymer 2014-08-06 13:19:52 -07:00
  • 75cda15ea4 fix self-redirect check with relative urls in Location Ilya Kreymer 2014-08-06 12:39:48 -07:00
  • 1cd82c1bc4 proxy: move test to seperate file cert: create seperate get_wildcard_cert for clarity Ilya Kreymer 2014-08-06 12:39:06 -07:00
  • da6c61376c fix errors from merge Ilya Kreymer 2014-08-05 11:14:22 -07:00
  • 95c3f080c3 Merge branch '0.5.4-fixes' into develop Ilya Kreymer 2014-08-05 10:46:18 -07:00