1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 16:14:48 +01:00

736 Commits

Author SHA1 Message Date
Ilya Kreymer
b99dcb41f0 banner: support rel and abs paths for banner_html, relative to current
dir or system absolute
2014-10-17 09:24:16 -07:00
Ilya Kreymer
cede54f0c1 self-redir: remove referrer-based self-redirect check, as it may be
triggered incorrectly during refresh.. (will need to investigate more if
there's an edge-case to test against)
2014-10-17 08:54:03 -07:00
Ilya Kreymer
1c23e12c06 banner: fixes for framed replay with new default banner 2014-10-17 08:40:57 -07:00
Ilya Kreymer
0efa2dc0ad rewrite/banner: add a seperate 'banner_html' setting which allows
overriding just the banner (and not the entire head_insert). Setting
banner_html: False will disable the banner, or setting to a custom
template will insert that template. Default template loads
default_banner.js which does the actual initialization.
2014-10-17 08:28:06 -07:00
Ilya Kreymer
b7a098a9a7 update rules for additional sites 2014-10-17 08:27:56 -07:00
Ilya Kreymer
614938479b jinaj2 replay: use ChoiceLoader to properly load either local file
system or package templates
2014-10-16 20:33:17 -07:00
Ilya Kreymer
aecc847ec1 rewrite: seperate stream_to_gen and text_rewriting_stream_to_gen
The regular stream_to_gen is much simpler and specifically for
binary/unrewritten content. text_rewriting_stream_to_gen() performs
rewriting. Use fixed buffer of 16384 for read size, allows for better
steaming when using live rewrite
2014-10-16 20:13:53 -07:00
Ilya Kreymer
50bf7d2634 rewrite: move extract_client_cookie to utils for access at rewrite
root cookie_rewriter: keep max-age
add csrf token copying (experimental)
update tests
2014-10-12 03:07:54 -07:00
Ilya Kreymer
498a864441 rewriting: support setting cookie_scope at collection level
js rewriting: add custom url rewrite option to per-url rewrite rules
2014-10-06 10:14:45 -07:00
Ilya Kreymer
f1b3f8c76f cookie rewriter work: ability to set a custom 'root scope' rewriter,
which sets the path of all cookies to pywb root.
Option to enable per url-prefix in rules, still more testing, other
options needed
2014-09-30 12:42:11 -07:00
Ilya Kreymer
7feb0893eb rewrite: add 'application/json' to a seperate 'json' regex rewriter type (rewrite links only, no
http), can be customized via rules
wombat: add rewrite_style for rewriting style attrs
query: don't include any filter in latest, custom filter can be used
without any other filters
tests: fix typos in tests
2014-09-30 10:57:25 -07:00
Ilya Kreymer
00efe33870 Merge branch 'master' into develop 2014-09-22 21:15:18 -07:00
Ilya Kreymer
319b8124be cdxobject: add ability to create empty CDXObject(), add tests for
CDXObject/IDXObject checking for supported and unsupported number of
fields
2014-09-22 21:12:25 -07:00
Ilya Kreymer
3aa70985a7 README: memento line tweak 2014-09-22 21:11:43 -07:00
Ilya Kreymer
eef1f1042a update README to mention memento protocol support 2014-09-22 21:10:10 -07:00
Ilya Kreymer
e2f8594ea7 rules: add [?&] prefix to query match, use {0} instead of {} for 2.6
compatibility
2014-09-21 20:04:51 -07:00
Ilya Kreymer
4c5a7d6bcd rules: use yaml lists in fuzzy rules, update CHANGES.rst 2014-09-21 19:48:14 -07:00
Ilya Kreymer
ec27ccfbb6 fuzzy match rules: to simplify custom fuzzy match use cases, add support
for matching fuzzy match query params as a list
2014-09-21 14:46:10 -07:00
Ilya Kreymer
7ac98fbfe2 cookie rewriter: use relative path for cookie path rewriting, pass
relative path to urlrewriter
rules: add more rules
2014-09-21 13:23:19 -07:00
Ilya Kreymer
9be7074183 bump version to 0.6.1
fix small typo in cert_download for not-available message, spacing in config.yaml
2014-09-07 11:58:03 -07:00
Ilya Kreymer
fced269bca Update README.rst with info about pywb-proxy-demo project 0.6.0 2014-09-07 11:19:58 -07:00
Ilya Kreymer
5849c729a5 fix master README.rst 2014-09-07 11:11:56 -07:00
Ilya Kreymer
fb12bf60d9 rename test_config_proxy http and https config files to end in '_cookie' to be
clearer about the test and config correspondence
2014-09-07 11:06:44 -07:00
Ilya Kreymer
5a536d75e4 proxy tests: refactor tests and add cookie resolver http-only test
rename tests to test_proxy_https_cookie, test_proxy_http_cookie, test_proxy_http_auth
to allow for testing, http proxy, cookie resolver, proxy auth and https support in a more
orthogonal way
rename configs to test_config_proxy_http and test_config_proxy_https
2014-09-07 11:02:43 -07:00
Ilya Kreymer
aeb247939d errors: ensure err msgs are properly encoded for jinja2 or raw text response 2014-09-07 01:07:58 -07:00
Ilya Kreymer
a95e74dc7d Fix CHANGES.rst 2014-09-06 18:38:38 -07:00
Ilya Kreymer
45628f7963 wsgi_wrapper: ensure error handling doesn't throw decoding errors 2014-09-06 18:35:30 -07:00
Ilya Kreymer
751084b097 update CHANGES, config.yaml docs for proxy mode
ensure proxy_options match defaults in config.yaml
default cookie_resolver to true
2014-09-06 17:03:04 -07:00
Ilya Kreymer
3a0b6fcb0a Update README.rst with proxy mode info 2014-09-06 16:30:38 -07:00
Ilya Kreymer
da7e6f31ac tests: pep8 and coverage pass, getting ready for release 2014-09-06 15:19:28 -07:00
Ilya Kreymer
f82afbc977 openssl: make openssl install optional, remove from dependency
https proxy support contingest on openssl installation
if not installed and https use is enabled, a warning is printed
tests: updated tests to skip if openssl not installed
(make https post to only run in 2.7, as there are issues with in 2.6)
2014-09-06 14:43:48 -07:00
Ilya Kreymer
c7228bf887 test coverage: proxy certauth: add unit tests for certauth cert creation (though not verifying validity yet)
add https proxy post test
2014-09-06 13:31:10 -07:00
Ilya Kreymer
eaaefbfd24 * config cleanup: remove 'hostpaths' setting entirely, avoiding the need to specify host on which pywb
will run (this was cumbersome to maintain and not really useful)
ReferRedirect just checks that the current request host header, if present, matches that of the referrer
and checks that the coll and script name match.
* removed proxy_pac as it was also unneeded/unused and required use of the hostpaths
* added test for invalid CONNECT usage (405 response)
2014-08-20 02:02:47 -04:00
Ilya Kreymer
6b476d83de proxy: extensive https and cookie resolver testing
move extract_cookie utility to wbrequest
fix head_insert 'wbinfo.proxy_magic' entry
2014-08-19 23:25:43 -04:00
Ilya Kreymer
5381c00c2a proxy: remove ciphers param to support 2.6 2014-08-19 03:30:08 -04:00
Ilya Kreymer
7ab398eba5 proxy tests: test download page 2014-08-19 03:15:42 -04:00
Ilya Kreymer
822a1c03e4 proxy tests: verify ssl, add a no-wildcard option (issues with requests and wildcard cert) 2014-08-18 20:57:21 -07:00
Ilya Kreymer
bfaad224fa proxy tests: add test for https proxy, using requests and wsgiref server!
testing one https replay and static https handling
fix bug in certauth params
2014-08-18 19:58:53 -07:00
Ilya Kreymer
01e8718640 add new test proxy config 2014-08-18 18:03:02 -07:00
Ilya Kreymer
1d1465f320 proxy tests: work on cookie selector tests 2014-08-18 13:34:47 -07:00
Ilya Kreymer
ba1e276e2f misc fixes: ensure buffered response is an iterator (no need to explicitly check, check doesn't work in jython)
query_handler: include check for '-' status code for revisits
2014-08-15 14:23:25 -07:00
Ilya Kreymer
61a9cd0dfa cleanup .travis.yml, remove lxml 2014-08-06 14:01:59 -07:00
Ilya Kreymer
394197411b fix readme 2014-08-06 13:36:59 -07:00
Ilya Kreymer
f7034a46b9 Merge branch '0.5.4-work' into develop 2014-08-06 13:35:32 -07:00
Ilya Kreymer
d02de63cbc update for 0.5.4 release 2014-08-06 13:33:08 -07:00
Ilya Kreymer
c3c7935546 Merge branch '0.5.4-work' into develop 2014-08-06 13:22:08 -07:00
Ilya Kreymer
501c942a6f tests: add test for rel self-redirect 2014-08-06 13:19:52 -07:00
Ilya Kreymer
75cda15ea4 fix self-redirect check with relative urls in Location 2014-08-06 12:39:48 -07:00
Ilya Kreymer
1cd82c1bc4 proxy: move test to seperate file
cert: create seperate get_wildcard_cert for clarity
2014-08-06 12:39:06 -07:00
Ilya Kreymer
da6c61376c fix errors from merge 2014-08-05 11:14:22 -07:00