1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 00:03:28 +01:00

520 Commits

Author SHA1 Message Date
Ilya Kreymer
4c5a7d6bcd rules: use yaml lists in fuzzy rules, update CHANGES.rst 2014-09-21 19:48:14 -07:00
Ilya Kreymer
ec27ccfbb6 fuzzy match rules: to simplify custom fuzzy match use cases, add support
for matching fuzzy match query params as a list
2014-09-21 14:46:10 -07:00
Ilya Kreymer
7ac98fbfe2 cookie rewriter: use relative path for cookie path rewriting, pass
relative path to urlrewriter
rules: add more rules
2014-09-21 13:23:19 -07:00
Ilya Kreymer
9be7074183 bump version to 0.6.1
fix small typo in cert_download for not-available message, spacing in config.yaml
2014-09-07 11:58:03 -07:00
Ilya Kreymer
fced269bca Update README.rst with info about pywb-proxy-demo project 0.6.0 2014-09-07 11:19:58 -07:00
Ilya Kreymer
5849c729a5 fix master README.rst 2014-09-07 11:11:56 -07:00
Ilya Kreymer
fb12bf60d9 rename test_config_proxy http and https config files to end in '_cookie' to be
clearer about the test and config correspondence
2014-09-07 11:06:44 -07:00
Ilya Kreymer
5a536d75e4 proxy tests: refactor tests and add cookie resolver http-only test
rename tests to test_proxy_https_cookie, test_proxy_http_cookie, test_proxy_http_auth
to allow for testing, http proxy, cookie resolver, proxy auth and https support in a more
orthogonal way
rename configs to test_config_proxy_http and test_config_proxy_https
2014-09-07 11:02:43 -07:00
Ilya Kreymer
aeb247939d errors: ensure err msgs are properly encoded for jinja2 or raw text response 2014-09-07 01:07:58 -07:00
Ilya Kreymer
a95e74dc7d Fix CHANGES.rst 2014-09-06 18:38:38 -07:00
Ilya Kreymer
45628f7963 wsgi_wrapper: ensure error handling doesn't throw decoding errors 2014-09-06 18:35:30 -07:00
Ilya Kreymer
751084b097 update CHANGES, config.yaml docs for proxy mode
ensure proxy_options match defaults in config.yaml
default cookie_resolver to true
2014-09-06 17:03:04 -07:00
Ilya Kreymer
3a0b6fcb0a Update README.rst with proxy mode info 2014-09-06 16:30:38 -07:00
Ilya Kreymer
da7e6f31ac tests: pep8 and coverage pass, getting ready for release 2014-09-06 15:19:28 -07:00
Ilya Kreymer
f82afbc977 openssl: make openssl install optional, remove from dependency
https proxy support contingest on openssl installation
if not installed and https use is enabled, a warning is printed
tests: updated tests to skip if openssl not installed
(make https post to only run in 2.7, as there are issues with in 2.6)
2014-09-06 14:43:48 -07:00
Ilya Kreymer
c7228bf887 test coverage: proxy certauth: add unit tests for certauth cert creation (though not verifying validity yet)
add https proxy post test
2014-09-06 13:31:10 -07:00
Ilya Kreymer
eaaefbfd24 * config cleanup: remove 'hostpaths' setting entirely, avoiding the need to specify host on which pywb
will run (this was cumbersome to maintain and not really useful)
ReferRedirect just checks that the current request host header, if present, matches that of the referrer
and checks that the coll and script name match.
* removed proxy_pac as it was also unneeded/unused and required use of the hostpaths
* added test for invalid CONNECT usage (405 response)
2014-08-20 02:02:47 -04:00
Ilya Kreymer
6b476d83de proxy: extensive https and cookie resolver testing
move extract_cookie utility to wbrequest
fix head_insert 'wbinfo.proxy_magic' entry
2014-08-19 23:25:43 -04:00
Ilya Kreymer
5381c00c2a proxy: remove ciphers param to support 2.6 2014-08-19 03:30:08 -04:00
Ilya Kreymer
7ab398eba5 proxy tests: test download page 2014-08-19 03:15:42 -04:00
Ilya Kreymer
822a1c03e4 proxy tests: verify ssl, add a no-wildcard option (issues with requests and wildcard cert) 2014-08-18 20:57:21 -07:00
Ilya Kreymer
bfaad224fa proxy tests: add test for https proxy, using requests and wsgiref server!
testing one https replay and static https handling
fix bug in certauth params
2014-08-18 19:58:53 -07:00
Ilya Kreymer
01e8718640 add new test proxy config 2014-08-18 18:03:02 -07:00
Ilya Kreymer
1d1465f320 proxy tests: work on cookie selector tests 2014-08-18 13:34:47 -07:00
Ilya Kreymer
ba1e276e2f misc fixes: ensure buffered response is an iterator (no need to explicitly check, check doesn't work in jython)
query_handler: include check for '-' status code for revisits
2014-08-15 14:23:25 -07:00
Ilya Kreymer
61a9cd0dfa cleanup .travis.yml, remove lxml 2014-08-06 14:01:59 -07:00
Ilya Kreymer
394197411b fix readme 2014-08-06 13:36:59 -07:00
Ilya Kreymer
f7034a46b9 Merge branch '0.5.4-work' into develop 2014-08-06 13:35:32 -07:00
Ilya Kreymer
d02de63cbc update for 0.5.4 release 2014-08-06 13:33:08 -07:00
Ilya Kreymer
c3c7935546 Merge branch '0.5.4-work' into develop 2014-08-06 13:22:08 -07:00
Ilya Kreymer
501c942a6f tests: add test for rel self-redirect 2014-08-06 13:19:52 -07:00
Ilya Kreymer
75cda15ea4 fix self-redirect check with relative urls in Location 2014-08-06 12:39:48 -07:00
Ilya Kreymer
1cd82c1bc4 proxy: move test to seperate file
cert: create seperate get_wildcard_cert for clarity
2014-08-06 12:39:06 -07:00
Ilya Kreymer
da6c61376c fix errors from merge 2014-08-05 11:14:22 -07:00
Ilya Kreymer
95c3f080c3 Merge branch '0.5.4-fixes' into develop 2014-08-05 10:46:18 -07:00
Ilya Kreymer
b68ef06067 banner: add back inner frame update of banner on load, if html
rewrite: banner only mode encodes to utf-8, adjusts length
2014-08-05 10:12:54 -07:00
Ilya Kreymer
4f9310fe4d rewrite: add support for js rewriting ';http:\\/' urls
add 'parse_comments' rule options for parsing comment contents via regex
banner: simplify banner insertion check, only insert for top frame, and check
for canon_url matching current href at top before redirecting to top
replace em_ -> mp_ as default embedded mod
2014-08-05 01:47:52 -07:00
Ilya Kreymer
c251840141 Merge branch 'https-proxy' into develop
Merge readme and changelist from 0.5.3
2014-08-04 23:15:57 -07:00
Ilya Kreymer
243de1f086 tweak CHANGES 2014-08-04 22:51:43 -07:00
Ilya Kreymer
fcf7971e86 update dev version 0.5.3, edit changelist 2014-08-04 22:51:43 -07:00
Ilya Kreymer
6e6688beb3 rewrite/testing: add additional test for live rewrite post, invalid post
htmlrewrite: annotate untestable sections (unimplemented, 2.6 only exceptions)
2014-08-04 22:51:43 -07:00
Ilya Kreymer
9e4459ae50 rewrite: remove extra wb_url param from rewrite_content(), the wb_url
will come from the urlrewriter, to get the 'mod'
2014-08-04 22:51:42 -07:00
Ilya Kreymer
c3004007d7 rewrite: add test for banner-only mode, rewriting w/o a head using local
'sample_no_head' file.
query.html: use client side rewriting for calendar dates
rewrite: remove unused decode stuff
2014-08-04 22:51:42 -07:00
Ilya Kreymer
4a39a4ed55 rewrite: better parametrize live rewrite timestamp cookie, restore LiveResourceException 2014-08-04 22:51:42 -07:00
Ilya Kreymer
ef8d910d01 banner: remove client side 'capture_str' formatting, just output wbinfo.timestamp,
allow js to format as needed, also helps with #41
update tests to only look at timestamp
2014-08-04 22:51:42 -07:00
Ilya Kreymer
103a1c6455 client js: use iframe onload event to detect when iframe changes, allows
setting banner even for non-html captures, instead of frame notifying parent
will fix issue mentioned in #41
move script from frame_insert.html -> wb_frame.js
2014-08-04 22:51:42 -07:00
Ilya Kreymer
8d54153326 refactoring for better extensibility:
remove BaseContentView, move top-frame functionality to SearchPageWbUrlHandler
remove RewriteLiveView, fold functionality into the handler
move default mod setting into RewriteContent
2014-08-04 22:51:42 -07:00
Ilya Kreymer
160182ec48 rewrite: add 'bn_' banner only rewrite
cleanup rewrite_content/fetch_request api to take a full wb_url
add content-length to responses whenever possible (WbResponse) and static files
bump version to 0.5.2
2014-08-04 22:51:42 -07:00
Ilya Kreymer
f71b83f587 tweak CHANGES 2014-08-04 22:51:03 -07:00
Ilya Kreymer
13881f5cf0 update dev version 0.5.3, edit changelist 2014-08-04 22:32:17 -07:00