pywb/requirements.txt

six
warcio>=1.7.1
requests
redis==2.10.6
jinja2>=3.1.2
surt>=0.3.1
brotlipy
pyyaml
werkzeug==2.2.3
webencodings
gevent==22.10.2
greenlet>=2.0.2,<3.0
webassets==2.0
portalocker
wsgiprox>=1.5.1
fakeredis<1.0
tldextract
python-dateutil
markupsafe>=2.1.1
ua_parser
py3AMF
build process: simplify build process by moving essential deps to requirements.txt, and extras to extra_requirements.txt setup.py just loads from requirements.txt Dockerfile pip installs requirements, then extra requirements for improved cacheing travis runs setup install, then installs extra requirements 2017-03-08 17:03:52 -08:00			`six`
Support/Improvements to Domain Cookie Cache (#491) * domain cookie fix: - don't set cookies for service worker modifiers if response is not 200 - don't add existing cookies to Cookie or Set-Cookie headers - add sw_/, wkrf_/ modifiers to generate paths - enable domain cookie cacheing by default with fakeredis for live index and record mode, keyed by collection - reqs: add fakeredis, tldextract, update warcio - tests: add initial tests for domain cookie rewriting 2019-07-31 14:58:15 -07:00			`warcio>=1.7.1`
build process: simplify build process by moving essential deps to requirements.txt, and extras to extra_requirements.txt setup.py just loads from requirements.txt Dockerfile pip installs requirements, then extra requirements for improved cacheing travis runs setup install, then installs extra requirements 2017-03-08 17:03:52 -08:00			`requests`
Pin redis for fakeredis (#904) It looks like `poetry install` will install the latest version of redis (v5.0.4) instead of what pip installs (v2.10.6). Unfortunately this means that the old version of fakeredis that is pinned in the requirements.txt will not work properly. Fixes #903 2024-04-26 01:03:27 -07:00			`redis==2.10.6`
Upgrade dependencies (#839) - Update and pin dependencies to specific versions that support Python 3.7-3.11 - Replace deprecated werkzeug.pop_path_info with wsgiref.shift_path_info - Use the latest httpbin from psf/httpbin - Remove unused flask test dependency - Drop Python 2 and Python <3.7 support - Ensure greenlet 2 is used for now, as psf/httpbin doesn't yet work with greenlet 3 --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> 2024-04-02 17:16:50 -04:00			`jinja2>=3.1.2`
HTML Unescape Improvements (#500) * html-unescape fix: - unescape any url that contains '&#' as it may be html-encoded - unescape css blocks that contain '&#' as well, as they may contain css urls that need rewriting * misc fixes: - Update CHANGES - Update to latest wombat - Update reqs to surt 0.3.1, fix tests 2019-08-22 18:35:32 -07:00			`surt>=0.3.1`
build process: simplify build process by moving essential deps to requirements.txt, and extras to extra_requirements.txt setup.py just loads from requirements.txt Dockerfile pip installs requirements, then extra requirements for improved cacheing travis runs setup install, then installs extra requirements 2017-03-08 17:03:52 -08:00			`brotlipy`
			`pyyaml`
Upgrade dependencies (#839) - Update and pin dependencies to specific versions that support Python 3.7-3.11 - Replace deprecated werkzeug.pop_path_info with wsgiref.shift_path_info - Use the latest httpbin from psf/httpbin - Remove unused flask test dependency - Drop Python 2 and Python <3.7 support - Ensure greenlet 2 is used for now, as psf/httpbin doesn't yet work with greenlet 3 --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> 2024-04-02 17:16:50 -04:00			`werkzeug==2.2.3`
build process: simplify build process by moving essential deps to requirements.txt, and extras to extra_requirements.txt setup.py just loads from requirements.txt Dockerfile pip installs requirements, then extra requirements for improved cacheing travis runs setup install, then installs extra requirements 2017-03-08 17:03:52 -08:00			`webencodings`
Upgrade dependencies (#839) - Update and pin dependencies to specific versions that support Python 3.7-3.11 - Replace deprecated werkzeug.pop_path_info with wsgiref.shift_path_info - Use the latest httpbin from psf/httpbin - Remove unused flask test dependency - Drop Python 2 and Python <3.7 support - Ensure greenlet 2 is used for now, as psf/httpbin doesn't yet work with greenlet 3 --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> 2024-04-02 17:16:50 -04:00			`gevent==22.10.2`
			`greenlet>=2.0.2,<3.0`
Upgrade webassets to v2.0 (#730) 2022-06-29 21:02:59 -04:00			`webassets==2.0`
build process: simplify build process by moving essential deps to requirements.txt, and extras to extra_requirements.txt setup.py just loads from requirements.txt Dockerfile pip installs requirements, then extra requirements for improved cacheing travis runs setup install, then installs extra requirements 2017-03-08 17:03:52 -08:00			`portalocker`
text updates: (#352) - Update CHANGES.rst for 2.0.4 - Docs: Improve new proxy docs for (#316), fix URL-T->URI-T - Requirements: bump to wsgiprox>=1.5.1 2018-06-27 09:02:01 -07:00			`wsgiprox>=1.5.1`
Support/Improvements to Domain Cookie Cache (#491) * domain cookie fix: - don't set cookies for service worker modifiers if response is not 200 - don't add existing cookies to Cookie or Set-Cookie headers - add sw_/, wkrf_/ modifiers to generate paths - enable domain cookie cacheing by default with fakeredis for live index and record mode, keyed by collection - reqs: add fakeredis, tldextract, update warcio - tests: add initial tests for domain cookie rewriting 2019-07-31 14:58:15 -07:00			`fakeredis<1.0`
			`tldextract`
Access Control Improvements: Embargo + ACL User Support (#642) * embargo: add support for per-collection date range embargo with embargo options of 'before', 'after', 'newer' and 'older' 'before' and 'after' accept a timestamp 'newer' and 'older' options configured with a dictionary consisting of any combo of 'years', 'months', 'days' add basic test for each embargo option * acl/embargo work: - support acl access value 'allow_ignore_embargo' for overriding embargo - support 'user' in acl setting, matched with value of 'X-Pywb-ACL-User' header - support passing through 'X-Pywb-ACL-User' setting to warcserver - aclmanager: support -u/--user param for adding, removing and matching rules - tests: add test for 'allow_ignore_embargo', user-specific acl rule matching * docs: add docs for new embargo system! * docs: add info on how to configure ACL header with short examples to usage page. sample-deploy: add examples of configuring X-pywb-ACL-user header based on IP for nginx and apache sample deployments * docs: fix access control page header, text tweaks * bump version to 2.6.0b0 2021-05-18 20:09:18 -07:00			`python-dateutil`
Upgrade dependencies (#839) - Update and pin dependencies to specific versions that support Python 3.7-3.11 - Replace deprecated werkzeug.pop_path_info with wsgiref.shift_path_info - Use the latest httpbin from psf/httpbin - Remove unused flask test dependency - Drop Python 2 and Python <3.7 support - Ensure greenlet 2 is used for now, as psf/httpbin doesn't yet work with greenlet 3 --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> 2024-04-02 17:16:50 -04:00			`markupsafe>=2.1.1`
User-Agent Detection Fix + New-Style rewriting on by default + Dependency Update (2.6.6) (#708) * js rewriting: default to moden js-proxy based rewriting by default, use legacy rewriting only if browsers are older than minimum, as suggested in #707 * user-agent detection: use ua_parser for user-agent detection instead of obsolete werkzeug.useragent, which also did not support browsers >=100 * tests: additional tests for rewriting with various user-agents, defaulting to new-style rewriting for unknown browsers * dockerfile: Update Dockerfile to use py3.8 * tests: skip s3 tests dependent on commoncrawl data (for now, need better s3 tests). * bump to 2.6.6, update CHANGES 2022-04-11 14:51:11 -07:00			`ua_parser`
requirements: Adjust installation of Py3AMF module. (#920) Move Py3AMF from setup.py load_requirements to requirements.txt --------- Co-authored-by: Tessa Walsh <tessa@bitarchivist.net> 2024-11-07 17:09:35 +00:00			`py3AMF`