1
0
mirror of https://github.com/webrecorder/pywb.git synced 2025-03-15 00:03:28 +01:00

Commit Graph

  • a60b9e6fee update CHANGES.rst Ilya Kreymer 2021-06-14 14:02:30 -07:00
  • c21eb3fb51 ui: ensure jinja2 templates are autoescaped to prevent xss issues (thanks @sebastian-nagel for suggested fix) Ilya Kreymer 2021-06-14 13:27:20 -07:00
  • 5743a141b1 ui: keep locale on error page home link Ilya Kreymer 2021-06-14 13:23:58 -07:00
  • 4d3d61340d coll list ui: include lang in home page collection listing Ilya Kreymer 2021-06-14 12:16:06 -07:00
  • 69cc3043f6 localization / doc fixes: - add missing header.html - docs: support 'i18n' extra, mention in docs - use 'default_locale' for html lang tag - access control docs: fix documentation for adding user with acl command - bump version to 2.6.0b1 Ilya Kreymer 2021-06-14 08:44:46 -07:00
  • 9587954856
    Fix typos in localization and access-control docs (#649) Lauren Ko 2021-06-12 00:50:35 -05:00
  • eabb854075 Fix typos in access-control doc Lauren Ko 2021-06-11 16:58:14 -05:00
  • 97342a99bd Fix typos in localization doc Lauren Ko 2021-06-11 14:10:59 -05:00
  • f2135d8358 Merge branch 'webrecorder:main' into main Philip Clegg 2021-06-10 11:57:14 +01:00
  • 12fcc87962
    Localization Support (#647) v-2.6.0b0 Ilya Kreymer 2021-06-09 13:12:53 -07:00
  • bfcef2ae7b docs: add localization to CHANGES add info about adding localizable text Ilya Kreymer 2021-06-09 13:04:40 -07:00
  • 0eedd1502f remove fakeredis from tests_require, fixes #644 Ilya Kreymer 2021-06-09 12:41:08 -07:00
  • 41b22dcd44 fix typo Ilya Kreymer 2021-06-07 12:13:19 -07:00
  • 39a50f7fe2 localization: wrap more text strings in templates docs: fix typos in docs, mention html lang setting Ilya Kreymer 2021-06-07 11:44:04 -07:00
  • 7ad216c8aa typo fixes Ilya Kreymer 2021-06-06 00:21:27 -07:00
  • efba4b8b40 docs: fix typos in docs Ilya Kreymer 2021-06-04 12:35:39 -07:00
  • bb399181b8 add localization utilities: - add locmanager to support extract, update, remove, list using pybabel - add po2csv/csv2po conversion with translate-utils - docs: add localization.rst to manual! Ilya Kreymer 2021-06-04 12:24:23 -07:00
  • d95b79a8ab CHANGES: update changelist for 2.6.0b0 bump version to 2.6.0b0 Ilya Kreymer 2021-06-09 12:18:45 -07:00
  • 8060ac5735
    Merge pull request #15 from webrecorder/main Philip Clegg 2021-05-20 10:24:37 +01:00
  • f07d35709a
    Access Control Improvements: Embargo + ACL User Support (#642) Ilya Kreymer 2021-05-18 20:09:18 -07:00
  • 234ee07523 docs: fix access control page header, text tweaks Ilya Kreymer 2021-05-18 15:33:11 -07:00
  • cae2c2406c docs: add info on how to configure ACL header with short examples to usage page. sample-deploy: add examples of configuring X-pywb-ACL-user header based on IP for nginx and apache sample deployments Ilya Kreymer 2021-05-18 15:26:01 -07:00
  • 9a7b10a0e8
    Merge 2b2d0cfdca4724d065457a3d4c1a14e610cbf474 into 818b5187656272092b48b35f3a54917743c769e8 ranafayed 2021-05-18 14:03:13 -05:00
  • 818b518765 update to latest wombat (3.1.6), includes more consist post-to-get handling on client-side to match server side handling fuzzymatcher: ensure fuzzy match enabled for non-get requests Ilya Kreymer 2021-05-17 23:00:57 -07:00
  • 1fc43004b9 docs: add docs for new embargo system! Ilya Kreymer 2021-05-17 22:58:34 -07:00
  • 551b8fe026
    xmlquery: remove space after the "limit:" query field name (#640) Alex Osborne 2021-05-13 10:33:58 +09:00
  • 554b95692e acl/embargo work: - support acl access value 'allow_ignore_embargo' for overriding embargo - support 'user' in acl setting, matched with value of 'X-Pywb-ACL-User' header - support passing through 'X-Pywb-ACL-User' setting to warcserver - aclmanager: support -u/--user param for adding, removing and matching rules - tests: add test for 'allow_ignore_embargo', user-specific acl rule matching Ilya Kreymer 2021-05-12 14:45:38 -07:00
  • 4f1fde26c2 xmlquery: remove space after the "limit:" query field name Alex Osborne 2021-05-12 12:22:24 +09:00
  • 18f01065ef embargo: add support for per-collection date range embargo with embargo options of 'before', 'after', 'newer' and 'older' 'before' and 'after' accept a timestamp 'newer' and 'older' options configured with a dictionary consisting of any combo of 'years', 'months', 'days' add basic test for each embargo option Ilya Kreymer 2021-05-05 19:37:24 -07:00
  • db984812a1
    Merge pull request #9 from webrecorder/main Philip Clegg 2021-04-29 15:20:51 +01:00
  • abb76911f5
    Recorder Pending count (#637) Ilya Kreymer 2021-04-28 16:10:39 -07:00
  • 8445793111
    Merge pull request #4 from webrecorder/master Philip Clegg 2021-04-28 14:24:24 +01:00
  • f98e7009a7 recorder: fix using default temp buffer if none provided Ilya Kreymer 2021-04-27 23:21:04 -07:00
  • 1ae69865fb recorder: add pending counter (in redis) to when using redis based dedup system Ilya Kreymer 2021-04-27 23:03:15 -07:00
  • 626da99899
    POST request handling and indexing improvements (#636) Ilya Kreymer 2021-04-27 20:52:24 -07:00
  • 91f9d5a5a0 inputrequest: don't truncate POST requst buffering, must read entire POST data to avoid hung request in live mode. instead, truncate final query string Ilya Kreymer 2021-04-27 20:22:37 -07:00
  • 106a9e9200
    IndexHandler: report BadRequestException as error while loading index (#625) Sebastian Nagel 2021-04-27 21:47:13 +02:00
  • b23ea61e06 IndexHandler: report BadRequestException as error while loading index Sebastian Nagel 2021-03-12 15:40:07 +01:00
  • 0fea91fa52 additional fixes: - support unique dupe params for json-to-query conversion - update tests for test_inputreq, - update post-test.cdxj tox: run full test suite! ci: disable appveyor Ilya Kreymer 2021-04-26 23:22:13 -07:00
  • 46718e70b2 fix tests for post-append-query Ilya Kreymer 2021-04-26 21:53:19 -07:00
  • 2336175cc3 post append improvements: - parse json primitives for post query - standardize post append indexing - include '__wb_method' in urlkey - add 'requestBody' and 'method' to cdxj fuzzy rules: add rule for yt update to latest wombat Ilya Kreymer 2021-02-28 16:03:16 -08:00
  • 5d34018b9f
    yt rules: more general yt rules (#635) Ilya Kreymer 2021-04-26 21:10:30 -07:00
  • ad9b431eaf
    Update the classifiers to match the Python factors in tox.ini (#634) Jon Betts 2021-04-27 05:00:18 +01:00
  • c5c4a54e7d
    xmlquery: use compressed length when available (#633) Alex Osborne 2021-04-27 12:59:37 +09:00
  • 73d6735bed
    Zipnum index: do fail if counting pages with filter params (#631) Sebastian Nagel 2021-04-27 05:55:06 +02:00
  • cdb17c4000
    Fix dedup_index_url configuration option (#617) Lukey3332 2021-04-27 05:52:58 +02:00
  • 7ce4573c70
    WarcServer CDXJ API: fail with CDXException (Bad Request) if params (#630) Sebastian Nagel 2021-04-27 05:52:21 +02:00
  • 212691bd38
    Handle CDXException and respond with HTTP 400 Bad Request (#626) Sebastian Nagel 2021-04-27 05:51:33 +02:00
  • 13ea5baee5
    FrontendApp: forward HTTP status of CDX backend (#624) Sebastian Nagel 2021-04-27 05:35:28 +02:00
  • c62b1bc987
    Warcserver / CDXJ API: properly handle unsupported output formats (#623) Sebastian Nagel 2021-04-27 05:33:37 +02:00
  • 4224cdd7e5
    IndexHandler: backward-compatibility for fl (fields) param (#621) Sebastian Nagel 2021-04-27 05:09:18 +02:00
  • ca14bdd8b2
    AccessChecker: exact-match rules not found in single-line ACLJ file, fixes #628 (#629) Sebastian Nagel 2021-04-27 05:07:19 +02:00
  • 084be82550 bump version to 2.6.0.dev0 Ilya Kreymer 2021-04-26 20:04:26 -07:00
  • 662fc747bf
    Fix ACL loading for auto collections (#620) Sebastian Nagel 2021-04-27 04:58:56 +02:00
  • b475d85c4f tests: fix failing test? update to latest wombat (3.1.4) Ilya Kreymer 2021-04-26 18:22:43 -07:00
  • 13fe5b3215 Update the classifiers to match the Python factors in tox.ini Jon Betts 2021-04-16 15:12:17 +01:00
  • 6cf5a9dee1 xmlquery: use compressed length when available Alex Osborne 2021-04-13 11:56:42 +09:00
  • 7593559263 yt rules: more general yt rules Ilya Kreymer 2021-04-07 23:56:25 -07:00
  • 76a5e47306 Zipnum index: do fail if counting pages with filter params - do not apply any filters (param filter, from, to, closest) if counting pages (param showNumPages=true) Sebastian Nagel 2021-03-22 18:31:56 +01:00
  • a8799b9e5f WarcServer CDXJ API: fail with CDXException (Bad Request) if params page or pageSize are no valid integers Sebastian Nagel 2021-03-22 17:01:48 +01:00
  • 0eb475df9d WarcServer: keep the HTTP status lines short - append the exception message only if the status isn't a string (WbException and inherited classes already have nice status string) - avoid overlong status lines, eg. HTTP/1.1 404 Not Found No Captures found for: https://very-long.url/... Sebastian Nagel 2021-03-22 11:42:50 +01:00
  • 292b620db5 Fix AccessChecker to match exact rules in a single-line rule file Sebastian Nagel 2021-03-19 12:14:10 +01:00
  • 6d607918c9 Add unit test to verify whether ACL exact-match rules in a single-line *.aclj file are found Sebastian Nagel 2021-03-19 10:52:25 +01:00
  • ea3c8d40ea Handle CDXExceptions properly, returning the exception status code - make that CDXException is raised early so that it can be handled in the IndexHandler Sebastian Nagel 2021-03-18 14:19:15 +01:00
  • 90912b9190 FrontendApp: forward HTTP status of CDX backend to allow clients to handle errors more easily Sebastian Nagel 2021-03-12 13:42:19 +01:00
  • 5aeb05454c Warcserver / CDXJ API: properly handle unsupported output formats - add unit test to verify unknown output formats are handled if output fields param is in request Sebastian Nagel 2021-03-09 14:08:46 +01:00
  • 52831f8203 IndexHandler: backward-compatibility for fl (fields) param Sebastian Nagel 2021-03-05 17:53:16 +01:00
  • 504babdad8 Typo: file suffix must be .aclj Sebastian Nagel 2021-03-05 15:31:27 +01:00
  • 1ffc9abd26 Pass collection name to ACL checker to load ACL lists for automatic collections Sebastian Nagel 2021-02-11 11:24:58 +01:00
  • 3ce9d64379 Fix dedup_index_url configuration option Lukas Straub 2021-02-13 18:52:31 +00:00
  • 78a9888b46
    Dedup Policy Tests (#613) v-2.5.0 Ilya Kreymer 2021-01-26 22:39:52 -08:00
  • 56d690157a more test fixes Ilya Kreymer 2021-01-26 22:19:52 -08:00
  • 49b5c24875 dedup tests: - ensure config merge works correctly - add basic tests for dedup system, continuing from #611 Ilya Kreymer 2021-01-26 21:32:33 -08:00
  • aee458b7f5 README: update for 2.5, update badge to github actions Ilya Kreymer 2021-01-26 19:09:36 -08:00
  • 94f6273a91
    Update CHANGES.rst for 2.5.0! (#612) Ilya Kreymer 2021-01-26 19:01:44 -08:00
  • 2102fc6a3a
    Update CHANGES.rst Ilya Kreymer 2021-01-26 18:59:44 -08:00
  • 087ef2f261 wombat: update to latest wombat (3.0.3) Ilya Kreymer 2021-01-26 18:58:13 -08:00
  • 69654fd013 update CHANGES for 2.5.0! Ilya Kreymer 2021-01-26 18:54:37 -08:00
  • e1cad621b9
    Dedup Improvments (#611) Ilya Kreymer 2021-01-26 18:53:54 -08:00
  • 44d2ecb893 test fix: convert default string setting string to dict, don't override custom config Ilya Kreymer 2021-01-26 18:37:54 -08:00
  • e6e0f7d149 docs: explain 'instant replay' that is possible when dedup_policy is set add check to ensure only redis:// URLs can be set for dedup_index_url for now Ilya Kreymer 2021-01-26 17:58:52 -08:00
  • 8282049484 dedup support, work towards patching support (#601) dudup work improvements from #597: - single key 'dedup_policy' of 'skip', 'revisit', 'keep' - optional 'dedup_index_url', defaults to redis urls - support for 'cache: always' to further add cacheing on all requests that have a referrer - updated docs Ilya Kreymer 2021-01-26 17:41:55 -08:00
  • ddf3207e40
    Add configuration options for dedup (#597) Lukey3332 2021-01-27 02:06:18 +01:00
  • 04d0586244
    Rewriting Rules Update (#610) Ilya Kreymer 2021-01-26 15:15:24 -08:00
  • 4683d95580
    cdx sorted output: switch to default list.sort() for cdx output, fixes #608 (#609) Ilya Kreymer 2021-01-26 14:35:30 -08:00
  • c86e1ae649 one more youtubee rule Ilya Kreymer 2021-01-26 14:01:33 -08:00
  • 841c02c123
    Default closest_limit to 100 instead of 10 (#606) Andy Jackson 2021-01-26 21:54:40 +00:00
  • 07fb6bbf1d
    Fix default banner css namespacing (#604) Kai Jauslin 2021-01-26 22:43:40 +01:00
  • a0aaa7558d
    Catch uWSGI TypeError for invalid headers (#603) Kai Jauslin 2021-01-26 22:40:14 +01:00
  • 163636200e cdx sorted output: switch to default list.sort() for cdx output, fixes #608 Ilya Kreymer 2021-01-26 13:24:02 -08:00
  • f628b40e02
    Add support for verifying ssl certificates (#596) Lukey3332 2021-01-26 21:41:26 +01:00
  • 7b4ddd04d9 rules: additional rules fix for vimeo Ilya Kreymer 2021-01-25 23:43:12 -08:00
  • 75e3d8bd5c rules: updated rule to fix replay of latest youtube watch and embed pages include youtube-nocookie variant fixes #607 Ilya Kreymer 2021-01-24 23:26:25 -08:00
  • 9dfc6455b9
    Default closest_limit to 100 instead of 10 Andy Jackson 2021-01-20 09:56:16 +00:00
  • e7c87d79aa Fix default banner css namespacing Kai Jauslin 2021-01-05 14:10:08 +01:00
  • 853eedc246 Fix url_post url encoding Kai Jauslin 2020-12-31 13:39:55 +01:00
  • 6eab105e82 Catch uWSGI TypeError for invalid headers Kai Jauslin 2020-12-29 10:52:30 +01:00
  • e9b64ec814 Add test to check the verification of ssl certificates Lukas Straub 2020-12-20 09:11:36 +00:00
  • b66608c5f3
    Handle Content-Type multipart/form-data without boundary (#599) Lauren Ko 2020-12-16 21:00:02 -06:00
  • a321486139 Add tests for multipart/form-data change Lauren Ko 2020-12-16 18:59:18 -06:00