Barbara Miller
da69503ed1
Merge branch 'limit_revisits' into qa
2023-08-15 15:50:29 -07:00
Barbara Miller
887680b0ec
try iso-8859-1
2023-08-15 15:50:02 -07:00
Barbara Miller
4e88c90f4d
Merge branch 'limit_revisits' into qa
2023-08-15 14:27:01 -07:00
Barbara Miller
533f5c0af2
limit_revisits wants str, not bytes
2023-08-15 14:26:14 -07:00
Barbara Miller
3023484cfc
Merge branch 'limit_revisits' into qa
2023-08-03 14:10:29 -07:00
Barbara Miller
a86169c56c
pep0440 version id (I think)
2023-08-03 14:09:23 -07:00
Barbara Miller
3c64ee1529
Merge branch 'limit_revisits' into qa
2023-07-21 13:37:38 -07:00
Barbara Miller
f83e82c900
limit_revisit check before dedup
2023-07-21 13:37:08 -07:00
Barbara Miller
0dc80c6044
Merge branch 'limit_revisits' into qa
2023-07-13 10:34:02 -07:00
Barbara Miller
e5b2561821
disable prepared statements: prepare_threshold=None
2023-07-13 10:19:01 -07:00
Barbara Miller
8d684b7e12
Merge branch 'limit_revisits' into qa
2023-07-12 17:57:43 -07:00
Barbara Miller
548c4e5cab
initial deploy fixes
2023-07-12 17:56:39 -07:00
Barbara Miller
af4c8b071a
lru_cache skip_revisit
2023-07-12 17:05:29 -07:00
Barbara Miller
47811977ef
lru_cache skip_revisit
2023-07-12 17:04:07 -07:00
Barbara Miller
3de580e352
Merge branch 'limit_revisits' into qa
2023-07-11 16:37:09 -07:00
Barbara Miller
64a152ee8c
lru_cache
2023-07-11 16:35:38 -07:00
Barbara Miller
b5ca3b6db6
Merge branch 'idna_unpeg' into qa
2023-07-11 13:28:43 -07:00
Vangelis Banos
6eb2bd1265
Drop idna==2.10 version lock
...
There is no need to use such an old `idna` version.
The latest works with py35+ and all tests pass.
Newer `idna` supports the latest Unicode standard and latest python
versions.
https://github.com/kjd/idna/blob/master/HISTORY.rst
2023-07-09 10:02:13 +00:00
Barbara Miller
8563b95ff6
Merge branch 'limit_revisits' into qa
2023-06-28 17:35:58 -07:00
Barbara Miller
b91a7d1d89
more updates qa prototyping
2023-06-28 17:34:26 -07:00
Barbara Miller
40ef6fc186
Merge branch 'limit_revisits' into qa
2023-06-28 16:26:49 -07:00
Barbara Miller
702afbd098
more updates qa prototyping
2023-06-28 16:23:32 -07:00
Barbara Miller
876a113470
Merge branch 'limit_revisits' into qa
2023-06-28 11:48:48 -07:00
Barbara Miller
dfc34e7561
more updates qa prototyping
2023-06-28 11:43:53 -07:00
Barbara Miller
ef75164f8b
fixes for qa prototyping
2023-06-27 17:19:40 -07:00
Barbara Miller
ad458ddb6a
backout skip_revisits
2023-06-27 11:50:18 -07:00
Barbara Miller
65d7776ec4
Merge branch 'limit_revisits' into qa
2023-06-27 11:48:28 -07:00
Barbara Miller
b3f7b09298
fixes for qa prototyping
2023-06-27 11:47:55 -07:00
Barbara Miller
d9145eefb5
LimitRecords, more LimitRevisitsPGMixin
2023-06-26 22:49:33 -07:00
Barbara Miller
0da822a555
Merge branch 'skip_revisits' into qa
2023-06-23 11:30:01 -07:00
Barbara Miller
08f2903f14
LimitRevisitsPGMixin
2023-06-22 19:29:53 -07:00
Barbara Miller
d864ea91ee
Merge pull request #187 from vbanos/cryptography-limit
...
Thanks, @vbanos!
2023-06-22 08:55:33 -07:00
Vangelis Banos
83c109bc9b
Change cryptography version limit to >=2.3,<40
2023-06-22 12:22:24 +00:00
Barbara Miller
5075920415
limit revisits mixin
2023-06-21 17:25:41 -07:00
Barbara Miller
ccb67e03b4
bump qa version
2023-06-19 14:30:33 -07:00
Barbara Miller
98f7032419
cryptography <40
2023-06-19 14:30:33 -07:00
Vangelis Banos
aa8948e612
Limit dependency version cryptography>=2.3,<=39.0.0
...
cryptography 41.0.0 crashes warcprox with the following exception:
```
File "/opt/spn2/lib/python3.8/site-packages/warcprox/main.py", line 317, in main
cryptography.hazmat.backends.openssl.backend.activate_builtin_random()
AttributeError: 'Backend' object has no attribute 'activate_builtin_random'
```
Also, cryptography==40.0.0 isn't OK because when I try to use it I get:
```
pyopenssl 23.2.0 requires cryptography!=40.0.0,!=40.0.1,<42,>=38.0.0, but you have cryptography 40.0.0 which is incompatible.
```
So, the version should be <=39.0.0
2023-06-19 14:30:33 -07:00
Barbara Miller
b45e49ccec
update readme — rm travis
2023-06-19 14:30:33 -07:00
Christian Clauss
243a225537
Delete .travis.yml
2023-06-19 14:30:33 -07:00
Vangelis Banos
1cc08233d6
Limit dependency version cryptography>=2.3,<=39.0.0
...
cryptography 41.0.0 crashes warcprox with the following exception:
```
File "/opt/spn2/lib/python3.8/site-packages/warcprox/main.py", line 317, in main
cryptography.hazmat.backends.openssl.backend.activate_builtin_random()
AttributeError: 'Backend' object has no attribute 'activate_builtin_random'
```
Also, cryptography==40.0.0 isn't OK because when I try to use it I get:
```
pyopenssl 23.2.0 requires cryptography!=40.0.0,!=40.0.1,<42,>=38.0.0, but you have cryptography 40.0.0 which is incompatible.
```
So, the version should be <=39.0.0
2023-06-18 09:09:07 +00:00
Barbara Miller
4f0644727d
get bytes from payload_digest obj
2023-06-08 17:08:30 -07:00
Barbara Miller
1863551cba
Merge pull request #185 from galgeek/qa
...
qa
2023-06-06 13:30:47 -07:00
Barbara Miller
2755a10ebc
fix logging
2023-06-06 12:31:46 -07:00
Barbara Miller
1ea069ae32
fix typos
2023-06-06 12:31:46 -07:00
Barbara Miller
2765942421
fix logging
2023-06-06 12:27:13 -07:00
Barbara Miller
419e5bc536
fix typos
2023-06-05 17:57:02 -07:00
Barbara Miller
2acaba19df
Merge pull request #183 from galgeek/qa
...
skip revisits
2023-06-05 13:51:43 -07:00
Barbara Miller
bc143a57fe
Merge branch 'qa' into qa
2023-06-05 13:51:19 -07:00
Barbara Miller
d98896094a
bump qa version
2023-06-05 13:47:14 -07:00
Barbara Miller
1dc7de7dd8
skip duplicate revisits, per ait-job-id
2023-06-05 13:40:21 -07:00
