1130 Commits

Author SHA1 Message Date
Barbara Miller
40ef6fc186 Merge branch 'limit_revisits' into qa 2023-06-28 16:26:49 -07:00
Barbara Miller
702afbd098 more updates qa prototyping 2023-06-28 16:23:32 -07:00
Barbara Miller
876a113470 Merge branch 'limit_revisits' into qa 2023-06-28 11:48:48 -07:00
Barbara Miller
dfc34e7561 more updates qa prototyping 2023-06-28 11:43:53 -07:00
Barbara Miller
ef75164f8b fixes for qa prototyping 2023-06-27 17:19:40 -07:00
Barbara Miller
ad458ddb6a backout skip_revisits 2023-06-27 11:50:18 -07:00
Barbara Miller
65d7776ec4 Merge branch 'limit_revisits' into qa 2023-06-27 11:48:28 -07:00
Barbara Miller
b3f7b09298 fixes for qa prototyping 2023-06-27 11:47:55 -07:00
Barbara Miller
d9145eefb5 LimitRecords, more LimitRevisitsPGMixin 2023-06-26 22:49:33 -07:00
Barbara Miller
0da822a555 Merge branch 'skip_revisits' into qa 2023-06-23 11:30:01 -07:00
Barbara Miller
08f2903f14 LimitRevisitsPGMixin 2023-06-22 19:29:53 -07:00
Barbara Miller
5075920415 limit revisits mixin 2023-06-21 17:25:41 -07:00
Barbara Miller
ccb67e03b4 bump qa version 2023-06-19 14:30:33 -07:00
Barbara Miller
98f7032419 cryptography <40 2023-06-19 14:30:33 -07:00
Vangelis Banos
aa8948e612 Limit dependency version cryptography>=2.3,<=39.0.0
cryptography 41.0.0 crashes warcprox with the following exception:
```
File "/opt/spn2/lib/python3.8/site-packages/warcprox/main.py", line 317, in main
  cryptography.hazmat.backends.openssl.backend.activate_builtin_random()
AttributeError: 'Backend' object has no attribute 'activate_builtin_random'
```

Also, cryptography==40.0.0 isn't OK because when I try to use it I get:
```
pyopenssl 23.2.0 requires cryptography!=40.0.0,!=40.0.1,<42,>=38.0.0, but you have cryptography 40.0.0 which is incompatible.
```

So, the version should be <=39.0.0
2023-06-19 14:30:33 -07:00
Barbara Miller
b45e49ccec update readme — rm travis 2023-06-19 14:30:33 -07:00
Christian Clauss
243a225537 Delete .travis.yml 2023-06-19 14:30:33 -07:00
Barbara Miller
4f0644727d get bytes from payload_digest obj 2023-06-08 17:08:30 -07:00
Barbara Miller
1863551cba
Merge pull request #185 from galgeek/qa
qa
2023-06-06 13:30:47 -07:00
Barbara Miller
2755a10ebc fix logging 2023-06-06 12:31:46 -07:00
Barbara Miller
1ea069ae32 fix typos 2023-06-06 12:31:46 -07:00
Barbara Miller
2765942421 fix logging 2023-06-06 12:27:13 -07:00
Barbara Miller
419e5bc536 fix typos 2023-06-05 17:57:02 -07:00
Barbara Miller
2acaba19df
Merge pull request #183 from galgeek/qa
skip revisits
2023-06-05 13:51:43 -07:00
Barbara Miller
bc143a57fe
Merge branch 'qa' into qa 2023-06-05 13:51:19 -07:00
Barbara Miller
d98896094a bump qa version 2023-06-05 13:47:14 -07:00
Barbara Miller
1dc7de7dd8 skip duplicate revisits, per ait-job-id 2023-06-05 13:40:21 -07:00
Barbara Miller
ca02c22ff7
Merge pull request #180 from cclauss/patch-1
Thanks, @cclauss!
2023-04-12 11:45:41 -07:00
Barbara Miller
1fd3b2c7a1
update readme — rm travis 2023-04-12 11:44:01 -07:00
Christian Clauss
ba14480a2d
Delete .travis.yml 2023-04-12 11:37:56 +02:00
Barbara Miller
50a4f35e5f
Merge pull request #177 from internetarchive/blocks-shrink
@adam-miller ok'd this elsewhere
2022-08-05 15:44:05 -07:00
Barbara Miller
9973d28de9 bump version 2022-08-04 17:28:33 -07:00
Barbara Miller
58f3e58531 bump qa version 2022-08-04 15:13:43 -07:00
Barbara Miller
460773a4a6 Merge branch 'blocks-shrink' into qa 2022-08-04 15:12:58 -07:00
Barbara Miller
ee9e375560 zlib decompression 2022-08-04 11:14:33 -07:00
Barbara Miller
8f10fce93a resetting to Jul 1 updates 2022-08-03 19:58:54 -07:00
Barbara Miller
20789e4edb bump qa version 2022-08-03 16:53:52 -07:00
Barbara Miller
5ed59a82d2 Merge branch 'qa' of github.com:internetarchive/warcprox into qa 2022-08-03 16:53:17 -07:00
Barbara Miller
e7fb1474ad Merge branch 'blocks-shrink' into qa 2022-08-03 16:52:44 -07:00
Barbara Miller
1205589fae decompress and json.loads 2022-08-03 16:52:31 -07:00
Barbara Miller
053a42a371
bump qa version 2022-08-03 16:30:49 -07:00
Barbara Miller
babbb8ca74 Merge branch 'blocks-shrink' into qa 2022-08-03 15:50:53 -07:00
Barbara Miller
2cdfceade1 decompress and split 2022-08-03 15:49:54 -07:00
Barbara Miller
09347c903e Merge branch 'master' of github.com:internetarchive/warcprox into blocks-shrink 2022-08-03 15:46:36 -07:00
Barbara Miller
a232ffc6ba
bump qa version 2022-08-03 15:04:39 -07:00
Barbara Miller
ea5ba9b007 Merge branch 'qa' of github.com:internetarchive/warcprox into qa 2022-08-03 15:01:13 -07:00
Barbara Miller
d617b4850c Merge branch 'blocks-shrink' into qa 2022-08-03 15:01:01 -07:00
Barbara Miller
3e8102221d use 'compressed_blocks' 2022-08-03 14:59:36 -07:00
Barbara Miller
106cb905db zlib decompression 2022-08-03 11:15:25 -07:00
Barbara Miller
c008c2eca7
bump version 2022-07-01 14:18:17 -07:00