Ilya Kreymer
|
54b265aaa8
|
s3 and zipnum fixes: (#253)
* s3 and zipnum fixes:
- update s3 to use boto3
- ensure zipnum indexes (.idx, .summary) are picked up automatically via DirectoryAggregator
- ensure showNumPages query always return a json object, ignoring output=
- add tests for auto-configured zipnum indexes
* reqs: add boto3 dependency, init boto Config only if avail
* s3 loader: first try with credentials, then with no-cred config
archive paths: don't add anything if path is fully qualified (contains '://')
* s3 loader: on first load, if credentialed load fails, try uncredentialed
fix typo
tests: add zinum auto collection tests
* zipnum page count query: don't add 'source' field to page count query (if 'url' key not present in dict)
* s3 loader: fix no-range load, add test, update skip check to boto3
* fix spacing
* boto -> boto3 rename error message, cleanup comments
|
2017-10-11 15:33:57 -07:00 |
|