Ilya Kreymer
fe0f8ed1d8
Merge branch '0.11.3' into develop
2016-03-16 14:38:49 -07:00
Ilya Kreymer
cd65ddafbc
bump version to 0.11.3
2016-03-16 14:29:42 -07:00
Ilya Kreymer
f962418c1f
html rewrite typo: ensure rw_mod is set for meta content rewrite
2016-03-16 14:27:55 -07:00
Ilya Kreymer
c26660e20f
cookies: use httplib headers pair list instead of requests headers dict to avoid 'set-cookie' headers being concatenated, as that messes up parsing in 3.5.1
2016-03-16 09:47:55 -07:00
Ilya Kreymer
ef5860901f
warc record loader: if no content-length is specified on WARC record (as opposed to error or invalid), leave stream alone, don't force size of 0 and 204
2016-03-13 17:56:37 -07:00
Ilya Kreymer
2051785e6b
statusandheaders: add to_str() method with 'exclude_list' to support converting to str with certain headers
...
excluded. also supported by to_bytes()
2016-03-11 11:02:13 -08:00
Ilya Kreymer
3f734e1c98
tests: remove 3.2, fix auto_index test assert
2016-03-10 13:07:57 -08:00
Ilya Kreymer
42aa12f9ae
test py3.2 also
2016-03-10 12:55:36 -08:00
Ilya Kreymer
34cc3ccacb
versions and readme: update version to 0.30.0, update README with python 2 and 3 support
2016-03-10 12:51:14 -08:00
Ilya Kreymer
0f6e3da127
cdx: tests: add tests for comparison ops
2016-03-10 12:47:36 -08:00
Ilya Kreymer
e5ca9bf601
Merge branch 'master' into py3
2016-03-10 10:53:30 -08:00
Ilya Kreymer
effd618bb3
tests: add parse_comment test for html_rewriter
2016-03-10 10:10:51 -08:00
Ilya Kreymer
8ae692d630
Merge pull request #172 from machawk1/patch-3
...
Spelling: Quick comment fix
2016-03-10 09:52:25 -08:00
Ilya Kreymer
a25bb5e238
Merge pull request #166 from machawk1/patch-2
...
Fixed misspelling
2016-03-10 09:51:56 -08:00
Ilya Kreymer
12ecb29a01
tweak CHANGES
2016-03-10 09:48:28 -08:00
Ilya Kreymer
2f67b78023
Update CHANGES for 0.11.2
2016-03-10 09:47:12 -08:00
Ilya Kreymer
c1bdeac92b
redis: fix redis key lookup, add tests for zrangebylex with new fakeredis
2016-03-09 18:33:04 -08:00
Ilya Kreymer
0198bf1213
Merge branch 'develop' into py3
2016-03-09 07:29:54 -08:00
Ilya Kreymer
bc84c2fda0
indexing: declare 'record' and bail if no record was loaded, add test for empty file indexing, fixes #168
2016-03-09 07:27:03 -08:00
Ilya Kreymer
b3372f64c3
timeutils: add datetime_to_iso_date
2016-03-08 08:39:45 -08:00
Ilya Kreymer
3af2979cf1
cdx: skip any fields starting with '_' when serializing
2016-03-08 08:38:55 -08:00
Ilya Kreymer
5ad01f7d64
statusandheaders: add a to_bytes() func for serializing header
2016-03-08 08:26:51 -08:00
Ilya Kreymer
648e567805
statusandheaders: add __str__ func to reconstruct statusline + headers text
2016-03-04 12:48:36 -08:00
Mat Kelly
96da397456
Quick comment fix
2016-03-04 11:17:35 -05:00
Ilya Kreymer
bb806d7f26
Merge branch 'develop' into py3
2016-03-03 14:09:00 -08:00
Ilya Kreymer
5ddc843094
resolvingloader: use string_types instead of str for compat
2016-03-03 14:05:14 -08:00
Ilya Kreymer
a6dc57cf4a
post query: ensure post query optional buffer is a byte not string buffer
...
exceptions: move LiveRequestException to wbexceptions
cdx query: support for 'alt_url' which, if set, is used to create start_key and end_key
2016-03-03 13:13:44 -08:00
Ilya Kreymer
fc5d7cc7cd
rewrite: add rewriting of <meta> content="" attribute if it is a url
2016-02-25 18:49:31 -08:00
Ilya Kreymer
8fc789cc8f
rewrite: leave out charset in top-frame and don't modify it in replay frame
...
to allow browser to detect best charset, as it would on original page if it is absent)
see #170 for details
2016-02-25 18:25:53 -08:00
Ilya Kreymer
c76aa17b78
wb.js: pad timestamp to 14 digits
2016-02-25 18:25:28 -08:00
Ilya Kreymer
e6361c58ac
bump version to 0.11.2
2016-02-25 18:15:29 -08:00
Ilya Kreymer
20bd9d118b
travis: remove --use-mirrors
2016-02-23 18:39:27 -08:00
Ilya Kreymer
1d5b23413f
proxy: ensure proxy cert download sets content length
...
proxy options: 'use_default_coll' must specify exact default coll
(otherwise a random coll is chosen, as ordering is not defined)
travis: add py3.4, py3.5!
2016-02-23 18:09:09 -08:00
Ilya Kreymer
cebd6b6239
rewrite: fix rewriting encoding -- for best rewriting, keep strategy of encoding
...
insert to match page, then using latin-1 for rewriting. support for non-ascii
based encoding still needed
2016-02-23 18:07:34 -08:00
Ilya Kreymer
3a584a1ec3
py3: all tests pass, at last!
...
but not yet py2... need to resolve encoding in rewriting issues
2016-02-23 13:26:53 -08:00
Ilya Kreymer
0dff388e4e
cdx: CDXQuery takes params dict not **params
...
CDXObject comparison using to_json()
2016-02-23 01:36:39 -08:00
Ilya Kreymer
57991fd0cf
cdx: ensure url param required check is performed on init
2016-02-22 13:59:07 -08:00
Ilya Kreymer
af7c876263
cdx: ensure CDXQuery computes key and end_key automatically
...
key and end_key encoded as utf-8 by default
2016-02-22 13:39:47 -08:00
Ilya Kreymer
7513011cac
path resolvers: add PathResolverMapper for converting paths to resolvers,
...
ResolvingLoader takes a list of resolvers, not paths (to allow for custom overrides)
ResolvingLoader and ArcWarcRecordLoader support 'no_record_parse' on load to not parse http headers from stream
2016-02-19 22:33:38 -08:00
Ilya Kreymer
bd841b91a9
more python 3 support work -- pywb.cdx, pywb.warc tests succeed
...
most relative imports replaced with absolute
2016-02-18 21:26:40 -08:00
Ilya Kreymer
b7008920de
fix setup.py typo
2016-02-16 16:14:10 -08:00
Ilya Kreymer
3c85f7b7ac
py3: make pywb.utils work with python 3!
2016-02-16 14:52:20 -08:00
Mat Kelly
50dab0bc98
Fixed misspelling
2016-01-12 18:21:05 -05:00
Ilya Kreymer
7cf81935e1
Update CHANGES for 0.11.1
2015-12-29 23:03:51 -08:00
Ilya Kreymer
d1c0bfac10
warc indexing: refactor to add create_payload_buffer() which can be overriden in custom iterators to create a file-like object
...
that will receive write() calls to buffer the payload when indexing. Default implementation does not buffer the payload
2015-12-29 17:01:25 -08:00
Ilya Kreymer
98843a2551
wombat: call reload() on actual location, possible fix related to #164
2015-12-29 16:17:39 -08:00
Ilya Kreymer
1e54f8c8fa
proxy: add tests for proxy-mode 'Pywb-Rewrite-Prefix' header which adds optional prefix to proxy mode rewrites.. ensures such rewrites always absolute to include the prefix
2015-12-29 16:10:23 -08:00
Ilya Kreymer
a25096968a
proxy: ip resolver: show 500 error if incorrect coll preconfigured for ip-based settings (todo: make it configurable?)
2015-12-29 14:53:50 -08:00
Ilya Kreymer
ba19ff1cd5
proxy: add custom rewrite prefix in proxy mode with 'pywb-proxy-rewrite: prefix' header
2015-12-23 23:14:47 -08:00
Ilya Kreymer
0cf6b40af9
wombat: add option to def_prop() to make overriden property enumerable, make WombatLocation and other loc overrides enumerable, fixes #163
2015-12-18 21:46:50 -08:00
