17 Commits

Author	SHA1	Message	Date
Noah Levitt	ebb9b6d625	new option --rollover-idle-time - WARC file rollover idle time threshold in seconds (so that Friday's last open WARC doesn't sit there all weekend waiting for more data) (default: None)	2013-10-19 15:25:42 -07:00
Noah Levitt	7367620dae	write WARC-IP-Address header on response record	2013-10-19 14:36:15 -07:00
Noah Levitt	e01691c1f2	fix bugs, improve logging of each warc record	2013-10-17 18:35:11 -07:00
Noah Levitt	568df5360d	some refactoring for clarity and modularity	2013-10-17 18:12:33 -07:00
Noah Levitt	e6a897412b	use tempfile.SpooledTemporaryFile to overflow recorded response to disk	2013-10-17 12:58:17 -07:00
Noah Levitt	039f892024	--verbose and --quiet	2013-10-17 02:51:51 -07:00
Noah Levitt	fc139f1f4e	send raw bytes from server response back to proxy client (not unchunked)	2013-10-17 02:47:55 -07:00
Noah Levitt	5f90e76ca6	shut down cleaning on sigterm	2013-10-17 01:58:07 -07:00
Noah Levitt	72f141fec3	calculate payload sha1	2013-10-16 19:10:04 -07:00
Noah Levitt	9d176a408b	working on proof of concept streaming support	2013-10-16 18:13:56 -07:00
Noah Levitt	6f12a9e3bf	--certs-dir option	2013-10-16 15:36:53 -07:00
Noah Levitt	096cb0a2b6	restore CA	2013-10-16 14:36:19 -07:00
Noah Levitt	9b394ee860	logging fix	2013-10-16 12:25:15 -07:00
Noah Levitt	b61b818baa	randomize generated cert serial to avoid error from browser	2013-10-16 01:05:06 -07:00
Noah Levitt	9140b16a6a	write request records	2013-10-15 18:37:26 -07:00
Noah Levitt	b3b6406e71	warcinfo record	2013-10-15 17:51:09 -07:00
Noah Levitt	556e969465	for now warcprox.py is just a command, not a module	2013-10-15 15:57:14 -07:00