Noah Levitt
a2c25d4242
split into even more source files
2014-11-20 00:04:43 -08:00
Noah Levitt
9b8ffbbb51
separate WarcWriter and WarcWriterThread
2014-11-15 04:47:26 -08:00
Noah Levitt
b34edf8fb1
split into multiple files
2014-11-15 03:20:05 -08:00
Noah Levitt
e8438dc8ad
Merge pull request #10 from ikreymer/dev.fix-sync
...
check if 'sync' method exists before calling it
2014-10-28 13:48:53 -07:00
Ilya Kreymer
a139465512
check if 'sync' method actually exists before calling -- anydbm does not have sync()
...
method
2014-10-28 12:49:02 -07:00
Noah Levitt
a0a5ef2355
fix formatting of Install section again so it looks right on pypi! (test with rst2html)
2014-08-08 12:53:16 -07:00
Noah Levitt
b2479d39f6
fix formatting of Install section so it looks right on github
2014-08-08 12:29:12 -07:00
Noah Levitt
9562338d01
add Install section to readme, update the --help dump
2014-08-08 12:22:33 -07:00
Noah Levitt
16f21b2e76
https://github.com/internetarchive/warcprox/issues/9 record warcprox version in warcinfo metadata, and add --version command line option
2014-08-08 12:10:45 -07:00
Noah Levitt
b434e33fdd
bump version number for updated submission to pypi
2014-08-05 19:04:07 -07:00
Noah Levitt
7b66f27758
since ndbm creates different files on different platforms, glob them all and delete them
2014-08-01 17:40:34 -07:00
Noah Levitt
1cdc013c75
some debugging to try to figure out what the hell is up with tox saying OSError: [Errno 2] No such file or directory: /tmp/tmpnz51j6.db
2014-08-01 17:32:16 -07:00
Noah Levitt
111c678cee
add python3.4 to travis, tox test list; remove apt-get install python3.3-gdbm from travis configuration to fix travis error "Unable to locate package python3.3-gdbm"
2014-08-01 16:43:00 -07:00
Noah Levitt
ccbe3522c5
timestamps in utc!
2014-08-01 16:00:53 -07:00
Noah Levitt
e79cdb84cb
set x509 cert version correctly fixes problem with firefox 31; set_version(2) really means version 3, because 0 is understood to mean version 1 (wtf)
2014-08-01 12:35:34 -07:00
Eldon
5d09aea67d
Merge pull request #6 from jcushman/master
...
If gdbm is not available, fall back to anydbm.
2014-01-31 08:08:01 -08:00
Jack Cushman
4488c04e5e
If gdbm is not available, fall back to anydbm.
2014-01-30 19:07:05 -05:00
Noah Levitt
37bd3b75a6
Merge pull request #5 from khawley/master
...
updated setup.py to use pytest (for compatilibity with dump-anydbm tests)
2014-01-20 14:25:42 -08:00
Kelsey Hawley
c0fbd61507
changed the way I was retrieving the python version
2014-01-17 16:20:16 -08:00
Kelsey Hawley
a87a5dd972
updated test to directly use the specified py version & access the file path to dump-anydbm directly. Also added some more helpful print error statements
2014-01-17 15:35:25 -08:00
Kelsey Hawley
ae3a039d95
updated setup.py to use pytest (for compatilibity with dump-anydbm tests)
2014-01-17 12:13:39 -08:00
Noah Levitt
2ab44d4adf
maybe travis build can use tox
2014-01-07 14:10:39 -08:00
Noah Levitt
62e58caea5
.travis.yml - use pip to install test dependencies
2014-01-07 14:00:46 -08:00
Noah Levitt
ad30585cbf
fix travis build?
2014-01-07 12:04:52 -08:00
Noah Levitt
8213c47969
py.test
2014-01-07 11:54:20 -08:00
Kelsey Karin Hawley
e3116482d4
Merge pull request #4 from nlevitt/test_dump-anydbm
...
small fixes to kelsey's tests
2014-01-07 11:14:08 -08:00
Noah Levitt
f69ec424fb
minor cleanup
2014-01-06 17:22:49 -08:00
Noah Levitt
b4a7a7fa5f
remove warcprox from deps, because it downloads and installs from pypi instead of using local checkout
2014-01-06 17:22:36 -08:00
Noah Levitt
e89fba4332
logic fix
2014-01-06 17:22:00 -08:00
Kelsey Hawley
b6ea681c2b
changed file creation and deletion to use temporaryfile. Still needed to use os to delete the 'extra' files that ndbm & dumbdbm created. Also did not explicitly state the file name in checking the output statements, as now they are random everytime.
2014-01-02 18:18:46 -08:00
Kelsey Hawley
1b69aea7ed
removed the string splicing and replaced with one clear assert statement based on the script output for each test. simplifies and clarifies the test
2014-01-02 17:05:45 -08:00
Kelsey Hawley
4b0ab0ff72
updated file to PEP 8, as editor was complaining, and tabs are generally bad
2014-01-02 16:29:15 -08:00
Kelsey Hawley
39fb1c75ba
added py27 & py32 back into envlist for tox to run against
2013-12-31 13:47:50 -08:00
Kelsey Hawley
e6606c67fa
committing updates to tox.ini file for use with tox
2013-12-31 12:34:09 -08:00
Kelsey Hawley
d643be1c8c
moved dump-anydbm test file to be in the existing test folder, as proximity to dump-anydbm script is not necessary
2013-12-20 14:01:42 -08:00
Kelsey Hawley
12e00e3060
Merge branch 'master' of https://github.com/internetarchive/warcprox
...
* 'master' of https://github.com/internetarchive/warcprox :
oops, adding missing comma
add some classifiers
since we depend on warctools trunk now, update the readme, and update the version number, so we can push latest to pypi
2013-12-20 13:54:15 -08:00
Kelsey Hawley
6a129fed34
corrected the import of python 3 modules. Updated print statements to function form to work correctly with python 2 & 3. Also decoded the subprocess output into unicode string for splicing and processing of keys
2013-12-20 13:51:34 -08:00
Kelsey Hawley
48a2db509f
updated string printing to be consistent between python 2 & 3. Previously, python 3 would print the db key & values as byte code, while python 2 inherently ignores this when printing. Now the stdout is the same in both versions.
2013-12-20 13:47:41 -08:00
Kelsey Hawley
44ea56d65c
addressed odd python 3 issue where whichdb cannot recognize an ndbm unless that module has been previously imported. Also removed file_location variable as it wasn't being used afterall
2013-12-20 13:43:49 -08:00
Noah Levitt
3bc4294227
oops, adding missing comma
2013-12-19 17:08:13 -08:00
Noah Levitt
115b7c03ee
add some classifiers
2013-12-19 17:03:40 -08:00
Noah Levitt
f07437f64d
since we depend on warctools trunk now, update the readme, and update the version number, so we can push latest to pypi
2013-12-19 16:48:28 -08:00
Kelsey Hawley
e01de5aad3
Merge branch 'master' of https://github.com/khawley/warcprox
...
* 'master' of https://github.com/khawley/warcprox :
ensure request headers always use \r\n (some servers barf if not, e.g. http://cleftomaniacsnyu.wix.com
2013-12-19 11:02:51 -08:00
Kelsey Hawley
f8549f69cc
cleaned up tests and removed unnecessary testing of fixtures. Only test of dump-anydbm remain
2013-12-18 21:17:41 -08:00
Kelsey Hawley
43158fdce2
reconfigured dump-anydbm to check the output of whichdb instead of checking for file existence first. This helps bypass the issue of an ndbm database only be recognized without its extension. If which returns None, then the file does not exist, and if it returns '' then it cannot process it
2013-12-18 21:16:52 -08:00
Kelsey Hawley
d6cee750bc
updating the test fixture for ndbm. whichdb needs the filename w/o '.db' to correctly identify and dbm.open does not the extension to read it
2013-12-18 18:23:15 -08:00
Kelsey Hawley
99d077b89c
still having trouble gettting the ndbm module to correctly make an ndbm instead of bsd db. this fixture setup seems to work, tho bogglingly. It creates 2 files, one ndbm & the other bsd db. requires further investigation
2013-12-17 17:29:50 -08:00
Kelsey Hawley
c6cbda1187
updated test for dumbdbm. dump-anydbm cannot run any dubmdbm, the test now reflects that
2013-12-17 16:50:35 -08:00
Kelsey Hawley
4718cd7853
updated keys & vals to global predefined, added db type specification (for the differences between py2 & 3), finished up test for dump-anydbm with gdbm
2013-12-17 16:04:26 -08:00
Kelsey Hawley
efb96ee0c3
added test for dump-anydbm that uses module subprocess to run script
2013-12-17 15:35:23 -08:00
