robertvokac/bitrot
Archived
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Activity

0.9.2, updated README and benchmarks

Browse Source
This commit is contained in:
Lukasz Langa 2016-11-01 12:02:34 -07:00
parent 7cf1577be7
commit 58aa762e5c
2 changed files with 28 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

32
README.rst
View File

@ -27,15 +27,32 @@ a folder after moving it to another drive.
Performance Performance
----------- -----------
Obviously depends on how fast the underlying drive is. No rigorous Obviously depends on how fast the underlying drive is. Since bandwidth
performance tests have been done. For informational purposes, a typical for checksum calculations is greater than your drive's data transfer
5400 RPM laptop hard drive scanning a 60+ GB music library takes around rate, even when comparing mobile CPUs vs. SSD drives, the script is
15 minutes. On an OCZ Vertex 3 SSD drive ``bitrot`` is able to scan single-threaded.
a 100 GB Aperture library in under 10 minutes. Both tests on HFS+.
No rigorous performance tests have been done. Scanning a ~1000 files
totalling ~4 GB takes 20 seconds on a 2015 Macbook Air (SM0256G SSD).
This is with cold disk cache.
Some other tests back from 2013: a typical 5400 RPM laptop hard drive
scanning a 60+ GB music library took around 15 minutes. On an OCZ
Vertex 3 SSD drive ``bitrot`` was able to scan a 100 GB Aperture library
in under 10 minutes. Both tests on HFS+.
If you'd like to contribute some more rigorous eenchmarks or any
performance improvements, I'm accepting pull requests! :)
Change Log Change Log
---------- ----------
0.9.2
~~~~~
* bugfix: one place in the code incorrectly hardcoded UTF-8 as the
filesystem encoding
0.9.1 0.9.1
~~~~~ ~~~~~
@ -155,4 +172,7 @@ Authors
Glued together by `Łukasz Langa <mailto:lukasz@langa.pl>`_. Multiple Glued together by `Łukasz Langa <mailto:lukasz@langa.pl>`_. Multiple
improvements by `Yang Zhang <mailto:yaaang@gmail.com>`_, `Jean-Louis improvements by `Yang Zhang <mailto:yaaang@gmail.com>`_, `Jean-Louis
Fuchs <mailto:ganwell@fangorn.ch>`_ and `Phil Lundrigan <mailto:philipbl@cs.utah.edu>`_. Fuchs <mailto:ganwell@fangorn.ch>`_, `Phil Lundrigan
<mailto:philipbl@cs.utah.edu>`_, `Ben Shepherd
<mailto:bjashepherd@gmail.com`, and `Peter Hofmann
<mailto:scm@uninformativ.de>`_.

4
src/bitrot.py
View File

@ -40,9 +40,9 @@ import tempfile
import time import time
DEFAULT_CHUNK_SIZE = 16384 DEFAULT_CHUNK_SIZE = 16384 # block size in HFS+; 4X the block size in ext4
DOT_THRESHOLD = 200 DOT_THRESHOLD = 200
VERSION = (0, 9, 1) VERSION = (0, 9, 2)
IGNORED_FILE_SYSTEM_ERRORS = {errno.ENOENT, errno.EACCES} IGNORED_FILE_SYSTEM_ERRORS = {errno.ENOENT, errno.EACCES}
FSENCODING = sys.getfilesystemencoding() FSENCODING = sys.getfilesystemencoding()