SEARCH
diglloydTools™
diglloydTools v 2.2.15 Now Includes Java IntegrityChecker with up to 50% Speed Improvement
Related: 4K and 5K display, computer display, data integrity, diglloydTools, iMac, IntegrityChecker, Java, scalability, SSD
Need help deciding on a Mac? Lloyd offers one-on-one consulting on choosing the best Mac and its best configuration, backup protocol, displays, storage and RAID, etc.
Get diglloydTools and please consider subscribing to my photographic publications also.
diglloydTools works fine with macOS High Sierra—no known issues, and no update was needed.
diglloydTools was updated a week ago to include an optimization to IntegrityChecker.
Now diglloydTools 2.2.15 is updated to include an optimized version of icj, the Java version of IntegrityChecker, which runs on any platform that has a JVM (Mac, Windows, Linux, etc). As yet, the other tools remain native to macOS only.
Download page and release notes. Note: if downloaded before Dec 30 22:45 PST, download again; I found another improvement and added it. icj should be version 1.00.
Like the native version, the optimization in icj is simple: choosing the optimal number of hashing threads, which helps hugely on SSDs capable of 1.5 GB/sec and faster. The default number of hashing threads is now set to the number of virtual CPU cores. Also, the number and size of I/O buffers was found to have a huge impact; the number was decreased by 8X and the size quadrupled, which was found to work optimally on both HDD and SSD systems.
On slower devices there won’t be any speedup versus the native version, since the speed is limited by disk I/O. Due to algorithmic differences, icj can sometimes be faster than the native version, but it will consume more CPU cycles.
See also: diglloydTools IntegrityChecker Java Version: Finds Duplicates, Saved me 100GB!
Examples: speed on the 2017 iMac 5K
Shown below, the 2017 iMac 5K with its 3 GB/sec SSD can hit about 1644 MiB/sec = 1723 MB/sec if it has full CPU availability. The native-code version can do about 2400 MiB/sec = 2500 MB/sec. So the Java version is running at about 68% of the native version—extremely good.
If the drives are slower, the java and native versions will run about the same speed, though the native version will take fewer CPU cycles.
On an 8-core iMac Pro, speeds could double if the internal SSD is fast enough.
Some of the other capabilities in diglloydTools
Aside from testing hard drive or SSD or RAID performance and reliability with DiskTester, data integrity with IntegrityChecker is a must-have workflow tool for anyone with important data:
- Checking drives before putting into “production”
- What a Bad Hard Drive Fails Like when Running diglloydTools 'fill-volume'
- diglloydTools IntegrityChecker Java Version: Finds Duplicates, Saved me 100GB!
- Reader Question: diglloydTools IntegrityChecker to address “had an experience where a number of my RAW files were silently corrupted”
- Detecting Corruption / Validating Data Integrity Over Time and Across Drives and Backup/Restore
- What an Impaired SSD Looks Like
- How to Safely Transfer Data or Verify Backups
- Example of Verifying Data Integrity.
- Are Your Backup Drives Still Functional? Are Your Files Subtly Damaged?
- How to Automate DiskUtility Verification of Mounted Volumes.
- Selling that Computer? Wipe Out Personal Files First
- Search for diglloydTools articles.
