Thank you for purchasing through links and ads on this site.
OWC / MacSales.com...
diglloyd Deal Finder...
Buy other stuff at Amazon.com...
Durable and fast, up to 1800MB/s

Mac Pro Westmere Digital Camera RAW File Processing Speed (Bibble Pro)

Last updated 2010-09-05 - Send Feedback
Related: Macs, Mac Pro, workflow, Mac

See test machine configuration.

BibblePro eclipses other RAW converters in absolute speed, and I deem it exceptionally well written for a RAW converter in terms of efficiency. According to a BibblePro engineer, there is some room for improvement, and so further gains might be forthcoming this year (or so I hope).

Bibble Pro 5.1g — convert to 16-bit uncompressed TIF

How much is gained for the 12-core model depends on I/O speed, as clearly shown by using a RAM disk, with a triple-SSD RAID-0 also doing well. It’s not worth the time or risk of setting up RAM disk to get these speeds, but it does show the potential of a system with very fast disk I/O.

But see notes below for why this is so, as well as the JPEG results further below. Note that with a RAM disk, it is faster to process to 16-bit uncompressed TIF than to 100% quality JPEG, presumably because the JPEG step requires compression.

RAW-file Processing Speed — Save as 16-bit TIF

A BibblePro engineer contacted me to state the following. Unfortunately, the assumptions are incorrect—the BibblePro team needs to order themselves an MPG Pro Workstation with a dual or triple SSD RAID-0 stripe!

I look forward to seeing a version of BibblePro that removes these limitations (I intend to work with the BibblePro team to improve its performance).

The reason why the conversion to 16-bit TIFF doesn't scale as well as conversion to JPEG is because the TIFF encoding introduces a disk bottleneck and thread serialization. To try and optimize disk throughput we only allow one TIFF to be encoded at a time because the TIFF encoding is primarily disk-bound. This results in the blocking of other threads that are also disk bound. For example, another thread may be trying to read the next RAW file off the disk.

With TIF, I observed disk I/O demands of no more than 160MB/sec when converting to TIF—far short of the ~500MB/sec which my dual-SSD RAID-0 stripe is capable of. Even single hard drives today can deliver 148MB/sec, such as the Western Digital RE4. If two TIF files were processed together, I/O demands would double, yet still be well below what my system delivers. Its not a seek-time issues; batches of related files are generally located on the same or adjacent tracks, and with solid state drives as I have, there is effectively zero seek time or latency. Old assumptions must be reworked for current realities.

Up to 1527MB/s sustained performance

Bibble Pro 5.1g — convert to max quality JPEG

Scalability is not perfect with JPEG files, but there is a 50% gain with the 12-core.

Because the I/O demands with JPEG are far lower, there must be something else at play; the 12-core time ought to be closer to 56 seconds.

Bibble deserves tremendous credit for nearly pegging out a 12-core system. If you want a fast workflow, then BibblePro is your RAW converter.

Note that on the 6-core system, hyperthreading(virtual cores) is of considerable value, but that on the 12-core system, turning it off is slightly faster. The difference might be due to internal inefficiencies in BibblePro that arise at 12 cores (in part), as well as memory bandwidth and scheduling inefficiencies in Mac OS X.

RAW-file Processing Speed — Save as 16-bit TIF

CPU core usage

See Monitoring system performance with Activity Monitor. Black areas are idle, red and green are usage.

The best performer is BibblePro 5.1G. It also runs about 3-4X faster than Lightroom 3! Its preview function could be improved however, because it uses only half the CPUs on a 12-core system.

          
CPU core usage with Bibble Pro 5.1g during batch processing
2010 Mac Pro 6-core @ 3.33GHz (TIF) and 2010 Mac Pro 12-core (JPEG)
Durable and fast, up to 1800MB/s
B&H Deal ZoneDeals by Brand/Category/Savings
Deals expire in 77 min unless noted. Certain deals may last longer.
$999 SAVE $700 = 41.0% $101 FREE ITEMS Canon EOS 6D DSLR in Cameras: DSLR
$649 SAVE $250 = 27.0% $20 FREE ITEMS Canon EOS 77D DSLR in Cameras: DSLR
$1049 SAVE $450 = 30.0% $20 FREE ITEMS Canon EOS 77D DSLR with 18-135mm USM in Cameras: DSLR
$1349 SAVE $450 = 25.0% $20 FREE ITEMS Canon EOS 7D Mark II DSLR in Cameras: DSLR
$1299 SAVE $500 = 27.0% $101 FREE ITEMS Canon EOS 80D DSLR with 18-135mm in Cameras: DSLR
$229 SAVE $170 = 42.0% $99 FREE ITEMS Dracast CamLux Max Bi-Color 3-Light Kit in All Other Categories
$7 SAVE $10 = 58.0% Joby Action Grip in Video: Camcorders
$2497 SAVE $470 = 15.0% $468 FREE ITEMS Nikon D500 DSLR with 16-80mm in Cameras: DSLR
$1497 SAVE $500 = 25.0% $466 FREE ITEMS Nikon D750 DSLR in Cameras: DSLR
$1997 SAVE $1100 = 35.0% $466 FREE ITEMS Nikon D750 DSLR with 24-120mm in Cameras: DSLR
$1747 SAVE $570 = 24.0% $61 FREE ITEMS Nikon D7500 DSLR with 16-80mm in Cameras: DSLR
$3297 SAVE $800 = 19.0% $556 FREE ITEMS Nikon D810 DSLR with 24-120mm in Cameras: DSLR
$1697 SAVE $200 = 10.0% Pentax K-1 DSLR in Cameras: DSLR
$599 SAVE $200 = 25.0% Rokinon 14mm f/2.8 AF in Lenses: DSLR
$100 SAVE $100 = 50.0% Sachtler Dr. Bag - 3 in All Other Categories
$1998 SAVE $400 = 16.0% Sony a7R II Mirrorless in Cameras: Mirrorless
$368 SAVE $80 = 17.0% Sony DSC-RX100 in Cameras: Point and Shoot
$648 SAVE $100 = 13.0% $37 FREE ITEMS Sony DSC-RX100 III in Cameras: Point and Shoot
$300 SAVE $160 = 34.0% $9 FREE ITEMS Steiner 8x32 XC Binocular in All Other Categories
$790 SAVE $400 = 33.0% Teradek COLR in Computers: Peripherals
$1399 SAVE $100 = 6.0% ZEISS 18mm f/2.8 Batis in Lenses: Mirrorless

diglloyd.com | Terms of Use | PRIVACY POLICY
Contact | About Lloyd Chambers | Consulting | Photo Tours
Mailing Lists | RSS Feeds | Twitter
Copyright © 2008-2017 diglloyd Inc, all rights reserved.
Display info: __RETINA_INFO_STATUS__