Hardware calibration systems: which ones to buy and use?

We both use and evaluate many monitor calibration and profiling instruments. This page summarizes our findings. Profiling systems are tested on a range of monitors, both LCD and CRT. These tend to be higher end displays, as it is both easier to evaluate profiling and calibration performance on these systems, and they are representative of monitors used by professional photographers.

Monitors tested (as of March, 2005)

• Sony Artisan CRT
• LaCie Electron22Blue III CRT
• HP p920 CRT
• Eizo CG-21 LCD
• LaCie 321 LCD
• IBM T41p laptop LCD
• Dell Inspiron 8600 Ultrasharp laptop LCD

Test Methodology

All test systems ran Windows XP Pro. All profiles were matrix based, except for LUT versions selected with GretagMacbeth and Monaco products on the LCD displays. The screens were calibrated using hardware adjustments when possible. Grayscale gradients and screen neutrality were checked both within and outside color managed applications. Spot checks of neutral tones were made using an RPS 380 spectroradiometer. Extensive checks were then performed on both actual and synthetic images viewed from within Photoshop CS.

Any monitor evaluations are necessarily subjective. Notes were compared from at least three sets of eyes. We ranked the various systems based on three criteria. First was grayscale neutrality and tonality. Obviously, the more neutral the better. Of equal importance, however, was smooth tonality and minimal calibration-induced shadow banding. The remaining two tests were of color performance. The first is a overall ranking based on accuracy and aesthetics for all types of images. The second evaluated only shadow performance. We looked for shadows that were open but not washed out, accurate color and neutrals, and smooth gradients as colors faded to black.

Hardware/Software tested: (Letter codes)

1. ColorVision Spyder2 + Colorvision Spyder2Pro software ($175)
2. ColorVision Spyder (original version) + OptiCal 3.7.8 ($220)
3. GretagMacbeth Spectrolino + ProfileMaker Pro 5.01 software ($6000)
4. GretagMacbeth Eye-One Display 2 + Eye-One Match 3.0 software ($240)
5. GretagMacbeth Eye-One Display 1 + Eye-One Match 3.0 software ($240)
6. Monaco Optix XR Pro (integrated package) ($350)
7. Sony Artisan integrated puck + Sony CRS 1.2.5 software (integrated)
8. GretagMacbeth Eye-One Display 1 + Eizo ColorNavigator 2.0.5 (integrated)
9. LaCie Blue-Eye 1.0.3 (same hardware as Eye-One Display 1) (integrated)
10. ColorEyes Display (with Monaco XR/DTP-94 sensor) ($180 software; $320 with sensor)

Results

Note: Our standard for much of 2004 has been the Monaco Optix XR Pro. This system came out ahead by a small margin in many of our initial tests. To see if familiarity biased our preferences, we switched our system calibration (with the exception of Sony Artisan monitors) to either the Eye-One 2 or Spyder 2 for over a month. The overall rankings remained essentially unchanged.

To help highlight differences between sensors, the following color codes are used:

The above subjective rankings are consistent for individual monitors only. Performance ranked acceptable on a Sony Artisan is far better than anything a laptop monitor can produce with any calibration system. In other words, the color-coded guide groups the performance of the calibration systems on a monitor by monitor basis.

Black and white performance (using key above)

Notes: The difference between the top four calibrators on the LaCie, Eizo, and HP monitors was small. All do a commendable job. The rankings of these instruments were largely determined by the spectroradiometer measurements of absolute neutrality. On the Artisan, the dedicated Sony puck gave results in a class by themselves. The Monaco XR, Eye-One 1, and Spyder2 were excellent but not at the same level. Strangely, this is one monitor where the new Eye-One 2 produced visibly less neutral results. On the laptop monitor, the top two calibrators were very close in performance, with a large gap to the next group.

Overall color performance

Notes: On all displays the top three calibrators were close in performance (with the exception of the Artisan where the Sony puck led the way again).

Shadow performance

Notes: The top four systems on the LaCie and Eizo monitors all showed very good performance. On the HP CRT and both laptops, the ColorVision Spyder2, GretagMacbeth Eye-One 2, and Monaco Optix XR all showed much better shadow detail and tonality than the rest of the field. The Spyder2 was particularly impressive on the HP p920 and IBM LCD.

Conclusions

Several results were system dependent. Nothing beats Sony's own specially tuned puck and software on the Artisan system. Not surprising, as the color filters are matched to the display phosphors. Neither Eizo nor LaCie's systems, both using non-modified hardware in their dedicated systems, were up to what third party software could provide. The poor showing of the GretagMacbeth Spectrolino on the Dell laptop came about because the Spectrolino's weight deformed the screen slightly, causing erroneous readings. The original ColorVision Spyder simply is not competitive in this bunch.

ColorEyes Display: This software combines stellar performance on high quality monitors with a poorly thought out user interface. The overall performance of ColorEyes Display is excellent on good monitors. For calibrating laptop screens or less than top-end LCD monitors, either the Monaco Optix XR or GretagMacbeth Eye-One Display will do a better job. ColorEyes Display is available as software-only, which is compatible with many standard sensors, or as a bundle with the X-Rite DTP-94/Monaco XR sensor. The tests made above used the DTP-94. Using the GretagMacbeth Eye-One Display 2 gave nearly identical results. Other sensors, including the Sequel Squid and Eye-One Display 1 did not produce good results.

The ColorEyes Display software is powerful, but has an unfinished feel. The user interface is non-intuitive, difficult to navigate, and distinctly designed for those familiar with monitor calibration and profiling. The flow through the software is not well thought out. For example, ColorEyes can use the instrument to guide setting screen luminance levels, although this requires starting the calibration with a CRT monitor selected, even if you use a LCD. You need to abort the process and restart if you have a LCD after setting the display luminance. In a similar vein, there is no direct readout of the screen white point. You can calculate it from the displayed xyY values, but this is not useful for most folks. If you are willing to live with quirky software and have a high quality monitor, ColorEyes Display gets our nod as the overall best performer.

Monaco Optix XR Pro: The Monaco Optix XR Pro package is well thought out and performs exceptionally well. ColorEyes Display has the edge on excellent monitors, but Monaco's software is more forgiving of lesser quality screens. Note the "Pro" version is required to gain access to LUT based profiles and using the instrument to set various screen parameters. The XR sensor, the X-Rite DTP-94, is superb and the software very good. Ignore its recommendations on where to set display luminance if it appears drastically too dark. This is a quirk that surfaces on some systems. The XR Pro package adds display trending and matching tools that can be of use in large offices. The previous 5 installation limit at a given site has been done away with. Highly recommended.

GretagMacbeth Eye-One Display 2: The new GretagMacbeth Eye-One Display 2 + Eye-One Match 3.0 is nearly the equal of the Optix XR. The Eye-One adds DDC capability (as of early 2004 a Mac-only feature) to automatically adjust the monitor settings, eliminating the bother of manual adjustments. Another automatic goodie is the software locates where the sensor is on the screen and positions the measurement window accordingly. It is fast, accurate, and does an impressive job. It also includes an ambient light measurement feature that can be used to verify the color temperature of your viewing light. Thankfully, the old Eye-One Match problem of not allowing the white luminance to be specified is fixed. The recommended luminance levels are often too high; drop down to a more sensible value if necessary. A quibble is that the possible luminance values are given in steps of 10. This precludes selecting useful values for CRT monitors such as 85 or 95 cd/m^2. Avoid the "Easy" mode, as this chooses the default, overly bright settings.

The Eye-One 2 produces a touch less shadow resolution than the Optix XR on most monitors. On good quality laptop screens, the tables turned, with the Eye-One 2 giving the best B&W marks. The midtone and highlight response is superb. If you are profiling a lesser quality laptop screen (typically 12" and under for both Mac and PC), be sure to check the release notes on making a single-gamma profile. This helps make these displays more neutral. Do not use the single gamma option for better displays, as overall color accuracy is reduced. The calibration options for CRT monitors that cannot be controlled by the software are limited, particularly the setting of the monitor black level. Highly recommended for most monitors.

Update: The Eye-One 2 uses tiny suction cups to attach the puck to CRT screens. This has the advantage of leaving less marks on the face of anti-glare coated screens. After less than two month's use, the suction cups hold became tenuous at best. A gentle cleaning helped, although the Eye-One 2 needs more care to ensure it stays attached during the measurement process. After six months, the Eye-One 2 refused to stick to any CRT screen. It could only be used by dangling it from the top of the monitor.

ColorVision Spyder2: The ColorVision Spyder2 bears little resemblance to the original Spyder. That is a good thing. The tonality and accuracy of shadow colors is excellent. Grayscale accuracy is, overall, exceptional. The exception was on some laptop monitors. The Dell UltraSharp was one example. Here the Spyder2 was good but not outstanding. A strength of ColorVision has always been their feature-laden software. This still holds for the new offering. The Spyder2Pro software is flexible and powerful with most of the features I deem essential. One exception is not calibrating to the native gamma for CRT screens, but a draw your own gamma curve gives even more power.

The Spyder2 exhibits two quirks. First, it is slow. You can make a sandwich and read most of a daily paper in the time it takes to measure a monitor. Second, the exceptional shadow performance does not carry over into the highlights. The Spyder2 does not measure any light colors - only up to the primary (e.g. [255, 0, 0] for red) values. The profiles appear to reflect this, with more abrupt highlight transitions than those made by GretagMacbeth or Monaco equipment. If shadow detail and accuracy are paramount, the Spyder2 is the one to buy. Wedding photographers faced with the combination of bright lights and slightly off-white gowns should look elsewhere. The Spyder2 is not as sensitive to ambient light levels as the original, but it is still advisable to perform the measurements in a darkened room. Recommended. Would be highly recommended if the highlight performance matched that of the midtones and shadows.

GretagMacbeth Eye-One Display (original version): The Eye-One Match 3.0 software is compatible with both the Eye-One One and the Eye-One Two. Aside from silly naming conventions, the original Eye-One Display held its own. Overall, the original Eye-One Display rates a notch below the Spyder2. It generally surpassed the Spyder2 in dealing with extreme highlights as colors faded to white.  Owners of the original Eye-One Display hardware should download the free upgrade to Match 3.0.

GretagMacbeth Spectrolino: At something over $6000 list, the GretagMacbeth Spectrolino + ProfileMaker Pro software is not realistic to use for monitor profiling alone. The ProfileMaker software affords more options and allows precise fine-tuning of the calibration parameters. This venerable instrument was used as a baseline for comparison. It is an expensive, heavy, slow, and superbly accurate spectrophotometer. Overall, the tide looks to be shifting towards colorimeters. The overall performance falls in the range of the Spyder2. A Spectrolino is still a fine instrument, but unless you need oddball printer profiling capability as well, there are better ways to spend your money.

ColorVision Spyder (original version): The original ColorVision Spyder simply was not competitive with the above products. ColorVision deserves much credit for bringing the first reasonably priced monitor calibration and profiling tool to market. The Spyder certainly remains better than calibrating by eye. Shadow resolution, grayscale neutrality, color accuracy —the original Spyder falls short in all these areas. There are better options.

LaCie Blue-Eye One: I can think of no reason to purchase the LaCie Blue-Eye system. It uses the same hardware as the original Eye-One Display, but the software does little to take advantage of it. The Blue-Eye costs more than the DDC-enabled Eye-One 2 and does less. Not recommended.

Eizo ColorNavigator: The Eizo ColorNavigator software comes for free with the monitor. You need to supply your own Eye-One. The grayscale was OK, and the gamma curve nearly perfect. Color response was not. Use the Eye-One with the new version of GretagMacbeth software.

Which product should I purchase?

On high quality monitors, ColorEyes Display gives the best balance of accuracy, smooth tonality, shadow resolution, and calibration flexibility. Using the software effectively takes careful reading of the user's manual. This is made more difficult because the installation program does not copy the help file to your computer. There is also no on-line help except for a few prompts which may or may not have anything to do with what is shown on-screen. The Mac version of ColorEyes offers automatic DDC control over the monitor hardware settings. The Windows version does not; this capability is in the "coming soon" state. Once you have mastered its quirks, the calibration and profiling of good quality monitors is simply superb. ColorEyes Display is unforgiving of lesser quality screens, particularly LCDs (including laptops). Either the Eye-One 2 or Monaco XR is a better choice here. Getting the most out of ColorEyes Display requires either using the bundled version with the Monaco XR/X-Rite DTP-94 puck or the GretagMacbeth Eye-One 2. Although the software supports older measurement hardware (e.g. Sequel Squid, Eye-One Display One), the profile quality can not compare.

You can not go wrong with the Monaco Optix XR Pro. It matches well with most monitors, and offers useful data analysis and trending capabilities. If you do not need display matching, performance trending, and other workgroup features, the added cost of the Pro package is significant. Unfortunately, the base version with its reduced feature set is not competitive.

The GretagMacbeth Eye-One Display 2 is a good performer. Overall color performance is excellent. The calibration options are not as extensive as those of the Optix XR or Spyder2. If your monitor is DDC-enabled, the Eye-One Match 3 software performs the necessary monitor adjustments automatically (Mac only for now - Windows capability is "coming soon"). The fast speed, particularly on CRT monitors, makes for quick and painless calibration and profiling. A drawback for CRT use is the suction cups used to attach the instrument to the screen. These are not durable, and you will end up needing to dangle the puck from the top of the monitor or get creative with gaffer's tape.

The ColorVision Spyder2 is a mixed performer. The limitation is in how highlights are handled. If your photography requires excellent shadow response or superb B&W performance, the Spyder2 is ideal. The included software offers the most flexibility of any of the recommended systems. Wedding photographers, or others needing to see delicate highlight details will do better with one of the above systems.

Ethan Hansen offers a printer profiling service at http://www.drycreekphoto.com/