Strongly agreed. For these and various other reasons (e.g., CRI being a poor metric for subjective spectral similarity to the reference source in my experience), I’ve learned to take colorimetric readings with a grain of salt. Most users likely measure in a much less controlled way compared to the author of this comparison, so the variation is even greater.
Nowadays I rely on eyeballing spectrograms to assess similarity to the reference spectrum (blackbody or sunlight), which has served me better than reading test numbers. Some key features are quite robust to noise (measuring hotspot vs spill, drive current, optic type, meter used, etc.), including
- Red content: does the spectrum dip below the reference around 650nm (R9>80) or noticeably before (630nm roughly indicates 50 R9)? Does it have a bump above the reference just before, indicating oversaturation?
- Cyan dip: how deep and wide is the cyan dip, and is it centered closer to blue (good) or green (bad)?
- Blue spike: how high is the blue spike, and is it centered closer to violet (good) or green (bad)?
Once these features are assessed, and CCT/duv estimated, there is very little variation left. This is because most phosphors emit in a broad range of wavelengths, which prevents pathological/spiky behavior in the emission spectrum aside from those assessed above. There exist exceptions, but they are not found in mainstream flashlight LEDs.