The effect of display capabilities on the gloss consistency between real and virtual objects

SIGGRAPH Asia 2023 Technical paper conference track

  Bin Chen1*,   Akshay Jindal23*,   Michal Piovarči4,   Chao Wang1,   Hans-Peter Seidel1,   Piotr Didyk5,
Karol Myszkowski1
, Ana Serrano6,   Rafał K. Mantiuk3

1Max-Planck-Institut für Informatik    2Intel Corporation    3University of Cambridge    4Institute of Science and Technology Austria     5Università della Svizzera Italiana    6Universidad de Zaragoza, I3A
*Contribute equally

A faithful reproduction of gloss is inherently difficult because of the limited dynamic range, peak luminance, and 3D capabilities of display devices. This work investigates how the display capabilities affect gloss appearance with respect to a real-world reference object. To this end, we employ an accurate imaging pipeline to achieve a perceptual gloss match between a virtual and real object presented side-by-side on an augmented-reality high-dynamic-range (HDR) stereoscopic display, which has not been previously attained to this extent. Based on this precise gloss reproduction, we conduct a series of gloss matching experiments to study how gloss perception degrades based on individual factors: object albedo, display luminance, dynamic range, stereopsis, and tone mapping. We support the study with a detailed analysis of individual factors, followed by an in-depth discussion on the observed perceptual effects. Our experiments demonstrate that stereoscopic presentation has a limited effect on the gloss matching task on our HDR display. However, both reduced luminance and dynamic range of the display reduce the perceived gloss. This means that the visual system cannot compensate for the changes in gloss appearance across luminance (lack of gloss constancy), and the tone mapping operator should be carefully selected when reproducing gloss on a low dynamic range (LDR) display.

Presentation (coming soon...)