- Collaboration with Stanford University provides a solution to the challenges of 3D image immersion and realism
- Paper published in the world’s leading computer graphics journal, ACM Transactions on Graphics

▲ (From left) Dongyeon Kim, Seung-Woo Nam, Researchers at the Optical Engineering and Quantum Electronics Laboratory, Seoul National University; and Suyeon Choi, Researcher at the Computational Imaging Lab, Stanford University

Seoul National University (SNU) College of Engineering announced that the research team from the Optical Engineering and Quantum Electronics Laboratory of the Department of Electrical and Computer Engineering, in collaboration with Stanford University’s Computational Imaging Lab, has identified key visual perceptual factors that enhance the viewing experience of 3D displays. The research revealed that the presence of parallax significantly impacts the perceived realism and immersion of 3D images viewed through holographic displays.

The results of this study were published in ACM Transactions on Graphics, the top-ranked journal in computer graphics, on July 19, and were presented at the prestigious international conference on computer graphics, SIGGRAPH 2024, held in Denver from July 28 to August 1.

Holographic displays, considered the next-generation 3D display technology, generate 3D images by using coherent light sources, such as lasers, and spatial light modulators that reconstruct digitally computed holograms. For 3D image representation in holographic displays, a method for expressing depth is required. Traditionally, a multilayer approach, which divides the object into multiple layers, has been used. While this approach produced high-quality images when captured on camera, it lacked sufficient user evaluation regarding the realism of the viewing experience.

Focusing on this issue, the research team analyzed which 3D image representation methods offer better user experiences when viewed through holographic displays. They specifically investigated parallax as a key visual perceptual factor that adds a sense of realism to the viewing experience. Parallax refers to the perceived speed variation of an object based on its distance from the viewer, where objects farther away appear to move more slowly. Incorporating this effect in 3D displays enhances the depth perception and realism of the image. However, the multilayer method struggled to accurately reproduce this effect.

With this in mind, the research focused on comparing the user experience of 3D images generated by the light field method, which accurately represents parallax, and the traditional multilayer method. By analyzing user evaluations of 3D images generated by both methods and viewed through holographic displays, the research team confirmed that 3D images using the light field method were preferred over those using the multilayer method.

The research team explained, “This discovery is a groundbreaking finding that can be used to maximize the immersion offered by next-generation 3D displays.” They added, “It is expected to make a significant contribution to addressing the limitations of immersion and realism in virtual reality (VR) and augmented reality (AR) 3D viewing experiences.”

The Optical Engineering and Quantum Electronics Laboratory, where the research was conducted, is currently led by Prof. Yoonchan Jeong following the passing of Prof. Byoungho Lee in November 2022. The lab continues its active research in 3D displays, holography, and metasurfaces. Stanford University’s Computational Imaging Lab, which collaborated on this research, is currently led by Gordon Wetzstein, an expert in spatial computing. This work was supported by Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government(MSIT).

▲ (Left) Hologram images captured of 3D images displayed using the multilayer and light field methods through holographic displays, alongside experimental results comparing user responses based on viewing angles.

[Reference]
D. Kim, S.-W. Nam, S. Choi, Jong-Mo Seo, Gordon Wetzstein, and Y. Jeong, “Holographic Parallax Improves 3D perceptual Realism,” ACM Transactions on Graphics (SIGGRAPH 2024), vol. 43, no. 4, article 68, 2024.
https://dl.acm.org/doi/10.1145/3658168

[Contact Number]
Seung-Woo Nam, Researcher, Optical Engineering and Quantum Electronics Lab, Seoul National University
Phone: +82-2-880-9570
Email: 711asd@snu.ac.kr

Prof. Yoonchan Jeong, Department of Electrical and Computer Engineering, Seoul National University
Phone: +82-2-880-1623
Email: yoonchan@snu.ac.kr