沉浸式虚拟现实中的视听融合感知研究及实验分析

打开文本图片集

中图分类号：TN27 文献标识码：A doi：10.37188/CJLCD.2025-0191 CSTR：32172.14.CJLCD.2025-0191

Experimental study on audio-visual integrated perception in immersive virtual reality

ZHENGKaiyue，XIA Zhenping*，ZHAO Guohui，LIU Saishuai （College of Electronics and Information Engineering， Suzhou University of Science and Technology ， Suzhou 215009，China）

Abstract：As metaverse-related technologies continue to advance acrossdomains，users are demanding everhigher-quality virtual-reality experiences. How to enhance immersion in virtual scenes through audio-visual integration stimulation has therefore become a pivotal research direction for metaverse development.This study investigates the impact of audio-visual integration on VR immersion by constructing six virtual scenes that difer only in their type of audio-visual integration. A combined subjective-objective approach was adopted. Subjective immersion was obtained with the IPQ questionnaire completed immediately after each trial，whereas objective immersion was quantified from EEG signals recorded throughout the trial with a portable device. The experimental results demonstrate that different types of audio-visual integration exert a highly significant impact on the quantified subjective sense of immersion （ p<0.001 ）and a significant impact on the quantified objective sense of immersion ⋅p<0.01 ）. Moreover， there is an extremely strong positive correlation between subjective and objective data （ r=0.990 ）.These findings provide both theoretical grounding and practical guidance for enhancing VR-scene immersion by improving audio-visual coherence. Key words： metaverse; virtual reality; audio-visual integration; immersion perception

1引言

随着技术的快速发展，“元宇宙”已从科幻走向现实：它最早出现在尼尔·斯蒂芬森的小说《雪崩》中，是依托沉浸式数字技术生成、可与现实世界无缝切换的共享空间[1。（剩余14623字）