基于虚拟现实技术的人机交互三维手势识别研究

打开文本图片集

关键词：虚拟现实技术；人机交互；三维手势识别；手势运动数据；手势骨骼特征；可视化中图分类号：TN911.73-34；TP391 文献标识码：A 文章编号：1004-373X（2025）20-0040-05

Research on human-computer interaction 3D gesture recognition based on virtual reality technology

LIU Xin1，2 （1.FoshanUniversity，Foshan528225，China;2.CityUniversityofMacau，Macau，China）

Abstract：Inorder to met theneedsof gesture recognition incomplex scenesand ensure thereliabilityof continuous gesturechangerecognition，amethodofhuman-computerinteraction3Dgesturerecognitionbasedonvirtualrealitytechnologyis proposed.In this method，RGB-Dcameraand VICON motion capture systemareusedto obtain3Dgestureposedata and construct3Dgesturemotiondataset.Basedonthisdataset，amanual interactivegesturevisualizationmodelisconstructedby meansof virtualrealitytechnology.Then，itisinputintothegraphconvolutionalmixedatentionnetwork，theundirectedspatial graphof thegesturejointboneisconstructedbasedongraphconvolutionalprocesing，andthefeaturesofthegestureboneare obtained.Themixedatentionmechnismisusedtoscreenandprocessbonefeatures，andclasificationandidentificationof human-computer interaction3D gestures areconductedaccording tothefeaturescreening results.The testingresultsshowthat virtualrealitytechnologycancompletethevisualizationand3Dmodelingofgestureactions，andobtainskeletalfeaturesthat better describe the spatiotemporal features of gesture. The directional angle error Δθ of 3D gesture recognition is below 6.05∘ ：

Keywords：virtualrealitytechnology；human-computer interaction;3Dgesturerecognition；gesturemotiondata；gesture skeletal feature;visualization

0 引言

人机交互三维手势识别是通过捕捉用户的三维手势，让用户仅依靠简单手势动作，在无需其他复杂按键操作时进行设备控制，以此实现人机间的交互，可使用户更好地沉浸在虚拟环境中，并提升用户对虚拟环境的控制体验[2。（剩余5009字）