基于多视图舌象特征融合的中医证型辨识

打开文本图片集

关键词：舌诊；证型辨识；特征融合；多视图

中图分类号：TP183 文献标志码：A 文章编号：1001-3695（2025）07-026-2116-07

doi：10.19734/j. issn.1001-3695.2024.11.0471

Abstract：Fortongue diagnosis inTCM（traditional Chinese medicine），clinical physiciansobservethequality，coating，and baseof the tongue to understand the patient’s health status and pathologicalchanges.Existing tongue diagnosis auxiliary syndromediferentiation modelslack comprehensiveanalysisand ignore thecomplementarycharacteristicsofthe tonguesurface and tongue base.To solvethe problem，thispaper proposedasyndrome identification model basedon multi-view tongue featurefusion（SI-MTF）.Bycolecting3348tonguesurfaceandtonguebaseimagesandrequestingtraditional Chinese medicine physicianstolabeltheimages with syndrome types，thispaperconstructedatongueimagedatasetand proposedSI-MTF.Firstly，this methodextractedthetongue surfaceand tongue base regions basedon Mask R-CNNand NanoDet，andthenconstructedaconvolutional neural network with denseconnectionsto extractandfusetonguesurfaceandtonguebase features.SI-MTF extractedcolor，shape，andtexturefeaturesof the tongue image throughchannelmeanof HSVcolormodel，localbinarypatternalgorithm，andGaborfilter.Duringthetrainingstage，thismethodusedateacher-studentnetwork toimprovetheability offusingtonguesurfaceandtonguebase.Finall，itusedfullyconnectedlayersandsoftmaxfunctiontolearntherelationship between fusion features and syndrome types for achieving TCM syndrome identification.Basedonthe tongue image dataset， this paper conductedcomparative experiment，parameter discussion，ablation experiment，and robustness experiment，and then the method obtained an accuracy of 76.75% ，improved by 7.51 percentage points compared to the baseline method. Theexperimentalresultsshowthat thecomprehensiveanalysisofthetonguesurfaceandtonguebasebasedonmultiviewcaneffectively improve theperformanceof the tongue diagnosis auxiliary syndrome diferentiation model.

Keywords：tongue diagnosis；syndrome identification；feature fusion；multi-view

0 引言

望诊是中医四诊之首，其中舌诊作为望诊中的关键流程，医师通过观察舌质、舌苔和舌底变化了解人体生理功能和病理变化，是中医学独具特色的诊法之一[1]。（剩余16306字）