Constructing tongue coating recognition model using deep transfer learning to assist syndrome diagnosis and its potential in noninvasive ethnopharmacological evaluation
单位:[1]Beijing Univ Chinese Med, Sch Life Sci, Beijing 100029, Peoples R China[2]Beijing Univ Chinese Med, Sch Tradit Chinese Med, Beijing 100029, Peoples R China[3]China Japan Friendship Hosp, Beijing 100029, Peoples R China[4]North China Univ Technol, Sch Informat Sci & Technol, Beijing 100144, Peoples R China[5]Beijing Normal Univ, Beijing 100875, Peoples R China
Ethnopharmacological relevance: Tongue coating has been used as an effective signature of health in traditional Chinese medicine (TCM). The level of greasy coating closely relates to the strength of dampness or pathogenic qi in TCM theory. Previous empirical studies and our systematic review have shown the relation between greasy coating and various diseases, including gastroenteropathy, coronary heart disease, and coronavirus disease 2019 (COVID-19). However, the objective and intelligent greasy coating and related diseases recognition methods are still lacking. The construction of the artificial intelligent tongue recognition models may provide important syndrome diagnosis and efficacy evaluation methods, and contribute to the understanding of ethno-pharmacological mechanisms based on TCM theory.& nbsp;Aim of the study: The present study aimed to develop an artificial intelligent model for greasy tongue coating recognition and explore its application in COVID-19.Materials and methods: Herein, we developed greasy tongue coating recognition networks (GreasyCoatNet) using convolutional neural network technique and a relatively large (N = 1486) set of tongue images from standard devices. Tests were performed using both cross-validation procedures and a new dataset (N = 50) captured by common cameras. Besides, the accuracy and time efficiency comparisons between the GreasyCoatNet and doc-tors were also conducted. Finally, the model was transferred to recognize the greasy coating level of COVID-19.& nbsp;Results: The overall accuracy in 3-level greasy coating classification with cross-validation was 88.8% and ac-curacy on new dataset was 82.0%, indicating that GreasyCoatNet can obtain robust greasy coating estimates from diverse datasets. In addition, we conducted user study to confirm that our GreasyCoatNet outperforms TCM practitioners, yet only consuming roughly 1% of doctors' examination time. Critically, we demonstrated that GreasyCoatNet, along with transfer learning, can construct more proper classifier of COVID-19, compared to directly training classifier on patient versus control datasets. We, therefore, derived a disease-specific deep learning network by finetuning the generic GreasyCoatNet.& nbsp;Conclusions: Our framework may provide an important research paradigm for differentiating tongue character-istics, diagnosing TCM syndrome, tracking disease progression, and evaluating intervention efficacy, exhibiting its unique potential in clinical applications.
基金:
National Key R&D Program of China [2017YFC1700106]; National Natural Science Foundation of China [82004222, 82025036, 82174224]; Beijing Excellent Talent Training Project [2018000020124G112]; Key Research Program of the Chinese Academy of Sciences [ZDRW-ZS-2021-1-2]; Fundamental Research Funds for the Central Universities [2018-JYB-XJQ009]; Double First-Class Funds in Beijing University of Chinese Medicine [1000061020051]; Hutian Scholar in Beijing University of Chinese Medicine
第一作者单位:[1]Beijing Univ Chinese Med, Sch Life Sci, Beijing 100029, Peoples R China
共同第一作者:
通讯作者:
通讯机构:[1]Beijing Univ Chinese Med, Sch Life Sci, Beijing 100029, Peoples R China[2]Beijing Univ Chinese Med, Sch Tradit Chinese Med, Beijing 100029, Peoples R China
推荐引用方式(GB/T 7714):
Wang Xu,Wang Xinrong,Lou Yanni,et al.Constructing tongue coating recognition model using deep transfer learning to assist syndrome diagnosis and its potential in noninvasive ethnopharmacological evaluation[J].JOURNAL of ETHNOPHARMACOLOGY.2022,285:doi:10.1016/j.jep.2021.114905.
APA:
Wang, Xu,Wang, Xinrong,Lou, Yanni,Liu, Jingwei,Huo, Shirui...&Chen, Jianxin.(2022).Constructing tongue coating recognition model using deep transfer learning to assist syndrome diagnosis and its potential in noninvasive ethnopharmacological evaluation.JOURNAL of ETHNOPHARMACOLOGY,285,
MLA:
Wang, Xu,et al."Constructing tongue coating recognition model using deep transfer learning to assist syndrome diagnosis and its potential in noninvasive ethnopharmacological evaluation".JOURNAL of ETHNOPHARMACOLOGY 285.(2022)