Recent digital pathology workflows mainly focus on mono-modality histopathology image analysis. However, they ignore the complementarity between Haematoxylin & Eosin (H&E) and Immunohistochemically (IHC) stained images, which can provide comprehensive gold standard for cancer diagnosis. To resolve this issue, we propose a cross-boosted multi-target domain adaptation pipeline for multi-modality histopathology images, which contains Cross-frequency Style-auxiliary Translation Network (CSTN) and Dual Cross-boosted Segmentation Network (DCSN). Firstly, CSTN achieves the one-to-many translation from fluorescence microscopy images to H&E and IHC images for providing source domain training data. To generate images with realistic color and texture, Cross-frequency Feature Transfer Module (CFTM) is developed to pertinently restructure and normalize high-frequency content and low-frequency style features from different domains. Then, DCSN fulfills multi-target domain adaptive segmentation, where a dual-branch encoder is introduced, and Bidirectional Cross-domain Boosting Module (BCBM) is designed to implement cross-modality information complementation through bidirectional inter-domain collaboration. Finally, we establish Multi-modality Thymus Histopathology (MThH) dataset, which is the largest publicly available H&E and IHC image benchmark. Experiments on MThH dataset and several public datasets show that the proposed pipeline outperforms state-of-the-art methods on both histopathology image translation and segmentation.
基金:
National Key Research and Development Program of China [2017YFA0700401]; National Natural Science Foundation of China [KKA309004533]; Fudan University [gyy_yc_2020-8]
第一作者单位:[1]Beijing Jiaotong Univ, Sch Comp Sci & Technol, Beijing 100044, Peoples R China
通讯作者:
推荐引用方式(GB/T 7714):
Zhang Huaqi,Liu Jie,Wang Pengyu,et al.Cross-Boosted Multi-Target Domain Adaptation for Multi-Modality Histopathology Image Translation and Segmentation[J].IEEE JOURNAL of BIOMEDICAL and HEALTH INFORMATICS.2022,26(7):3197-3208.doi:10.1109/JBHI.2022.3153793.
APA:
Zhang, Huaqi,Liu, Jie,Wang, Pengyu,Yu, Zekuan,Liu, Weifan&Chen, Huang.(2022).Cross-Boosted Multi-Target Domain Adaptation for Multi-Modality Histopathology Image Translation and Segmentation.IEEE JOURNAL of BIOMEDICAL and HEALTH INFORMATICS,26,(7)
MLA:
Zhang, Huaqi,et al."Cross-Boosted Multi-Target Domain Adaptation for Multi-Modality Histopathology Image Translation and Segmentation".IEEE JOURNAL of BIOMEDICAL and HEALTH INFORMATICS 26..7(2022):3197-3208