Current Issue Cover
  • 发布时间: 2024-09-04
  • 摘要点击次数:  18
  • 全文下载次数: 11
  • DOI:
  •  | Volume  | Number
视网膜血管图像分割的尺度特征表示学习网络

杨可欣, 刘骊, 付晓东, 刘利军, 彭玮(昆明理工大学)

摘 要
目的 针对视网膜血管图像分割中血管特征尺度多变、毛细血管细节丰富以及视杯视盘、病变等特殊区域干扰导致的表征不精确、分割误差大以及结果不准确等问题,提出一种基于尺度特征表示学习的视网膜血管图像分割网络,包括尺度特征表示、纹理特征增强和双重对比学习三个模块。方法 首先输入视网膜图像集中的图像,通过引入空间自注意力构建尺度特征表示模块,对视网膜血管进行分层尺度表征;然后,采用上下文信息引导的纹理滤波器对血管尺度特征进行纹理特征增强;最后,通过采样血管尺度特征和纹理增强特征,并定义联合损失进行双重对比学习,优化两种特征空间中视杯视盘、病变等特殊区域的血管。结果 为了验证方法的有效性,在三个具挑战性的数据集进行对比实验,结果表明,构建的视网膜血管图像分割网络有助于准确表示血管尺度特征和纹理增强特征,能够较好获得完整的视网膜毛细血管等特殊区域的血管分割结果。本文方法在DRIVE数据集中较大多数方法,Acc值提高了0.67%,Sp值提高了0.48%;在STARE数据集中较大多数方法Se值提高了6.26%,Sp值提高了7.52%;在CHASE_DB1数据集中较大多数方法,Se值提高了2.12%,F1值提高了2.13%。结论 本文提出的视网膜血管图像分割网络,能精准分割多尺度血管、毛细血管和特殊区域的血管,有效辅助视网膜血管疾病诊断。
关键词
Scale feature representation learning network for retinal vessels image segmentation

Yang Kexin, Liu Li, Fu Xiaodong, Liu Lijun, Peng Wei(Kunming University of Science and Technology)

Abstract
Objective Retinal vessels image segmentation refers to the separation of vessel pixels in a color fundus image from the background pixels. The morphology of retinal vessels is closely associated with many kinds of ophthalmic diseases and plays a crucial role in computer aided diagnosis and smart medicine. Retinal vessels image is also an important type of biological information that can be used as a recognition condition to construct personal identification systems in the field of social security. Lastly, the segmented retinal vessels images can serve as a priori for other anatomical sites, such as the macula. At present, retinal image segmentation methods can be divided into traditional methods and deep learning methods. Current methods of retinal vessels image segmentation have a good performance in the segmentation of large-scale vessels, which attributes to the ease of capturing features related to these prominent vessels. U-Net can effectively handle the complicated anatomical semantics in retinal vessels segmentation task and fuse adjacent-level features to learn more local and global semantic information for more accurate segmentation. Although significant progress in retinal vessels segmentation has been achieved with the advancement of deep learning, some challenging issues for retinal vessels image segmentation still remain. Firstly, current methods do not adequately represent vessels feature at multiple scales, resulting in poor segmentation results for retinal vessels with large differences in size and shape. Secondly, thin vessels are easily missed by current methods, especially located at the end of the extremely low contrast branches, leading to incomplete vessels segmentation. In addition, the medical semantic around retinal vessels is complex, special regions such as the optic cup, optic disc, and lesions can interfere with vessels segmentation and seriously affect the accuracy of retinal vessels segmentation. We propose the retinal vessels image segmentation network based on scale feature representation learning by introducing three modules: scale feature representation, texture feature enhancement and double contrastive learning. Method In this study, first, we input the images in the retinal image set, and the first layer retinal vessel feature is extracted by U-Net-based backbone network. The hierarchical representation and stepwise fusion strategies from local details to global structure are used to fully represent the scale features of the vessels by introducing average pool operation and spatial self attention mechanism, to rich multi-scale information and obtain a vessel scale feature representation. Then, based on the vessel scale feature, the last four layers of scale encoding features are obtained by down-sampling, and in the process of skipping connection the scale encoding features combine the deeper features to obtain the intermediate features by using three types of convolutions. Intermediate features are enhanced using contextual information-guided texture filters, obtaining enhanced texture features, which effectively focus on the edge of the thin vessels by supplementing texture information. Finally, we sample the vessel scale feature and texture enhanced feature to obtain vessel pixels, background pixels near vessels and other background pixels in the two feature space domains. They are used as inputs for double constraint learning to calculate double constraint loss. Double constraint learning can reduce the intra-class distance, increase the variance between classes, and significantly improve the segmentation effect of thin vessels and vessels in special regions, such as optic cup, optic disc or lesions regions. Result The illustrated method is validated on three challenging retinal vessels image datasets (DRIVE, STARE and CHASE_DB1). The Acc, Se and Sp on the STARE and CHASE_DB1 are 0.9761, 0.8191, 0.9866, 0.9765 0.8415 and 0.9874 respectively, which indicate that our proposed method outperforms the most competing methods and significantly improves the performance when extracting thin vessels in the regions of lesions or optic disc. Compared with other methods, the Acc value of the proposed method in the DRIVE dataset is increased by 0.67% and the Sp value is increased by 0.48% by average. In the STARE dataset, compared with other methods, the Se value is increased by 6.26% and the Sp value is increased by 7.52% by average. In the CHASE_DB1 dataset, the Se value is increased by 2.12% and the F1 value is increased by 2.13% compared to other methods. We visually analyze the advantages of our method by showing the vessels details and our method has achieved better results in the thin vessels with few vessel breaks. And we achieve better results in dark and unevenly illuminated images. Some methods have inaccurate segmentation results on crossed vessels at the optic disc and cannot easily segment thin vessels around the optic disc. Compared with other methods, the segmentation results of our methods on the cross vessels at the optic disc do not show the phenomenon of vessels rupture. It can be observed that we significantly improve the segmentation of vessels and thin vessels in the regions of optic disc, lesions or other regions. Our demonstrations show that the constructed retinal vessels image segmentation network is helpful to accurately represent the scale features of vessels and enhance the texture of vessels, it can effectively obtain complete retinal capillaries and vessel segmentation results in special regions. Lastly, among the ablation studies and analyses, these findings will doubtlessly prove that only a combination of three modules can simultaneously deal with the variable scale and anatomical semantics variations of retinal vessels. Conclusion In this paper, the retinal vessels image segmentation network can accurately segment multi-scale vessels, thin vessels and vessels in special regions by effectively representing the vessels scale features and enhancing texture features, and effectively assist in the diagnosis of vessel diseases.
Keywords

订阅号|日报