Dynamic Snake Convolution based on Topological Geometric Constraints for Tubular Structure Segmentation

1 Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, Nanjing 210096, China
2 Jiangsu Province Joint International Research Laboratory of Medical Information Processing
3 Centre de Recherche en Information Biomédicale sino-français, Rennes, France
ICCV 2023
MY ALT TEXT

Our DSCNet dynamically adapts the shape to tubular structures, and the attention well fits the target.

Abstract

Accurate segmentation of topological tubular structures, such as blood vessels and roads, is crucial in various fields, ensuring accuracy and efficiency in downstream tasks. However, many factors complicate the task, including thin local structures and variable global morphologies. In this work, we note the specificity of tubular structures and use this knowledge to guide our DSCNet to simultaneously enhance perception in three stages: feature extraction, feature fusion, and loss constraint. First, we propose a dynamic snake convolution to accurately capture the features of tubular structures by adaptively focusing on slender and tortuous local structures. Subsequently, we propose a multi-view feature fusion strategy to complement the attention to features from multiple perspectives during feature fusion, ensuring the retention of important information from different global morphologies. Finally, a continuity constraint loss function, based on persistent homology, is proposed to constrain the topological continuity of the segmentation better. Experiments on 2D and 3D datasets show that our DSCNet provides better accuracy and continuity on the tubular structure segmentation task compared with several methods.

Video Presentation

Poster

MY ALT TEXT

BibTeX

@InProceedings{Qi_2023_ICCV,
    author    = {Qi, Yaolei and He, Yuting and Qi, Xiaoming and Zhang, Yuan and Yang, Guanyu},
    title     = {Dynamic Snake Convolution Based on Topological Geometric Constraints for Tubular Structure Segmentation},
    booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
    month     = {October},
    year      = {2023},
    pages     = {6070-6079}
}