Skip to main content
SpringerLink
Log in

MSCA-UNet: multi-scale channel attention-based UNet for segmentation of medical ultrasound images

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Since deep learning is introduced to medical image segmentation, UNet and its variants have been extensively applied in medical image analysis. This paper proposes a multi-scale channel attention UNet (MSCA-UNet) to raise the accuracy of the segmentation in medical ultrasound images. Specifically, a multi-scale module is constructed to connect and to enhance the feature maps with different scales extracted by convolution. Subsequently, A channel attention mechanism is designed to compress feature maps through learnable depth separable convolutions. Eventually, we have explored the global feature module to establish the dependency between multi-level features. The proposed method is thoroughly evaluated and compared with the existing methods on four medical ultrasound image datasets. The experiments indicate that our method outperforms the SOTA method in accuracy on four medical ultrasound image datasets. Compared with UNet network, the parameters of our model have decreased 29.82%. In addition, visual comparisons further demonstrate the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data Availability

Enquiries about data availability should be directed to the authors.

Notes

  1. Pre-processed data from DDTI. https://www.kaggle.com/Datasets/eiraoi/thyroidultrasound.

  2. https://github.com/806036869/MSCAunet.

  3. Preprocessed data from DDTI. https://www.kaggle.com/Datasets/eiraoi/thyroidultrasound.

References

  1. Ronneberger, O., Fischer, P., Brox, T.: U-Net: Convolutional Networks for Biomedical Image Segmentation, pp. 234–241. Springer, Berlin (2015)

    Google Scholar 

  2. Huang, H.: UNet 3+: A full-scale connected unet for medical image segmentation. In: ICASSP 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1055–1059. IEEE, New York (2020)

    Chapter  Google Scholar 

  3. Zhou, Z., et al.: Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging. 39(6), 1856–1867 (2019)

    Article  PubMed  PubMed Central  Google Scholar 

  4. He, K., et al.: HF-UNet: Learning hierarchically inter-task relevance in multi-task U-Net for accurate prostate segmentation in CT images. In: IEEE Transactions on Medical Imaging, vol. 40 (8), pp. 2118–2128. New York (2021)

  5. Pan, H., Zhou, Q., Latecki, L.J.: SGUNET: Semantic Guided UNET for thyroid nodule segmentation. In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 630–634. IEEE, New York (2021)

    Chapter  Google Scholar 

  6. Isunuri, B.V., Kakarla, J.: Brain tumor extraction using adaptive threshold selection network. In: 2019 IEEE 1st International Conference on Energy, Systems and Information Processing (ICESIP), pp. 1–6. IEEE, New York (2019)

    Google Scholar 

  7. Ilayarajaa, K.T., Logashanmugam, E.: Retinal blood vessel segmentation using morphological and canny edge detection technique. In: 2020 International Conference on System, Computation, Automation and Networking (ICSCAN), pp. 1–5. IEEE, New York (2020)

    Google Scholar 

  8. Mishro, P.K., Agrawal, S., Panda, R., Abraham, A.: A Novel Type-2 Fuzzy C-Means Clustering for Brain MR Image Segmentation. In: IEEE Transactions on Cybernetics, vol. 51, pp. 3901–3912. IEEE, New York (2021)

    Google Scholar 

  9. Hou, J.: Research on tumor image segmentation in medical imaging based on extremum adaptive median filtering. In: 2022 IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA), pp. 648–652. (2022)

  10. Azad, R., et al.: Medical image segmentation review: the success of U-Net. ArXiv abs/2211.14830. (2022)

  11. Oktay, O., et al.: Attention u-net: Learning where to look for the pancreas, In Computer Vision and Pattern Recognition, Los Alamitos (2018)

  12. Roy, A., Guha, N., Navab, Wachinger, C.: Concurrent spatial and channel squeeze & excitation in fully convolutional networks. In: MICCAI, pp.421–429. Berlin (2018)

  13. Huang, G., et al.: Channel-attention U-Net: channel attention mechanism for semantic segmentation of esophagus and esophageal cancer. In: IEEE Access, vol. 8, pp. 122798–122810. Piscataway (2020)

  14. Chen, J., et al.: Transunet: Transformers make strong encoders for medical image segmentation. In CVPR. Los Alamitos (2021)

  15. Hu, C., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., Wang, M.: Swin-Unet: unet-like pure transformer for medical image segmentation. In: CVPR. Los Alamitos (2021)

  16. Lin, A., Chen, B., Xu, J., Zhang, Z., Lu, G., Zhang, D.: DS-TransUNet: Dual swin transformer U-Net for Medical Image Segmentation. IEEE Trans. Instrum. Meas. 71, 1–15 (2022)

    Google Scholar 

  17. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., Hu, Q., ECA-Net: efficient channel attention for deep convolutional neural network. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11531–11539. Los Alamitos (2020)

  18. Qin, X., Zhang, Z.V., Huang, C., Dehghan, M., Zaiane, O.R., Jägersand, M.: U2-Net: going deeper with nested U-structure for salient object detection. In CVPR, Los Alamitos (2020)

  19. Alom, M.Z., Yakopcic, C., Hasan, M., Taha, T.M., Asari, V.K.: Recurrent residual U-Net for medical image segmentation. J. Med. Imaging (Bellingham). 6(1), 014006 (2019)

    PubMed  Google Scholar 

  20. Z.Qiang, S., Chen, Wang, Z.: R2AU-Net: Attention recurrent residual convolutional neural network for multimodal medical image segmentation. Secur. Commun. Netw. 2021, 1–6625688 (2021)

    Google Scholar 

  21. Jha, D., Riegler, M.A., Johansen, D., Halvorsen, P., Johansen, H.D.: DoubleU-Net: a deep convolutional neural network for medical image segmentation. In: 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS), pp. 558–564. IEEE, New York (2020)

    Chapter  Google Scholar 

  22. Foivos, D., Waldner, I.F., P.Caccetta and, Wu, C.: ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data. ISPRS J. Photogrammetry Remote Sens. 162, 94–114 (2020)

    Article  ADS  Google Scholar 

  23. Jha, D., et al.: ResUNet++: An Advanced Architecture for Medical Image Segmentation, 2019 IEEE International Symposium on Multimedia (ISM), pp. 225–2255. (2019)

  24. Ibtehaz, N., Rahman, M.S.: MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw. 121, 74–87 (2020)

    Article  PubMed  Google Scholar 

  25. Lou, A., Guan, S., Loew, M.H.: DC-UNet: Rethinking the U-Net architecture with dual channel efficient CNN for medical image segmentation. Med. Imaging (2021)

  26. Michard, H., Luvison, B., Pham, Q.C., Morales-Artacho, A.J.: G.Guilhem AW-Net: automatic muscle structure analysis on B-mode ultrasound images for injury prevention, In Proceedings of the 12th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics (pp. 1–9). (2021), August

  27. Al-Dhabyani, W., Gomaa, M., Khaled, H., Fahmy, A.: Data set of breast ultrasound images. Data in Brief 28, 104863 (2020). https://doi.org/10.1016/j.dib.2019.104863

    Article  PubMed  Google Scholar 

  28. Jin, Q., Meng, Z., Sun, C., Cui, H., Su, R.: RA-unet: A hybrid deep attention-aware network to extract liver and tumor in ct scans. Front. Bioeng. Biotechnol. 8, 1471 (2020)

    Article  Google Scholar 

  29. Fan, T., Wang, G., Li, Y., Wang, H.: MA-Net: A Multi-Scale Attention Network for Liver and Tumor Segmentation. IEEE Access 8, 179656–179665 (2020)

    Article  Google Scholar 

  30. Guo, C., Szemenyei, M., Yi, Y., Wang, W., Chen, B., Fan, C.: SA-Unet: Spatial attention u-net for retinal vessel segmentation. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 1236–1242. IEEE, New York (2021)

    Chapter  Google Scholar 

  31. Azad, R., Khosravi, N., Merhof, D.: SMU-net: Style matching u-net for brain tumor segmentation with missing modalities. In: Medical Imaging with Deep Learning. Westminster (2022)

  32. Zeng, Z., Xie, W., Zhang, Y., Lu, Y.: RIC-Unet: An improved neural network based on unet for nuclei segmentation in histology images. IEEE Access 7, 21420–21428 (2019)

    Article  Google Scholar 

  33. Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., Pal, C.: The importance of skip connections in biomedical image segmentation. In: Deep Learning and Data Labeling for Medical Applications, pp. 179–187. Springer, Berlin (2016)

    Chapter  Google Scholar 

  34. Wang, H., Xie, S., Lin, L., Iwamoto, Y., Han, X.-H., Chen, Y.-W., Tong, R.: Mixed transformer u-net for medical image segmentation. In: ICASSP 2022–2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2390–2394. IEEE, New York (2022)

    Chapter  Google Scholar 

  35. Dolz, J., Ben Ayed, I., Desrosiers, C.: Dense multi-path u-net for ischemic stroke lesion segmentation in multiple image modalities. In: International MICCAI Brainlesion Workshop, pp. 271–282. Springer, Berlin (2018)

    Google Scholar 

  36. Brudfors, M., Balbastre, Y., Ashburner, J., Rees, G., Nachev, P., Ourselin, S., Cardoso, M.J.: An MRF-Unet Product of Experts for Image Segmentation. In: Medical Imaging with Deep Learning, pp. 48–59. PMLR, Westminster (2021)

  37. Klug, J., Leclerc, G., Dirren, E., Preti, M.G., Ville, D.V.D., Carrera, E.: Bayesian skip net: building on prior information for the prediction and segmentation of stroke lesions. In: International MICCAI Brainlesion Workshop, pp. 168–180. Springer, Berlin (2020)

    Google Scholar 

  38. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern, Recognition, pp. 7132–7141. (2018)

  39. Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: CBAM: Convolutional block attention module, In: ECCV, pp. 3–19. (2018)

Download references

Funding

The National Natural Science Foundation of China under grant no. 61672084.

Author information

Authors and Affiliations

  1. College of Information Science & Technology, Beijing University of Chemical Technology, Beijing, 100029, China

    Zihan Chen, Haijiang Zhu & Yutong Liu

  2. Department of Function Test, First Teaching Hospital of Tianjin University of Tradition Chinese Medicine, Tianjin, 300193, China

    Xiaoyu Gao

Authors
  1. Zihan Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haijiang Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yutong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaoyu Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Zihan Chen and Haijiang Zhu wrote the main manuscript text. Yutong Liu and Xiaoyu Gao provided resources and information. All authors reviewed the manuscript.”

Corresponding author

Correspondence to Haijiang Zhu.

Ethics declarations

Conflict of interest

The authors have stated explicitly that there are no conflicts of interest in connection with this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Z., Zhu, H., Liu, Y. et al. MSCA-UNet: multi-scale channel attention-based UNet for segmentation of medical ultrasound images. Cluster Comput (2024). https://doi.org/10.1007/s10586-024-04292-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10586-024-04292-y

Keywords

Search

Navigation