Abstract
In this paper, we address the problem of detecting and segmenting leukocytes in images. These cells are an important part of the immune system and some of their attributes (such as the amount and aspect of the cells) are used to detect several diseases (e.g., leukemia). To accomplish this task, we used the deep learning architecture named U-Net, a commonly used segmentation network originally developed aiming at biomedical image segmentation. Since the background in leukocytes images is more constant than in other segmentation tasks, i.e., there is little variety of undesired objects, we opted to use a personalized version of the network and we evaluated the impact of using different combinations of convolutional blocks and filters to build the network model. We compared our network model with different approaches found in the literature using an image dataset containing images of leukocytes and other blood structures. Results demonstrated the superiority of our approach in terms of Jaccard index and, for this given problem, the number of blocks is more important than the total number of trainable parameters of the U-Net.
Similar content being viewed by others
Availability of data and materials
Data available on request.
References
Al-Dulaimi, K., Banks, J., Nguyen, K., Al-Sabaawi, A., Tomeo-Reyes, I., Chandran, V.: Segmentation of white blood cell, nucleus and cytoplasm in digital haematology microscope images: a review-challenges, current and future potential techniques. IEEE Rev. Biomed. Eng. (2020)
Banik, P.P., Saha, R., Kim, K.D.: An automatic nucleus segmentation and CNN model based classification method of white blood cell. Expert Syst. Appl. 149, 113211 (2020)
Bras, G., Fernandes, V., de Paiva, A.C., Júnior, G.B., Rivero, L.: Transfer learning method evaluation for automatic pediatric chest x-ray image segmentation. In: 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), pp. 128–133 (2020)
Dias Junior, J.D., Backes, A.R.: Unsupervised segmentation of leukocytes images using particle swarm. In: International Conference on Computer Vision Theory and Applications, vol. 4, pp. 439–446 (2021)
Diaz Resendiz, J.L., Ponomaryov, V., Reyes Reyes, R., Sadovnychiy, S.: Explainable cad system for classification of acute lymphoblastic leukemia based on a robust white blood cell segmentation. Cancers 15(13), 3376 (2023)
Feng, D., Haase-Schütz, C., Rosenbaum, L., Hertlein, H., Glaeser, C., Timm, F., Wiesbeck, W., Dietmayer, K.: Deep multi-modal object detection and semantic segmentation for autonomous driving: Datasets, methods, and challenges. IEEE Trans. Intell. Transp. Syst. (2020)
Ghose, S., Oliver, A., Martí, R., Lladó, X., Vilanova, J.C., Freixenet, J., Mitra, J., Sidibé, D., Meriaudeau, F.: A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images. Comput. Methods Programs Biomed. 108(1), 262–287 (2012)
Kutlu, H., Avci, E., Özyurt, F.: White blood cells detection and classification based on regional convolutional neural networks. Med. Hypotheses 135, 109472 (2020)
Madhloom, H.T., Kareem, S.A., Ariffin, H., Zaidan, A.A., Alanazi, H.O., Zaidan, B.B.: An automated white blood cell nucleus localization and segmentation using image arithmetic and automatic threshold. J. Appl. Sci. 10, 959–966 (2010)
Mohamed, M., Far, B., Guaily, A.: An efficient technique for white blood cells nuclei automatic segmentation. In: SMC, pp. 220–225. IEEE (2012)
Mohamed, M.M.A., Far, B.: A fast technique for white blood cells nuclei automatic segmentation based on gram-schmidt orthogonalization. In: ICTAI, pp. 947–952. IEEE Computer Society (2012)
Mohamed, M.M.A., Far, B.H.: An enhanced threshold based technique for white blood cells nuclei automatic segmentation. In: Healthcom, pp. 202–207. IEEE (2012)
Ni, Z.L., Bian, G.B., Zhou, X.H., Hou, Z.G., Xie, X.L., Wang, C., Zhou, Y.J., Li, R.Q., Li, Z.: Raunet: Residual attention u-net for semantic segmentation of cataract surgical instruments. In: International Conference on Neural Information Processing, pp. 139–149. Springer (2019)
Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., Kainz, B., et al.: Attention u-net: learning where to look for the pancreas. arXiv preprint arXiv:1804.03999 (2018)
Rezatofighi, S.H., Soltanian-Zadeh, H., Sharifian, R., Zoroofi, R.A.: A new approach to white blood cell nucleus segmentation based on gram-schmidt orthogonalization. In: ICDIP, pp. 107–111. IEEE Computer Society (2009)
Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, pp. 234–241. Springer (2015)
Roy, R.M., Ameer, P.: Segmentation of leukocyte by semantic segmentation model: a deep learning approach. Biomed. Signal Process. Control 65, 102385 (2021)
Stan, T., Thompson, Z.T., Voorhees, P.W.: Optimizing convolutional neural networks to perform semantic segmentation on large materials imaging datasets: X-ray tomography and serial sectioning. Mater. Charact. 160, 110119 (2020)
Tareef, A., Song, Y., Cai, T.W., 0021, Y.W., Feng, D.D., Chen, M.: Automatic nuclei and cytoplasm segmentation of leukocytes with color and texture-based image enhancement. In: ISBI, pp. 935–938. IEEE (2016)
Tareef, A., Song, Y., Feng, D., Chen, M., Cai, W.: Automated multi-stage segmentation of white blood cells via optimizing color processing. In: ISBI, pp. 565–568. IEEE (2017)
Tosta, T.A.A., de Abreu, A.F., Travençolo, B.A.N., do Nascimento, M.Z., Neves, L.A.: Unsupervised segmentation of leukocytes images using thresholding neighborhood valley-emphasis. In: 28th CBMS, Sao Carlos, Brazil, pp. 93–94. IEEE Computer Society (2015)
Treml, M., Arjona-Medina, J., Unterthiner, T., Durgesh, R., Friedmann, F., Schuberth, P., Mayr, A., Heusel, M., Hofmarcher, M., Widrich, M., et al.: Speeding up semantic segmentation for autonomous driving. In: MLITS, NIPS Workshop, vol. 2 (2016)
Zhang, Z., Liu, Q., Wang, Y.: Road extraction by deep residual u-net. IEEE Geosci. Remote Sens. Lett. 15(5), 749–753 (2018)
Funding
André R. Backes gratefully acknowledges the financial support of CNPq (Grant #307100/2021-9). This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brazil (CAPES) - Finance Code 001.
Author information
Authors and Affiliations
Contributions
ARB performed the experiments, wrote the main manuscript text and prepared the figures.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Backes, A.R. Automatic segmentation of leukocytes images using deep learning. SIViP (2024). https://doi.org/10.1007/s11760-024-03069-5
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11760-024-03069-5