Abstract
This paper introduces a novel model for image fusion that is based on a fractional-order osmosis approach. The model incorporates a definition of osmosis energy that takes into account nonlocal pixel relationships using fractional derivatives and contrast change. The proposed model was subjected to theoretical and experimental investigation. The semigroup theory was used to demonstrate the existence and uniqueness of the evolution equation solution. Additionally, the model was validated and tested using numerical experiments and compared to local image fusion methods. The findings demonstrate that the proposed model outperforms the competitive local image fusion models.
Similar content being viewed by others
References
Kaur, K.D.H., Kadyan, V.: Image fusion techniques: a survey. Arch. Computat. Methods Eng. 28, 4425–4447 (2021)
Li, S., Kang, X., Fang, L., Hu, J., Yin, H.: Pixel-level image fusion: a survey of the state of the art. Inform. Fusion. 33, 100–112 (2017)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graphics. 22, 313–318 (2003)
Ancuti, C., Ancuti, C.O., De Vleeschouwer, C., Bovik, A.C.: Night-time dehazing by fusion. In: 2016 IEEE International conference on image processing (ICIP), pp. 2256–2260 (2016)
Ancuti, C., Ancuti, C.O., Haber, T., Bekaert, P.: Enhancing underwater images and videos by fusion. In: 2012 IEEE Conference on computer vision and pattern recognition, pp. 81–88 (2012)
Li, S., Yang, B.: Multifocus image fusion by combining curvelet and wavelet transform. Pattern Recogn. Lett. 29(9), 1295–1301 (2008)
Mertens, T., Kautz, J., Van Reeth, F.: Exposure fusion: a simple and practical alternative to high dynamic range photography. Comp. Graphics Forum. 28(1), 161–171 (2009)
Thies, J., Zollhöfer, M., Nießner, M., Valgaerts, L., Stamminger, M., Theobalt, C.: Real-time expression transfer for facial reenactment. ACM Trans. Graph. 34(6) (2015)
Parisotto, S., Calatroni, L., Bugeau, A., Papadakis, N., Schönlieb, C.-B.: Variational osmosis for non-linear image fusion. IEEE Transactions on Image Processing, 5507–5516 (2020)
Darwish, S.M.: Multi-level fuzzy contourlet-based image fusion for medical applications. IET Image Process. 7, 694–7006 (2013)
James, A.P., Dasarathy, B.V.: Medical image fusion: a survey of the state of the art. Information Fusion. 19, 4–19 (2014). Special Issue on Information Fusion in Medical Image Computing and Systems
Ma, J., Ma, Y., Li, C.: Infrared and visible image fusion methods and applications: a survey. Inform. Fusion. 45, 153–178 (2019)
Gabarda, S., Cristóbal, G.: Cloud covering denoising through image fusion. Image Vision Comput. 25(5), 523–530 (2007)
Amolins, K., Zhang, Y., Dare, P.: Wavelet based image fusion techniques -an introduction, review and comparison. ISPRS J. Photogrammetry Remote Sensing. 62(4), 249–263 (2007)
Kim, Y., Lee, C., Han, D., Kim, Y., Kim, Y.: Improved additive-wavelet image fusion. IEEE Geosci. Remote Sensing Lett. 8(2), 263–267 (2011)
Dogra, A., Goyal, B., Agrawal, S.: From multi-scale decomposition to non-multi-scale decomposition methods: a comprehensive survey of image fusion techniques and its applications. IEEE Access. 5, 16040–16067 (2017)
Zhao, W., Lu, H., Wang, D.: Multisensor image fusion and enhancement in spectral total variation domain. IEEE Trans. Multimed. 20(4), 866–879 (2018)
Liu, Y., Chen, X., Wang, Z., Wang, Z.J., Ward, R.K., Wang, X.: Deep learning for pixel-level image fusion: recent advances and future prospects. Inform. Fusion. 42, 158–173 (2018)
Hafner, D., Weickert, J.: Variational image fusion with optimal local contrast. Comput. Graphics Forum. 35(1), 100–112 (2016)
Yuan, J., Miles, B., Garvin, G., Tai, X.-C., Fenster, A.: Efficient convex optimization approaches to variational image fusion. Numerical Math. 7, 234–250 (2014)
Wang, W., Shui, P.-L., Feng, X.: Variational models for fusion and denoising of multifocus images. Signal Process. Lett. IEEE. 15, 65–68 (2008)
Li, F., Zeng, T.: Variational image fusion with first and second-order gradient information. J. Computat. Math. 34(2), 200–222 (2016)
Buades, A., Coll, B., Morel, J.-M.: A non-local algorithm for image denoising. In: 2005 IEEE Computer society conference on computer vision and pattern recognition (CVPR’05), vol. 2, pp. 60–652 (2005)
Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Non-local sparse models for image restoration. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 2272–2279 (2009)
Gilboa, G., Osher, S.: Nonlocal operators with applications to image processing. Multiscale Modeling and Simulation, 1005–1028 (2009)
Benalia, S., Hachama, M.: A nonlocal method for image shadow removal. Comput. Math. Appl. 107, 95–103 (2022)
Bai, J., Feng, X.-C.: Fractional-order anisotropic diffusion for image denoising. IEEE Trans. Image Process. 16(10), 2492–2502 (2007)
Yin, X., Zhou, S., Siddique, M.: Fractional nonlinear anisotropic diffusion with p-Laplace variation method for image restoration. Multimedia Tools and Applications. 75 (2015)
Yang, Q., Chen, D., Zhao, T., Chen, Y.Q.: Fractional calculus in image processing: a review. Fractional Calculus Appl. Anal. 19, 1222–1249 (2016)
Motłoch , S., Sarwas, G., Dzieliński, A.: Fractional derivatives application to image fusion problems. Sensors. 22(3) (2022)
Pazy, A.: Semigroups of linear operators and applications to partial differential equations. Applied Mathematical Sciences, (1983)
Liu, Z., Zheng, S.: Semigroups associated with dissipative systems. CRC Press, (1999)
Brezis, H.: Function analysis. Springer, Sobolev Spaces and Partial Differential Equations (2010)
Vrabie, I.: Co-semigroups and applications. Elsevier, (2003)
Di Martino, J.M., Facciolo, G., Meinhardt-Llopis, E.: Poisson image editing. Image Processing On Line, 300–325 (2016)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Communicated by: Russell Luke
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Hachama, M., Boutaous, F. A fractional osmosis model for image fusion. Adv Comput Math 50, 7 (2024). https://doi.org/10.1007/s10444-023-10103-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10444-023-10103-6