Skip to main content
Springer Nature Link
Log in

Multi-focus image fusion for different datasets with super-resolution using gradient-based new fusion rule

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multi-focus image fusion methods combine two or more images which have blurred and defocused parts to create an all-in-focused image. All-in-focused image has more information, clearer parts and clearer edges than the source images. In this paper, a new approach for multi-focus image fusion is proposed. Firstly, the information of source images is enhanced using bicubic interpolation-based super-resolution method. Secondly, source images with high resolution are decomposed into four sub-bands which are LL (low-low), LH (low-high), HL (high-low) and HH (high-high) using Stationary Wavelet Transform with dmey (Discrete Meyer) filter. Then, a new fusion rule which depend on gradient-based method with sobel operator is implemented to create fused images with good visuality. The weight coefficients which show the importance rates of corresponding pixels in source images for fused image are calculated using designed formula based on gradient magnitudes. The each pixel of fused sub-bands is created using these weight coefficients and fused image is reconstructed using Inverse Stationary Wavelet Transform. Lastly, the performance evaluation of proposed method is measured using three different metrics which are objective, subjective and time criterion metrics. Besides these features, the new dataset which is different from the datasets in the literature is created and used firstly in this paper. The results show that the proposed method produces high quality images with clear edges and transmits most of the information of source images into all-in-focused image.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (France)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Abdipour M, Nooshyar M (2016) Multi-focusimage fusion using sharpness criteria for visual sensor networks in wavelet domain. Computers and Electrical Engineerring 51:74–88

    Article  Google Scholar 

  2. Amin-Naji M, Aghagolzadeh A, Ezoji M (2019) Ensemble of CNN for multi-focus image fusion. Information Fusion 51:201–214

    Article  Google Scholar 

  3. Anandhi D, Valli S (2018) An algorithm for multi-sensor image fusion using maximum a posteriori and nonsubsampled counterlet transform. Computers , Computers and Electrical Engineering 65:139–152

    Article  Google Scholar 

  4. Aymaz S, Köse C (2019) A novel image decomposition-based hybrid technique with super-resolution method for multi-focus image fusion. Information Fusion 45:113–127

    Article  Google Scholar 

  5. Chaudhary V, Kumar V (2018) Block-based image fusion using multi-scale analysis to enhance depth of field and dynamic rang. SIViP 12:271–279

    Article  Google Scholar 

  6. Chen C, Gend P, Lu K (2015) Multi-focusImage fusion based on multiwavelet and DFB

    Google Scholar 

  7. Du C, Gao S (2018) Multi-focus image fusion algorithm based on pulse coupled neural networks and modified decision map. Optik 157:1003–1015

    Article  Google Scholar 

  8. Du J, Li W, Lu K, Xiao B (2016) An overview of multi-modal medical image fusion. Neurocomputing 215:3–20

    Article  Google Scholar 

  9. Du C, Gao S, Liu Y, Gao B (2019) Multi-focus image fusion using deep support value convolutional neural network. Optik 176:567–578

    Article  Google Scholar 

  10. Farid MS, Mahmood A, Al-Maadeed SA (2019) Multi-focus image fusion using content adaptive blurring. Information Fusion 45:96–112

    Article  Google Scholar 

  11. Fu W, Huang S, Li Z, Shen H, Li J, Wang P (2016) The optimal algorithm for multi-source RS image fusion. MethodsX 3:87–101

    Article  Google Scholar 

  12. Garnico-Carrillo A, Calderon F, Flores J (2018) Multi-focus image fusion by local optimization over sliding windows. Signal

  13. Guo D, Yan J, Qu X (2015) High-quality multi-focus image fusion using self-similarity and depth information. Opt Commun 338:138–144

    Article  Google Scholar 

  14. He K, Zhou D, Zhang X, Nie R, Jin X (2018) Energy multi-focus image fusion combining focus-region-level partition and pulse-coupled neural network. Methodologies and Application, 127

  15. He K, Zhou D, Zhang X, Nie R (2018) Multi-focus: focused region finding and multi-scale transform for image fusion. Neurocomputing 320:157–170

    Article  Google Scholar 

  16. He K, Zhou D, Zhang X, Nie R, Jin X (2019) Multi-focus image fusion combining focus-region-level partition and pulse-coupled neural network. Methodologies and Application 23:4685–4699

    Google Scholar 

  17. Hua KL, Wang HC, Rusdi AH, Jiang SY (2014) A novel multi-focus image fusion based on random walks. J.Vis.Commun.İmage R. 25:951–962

    Article  Google Scholar 

  18. Jıang Q, Jin X, Lee S, Yao S (2016) A novel multi-focus image fusion method based on stationary wavelet transform and local features of fuzzy sets. Neurocomputing 174:733–748

    Article  Google Scholar 

  19. Li H, Chai Y, Yin H, Liu G (2012) Multi-focus image fusion and denoising scheme based on homogeneity similarity. Opt Commun 285:91–100

    Article  Google Scholar 

  20. Li H, Li X, Yu Z, Mao C (2016) Multi-focus image fusion by combining with mixed-order structure tensors and multiscale neighborhood. İnformation Sciences 349-350:25–40

    Article  Google Scholar 

  21. Liu Y, Zheng C, Zheng Q, Yuan H (2018) Removing Monte Carlo noise using a Sobel operator and a guided image filter. Vis Comput 34:589–601

    Article  Google Scholar 

  22. Lu J, Liu HP, Hsu CY (2012) Discrete Meyer wavelet transform features for online Hangul script recognition. Res J Appl Sci Eng Technol 4(20):3905–3910

    Google Scholar 

  23. Mirulanni K, Geethalashmi SN (2017) Enhanced interpolation method for enlargement of mammogram images, International Conference On Advanced Computing and Communication Systems (Icaccs -2017), Coimbatore, India.

  24. Moushmi S, Sowmya V, Soman KP (2016) Empirical wavelet transform for multi-focus image fusion, proceedings of the international conference on soft computing systems. Advances in Intelligent Systems and Computing, India

    Google Scholar 

  25. Nejati M, Samavi S, Karimi N, Soroushmehr SMR, Shirani S, Roosta I, Najarian K (2017) Surface-area based focus criterion for multi-focus image fusion. Information Fusion 36:284–295

    Article  Google Scholar 

  26. Pa J, Hegde AV (2015) A review of quality metrics for fused image. Aquatic Procedia 4:133–142

    Article  Google Scholar 

  27. Qayyum H, Majid M, Anwar SM, Khan B (2017) Facial expression recognition using stationary wavelet transform features, mathematical problems in engineering, vol.2017.

    Article  Google Scholar 

  28. Sharma M, Khandelwal S (2016) Image fusion on coloured and gray scale multi focus images by using hybrid DWT-DCT. Int J Comput Appl Technol 152(9)

    Article  Google Scholar 

  29. Shinde A, Ruickar S (2017) Nearest neighbor and interpolation based super-resolution. International Journal of Control Theory and Applications 10(6)

  30. Shukla J, Barreda-Angeles M, Oliver J, Puig D (2018) Efficient wavelet-based artifact removal for electrodermal activity in real-world application. Biomedical Signal Processing and Control 42:45–52

    Article  Google Scholar 

  31. Stramaglia S, Bassez I, Faes L, Marinazzo D (2017) Multiscale granger causality analysis by atrous wavelet transform, IEEE

    Google Scholar 

  32. Tang H, Xiao B, Li W, Wang G (2018) Pixel convolutional neural network for multi-focus image fusion. Inf Sci 433-434:125–141

    Article  MathSciNet  Google Scholar 

  33. Tuna C, Unal G, Sertel E (2018) Single-frame super resolution of remote-sensing images by convolutional neural network. Int J Remote Sens 39(28):2463–2478

    Article  Google Scholar 

  34. Vijitha B, Reddy KS, Image reconstruction with super-resolution, International Journal of Research in Computer Applications and Robotics, vol.4, ıss. 9, pp. 36–40, 2016.

  35. Yang Y, Tong S, Huang S, Lin P, Fang Y (2014) A hybrid method for multi-focus image fusion based on fast discrete curvelet transform. JVisCommunİmage R 25:951–962

    Google Scholar 

  36. Yin H, Li Y, Chai Y, Liu Z, Zhu Z (2016) A novel sparse-representation-based multi-focus image fusion approach. Neurocomputing 216:216–229

    Article  Google Scholar 

  37. Zhang B, Lu X, Pei H, Liu H, Zhao Y, Zhou W (2016) Multi-focus Image fusion algorithm based on focused region extraction. Neurocomputing 174(9):733–748

    Article  Google Scholar 

  38. Zhang X, Li X, Feng Y (2016) A new multi-focus image fusion based on spectrum comparison. Signal Process 123:127–142

    Article  Google Scholar 

  39. Zhang Y, Wei W, Yuan Y (2019) Multi-focus image fusion with alternating guided filtering. SIViP 13:727–735

    Article  Google Scholar 

  40. Zhou Z, Li S, Wang B (2014) Multi-scale weighted gradient-based fusion for multi-focus image fusion. Information Fusion 26:60–72

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Karadeniz Technical University, Trabzon, Turkey

    Samet Aymaz, Cemal Köse & Şeyma Aymaz

Authors
  1. Samet Aymaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cemal Köse
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Şeyma Aymaz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Şeyma Aymaz.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aymaz, S., Köse, C. & Aymaz, Ş. Multi-focus image fusion for different datasets with super-resolution using gradient-based new fusion rule. Multimed Tools Appl 79, 13311–13350 (2020). https://doi.org/10.1007/s11042-020-08670-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08670-7

Keywords

Search

Navigation