Research on objective assessment of dual-band color night vision fusion image quality based on scene understanding

Shaoshu Gao; Sheng Yi; Qilin Tian; Xiao Ni; Shangge Song

doi:10.1117/1.OE.62.8.083102

14 August 2023 Research on objective assessment of dual-band color night vision fusion image quality based on scene understanding

Shaoshu Gao, Sheng Yi, Qilin Tian, Xiao Ni, Shangge Song

Author Affiliations +

Optical Engineering, Vol. 62, Issue 8, 083102 (August 2023). https://doi.org/10.1117/1.OE.62.8.083102

Abstract

The color quality and sharpness of the dual-band color fusion images have the greatest impact on the audience’s understanding of the scene content. Traditional image quality assessment (IQA) methods focus on the luminance contrast of image and attach limited attention to pixel-wise relationship. As a result, these methods perform poorly on color-related distortions. An objective assessment model for the comprehensive quality of fusion images is proposed. According to the correlation between the gray level co-occurrence matrix (GLCM) and the image color, the model extracts the homogeneity, angular second moment, and contrast of the GLCM as the image color quality features. Gradient-weighted class activation mapping is used to calculate the heat map, reflecting the visual saliency of each region. We use the visual saliency weight of each region to weight the rotation and uniform invariant local binary pattern histograms of the corresponding regions to obtain sharpness features. The experimental results show that the performance of the proposed method is better than the existing eight no-reference IQA models.

Citation Download Citation

Shaoshu Gao, Sheng Yi, Qilin Tian, Xiao Ni, and Shangge Song "Research on objective assessment of dual-band color night vision fusion image quality based on scene understanding," Optical Engineering 62(8), 083102 (14 August 2023). https://doi.org/10.1117/1.OE.62.8.083102

Received: 3 January 2023; Accepted: 11 July 2023; Published: 14 August 2023

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $24.00

Non-members: $28.00 ADD TO CART

JOURNAL ARTICLE
16 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image fusion

Image quality

Cooccurrence matrices

Feature extraction

Color

Night vision

Performance modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years