No-reference Automatic Quality Assessment for Colorfulness-Adjusted, Contrast-Adjusted, and Sharpness-Adjusted Images Using High-Dynamic-Range-Derived Features
Abstract
:1. Introduction
1.1. Correlation between the Evaluation Scores and the Adjustment Levels
1.2. Visual Preference Comparison between LDR and HDR Images
2. Materials and Methods
2.1. Proposed Assessment Method
2.1.1. Colorfulness
2.1.2. Contrast
2.1.3. Sharpness
2.1.4. HDR-Derived Features
2.1.5. Assessment Metric Scheme
2.2. Experimental Setup
3. Evaluation Results
4. Discussion and Conclusions
Author Contributions
Funding
Conflicts of Interest
References
- Danielyan, A.; Katkovnik, V.; Egiazarian, K. BM3D Frames and Variational Image Deblurring. IEEE Trans. Image Process. 2012, 21, 1715–1728. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Portilla, J.; Strela, V.; Wainwright, M.; Simoncelli, E. Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Trans. Image Process. 2003, 12, 1338–1351. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Polesel, A.; Ramponi, G.; Mathews, V. Image enhancement via adaptive unsharp masking. IEEE Trans. Image Process. 2000, 9, 505–510. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Yu, H.; Zhao, L.; Wang, H. Image Denoising Using Trivariate Shrinkage Filter in the Wavelet Domain and Joint Bilateral Filter in the Spatial Domain. IEEE Trans. Image Process. 2009, 18, 2364–2369. [Google Scholar] [PubMed]
- Kazubek, M. Wavelet domain image denoising by thresholding and Wiener filtering. IEEE Signal Process. Lett. 2003, 10, 324–326. [Google Scholar] [CrossRef]
- Stark, J. Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Trans. Image Process. 2000, 9, 889–896. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Park, S.; Park, M.; Kang, M. Super-resolution image reconstruction: A technical overview. IEEE Signal Process. Mag. 2003, 20, 21–36. [Google Scholar] [CrossRef]
- Yang, J.; Wright, J.; Huang, T.S.; Ma, Y. Image super-resolution via sparse representation. IEEE Trans. Image Process. 2010, 19, 2861–2873. [Google Scholar] [CrossRef] [PubMed]
- Zhou, D.; Wang, R.; Lu, J.; Zhang, Q. Depth Image Super Resolution Based on Edge-Guided Method. Appl. Sci. 2018, 8, 298. [Google Scholar] [CrossRef]
- Lai, J.; Liaw, Y.; Lo, W. Artifact reduction of JPEG coded images using mean-removed classified vector quantization. Signal Process. 2002, 82, 1375–1388. [Google Scholar] [CrossRef]
- Lee, R.; Kim, D.; Kim, T. Regression-based prediction for blocking artifact reduction in JPEG-compressed images. IEEE Trans. Image Process. 2005, 14, 36–48. [Google Scholar] [PubMed]
- Lucchese, L.; Mitra, S.; Mukherjee, J. A new algorithm based on saturation and desaturation in the xy chromaticity diagram for enhancement and re-rendition of color images. In Proceedings of the International Conference on Image Processing, Thessaloniki, Greece, 7–10 October 2001; Volume 2, pp. 1077–1080. [Google Scholar]
- Naik, S.; Murthy, C. Hue-preserving color image enhancement without gamut problem. IEEE Trans. Image Process. 2003, 12, 1591–1598. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Agaian, S.; Silver, B.; Panetta, K. Transform Coefficient Histogram-Based Image Enhancement Algorithms Using Contrast Entropy. IEEE Trans. Image Process. 2007, 16, 741–758. [Google Scholar] [CrossRef] [PubMed]
- Panetta, K.; Wharton, E.; Agaian, S. Human Visual System-Based Image Enhancement and Logarithmic Contrast Measure. IEEE Trans. Syst. Man Cybern. Syst. 2008, 38, 174–188. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Zhang, B.; Allebach, J. Adaptive Bilateral Filter for Sharpness Enhancement and Noise Removal. IEEE Trans. Image Process. 2008, 17, 664–678. [Google Scholar] [CrossRef] [PubMed]
- Panetta, K.; Agaian, S.; Zhou, Y.; Wharton, E. Parameterized Logarithmic Framework for Image Enhancement. IEEE Trans. Syst. Man Cybern. Syst. 2011, 41, 460–473. [Google Scholar] [CrossRef] [PubMed]
- Gu, K.; Zhai, G.; Yang, X.; Zhang, W.; Chen, C. Automatic Contrast Enhancement Technology with Saliency Preservation. IEEE Trans. Circuits Syst. Video Technol. 2015, 25, 1480–1494. [Google Scholar]
- Ferzli, R.; Karam, L. A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB). IEEE Trans. Image Process. 2009, 18, 717–728. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Liu, A.; Lin, W.; Paul, M.; Deng, C.; Zhang, F. Just Noticeable Difference for Images with Decomposition Model for Separating Edge and Textured Regions. IEEE Trans. Circuits Syst. Video Technol. 2010, 20, 1648–1652. [Google Scholar] [CrossRef]
- Moorthy, A.; Bovik, A. Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality. IEEE Trans. Image Process. 2011, 20, 3350–3364. [Google Scholar] [CrossRef] [PubMed]
- Saad, M.; Bovik, A.; Charrier, C. Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain. IEEE Trans. Image Process. 2012, 21, 3339–3352. [Google Scholar] [CrossRef] [PubMed]
- Mittal, A.; Moorthy, A.; Bovik, A. No-Reference Image Quality Assessment in the Spatial Domain. IEEE Trans. Image Process. 2012, 21, 4695–4708. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Mittal, A.; Soundararajan, R.; Bovik, A. Making a “Completely Blind” Image Quality Analyzer. IEEE Signal Process. Lett. 2013, 20, 209–212. [Google Scholar] [CrossRef]
- Zhang, Z.; Wang, H.; Liu, S.; Durrani, T.S. Deep Activation Pooling for Blind Image Quality Assessment. Appl. Sci. 2018, 8, 478. [Google Scholar] [CrossRef]
- Gu, K.; Zhai, G.; Lin, W.; Liu, M. The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement. IEEE Trans. Cybern. 2016, 46, 284–297. [Google Scholar] [CrossRef] [PubMed]
- Kim, H.; Ahn, S.; Kim, W.; Lee, S. Visual Preference Assessment on Ultra-High-Definition Images. IEEE Trans. Broadcast. 2016, 62, 757–769. [Google Scholar] [CrossRef]
- Feichtenhofer, C.; Fassold, H.; Schallauer, P. A Perceptual Image Sharpness Metric Based on Local Edge Gradient Analysis. IEEE Signal Process. Lett. 2013, 20, 379–382. [Google Scholar] [CrossRef]
- Gu, K.; Zhai, G.; Lin, W.; Yang, X.; Zhang, W. No-Reference Image Sharpness Assessment in Autoregressive Parameter Space. IEEE Trans. Image Process. 2015, 24, 3218–3231. [Google Scholar] [PubMed]
- Panetta, K.; Gao, C.; Agaian, S. No reference color image contrast and quality measures. IEEE Trans. Consum. Electron. 2013, 59, 643–651. [Google Scholar] [CrossRef]
- Panetta, K.; Bao, L.; Agaian, S. A human visual “no-reference” image quality measure. IEEE Instrum. Meas. Mag. 2016, 19, 34–38. [Google Scholar] [CrossRef]
- Reinhard, E. High Dynamic Range Imaging; Elsevier Morgan Kaufmann: Amsterdam, The Netherlands, 2010. [Google Scholar]
- Ofili, C.; Glozman, S.; Yadid-Pecht, O. Hardware Implementation of an Automatic Rendering Tone Mapping Algorithm for a Wide Dynamic Range Display. J. Low Power Electron. Appl. 2013, 3, 337–367. [Google Scholar] [CrossRef] [Green Version]
- Cauwerts, C.; Piderit, M.B. Application of High-Dynamic Range Imaging Techniques in Architecture: A Step toward High-Quality Daylit Interiors? J. Imaging 2018, 4, 19. [Google Scholar] [CrossRef]
- Ponomarenko, N.; Jin, L.; Ieremeiev, O.; Lukin, V.; Egiazarian, K.; Astola, J.; Vozel, B.; Chehdi, K.; Carli, M.; Battisti, F.; et al. Image database TID2013: Peculiarities, results and perspectives. Signal Process. Image Commun. 2015, 30, 57–77. [Google Scholar] [CrossRef] [Green Version]
- Lübbe, E. Colours in the Mind-Colour Systems in Reality; Books on Demand: Norderstedt, Germany, 2010. [Google Scholar]
- Al-amri, S.; Kalyankar, N.; Khamitkar, S. Linear and non-linear contrast enhancement image. Int. J. Comput. Sci. Netw. Secur. 2010, 10, 139–143. [Google Scholar]
- Streijl, R.; Winkler, S.; Hands, D. Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives. Multimed. Syst. 2014, 22, 213–227. [Google Scholar] [CrossRef]
- EMPA Media Technology. Available online: http://www.empamedia.ethz.ch/hdrdatabase/index.php (accessed on 25 January 2017).
- Wang, Z.; Simoncelli, E.; Bovik, A. Multi-scale structural similarity for image quality assessment. In Proceedings of the Thirty-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA, 9–12 November 2003; Volume 2, pp. 1398–1402. [Google Scholar]
- Ashikhmin, M.; Goyal, J. A reality check for tone-mapping operators. ACM Trans. Appl. Percept. 2006, 3, 399–411. [Google Scholar] [CrossRef]
- Seshadrinathan, K.; Soundararajan, R.; Bovik, A.; Cormack, L. Study of Subjective and Objective Quality Assessment of Video. IEEE Trans. Image Process. 2010, 19, 1427–1441. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Basketball | Cactus | Traffic | Average | ||
---|---|---|---|---|---|
NIQE | SROCC | 0.6465 | 0.3233 | 0.1650 | 0.3283 |
PLCC | 0.7144 | 0.3221 | 0.2373 | 0.4246 | |
CQE | SROCC | 0.6207 | 0.4241 | 0.5292 | 0.5247 |
PLCC | 0.6225 | 0.4236 | 0.5205 | 0.5222 | |
Proposed Method | SROCC | 0.8042 | 0.9121 | 0.9669 | 0.8944 |
PLCC | 0.7626 | 0.9284 | 0.9538 | 0.8816 |
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Jang, J.; Jang, H.; Eo, T.; Bang, K.; Hwang, D. No-reference Automatic Quality Assessment for Colorfulness-Adjusted, Contrast-Adjusted, and Sharpness-Adjusted Images Using High-Dynamic-Range-Derived Features. Appl. Sci. 2018, 8, 1688. https://doi.org/10.3390/app8091688
Jang J, Jang H, Eo T, Bang K, Hwang D. No-reference Automatic Quality Assessment for Colorfulness-Adjusted, Contrast-Adjusted, and Sharpness-Adjusted Images Using High-Dynamic-Range-Derived Features. Applied Sciences. 2018; 8(9):1688. https://doi.org/10.3390/app8091688
Chicago/Turabian StyleJang, Jinseong, Hanbyol Jang, Taejoon Eo, Kihun Bang, and Dosik Hwang. 2018. "No-reference Automatic Quality Assessment for Colorfulness-Adjusted, Contrast-Adjusted, and Sharpness-Adjusted Images Using High-Dynamic-Range-Derived Features" Applied Sciences 8, no. 9: 1688. https://doi.org/10.3390/app8091688