Image Enhancement using Convolutional Neural Network for Low Light Face Detection

Antonius Filian Beato Istianto(1*), Gede Putra Kusuma(2),

(1) Bina Nusantara University, Jakarta, Indonesia
(2) Bina Nusantara University, Jakarta, Indonesia
(*) Corresponding Author

Abstract


This research aims to combine the study of face detection with improvement of image quality in low-light conditions. In this research, we introduce a method that combines Convolutional Neural Networks for image processing to enhance face detection performance in low-light conditions. The proposed method involves pre-processing the images using three image enhancement methods: Deep Lightening Network, Deep Retinex Net, and Signal-to-Noise Ratio Aware. Each of these methods is combined with the face detection method, RetinaFace. The experiment is evaluated using the DARKFACE Dataset, and the performance of each combination is assessed using Average Precision (AP). The combination that yields the best AP value will be determined as the best approach for low-light face detection. The best combination, which utilizes Signal to Noise Ratio Aware for image enhancement and RetinaFace for face detection, achieves an AP score of 52.92%. This result surpasses the face detection performance using the original images from the DARKFACE Dataset, which scored 7.12% in AP. Thus, this experiment demonstrates that image enhancement using Convolutional Neural Networks can significantly improve face detection in low-light conditions

Full Text:

PDF

References


Wang, L.-W., Liu, Z.-S., Siu, W.-C., & Lun, D. P. K. (2020). Lightening Network for Low-Light Image Enhancement. Dalam IEEE Transactions on Image Processing (Vol. 29, hlm. 7984–7996). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/tip.2020.3008396

Wei, C., Wang, W., Yang, W., & Liu, J. (2018). Deep retinex decomposition for low-light enhancement. arXiv. http://arxiv.org/abs/1808.04560.

Xu, X., Wang, R., Fu, C.-W., & Jia, J. (2022). SNR-Aware Low-light Image Enhancement. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. https://doi.org/10.1109/cvpr52688.2022.01719

Deng, J., Guo, J., Zhou, Y., Yu, J., Kotsia, I., & Zafeiriou, S. (2019). RetinaFace: Single-stage Dense Face Localisation in the Wild (Version 2). arXiv. https://doi.org/10.48550/ARXIV.1905.00641

Zhang, Y., Di, X., Zhang, B., Li, Q., Yan, S., & Wang, C. (2021). Self-supervised Low Light Image Enhancement and Denoising (Versi 1). arXiv. https://doi.org/10.48550/ARXIV.2103.00832

Patil, A., Chaudhari, T., Deo, K., Sonawane, K., & Bora, R. (2020). Low Light Image Enhancement for Dark Images. Dalam International Journal of Data Science and Analysis (Vol. 6, Issue 4, hlm. 99). Science Publishing Group. https://doi.org/10.11648/j.ijdsa.20200604.11

Park, S., Yu, S., Moon, B., Ko, S., & Paik, J. (2017). Low-light image enhancement using variational optimization-based retinex model. IEEE Transactions on Consumer Electronics, 63(2), 178-184.

Guo, Y., Lu, Y., Liu, R. W., Yang, M., & Chui, K. T. (2020). Low-Light Image Enhancement With Regularized Illumination Optimization and Deep Noise Suppression. In IEEE Access (Vol. 8, pp. 145297–145315). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/access.2020.3015217

Guo, X., Li, Y., & Ling, H. (2017). LIME: Low-Light Image Enhancement via Illumination Map Estimation. In IEEE Transactions on Image Processing (Vol. 26, Issue 2, pp. 982–993). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/tip.2016.2639450

Ren, W., Liu, S., Ma, L., Xu, Q., Xu, X., Cao, X., ... & Yang, M. H. (2019). Low-light image enhancement via a deep hybrid network. IEEE Transactions on Image Processing, 28(9), 4364-4375.

Shen, L., Yue, Z., Feng, F., Chen, Q., Liu, S., & Ma, J. (2017). Msr-net: Low-light image enhancement using deep convolutional network. arXiv preprint arXiv:1711.02488.

S. Singhal, S. Nanduri, Y. Raghav and A. S. Parihar, "LRD-Net: A Lightweight Deep Network for Low-light Image Enhancement," 2021 3rd International Conference on Signal Processing and Communication (ICPSC), 2021, pp. 647-651, doi: 10.1109/ICSPC51351.2021.9451681.

Guo, C., Li, C., Guo, J., Loy, C. C., Hou, J., Kwong, S., & Cong, R. (2020). Zero-reference deep curve estimation for low-light image enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 1780-1789).

Nath, Raktim & Kakoty, Kaberi & Bora, Dibya & Welipitiya, Udari. (2021). Face Detection and Recognition Using Machine Learning. 43. 194-197.

Vimal, C. (2022). Face Detection’s Various Techniques and Approaches: A Review. Dalam International Journal for Research in Applied Science and Engineering Technology (Vol. 10, Issue 1, hlm. 839–843). International Journal for Research in Applied Science and Engineering Technology (IJRASET). https://doi.org/10.22214/ijraset.2022.39890

Jadhav, A., Lone, S., Matey, S., Madamwar, T., & Jakhete, S. (2021). Survey on face detection algorithms. International Journal of Innovative Science and Research Technology, 6(2).

Shamrat, F. J. M., Al Jubair, M., Billah, M. M., Chakraborty, S., Alauddin, M., & Ranjan, R. (2021). A Deep Learning Approach for Face Detection using Max Pooling. In 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI) (pp. 760-764). IEEE.

Jiang, H., & Learned-Miller, E. (2017, May). Face detection with the faster R-CNN. In 2017 12th IEEE international conference on automatic face & gesture recognition (FG 2017) (pp. 650-657). IEEE.

Li, H., Lin, Z., Shen, X., Brandt, J., & Hua, G. (2015). A convolutional neural network cascade for face detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 5325-5334).

Obaida, T. H., Hassan, N. F., & Jamil, A. S. (2022). Comparative of Viola-Jones and YOLO v3 for Face Detection in Real time. Iraqi Journal Of Computers, Communications, Control And Systems Engineering, 22(2), 63-72.

Li, C., Wang, R., Li, J., & Fei, L. (2020). Face detection based on YOLOv3. In Recent Trends in Intelligent Computing, Communication and Devices (pp. 277-284). Springer, Singapore.

Li, X., Lai, S., & Qian, X. (2021). Dbcface: Towards pure convolutional neural network face detection. IEEE Transactions on Circuits and Systems for Video Technology, 32(4), 1792-1804.

Zhang, S., Chi, C., Lei, Z., & Li, S. Z. (2020). Refineface: Refinement neural network for high performance face detection. IEEE transactions on pattern analysis and machine intelligence, 43(11), 4008-4020.

Yu, J., Hao, X., & He, P. (2021). Single-stage Face Detection under Extremely Low-light Conditions. Dalam 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW). 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW). IEEE. https://doi.org/10.1109/iccvw54120.2021.00392.

J. Liang et al., "Recurrent Exposure Generation for Low-Light Face Detection," in IEEE Transactions on Multimedia, vol. 24, pp. 1609-1621, 2022, doi: 10.1109/TMM.2021.3068840.

Wang, W., Yang, W., & Liu, J. (2021). HLA-Face: Joint High-Low Adaptation for Low Light Face Detection. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 16190-16199.

Theoffilus, R. B., Dharmadinata, O. J., & Kusuma, G. P. (2022). Low-Light Face Detection using Deep Learning. Journal of Theoretical and Applied Information Technology, 100(10).

Wang, P., Ji, L., Ji, Z., Gao, Y., & Liu, X. (2021). 1st Place Solutions for UG2+ Challenge 2021 - (Semi-)supervised Face detection in the low light condition. ArXiv, abs/2107.00818.

Asadzadeh, M., & Rikhtegar, A. (2018). Face Detection at the Low Light Environments. Journal of Artificial Intelligence in Electrical Engineering, 6(24), 29-37.

Wakhidah, N. (2011). Perbaikan Kualitas Citra Menggunakan Metode Contrast Stretching. Jurnal Transformatika, 8(2), 78-83.

Sugiarti, S. (2018). Peningkatan Kualitas Citra Dengan Metode Fuzzy Possibility Distribution. ILKOM Jurnal Ilmiah, 10(1), 100-104.




DOI: https://doi.org/10.30645/kesatria.v5i1.318

DOI (PDF): https://doi.org/10.30645/kesatria.v5i1.318.g315

Refbacks

  • There are currently no refbacks.


Published Papers Indexed/Abstracted By: