Document Type
Book Chapter
Publication Date
2020
DOI
10.5772/intechopen.90607
Publication Title
Recent Advances in Image Restoration with Applications to Real World Problems
Pages
285-289
Abstract
Deep learning models are data driven. For example, the most popular convolutional neural network (CNN) model used for image classification or object detection requires large labeled databases for training to achieve competitive performances. This requirement is not difficult to be satisfied in the visible domain since there are lots of labeled video and image databases available nowadays. However, given the less popularity of infrared (IR) camera, the availability of labeled infrared videos or image databases is limited. Therefore, training deep learning models in infrared domain is still challenging. In this chapter, we applied the pix2pix generative adversarial network (Pix2Pix GAN) and cycle-consistent GAN (Cycle GAN) models to convert visible videos to infrared videos. The Pix2Pix GAN model requires visible-infrared image pairs for training while the Cycle GAN relaxes this constraint and requires only unpaired images from both domains. We applied the two models to an open-source database where visible and infrared videos provided by the signal multimedia and telecommunications laboratory at the Federal University of Rio de Janeiro. We evaluated conversion results by performance metrics including Inception Score (IS), Frechet Inception Distance (FID) and Kernel Inception Distance (KID). Our experiments suggest that cycle-consistent GAN is more effective than pix2pix GAN for generating IR images from optical images.
Original Publication Citation
Uddin, M. S., & Li, J. (2020). Generative adversarial networks for visible to infrared video conversion. In C. Kwan (Ed.), Recent Advances in Image Restoration with Applications to Real World Problems (pp. 285-289). IntechOpen. https://doi.org/10.5772/intechopen.90607
Repository Citation
Uddin, Mohammad Shahab; Li, Jiang; and Kwan, Chiman (Ed.), "Generative Adversarial Networks for Visible to Infrared Video Conversion" (2020). Electrical & Computer Engineering Faculty Publications. 286.
https://digitalcommons.odu.edu/ece_fac_pubs/286
Included in
Artificial Intelligence and Robotics Commons, Electrical and Computer Engineering Commons, OS and Networks Commons
Comments
© 2020 The Author(s).
This chapter is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License, which permits use, distribution and reproduction for non-commercial purposes, provided the original is properly cited.