In:
PLOS ONE, Public Library of Science (PLoS), Vol. 17, No. 4 ( 2022-4-6), p. e0265185-
Abstract:
Humans perceive light in the visible spectrum (400-700 nm). Some night vision systems use infrared light that is not perceptible to humans and the images rendered are transposed to a digital display presenting a monochromatic image in the visible spectrum. We sought to develop an imaging algorithm powered by optimized deep learning architectures whereby infrared spectral illumination of a scene could be used to predict a visible spectrum rendering of the scene as if it were perceived by a human with visible spectrum light. This would make it possible to digitally render a visible spectrum scene to humans when they are otherwise in complete “darkness” and only illuminated with infrared light. To achieve this goal, we used a monochromatic camera sensitive to visible and near infrared light to acquire an image dataset of printed images of faces under multispectral illumination spanning standard visible red (604 nm), green (529 nm) and blue (447 nm) as well as infrared wavelengths (718, 777, and 807 nm). We then optimized a convolutional neural network with a U-Net-like architecture to predict visible spectrum images from only near-infrared images. This study serves as a first step towards predicting human visible spectrum scenes from imperceptible near-infrared illumination. Further work can profoundly contribute to a variety of applications including night vision and studies of biological samples sensitive to visible light.
Type of Medium:
Online Resource
ISSN:
1932-6203
DOI:
10.1371/journal.pone.0265185
DOI:
10.1371/journal.pone.0265185.g001
DOI:
10.1371/journal.pone.0265185.g002
DOI:
10.1371/journal.pone.0265185.g003
DOI:
10.1371/journal.pone.0265185.g004
DOI:
10.1371/journal.pone.0265185.g005
DOI:
10.1371/journal.pone.0265185.g006
DOI:
10.1371/journal.pone.0265185.g007
DOI:
10.1371/journal.pone.0265185.g008
DOI:
10.1371/journal.pone.0265185.g009
DOI:
10.1371/journal.pone.0265185.s001
Language:
English
Publisher:
Public Library of Science (PLoS)
Publication Date:
2022
detail.hit.zdb_id:
2267670-3
Permalink