Friday, March 29, 2024
News

Researchers develop AI light-field camera that reads 3D facial expressions

   SocialTwist Tell-a-Friend    Print this Page   COMMENT

Washington | January 22, 2022 7:20:27 PM IST
A team of researchers reported the development of a technique for facial expression detection by merging near-infrared light-field camera techniques with artificial intelligence (AI) technology.

The study has been published in the 'Advanced Intelligent Systems Journal'.

Unlike a conventional camera, the light-field camera contains micro-lens arrays in front of the image sensor, which makes the camera small enough to fit into a smartphone, while allowing it to acquire the spatial and directional information of the light with a single shot. The technique has received attention as it can reconstruct images in a variety of ways including multi-views, refocusing, and 3D image acquisition, giving rise to many potential applications.

However, the optical crosstalk between shadows caused by external light sources in the environment and the micro-lens has limited existing light-field cameras from being able to provide accurate image contrast and 3D reconstruction.

The joint research team applied a vertical-cavity surface-emitting laser (VCSEL) in the near-IR range to stabilize the accuracy of 3D image reconstruction that previously depended on environmental light. When an external light source is shone on a face at 0-, 30-, and 60-degree angles, the light field camera reduces 54 per cent of image reconstruction errors.

Additionally, by inserting a light-absorbing layer for visible and near-IR wavelengths between the micro-lens arrays, the team could minimize optical crosstalk while increasing the image contrast by 2.1 times.

Through this technique, the team could overcome the limitations of existing light-field cameras and be able to develop their NIR-based light-field camera (NIR-LFC), optimized for the 3D image reconstruction of facial expressions. Using the NIR-LFC, the team acquired high-quality 3D reconstruction images of facial expressions expressing various emotions regardless of the lighting conditions of the surrounding environment.

The facial expressions in the acquired 3D images were distinguished through machine learning with an average of 85 per cent accuracy -- a statistically significant figure compared to when 2D images were used. Furthermore, by calculating the interdependency of distance information that varies with facial expression in 3D images, the team could identify the information a light-field camera utilizes to distinguish human expressions.

Professor Ki-Hun Jeong said, "The sub-miniature light-field camera developed by the research team has the potential to become the new platform to quantitatively analyse the facial expressions and emotions of humans."

To highlight the significance of this research, he added, "It could be applied in various fields including mobile healthcare, field diagnosis, social cognition, and human-machine interactions." (ANI).

 
  LATEST COMMENTS ()
POST YOUR COMMENT
Comments Not Available
 
POST YOUR COMMENT
 
 
TRENDING TOPICS
 
 
CITY NEWS
MORE CITIES
 
 
 
MORE SCIENCE NEWS
AI technique accurately predicts deadly ...
Researchers discover new approach to tre...
Researchers discover how gene mutation r...
Climate change disrupts vital ecosystems...
Study finds how ageing reduces ability o...
Israeli researchers uncover biological p...
More...
 
INDIA WORLD ASIA
'Who is real enemy of Congress, BJP or l...
'Was unwell, not being given treatment,'...
Ten dead as taxi rolls down gorge on Jam...
ASI continues survey at Bhojshala Comple...
'We need to establish some Dos and don't...
PM Modi recalls 'profound sacrifice' of ...
More...    
 
 Top Stories
PM Modi wears ethnic jacket made fr... 
Energeia's Innovative Energy Soluti... 
"He had fair time out of game": Del... 
"Next target is to ensure all girls... 
PM Modi to interact with Tamil Nadu... 
FTAs and new markets will increase ... 
Time to Prepare for Summers with 5 ... 
Punjab: BSF seize packet of suspect...