Established in 2020 Saturday, September 23, 2023

Developing AI models based on human brain activity to solve self-locating and navigation issues
Future scenes predicted by human subjects during maze navigation were decoded from fMRI activity patterns. Image courtesy: KyotoU/Global Comms/Risa Katayama.

KYOTO.- Imagine a future where your hometown gets destroyed by some calamity. In the aftermath, how easily could you locate your home after your neighborhood has been transformed into a giant maze of rubble, leaving only minimal landmarks?

Now researchers at Kyoto University have used partial-observation mazes in virtual reality to find that they can decode from brain activity the subjects' abilities to predict their positions and scenes within the maze, as well as the degree of confidence in their predictions.

"An AI model based on human brain activity shows that the decoding accuracy of the scene prediction is dependent on the confidence level of the subject's ability to predict," says lead author Risa Katayama.

In the hypothetical apocalyptic scenario, the subject navigates through a sequence of scenes by comparing each scene prediction with the observed scene, thereby confirming or updating the preceding VR.

The team investigated whether AI can decode the neuronal representations of every VR experienced by the subjects, and perhaps more intriguingly, whether associated self-confidence levels affect how the predictions can be reproduced.

Brain activity was measured via functional magnetic resonance imaging, or fMRI, while subjects were engaged in a VR maze game. Despite having no knowledge of the final destination, subjects appeared to be able to use their predictions and map memory to help estimate their positions in the maze and choose the right way to proceed.

"Our results suggest that when prediction confidence is high, subjects are able to imagine the scene clearly and predict quickly," notes the author.

This study may have broad implications in the growing field of metaverse research. While scene prediction here was based on door arrangements in a maze, it may lead to the development of brain-machine interfaces as communication tools utilizing a variety of rich environments.

"Scene prediction can be generalized and lead to new applications such as control methods connecting human brains and AI for aerial and land vehicles," adds Katayama.

The author concludes, "We believe the intersection of the human mind and AI has interdisciplinary significance for further elucidation of the source of our self-consciousness."

The research was published in Communications Biology.

Today's News

August 5, 2022

Low pressure, high stakes: Physicists make major gains in race for room-temperature superconductivity

Microscopic blood vessel disease in the brain's white matter associated with worse cognition in Alzheimer's

Explosive neutron star merger captured for first time in millimeter light

Transition metal catalyst discovery could help establish renewably generated electricity

What's new under the sun? Researchers offer an alternate view on how 'novel' structures evolve

A better way to quantify radiation damage in materials

Rotary motor reveals how microbial metabolites modulate bacterial energetics

A flexible device that harvests thermal energy to power wearable electronics

Developing AI models based on human brain activity to solve self-locating and navigation issues

Asexual reproduction leads to harmful genetic mutations

New technique protects data on solid-state drives from radiation

New vaccine formulation protects newborn mice against respiratory syncytial virus (RSV)

Cancer research repurposed to expose age-related blood diseases

New nanoparticle-based material could detect antibiotics in water

Next-gen heat pump could cut energy bills and carbon emissions

Automation speeds the search for stable proteins

Mechanism of bacterial toxins in deadly attacks

Advanced imaging reveals mired migration of neurons in Rett syndrome lab models

Why is There So Much Research Focused on Space?


Editor & Publisher: Jose Villarreal
Art Director: Juan José Sepúlveda Ramírez

Tell a Friend
Dear User, please complete the form below in order to recommend the ResearchNews newsletter to someone you know.
Please complete all fields marked *.
Sending Mail
Sending Successful