Scientists have developed a new artifical intelligence system that can decode the human mind , and interpret what a person is seeing by analysing brain scans.
The advance could aid efforts to improve artifical intelligence (AI) and lead to new insights into brain function.
Critical to the research is a type of algorithm called a convolutional neural network , which has been instrumental in enabling computers and smart phones to recognise faces and objects.
That type of network has made an enormous impact in the field of computer vision in recents years " said Zhongming Liu , an assistant professor at purdue University in the US.
"Our technique uses the neural network to understand what you are seeing ," Liu said.
Convolutional neural networks , a form of deep- learning algorithm , have been used to study how the brain process static images and other visual stimuli.
"This is the first time such an approach has been used to see how the brain processes movies of natural scenes - a step toward decoding the brain while people are try to make sense complex and dynamic visual surroundings, "said Haiguang Wen , a doctoral student at Purdue University .
The researches acquired 11.5 hours of Functional magnetic resonance imaging (MRI) data from each of three women subject watching 972 videos clips , including those showing people or animals in action and nature scenes.
The data was used to train the system to predict the activity in the brain's visual cortex while the subject were watching the videos.The model was then used to decode fMRI data from the subject to reconstruct the videos, even ones the model had never watched before.
The model was able to accurately decode the fMRI data into specific image categories , Actual video images were then presented side by side with the computer's interpretation of what the person's brain saw based on fMRI data.
# Critical to the research is a type of algorithm called a convolutional neural network , Which has been instrumental in enabling computers and smartphones to recognise face and objects.
The advance could aid efforts to improve artifical intelligence (AI) and lead to new insights into brain function.
Critical to the research is a type of algorithm called a convolutional neural network , which has been instrumental in enabling computers and smart phones to recognise faces and objects.
That type of network has made an enormous impact in the field of computer vision in recents years " said Zhongming Liu , an assistant professor at purdue University in the US.
"Our technique uses the neural network to understand what you are seeing ," Liu said.
Convolutional neural networks , a form of deep- learning algorithm , have been used to study how the brain process static images and other visual stimuli.
The researches acquired 11.5 hours of Functional magnetic resonance imaging (MRI) data from each of three women subject watching 972 videos clips , including those showing people or animals in action and nature scenes.
The data was used to train the system to predict the activity in the brain's visual cortex while the subject were watching the videos.The model was then used to decode fMRI data from the subject to reconstruct the videos, even ones the model had never watched before.
The model was able to accurately decode the fMRI data into specific image categories , Actual video images were then presented side by side with the computer's interpretation of what the person's brain saw based on fMRI data.
# Critical to the research is a type of algorithm called a convolutional neural network , Which has been instrumental in enabling computers and smartphones to recognise face and objects.
No comments:
Post a Comment