Create a free Industrial Equipment News account to continue

Robot Watches Soap Opera to Learn About Dementia

Robbie has watched over 13 episodes of the popular soap.

Edge Hill University's Robbie the Robot catches up on soap opera 'Emmerdale' to recognize dementia signs.
Edge Hill University's Robbie the Robot catches up on soap opera "Emmerdale" to recognize dementia signs.
Edge Hill University

Edge Hill University's robot, Robbie, has become a soap fan after watching episodes of popular UK drama Emmerdale to learn about dementia.

Robbie has watched over 13 episodes of the popular soap featuring the storyline of dementia sufferer Ashley Thomas.

He can now spot signs of depression and aggressive behavior in the hope that robots like him will be able to help people living with the condition.

Ardhendu Behera, Senior Lecturer in Computer Science who led the project with three students, said: "There are 46.8M people living with dementia and this is set to rise to 115.4M in 2050.

"Depression and aggressive behavior are often the most upsetting and challenging symptoms for those closest to the person living with the condition.

"Currently the only ways to monitor and manage dementia is by direct observation which is labor intensive, time consuming and can be costly from a care perspective. Or there's wearable bio-sensing devices.

"Monitoring and recognition is still very much in its infancy and we believe Robbie is the first robot to use vision-based recognition to recognize four behaviors; aggressive, depressive, happy and neutral."

Ardhendu and the team chose the Emmerdale episodes as the Alzheimer's Society described them as a 'realistic portrayal' of the condition.

They broke the 35-minute-long episodes featuring Ashley into 65,082 images, teaching Robbie to recognize facial expressions and body language.

Edge Hill University's Robbie the Robot.Edge Hill University's Robbie the Robot.Edge Hill University

Third-year-student Zachary Wharton, from Ormskirk, added: "The aim is for Robbie and robots like him to look for clues as to when the person might be beginning to show aggressive behavior and perhaps offer a distraction to help them calm down.

"It might be through playing music or showing a video, talking to them. The potential use of robots is huge as they can not only with the daily routine of a sufferer for friends and family but could potentially intervene in situations to help."

In test situations Robbie was highly accurate at identifying aggressive and depressive behavior when compared to happy and neutral behavior.

Ardhendu has presented the research to Alzheimer's Research UK, palliative care organisations, the IEEE (the world's largest technical professional organisation for advancing technology for the benefit of humanity) and other universities.

Through previous projects Robbie has already been trained to recognize over 80 common objects, human actions and emotions.

He can be used as a companion to the young and old following anything from how many times they have a drink and take medication to how active they are.

More in Product Development