We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message
80,259 News Articles

Boffins create lip-reading computer

Machine converts video conversations

A lip-reading system that converts videos of conversations into written transcripts is being developed by researchers from the University of East Anglia's (UEA's) School of Computing Sciences and Surrey University.

Funded by England's Engineering and Physical Sciences Research Council (EPSRC), it is hoped the research will be used to develop a system for the deaf to dictate commands to computers in noisy environments.

Dr Richard Harvey, a Professor at UEA hopes a prototype will emerge within two years.

"To be effective the systems must accurately track the head over a variety of poses, extract numbers or features that describe the lips, and then learn what features correspond to what text," explained Harvey.

Software to track face and lip movements has already been developed, and the team is now working on building a library of videos in order to create a database of facial expressions and lip movements used for each letter combination.


IDG UK Sites

Best camera phone of 2015: iPhone 6 Plus vs LG G4 vs Galaxy S6 vs One M9 vs Nexus 6

IDG UK Sites

In defence of BlackBerrys

IDG UK Sites

Why we should reserve judgement on Apple ditching Helvetica in OS X/iOS for the Apple Watch's San...

IDG UK Sites

Retina 3.3GHz iMac 27in preview: Apple cuts £400 of price of Retina iMac with new model