We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message
80,259 News Articles

Boffins create lip-reading computer

Machine converts video conversations

A lip-reading system that converts videos of conversations into written transcripts is being developed by researchers from the University of East Anglia's (UEA's) School of Computing Sciences and Surrey University.

Funded by England's Engineering and Physical Sciences Research Council (EPSRC), it is hoped the research will be used to develop a system for the deaf to dictate commands to computers in noisy environments.

Dr Richard Harvey, a Professor at UEA hopes a prototype will emerge within two years.

"To be effective the systems must accurately track the head over a variety of poses, extract numbers or features that describe the lips, and then learn what features correspond to what text," explained Harvey.

Software to track face and lip movements has already been developed, and the team is now working on building a library of videos in order to create a database of facial expressions and lip movements used for each letter combination.


IDG UK Sites

5 reasons Facebook Messenger is terrible, and 5 reasons it's great

IDG UK Sites

Samsung: King of the Androids (or MWC, at least)

IDG UK Sites

Inside Microsoft's universal platform for designing apps that work on PCs, tablets, phones, Xbox...

IDG UK Sites

How to watch Apple's 9 March 'Spring Forward' Apple Watch event live stream, and what to expect: Ap?......