We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message
79,812 News Articles

Boffins create lip-reading computer

Machine converts video conversations

A lip-reading system that converts videos of conversations into written transcripts is being developed by researchers from the University of East Anglia's (UEA's) School of Computing Sciences and Surrey University.

Funded by England's Engineering and Physical Sciences Research Council (EPSRC), it is hoped the research will be used to develop a system for the deaf to dictate commands to computers in noisy environments.

Dr Richard Harvey, a Professor at UEA hopes a prototype will emerge within two years.

"To be effective the systems must accurately track the head over a variety of poses, extract numbers or features that describe the lips, and then learn what features correspond to what text," explained Harvey.

Software to track face and lip movements has already been developed, and the team is now working on building a library of videos in order to create a database of facial expressions and lip movements used for each letter combination.


IDG UK Sites

45 Best Android games: top Android games for your smartphone or tablet in 2014 (24 are free!)

IDG UK Sites

How Apple, Adobe, Microsoft and others have let us down over UltraHD and hiDPI screens

IDG UK Sites

Do you have the X-Factor too? Mix Off app puts fans in the frame

IDG UK Sites

iPad Pro release date, rumours and leaked images - 12.9 screen 'coming in 2015'