Learning to read is a time-consuming and complex task for many kids, and for deaf children, it's even more difficult.
Chinese mobile giant Huawei has recently launched StorySign, a free mobile app that translates children's books into sign language, so as to enrich family story times and enhance learning experiences for kids with hearing problems.
When users open the app, an animated girl named Star pops out, and when you hold the smartphone over the page, she will start to recognize and sign the text on screen in real time. Each printed word is highlighted as she goes.
StorySign. /Photo via Huawei's website
By using a combination of augmented reality and AI technologies, the app is designed to provide more opportunities for deaf children who are underserved in early years reading resources.
The app became available to download for free on both Google Play and Huawei's own AppGallery in 10 European markets on December 4. But it has yet to be confirmed whether it will be available on iPhone.
StorySign's animated girl, Star. /Photo via Huawei's website
The World Health Organization (WHO) said in March that around 466 million people worldwide have a disabling hearing loss, including 34 million children.
They also noted that children with deafness should be given the opportunity to learn sign language along with their families to minimize the impact of hearing loss on their development and education.
However, few people know sign language outside the deaf community as 90 percent of deaf children are born to hearing parents.
Supported by charities including the European Union of the Deaf and the British Deaf Association, StorySign is an example of AI technologies with the potential to bridge the gap between the hearing and non-hearing.
"We're very hopeful that it will make a significant impact in the deaf community, helping more deaf children learn how to read at the same level as hearing children," said Mark Wheatley, executive director for the European Union of the Deaf in a statement.