At Huawei, our mission is to bring digital to every person, home and organization for a fully connected, intelligent world. We believe that technology should enrich people’s lives and AI can extend the boundaries of what is humanly possible.
So in 2018, using AI and augmented reality, we created StorySign - the world’s first literacy platform for deaf children. Learning to read can be difficult for any child, but for small children who are severely or profoundly deaf, it can be an overwhelming challenge. We knew our technology could help to open the realm of books to 32 million deaf children around the globe and introduce them to a world of imagination, curiosity and creativity.
StorySign is a free mobile app that aims to help deaf children read by translating the text from selected books into sign language. Through the power of AI and augmented reality, StorySign brings these books to life and helps deaf children enjoy storytime as every child should.
App available to download from
HOW STORYSIGN WORKS
1. A child opens a selected reading book in front of them, then opens the app and holds the phone over the page.
2. Star, our friendly avatar, signs the story while the app highlights each word that she signs.
3. StorySign helps children and their parents to share the magic of storytime while they learn to read and sign together.
CREATIVITY POWERED BY TECHNOLOGY
We’ve developed StorySign in partnership with the European Union of the Deaf, the British Deaf Association, Penguin Books and Aardman Animations among others.
Our collaboration with Penguin Books allows us to bring some of their best loved children’s stories to life. Together with Aardman, we’ve used state of the art motion capture technology and animation to ensure that Star's facial expressions and hands deliver perfect sign language. And create a fun virtual character that kids love.
Working with Deaf Associations, we’ve been able to understand a human challenge and find a technological solution that makes a true difference to the lives of deaf children. A solution, we hope, that changes the story of deaf literacy forever.
Mark Wheatley, Executive Director, European Union of the Deaf.