It now supports ten sign languages (including most European languages).
The Chinese major has developed StorySign app in a collaboration with the nonprofit European Union for the Deaf, Penguin, and animation gurus Aardman. When you consider that 90% of deaf children are apparently born to hearing parents, you can see the problem.
The app can instantly translate children's books into sign language, using the power of artificial intelligence.
With StorySign parents and their families can simply hold their phone up to the words on the page and avatar Star will point out highlight words in sign language. This would make it easier for kids to associate words with signs.
Learning to read is a time-consuming and complex process for any kiddo, but the 32 million deaf children in the world face an extra challenge. The Image Recognition allows children to position the phone at an angle from the book and the app will still recognise the words perfectly, whilst the OCR permits the app to function with greater accuracy.
Currently, there's only one book for each language. However, while the app can be downloaded for any smartphone, it was reportedly optimized for the Huawei Mate 20 Pro.
Huawei's chief marketing officer for western Europe Andrew Garrihy said the company hoped to raise awareness of deaf literacy skills and encourage more support for charities linked to the cause. Mark Wheatley, Executive Director of the European Union of the Deaf, even welcomed it: "We are convinced that it will have a significant impact on the deaf by helping more deaf children reach the same level of reading learning as hearing children".
HELLO! were lucky enough to test the app and preview their incredibly moving Christmas campaign weeks before its launch and in the company of Maisie Sly, the profoundly deaf seven-year-old who starred in the Oscar-winning short film The Silent Child last year.
"We also hope the launch of StorySign will support a wider conversation about ensuring equality in every aspect of their lives for deaf people across Europe", he said. The collected money would also be invested in the future development of StorySign.