App uses Avatars to translate speech into Kenyan sign language

印刷用画面を開く

Posted

Category: Technology/Innovations

Listening

Unlocking Word Meanings

Read the following words/expressions found in today’s article.

  1. harness / ˈhɑr nɪs / (v.) – to control and use something for a useful purpose
    Example:

    The company is harnessing solar power to provide clean energy for homes.


  2. translation / trænsˈleɪ ʃən / (n.) – the process of changing something from one language into another that has the same meaning
    Example:

    He feels confident traveling to other countries because of the translation app that helps him understand the local language.


  3. digitize / ˈdɪdʒ əˌtaɪz / (v.) – to change information into a digital form that a computer can use
    Example:

    The library wants to digitize old newspapers to save them online.


  4. articulation / ɑrˌtɪk yəˈleɪ ʃən / (n.) – the act of clearly forming sounds in speech, or movements so that they can be understood
    Example:

    During early language learning, children may find the articulation of some letter sounds difficult.


  5. benefit / ˈbɛn ə fɪt / (v.) – to help or improve something or someone; to be useful in a positive way
    Example:

    Better road signs are benefiting drivers by helping them find their way more easily.


Article

Read the text below.

A young Kenyan entrepreneur is harnessing AI to break communication barriers for the deaf community. His web app, Terp 360, aims to become Africa’s first sign language translation platform built for local use.


Signvrse’s Terp 360 claims to be Africa’s first AI translation platform built specifically for local use. It translates text and speech into Kenyan Sign Language through avatars, enhancing communication for both deaf and hearing individuals.


“We like to call it Google Translate for sign language—and how this works is it interprets text and speech input and outputs very fluid natural avatars, which is a digital human that now signs the same way a human being does at scale,” explains Elly Savatia, the 24-year-old founder of Signvrse.


Founded in 2023 and a recipient of the Kenya Presidential Innovation Award, Signvrse is on a mission to digitize Kenyan Sign Language by using motion capture systems to accurately record sign language motion from real interpreters. The combination of body movement, hand rotation and articulation, and facial expressions allows the application to accurately capture the linguistic and vibrant nature of sign language.


Eventually, the company hopes the solution can be used in both business and personal contexts through a subscription.


For the deaf community, it could be a very helpful solution to the challenges of daily life. “I had a lot of challenges when searching for a job, and sometimes when I go to hospital, I have a lot of challenges,” says Kelvin Munene, a deaf waiter working in Nairobi.


“I think when using this app, it will help those challenges and it will make communication easier,” he adds.


However, he says he hopes the application can one day use both English and Kiswahili.


Leakey Nyabaro, a member of the deaf community and the founder and director of Galaxy Sign Language Training Centre in Kenya, says, “We find that there are a lot of errors. It’s not that perfect, but somehow I find it more effective when it is sign-to-voice (translation). We find that it is voiced correctly, benefiting more of the hearing community but not the deaf.”


This article was provided by The Associated Press.


Viewpoint Discussion

Enjoy a discussion with your tutor.

Discussion A

  • For many deaf people, communication can be a big challenge in daily life, such as finding a job or visiting a hospital. Do you find it a challenge to communicate with others? Why or why not? In what situations do you find it most difficult? Discuss.
  • Good communication is important for everyone. In your opinion, what is the biggest communication challenge in your own community? Do you think this could be solved easily with the help of technology? Why or why not? Discuss.

Discussion B

  • The app aims to be available for both personal and business use through a subscription. Do you think it is fair for life-changing technology to be offered as a subscription, or should it be free for those who need it most? Why? Discuss.
  • If you could invent something useful for your community, what kind of problem would you want to solve? Would you want everyone to use it for free, or would you make it a paid service like a subscription? Why? Discuss.