TFOOD (TensorFlow Object Detection) Application Design Smart Solution to Create Digital Communication Tools for People with Deaf and Speech Disabilities

Authors

  • Nur 'Afifah Universitas Muhammadiyah Sumatera Utara
  • Sella Gustrinita Universitas Muhammadiyah Sumatera Utara
  • Sylvi Agustin Universitas Muhammadiyah Sumatera Utara
  • Yudi Firmansyah Universitas Muhammadiyah Sumatera Utara
  • Ukhairi Alpatih Universitas Muhammadiyah Sumatera Utara

DOI:

https://doi.org/10.30596/aihss.v3i2.541

Keywords:

TensorFlow, Object detection, digital communication, hearing impaired, speech disabled

Abstract

Advances in technology have paved the way for innovative solutions aimed at improving the
well-being of the lives of deaf and speech-impaired individuals. This paper presents the design
of TFOOD (TensorFlow Object Detection), a smart application designed to facilitate digital
communication for deaf and speech impaired people. Utilizing TensorFlow object detection
technology, TFOOD translates visual cues, such as SIBI and BISINDO sign language cues,
into text or audio output that is easily understood by others. Prototype of “TFOOD” application
which is designed to help reduce the difficulties faced by people with hearing and speech
impairments. These applications involve training sophisticated models on diverse data sets
and optimizing algorithms to ensure high accuracy and responsiveness in real-world
scenarios. Results show that TFOOD significantly increases communication accessibility for
deaf and speech-impaired individuals, providing an effective tool for interacting in a variety of
social and professional contexts. This paper also discusses the challenges faced during
implementation, including model accuracy and integration, and discusses potential future
developments to further improve the system's capabilities and accessibility. Through this
exploration, TFOOD demonstrates its contribution to digital inclusion and offers insight into
the development of supporting communications technologies.

References

Amka. “Implementasi Pendidikan Karakter Inklusif Bagi Anak Berkebutuhan Khusus Di Sekolah

Reguler”. Jurnal Disabilitas, Jilid 1, No. 1 Juli 2017,hlm. 1-9.

B. R. Pandapotan, S. Aulia, and S. Hadiyoso, “Perancangan Sistem Penerjemah Sign Language

To Text Berbasis Image Processing,” eProceedings Appl. Sci., vol. 9, no. 1, 2023.).

H. fonda,Y. Irawan, A. Febriani. “klasifikasi batik riau dengan menggunakan convolutional

neural networks (cnn). Jurnal Ilmu Komputer, JIK, Vol. 9, No. 1,hal 8-10.

Luh Putu Ary Sri Tjahyanti, Gede Danu Setiawan. “perancangan media pembelajaran

bahasa isyarat merangkai kalimat penyandang disabilitas anak tuna rungu wicara

berbasis web.” DAIWI WIDYA Jurnal Pendidikan Vol.06 No.3, hal 44-57.

S. Apendi, C. Setianingsih, and M. W. Paryasto, “Deteksi Bahasa Isyarat Sistem Isyarat

Bahasa Indonesia Menggunakan Metode Single Shot Multibox Detector,” eProceedings Eng.,

vol. 10, no. 1, 2023.

Sinukun, R., & Darise, Y. 2017. Aplikasi Bahasa Isyarat Sederhana Berbasis Android. Jurnal Teknologi Informasi Indonesia (JTII), 2(1), 20-26.

Downloads

Published

2024-08-02

Issue

Section

Articles