Implementasi Metode Dynamic Time Warping Pada Aplikasi Kamus Bahasa Isyarat Indonesia Sebagai Media Komunikasi

  • Rizki Amalia Daulay Universitas Islam Negeri Sumatera Utara
  • Muhammad Ikhsan Universitas Islam Negeri Sumatera Utara
  • Abdul Halim Hasugian Universitas Islam Negeri Sumatera Utara

Abstract

Communication is something vital in human existence. Communication is generally divided into two, namely verbal and non-verbal. For deaf and speech impaired people, the comic used is sign language and the intermediary used is a web-based application based on sign language from SIBI, with the implementation of the Dynamic Time Warping (DTW) method to analyze its usability and use. The use of this method in sign language dictionaries is to change the time coefficient into distance, because similarities in images can produce patterns from the object that is the example. In this test there are 24 letters and for each letter 10 image models taken via camera are used, and training is carried out with 50 datasets. The average test result collected reaches 90% because the condition of the hand can be said to be like the condition of other hands. This application is used to learn SIBI language, translate and read hand movements via real-time video. And during testing, accuracy results affect certain situations such as camera capacity, model coloring in the background and hand movements, and light brightness in the training data.

 

Keyword: Metode Dynamic Time Warping, Indonesian Sign Language System, Deaf and Speech Impaired

References

[1] A. S. Nugraheni, A. P. Husain, and H. Unayah, “Optimalisasi Penggunaan Bahasa Isyarat Dengan SIBI dan BISINDO Pada Mahasiswa Difabel Tunarungu di Prodi PGMI UIN Sunan Kalijaga,” Holistika, pp. 28–33, 2021.
[2] N. F. I. Prayoga, Y. Astuti, and C. B. Waluyo, “Analisis Speaker Recognition Menggunakan Metode Dynamic Time Warping (DTW) Berbasis Matlab,” AVITEC, vol. 1, no. 1, pp. 77–85, 2019.
[3] D. I. Setyawan, H. Tolle, and A. P. Kharisma, “Perancangan Aplikasi Communication Board Berbasis Android Tablet Sebagai Media Pembelajaran dan Komunikasi Bagi Anak Tuna Rungu,” J. Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 2, no. 8, pp. 2933–2943, 2018.
[4] F. Nofiaturrahmah, “Problematika Anak Tunarungu dan Cara Mengatasinya,” Quality, vol. 6, no. 1, pp. 1–15, 2018.
[5] A. Maftuhin, “Mengikat Makna Diskriminasi: Penyandang Cacat, Difabel, dan Penyandang Disabilitas,” Inklusi, vol. 3, no. 2, pp. 139–162, 2016, doi: 10.14421/ijds.030201.
[6] M. S. Restendy, “Model Belajar Dan Komunikasi Anak Disabilitas Tunarungu Wicara Di Taman Pendidikan Al Quran Luar Biasa (Tpqlb) Spirit Dakwah Indonesia Tulungagung,” J. Komunika Islam., vol. 6, no. 1, pp. 58–74, 2019.
[7] Y. Hendrayani, “Pola Komunikasi Guru kepada Siswa Penyandang Disabilitas,” J. Penelit. Komun., vol. 2, no. 2, pp. 181–194, 2019, doi: 10.20422/jpk.v22i2.622.
[8] T. Anggita, W. N. Khotimah, and N. Suciati, “Pengenalan Bahasa Isyarat Indonesia dengan Metode Dynamic Time Warping (DTW) menggunakan Kinect 2.0,” J. Tek. ITS, vol. 7, no. Vol 7, No 1 (2018), pp. 199–202, 2018.
[9] S. Mariko, “Aplikasi website berbasis HTML dan JavaScript untuk menyelesaikan fungsi integral pada mata kuliah kalkulus,” J. Inov. Teknol. Pendidik., vol. 6, no. 1, pp. 80–91, 2019, doi: 10.21831/jitp.v6i1.22280.
[10] M. F. Ramadhani, “Pembangunan Aplikasi Informasi, Pengaduan, Kritik, Dan Saran Seputar Kota Cimahi Pada Platform Android,” J. Ilm. Komput. dan Inform., p. 9, 2018.
[11] H. Halimah and D. Kinanti, “E- Customer Relationship Management(CRM) untuk Sistem Informasi Paket Wisata pada CV Alea Tour & Travel Bandar Lampung,” Explor. J. Sist. Inf. dan Telemat., vol. 8, no. 2, 2017, doi: 10.36448/jsit.v8i2.951.
Published
2023-10-07