Pengembangan Sistem Dialog Interaksi Manusia dan Mesin Menggunakan Finite State Machine
Abstract
Abstrak— Penerapan sistem dialog di dalam kendaraan tidak hanya untuk memudahkan aktifitas pengguna, namun untuk menjaga pengguna agar tetap fokus selama mengemudi, sehingga dapat menghindari kecelakaan. Sistem dialog pada penelitian ini memanfaatkan pengenalan ucapan sebagai data input dari pengguna untuk mengontrol peralatan kendaraan mobil seperti menyalakan lampu, mematikan AC, menyalakan radio, dll. Penelitian ini menyajikan pengembangan sistem dialog berbasis Internet of Things (IoT) dengan menggunakan algoritma model Finite State Machine (FSM) untuk mengelola sistem dialog. Sistem ini diimplementasikan pada Raspberry Pi yang merupakan komputer berukuran kecil sebagai alat kendali utama, kemudian menggunakan Firebase real-time database sebagai penerima dan pengirim data berdasarkan input sebuah sistem dialog. Data pada Firebase akan tersinkronisasi dengan mikrokontroler ESP32 yang akan menghidupkan atau mematikan perangkat kendaraan. Metode perancangan pada penelitian ini menggunakan model prototyping karena akan sering dilakukan percobaan sebelum mencapai tahap akhir. Hasil dari penelitian ini yaitu, berhasil menciptakan sebuah prototipe sistem dialog interaksi manusia dan mesin berbasis IoT pada kendaraan mobil dengan mencapai rata-rata akurasi perintah berhasil 89,5% untuk menyalakan dan mematikan aliran listrik yang terhubung pada ESP32.
Kata kunci— finite state machine, internet of things, sistem dialog.
References
J. A. Horne and A. L. Reyner, "Driver sleepiness," European Sleep Research Society, pp. 23-29, 1995.
H. Fakhrurroja, A. S. Prihatmanto, A. Purwarianti, C. Machbub and Riyanto, "Integration of Indonesian Speech and Hand Gesture Recognition for Controlling Humanoid Robot," 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 1590-1595, 2018.
V. Pravalika and C. R. Prasad, "Internet of Things Based Home Monitoring and Device Control Using Esp32," International Journal of Recent Technology and Engineering (IJRTE), pp. 58-62, 2019.
E. Fytrakis, I. Georgoulas, J. Part and Y. Zhu, "Speech-Based Home Automation System," British HCI Conference, pp. 271-272, 2015.
H. Fakhrurroja, C. Machbub, A. S. Prihatmanto and A. Purwarianti, "Multimodal Fusion Algorithm and Reinforcement Learning-Based Dialog," International Journal on Electrical Engineering and Informatics, pp. 1016-1046, 2020.
N. Anggraini, A. Kurniawan, L. K. Wardhani and N. Hakiem, "Speech Recognition Application for the Speech Impaired using the Android-based Google Cloud Speech API," TELKOMNIKA, vol. 16, no. 6, p. 2733~2739, 2018.
W. Mustikarini, R. Hidayat and A. Bejo, "Real-Time Indonesian Language Speech Recognition with MFCC Algorithms and Python-Based SVM," IJITEE, Vol. 3, No. 2, pp. 55-60, 2019.
Y. Fan, X. Luo and P. Lin, "A Survey of Response Generation of Dialogue Systems," World Academy of Science, Engineering and Technology International Journal of Computer and Information Engineering Vol:14, No:12, pp. 461-472, 2020.
Z. Zhang and M. Huang, "Memory-Augmented Dialogue Management for Task-Oriented Dialogue Systems," ACM Transactions on Information Systems, Vol. 37, No. 3, pp. 34:1-34:30, 2019.
H. Fakhrurroja, A. S. Prihatmanto and C. Machbub, "Multimodal Interaction System for Home Appliances Control," International Journal of Interactive Mobile Technologies (iJIM) Vol.14, No.15, pp. 44-67, 2020.
Y. J. Zhao, Y. L. Li and M. Lin, "A Review of the Research on Dialogue Management of Task-Oriented Systems," Australian International Academic Centre, 2019.
P. Uma , P. Prasenjeet , B. Nilesh and A. Manvita, "Internet of Things based Integrated Smart Home Automation," International Conference on Communication and Information Processing (ICCIP-2020), 2020.
B. S. Sarjerao and A. Prakasarao, "A Low Cost Smart Pollution Measurement System Using REST API and ESP32," 2018 3rd International Conference for Convergence in Technology (I2CT), 2018.
F. Alberto, U. Rubén, L. C. Juan and C. Ruben, "Driver Distraction Using Visual-Based Sensors and Algorithms," Molecular Diversity Preservation International (MDPI), vol. 16, no. 1805, 2016.
G. Larionov, Z. Kaden, H. V. Dureddy, G. B. T. Kalejaiye, M. Kale, S. P. Potharaju, A. P. Shah and A. I. Rudnicky, "Tartan: A retrieval-based socialbot powered by a dynamic finite-state machine architecture," 2nd Proceedings of Alexa Prize, 2018.
R. Balogh and D. Obdrz'alek, "Using Finite State Machines in Introductory Robotics," International Conference on Robotics and Education RiE 2017, pp. 85-91, 2018.
C. Khawas and P. Shah, "Application of Firebase in Android App Development-A Study," International Journal of Computer Applications, pp. 49-53, 2018.
M. Firdaus, H. Chauhan, A. Ekbal and P. Bhattacharyya, "EmoSen: Generating Sentiment and Emotion Controlled Responses in a Multimodal Dialogue System," Journal of Latex Class Files, Vol. 14, NO. 8, 2015.
M. Chernyshev, Z. Baig, O. Bello and S. Zeadally, "Internet of Things (IoT): Research, Simulators, and Testbeds," IEEE Internet of Things Journal Volume: 5, Issue: 3, pp. 1637-1647, 2018.
S. Khattar, A. Sachadeva, R. Kumar and R. Gupta, "Smart Home With Virtual Assistant Using Raspberry Pi," 9th International Conference on Cloud Computing, Data Science & Engineering, pp. 576-579, 2019.
M. T. Tombeng, R. Najoan and N. Karel, "Smart Car: Digital Controlling System Using Android Smartwatch Voice Recognition," The 6th International Conference on Cyber and IT Service Management (CITSM 2018), 2018.
I. S. Areni, A. D. Mufidah, I. S. Wahyuni, I. Nurtanio, I. R. Sahali and A. Bustamin, "Speech to Text in Indonesian Personal Assistant," Journal of Computer Science, vol. 15, no. 6, pp. 824-831, 2019.
M. A. Rosid, A. S. Fitrani, I. R. I. Astutik, N. I. Mulloh and H. A. Gozali, "Improving Text Preprocessing For Student Complaint Document Classification Using Sastrawi," IOP Conf. Series: Materials Science and Engineering, 2019
