Perancangan Sistem Untuk Menganalisis Respons Emosi Berdasarkan Estimasi Pergerakan Mata Dari Perekaman Wajah
Abstract
Penelitian ini merancang sistem eye tracking untuk menganalisis pola pergerakan mata terhadap stimulus video sebagai langkah awal memahami respons emosional melalui pola pergerakan mata. Data diambil menggunakan webcam 30 fps dan diolah dengan Mediapipe Face Mesh untuk mendeteksi posisi iris serta menghitung fitur gerakan mata seperti fiksasi dan sakade. Analisis statistik menggunakan paired t-test dilakukan untuk membandingkan segmen puncak dan non-puncak dari stimulus video. Hasil menunjukkan tidak terdapat perbedaan signifikan (p>0,05), namun pola hypervigilance dan attentional avoidance teridentifikasi secara deskriptif. Sistem eye tracking yang dirancang terbukti mampu mendeteksi pergerakan mata secara akurat dan berpotensi menjadi alat bantu objektif dalam mendeteksi respons emosional secara non-verbal.
Kata Kunci — Eye Tracking, Hypervigilance, Attentional Avoidance
References
“Eye Movement: Types and functions explained,” Tobii. Accessed: Sep. 20, 2025. [Online]. Available: https://www.tobii.com/resource-center/learn-articles/types-of-eye-movements
H. Gorin, J. Patel, Q. Qiu, A. Merians, S. Adamovich, and G. Fluet, “A Review of the Use of Gaze and Pupil Metrics to Assess Mental Workload in Gamified and Simulated Sensorimotor Tasks,” Sensors, vol. 24, no. 6, pp. 1–16, 2024, doi: 10.3390/s24061759.
R. S. Hessels, A. Nuthmann, M. Nyström, R. Andersson, D. C. Niehorster, and I. T. C. Hooge, “The fundamentals of eye tracking part 1: The link between theory and research question,” Behav. Res. Methods, vol. 57, no. 1, 2025, doi: 10.3758/s13428-024-02544-8.
“Mental Health,” Institute for Health Metric and Evaluation. Accessed: Apr. 04, 2025. [Online]. Available: https://www.healthdata.org/research-analysis/health-topics/mental-health#:~:text=Gangguan mental termasuk dalam 10,gangguan mental pada tahun 2021.
“Anxiety disorders,” World Health Organization. Accessed: Sep. 10, 2025. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/anxiety-disorders
G. Barus, “Hasil Survei I-NAMHS: Satu dari Tiga Remaja Indonesia Memiliki Masalah Kesehatan Mental,” Universitas Gadjah Mada. Accessed: Apr. 04, 2025. [Online]. Available: https://ugm.ac.id/id/berita/23086-hasil-survei-i-namhs-satu-dari-tiga-remaja-indonesia-memiliki-masalah-kesehatan-mental/
M. T. Wilmer, K. Anderson, and M. Reynolds, “Correlates of Quality of Life in Anxiety Disorders: Review of Recent Research,” Curr. Psychiatry Rep., vol. 23, no. 11, 2021, doi: 10.1007/s11920-021-01290-4.
L. Palagini et al., “Insomnia, anxiety and related disorders: a systematic review on clinical and therapeutic perspective with potential mechanisms underlying their complex link,” Neurosci. Appl., vol. 3, no. July 2023, p. 103936, 2024, doi: 10.1016/j.nsa.2024.103936.
C. A. Mulianda, B. Murti, and H. Prasetya, “Associations between Anxiety, Depression, and Poor Quality of Sleep on the Risk of Irritable Bowel Syndrome: A Meta-Analysis,” J. Epidemiol. Public Heal., vol. 8, p. 1, 2023, [Online]. Available: https://www.jepublichealth.com/index.php/jepublichealth/article/view/565
C. Jyotsna, J. Amudha, A. Ram, and G. Nollo, “IntelEye: An Intelligent Tool for the Detection of Stressful State based on Eye Gaze Data while Watching Video,” Procedia Comput. Sci., vol. 218, pp. 1270–1279, 2022, doi: 10.1016/j.procs.2023.01.105.
D. J. Ariyadi, I. G. A. Gunadi, and D. G. H. Divayana, “Analisis Gerakan Mata Terhadap Tingkat Kecemasan Mahasiswa Dengan Metode Fuzzy Inference System,” J. Teknol. Inf. dan Terap., vol. 10, no. 1, pp. 13–22, 2023, doi: 10.25047/jtit.v10i1.304.
A. L. Nelson, L. Quigley, J. Carriere, E. Kalles, D. Smilek, and C. Purdon, “Avoidance of mild threat observed in generalized anxiety disorder (GAD) using eye tracking,” J. Anxiety Disord., vol. 88, p. 102577, May 2022, doi: 10.1016/J.JANXDIS.2022.102577.
H. Burns et al., “Attentional biases for dynamic stimuli in emerging adults with anxiety: A preliminary eye-tracking study,” J. Psychiatr. Res., vol. 184, pp. 262–271, Apr. 2025, doi: 10.1016/J.JPSYCHIRES.2025.02.046.
V. Dragoi, “Chapter 8: Ocular Motor Control,” Univ. Texas, 2020, [Online]. Available: https://nba.uth.tmc.edu/neuroscience/m/s3/chapter08.html
C. L. Shumway, M. Motlagh, and M. W. Marjorie V. Launico, “Anatomy, Head and Neck: Eye Medial Rectus Muscles,” Natl. Libr. Med., 2023, [Online]. Available: https://www.ncbi.nlm.nih.gov/books/NBK519026/
“Types of eye movements,” Tobii. Accessed: Sep. 20, 2020. [Online]. Available: https://connect.tobii.com/s/article/types-of-eye-movements?language=en_US
B. Mahanama et al., “Eye Movement and Pupil Measures: A Review,” Front. Comput. Sci., vol. 3, no. January, pp. 1–22, 2022, doi: 10.3389/fcomp.2021.733531.
“What is Eye Tracking,” Tobii. Accessed: Sep. 20, 2025. [Online]. Available: https://www.tobii.com/learn-and-support/get-started/what-is-eye-tracking
A. Vakunov and D. Lagun, “MediaPipe Iris: Real-time Iris Tracking & Depth Estimation,” Google Research. Accessed: Sep. 20, 2025. [Online]. Available: https://research.google/blog/mediapipe-iris-real-time-iris-tracking-depth-estimation/
N. Xie, Z. Liu, Z. Li, W. Pang, and B. Lu, “Student engagement detection in online environment using computer vision and multi-dimensional feature fusion,” Multimed. Syst., vol. 29, no. 6, pp. 3559–3577, 2023, doi: 10.1007/s00530-023-01153-3.
K. Clauss, J. Y. Gorday, and J. R. Bardeen, “Eye tracking evidence of threat-related attentional bias in anxiety- and fear-related disorders: A systematic review and meta-analysis,” Clin. Psychol. Rev., vol. 93, p. 102142, Apr. 2022, doi: 10.1016/J.CPR.2022.102142.
I. Konovalova, J. V. Antolin, H. Bolderston, and N. J. Gregory, “Adults with higher social anxiety show avoidant gaze behaviour in a real-world social setting: A mobile eye tracking study,” PLoS One, vol. 16, no. 10 October, pp. 1–17, 2021, doi: 10.1371/journal.pone.0259007.
C. I. Szepesi et al., “Multimodal assessment of social anxiety among international students,” Pers. Individ. Dif., vol. 225, p. 112637, Jul. 2024, doi: 10.1016/J.PAID.2024.112637.
L. M. Tully et al., “The SocialVidStim: a video database of positive and negative social evaluation stimuli for use in social cognitive neuroscience paradigms,” Soc. Cogn. Affect. Neurosci., vol. 19, no. 1, 2024, doi: 10.1093/scan/nsae024.
S. Saganowski et al., “Emognition dataset: emotion recognition with self-reports, facial expressions, and physiology using wearables,” Sci. Data, vol. 9, no. 1, pp. 1–11, 2022, doi: 10.1038/s41597-022-01262-0.
B. Langenberg, M. Janczyk, V. Koob, R. Kliegl, and A. Mayer, “A tutorial on using the paired t test for power calculations in repeated measures ANOVA with interactions,” Behav. Res. Methods, vol. 55, no. 5, pp. 2467–2484, 2023, doi: 10.3758/s13428-022-01902-8.
D. C. Niehorster et al., “The fundamentals of eye tracking part 4: Tools for conducting an eye tracking study,” Behav. Res. Methods, vol. 57, no. 1, 2025, doi: 10.3758/s13428-024-02529-7.
S. Madariaga et al., “SaFiDe: Detection of saccade and fixation periods based on eye-movement attributes from video-oculography, scleral coil or electrooculography data,” MethodsX, vol. 10, no. January, p. 102041, 2023, doi: 10.1016/j.mex.2023.102041.
