Klasifikasi Teks Soal Ujian Berbahasa Indonesia Berdasarkan Ranah Kognitif Taksonomi Bloom
DOI:
https://doi.org/10.34818/eoe.v9i3.18001Abstrak
Abstrak Ujian tertulis merupakan bentuk ujian yang paling umum digunakan untuk mengukur capaian belajar siswa, baik dari jenjang SD, SMP ataupun SMA. Tingkat kesulitan dari ujian dapat bervariasi antar soal, sehingga hasil ujian dari siswa dapat dianalisis lebih jauh dengan melihat pada tingkat kesulitan apa siswa mampu dan tidak mampu menjawab dengan benar. Taksonomi Bloom memiliki ranah kognitif yang dapat dijadikan acuan dalam menentukan tingkat kesulitan dari soal ujian. Dalam ranah kognitif tersebut, terdapat 6 kelas berbeda yang secara urut diantaranya mengingat, memahami, menerapkan, menganalisa, mengevaluasi dan mencipta. Pada Tugas Akhir ini, latihan soal diklasifikasikan ke dalam 6 kelas dari ranah kognitif Taksonomi Bloom. Data yang digunakan berupa teks soal dalam Bahasa Indonesia dari jenjang pendidikan Sekolah Dasar, Sekolah Menengah Pertama, dan Sekolah Menengah Atas. Metode yang digunakan adalah Support Vector Machine dan Naive Bayes, karena terbukti pada penelitian sebelumnya mampu menghasilkan performa yang cukup baik dalam melakukan klasifikasi pada bidang yang sama. Selain itu, ekstraksi fitur dilakukan menggunakan TF-IDF yang telah dimodifikasi berdasarkan nilai bobot dari POS Tag. Metode ekstraksi fitur tersebut terbukti memiliki performa yang lebih baik dibandingkan TF-IDF reguler pada penelitian sebelumnya. Kata kunci : Taksonomi Bloom, Support Vector Machine, Naïve Bayes, TF-IDF
Referensi
[1] S. F. Kusuma, D. Siahaan and U. L. Yuhana, "Automatic Indonesia's questions classification based on bloom's taxonomy using Natural Language Processing a preliminary study," 2015 International Conference on Information Technology Systems and Innovation (ICITSI), 2015, pp. 1-6, doi: 10.1109/ICITSI.2015.7437696.
[2] Utari, Retno. 2011. Taksonomi Bloom Apa dan Bagaimana Menggunakannya?
[3] A. Aninditya, M. A. Hasibuan and E. Sutoyo, "Text Mining Approach Using TF-IDF and Naive Bayes for Classification of Exam Questions Based on Cognitive Level of Bloom's Taxonomy," 2019 IEEE International Conference on Internet of Things and Intelligence System (IoTaIS), 2019, pp. 112-117, doi: 10.1109/IoTaIS47347.2019.8980428.
[4] H. S. Bhargav, G. Akalwadi and N. V. Pujari, "Application of Blooms Taxonomy in Day-to-Day Examinations," 2016 IEEE 6th International Conference on Advanced Computing (IACC), 2016, pp. 825-829, doi: 10.1109/IACC.2016.157.
[5] S. K. Patil and M. M. Shreyas, "A Comparative Study of Question Bank Classification based on Revised Bloom’s Taxonomy using SVM and K-NN," 2017 2nd International Conference On Emerging Computation and Information Technologies (ICECIT), 2017, pp. 1-7, doi: 10.1109/ICECIT.2017.8453305.
[6] A. B. Prasetijo, R. R. Isnanto, D. Eridani, Y. A. A. Soetrisno, M. Arfan and A. Sofwan, "Hoax detection system on Indonesian news sites based on text classification using SVM and SGD," 2017 4th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), 2017, pp. 45-49, doi: 10.1109/ICITACEE.2017.8257673.
[7] E. Subiyantoro, A. Ashari and Suprapto, "Cognitive Classification Based on Revised Bloom’s Taxonomy Using Learning Vector Quantization," 2020 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM), 2020, pp. 349-353, doi: 10.1109/CENIM51130.2020.9297879.
[8] N. Kalcheva, M. Karova and I. Penev, "Comparison of the accuracy of SVM kernel functions in text classification," 2020 International Conference on Biomedical Innovations and Applications (BIA), 2020, pp. 141-145, doi: 10.1109/BIA50171.2020.9244278.
[9] Gandhi, Rohith. 2018. Support Vector Machine — Introduction to Machine Learning Algorithms. [Online]. Available at: https://towardsdatascience.com/support-vector-machine-introduction-to-machine-learning-algorithms-934a444fca47 [Accessed 24 November 2021]
[10] Anonymous. Naive Bayes. [Online]. Available at: https://scikit-learn.org/stable/modules/naive_bayes.html [Accessed 30 November 2021]
[11] W Zhang, T Yoshida, and X Tang. 2011. A comparative study of TFIDF, LSI and multi-words for text classification. Expert Systems with Applications Volume 38 Issue 3 Pages 2758-2765. doi: 10.1016/j.eswa.2010.08.066.
[12] Mohammed M, Omar N (2020) Question classification based on Bloom’s taxonomy cognitive domain using modified TF-IDF and word2vec. PLoS ONE 15(3): e0230442. https://doi.org/10.1371/journal.pone.0230442
[13] Narkhede S. 2018. Understanding Confusion Matrix. [Online]. Available at: https://towardsdatascience.com/understanding-confusion-matrix-a9ad42dcfd62 [Accessed 12 December 2021]
[14] [Online]. Available at: https://www.ruangguru.com/blog/ [Accessed 21 December 2021]
[15] Syarifah L., Yenni Y., & Dewi W. (2020). Analisis Soal-Soal Pada Buku Ajar Matematika Siswa Kelas XI Ditinjau Dari Aspek Kognitif. Jurnal Cendekia : Jurnal Pendidikan Matematika, 4(2), 1259-1272. https://doi.org/10.31004/cendekia.v4i2.335
[16] David R. Krathwohl (2002) A Revision of Bloom's Taxonomy: An Overview, Theory Into Practice, 41:4, 212-218, DOI: 10.1207/s15430421tip4104_2
[17] Akbik A., Bergmann, T., Blythe, D., Rasul, K., Schweter, S. and Vollgraf, R., 2019, June. FLAIR: An easy-to-use framework for state-of-the-art NLP. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations) (pp. 54-59).
[18] Pedregosa, F. et al., 2011. Scikit-learn: Machine learning in Python. Journal of machine learning research, 12(Oct), pp.2825–2830.
[19] Guillaume Lemaître, Fernando Nogueira, and Christos K. Aridas. 2017. Imbalanced-learn: a python toolbox to tackle the curse of imbalanced datasets in machine learning. J. Mach. Learn. Res. 18, 1 (January 2017), 559–563.
[20] Padurariu C., Breaban M.E. 2019. Dealing with Data Imbalance in Text Classification. Procedia Computer Science, Volume 159, Pages 736-745.
[21] Gholamy, Afshin; Kreinovich, Vladik; and Kosheleva, Olga, "Why 70/30 or 80/20 Relation Between Training and Testing Sets: A Pedagogical Explanation" (2018). Departmental Technical Reports (CS). 1209.
[22] E. R. Setyaningsih and I. Listiowarni, "Categorization of Exam Questions based on Bloom Taxonomy using Naïve Bayes and Laplace Smoothing," 2021 3rd East Indonesia Conference on Computer and Information Technology (EIConCIT), 2021, pp. 330-333, doi: 10.1109/EIConCIT50028.2021.9431862.
