Ekspansi Fitur Dengan Word2vec Pada Klasifikasi Topik Dengan Metode Naive Bayes-support Vector Machine Di Twitter
DOI:
https://doi.org/10.34818/eoe.v9i1.17390Abstrak
Pada layanan microblogging seperti Twitter, pengguna mungkin kesulitan dalam memahami tulisan dan topik yang ada, karena sering sekali ditemukan penyingkatan kata dalam setiap tweet. Solusi yang diterapkan pada penelitian ini adalah melakukan ekspansi fitur untuk topik pada tweet. Ekspansi fitur adalah proses memperkaya teks asli dengan tambahan semantik agar tampak seperti dokumen teks berukuran besar. Metode yang digunakan untuk ekspansi fitur adalah dengan menggunakan Word2Vec, Metode yang digunakan dalam melakukan klasifikasi adalah Naive Bayes-Support Vector Machine. Hasil penelitian menunjukkan bahwa sistem klasifikasi topik dengan ekspansi fitur Word2Vec menggunakan metode klasifikasi Naive Bayes-Support Vector Machine memiliki akurasi 84%. Kata Kunci : ekspansi fitur, klasifikasi, nbsvm, tweet, twitter, word2vecReferensi
[1] E. B. Setiawan, D. H. Widyantoro, and K. Surendro, “Feature Expansion using Word Embedding for
Tweet Topic Classification,” Proceeding 2016 10th Int. Conf. Telecommun. Syst. Serv. Appl. TSSA 2016
Spec. Issue Radar Technol., 2017, doi: 10.1109/TSSA.2016.7871085.
[2] M. A. Zingla, L. Chiraz, Y. Slimani, and C. Berrut, “Statistical and semantic approaches for tweet
contextualization,” Procedia Comput. Sci., vol. 60, no. 1, pp. 498–507, 2015, doi:
10.1016/j.procs.2015.08.171.
[3] M. A. Fauzi, R. F. N. Firmansyah, and T. Afirianto, “Improving sentiment analysis of short informal
Indonesian product reviews using synonym based feature expansion,” 2018, doi:
10.12928/TELKOMNIKA.v16i3.7751.
[4] C.-F. Tsai, W.-Y. Lin, Z.-F. Hong, and C.-Y. Hsieh, “Distance-based features in pattern classification,”
EURASIP J. Adv. Signal Process., 2011, doi: 10.1186/1687-6180-2011-62.
[5] K. Yao, W. Lu, S. Zhang, H. Xiao, and Y. Li, “Feature expansion and feature selection for general
pattern recognition problems,” Proc. 2003 Int. Conf. Neural Networks Signal Process. ICNNSP’03, vol.
1, pp. 29–32, 2003.
[6] J. Dalton, L. Dietz, and J. Allan, “Entity query feature expansion using knowledge base links,” SIGIR
2014 - Proc. 37th Int. ACM SIGIR Conf. Res. Dev. Inf. Retr., pp. 365–374, 2014.
[7] C. Guo, Y. Zhou, Y. Ping, Z. Zhang, G. Liu, and Y. Yang, “A distance sum-based hybrid method for
intrusion detection,” Appl. Intell., vol. 40, no. 1, pp. 178–188, 2014, doi: 10.1007/s10489-013-0452-6.
[8] J. Jotheeswaran and D. S. Koteeswaran, “A WEIGHTED SEMANTIC FEATURE EXPANSION
USING HYPONYMY TREE FOR FEATURE INTEGRATION IN SENTIMENT ANALYSIS,” Int.
Conf. Green Comput. Internet ofThings, pp. 289–293, 2015.
[9] F. Sun and H. Chen, “Feature extension for Chinese short text classification based on LDA and
Word2vec,” Proc. 13th IEEE Conf. Ind. Electron. Appl. ICIEA 2018, no. 1, pp. 1189–1194, 2018.
[10] F. F. Irfani, M. A. Fauzi, and Y. A. Sari, “News Classification on Twitter Using Naive Bayes and
Hypernym-Hyponym Based Feature Expansion,” 3rd Int. Conf. Sustain. Inf. Eng. Technol. SIET 2018 -
Proc., pp. 317–321, 2018, doi: 10.1109/SIET.2018.8693213.
[11] W. Fenlin, Z. Yifei, and W. Cheng, “ADAPTIVE NORMALIZED WEIGHTED KNN TEXT
CLASSIFICATION BASED ON PSO,” pp. 109–115, 2016.
[12] J. Chen, H. Huang, S. Tian, and Y. Qu, “Feature selection for text classification with Naïve Bayes,”
Expert Syst. Appl., vol. 36, no. 3, pp. 5432–5435, 2009, doi: 10.1016/j.eswa.2008.06.054.
[13] K. Gayathri and A. Marimuthu, “Text document pre-processing with the KNN for classification using
the SVM,” 7th Int. Conf. Intell. Syst. Control. ISCO 2013, pp. 453–457, 2013, doi:
10.1109/ISCO.2013.6481197.
[14] D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent Dirichlet allocation,” J. Mach. Learn. Res., vol. 3, pp.
993–1022, 2003.
[15] S. Wang and C. D. Manning, “Baselines and bigrams: Simple, good sentiment and topic classification,”
50th Annu. Meet. Assoc. Comput. Linguist. ACL 2012 - Proc. Conf., vol. 2, no. July, pp. 90–94, 2012.
[16] H. Kwak, C. Lee, H. Park, and S. Moon, “What is Twitter, a Social Network or a News Media?,” What
is Twitter, a Soc. Netw. or a News Media?, 2010.
[17] Y. Genc, Y. Sakamoto, and J. V. Nickerson, “Discovering context: Classifying tweets through a
semantic transform based on wikipedia,” Proc. HCI Int., pp. 484–492, 2011.
[18] X. H. Phan, L. M. Nguyen, and S. Horiguchi, “Learning to classify short and sparse text & web with
hidden topics from large-scale data collections,” Proceeding 17th Int. Conf. World Wide Web 2008,
WWW’08, pp. 91–99, 2008, doi: 10.1145/1367497.1367510.
[19] M. Chen, X. Jin, and D. Shen, “Short text classification improved by learning multi-granularity topics,”
IJCAI Int. Jt. Conf. Artif. Intell., pp. 1776–1781, 2011, doi: 10.5591/978-1-57735-516-8/IJCAI11-298.
[20] S. H. Myaeng, K. S. Han, and H. C. Rim, “Some effective techniques for naive bayes text classification,”
IEEE Trans. Knowl. Data Eng., vol. 18, no. 11, pp. 1457–1466, 2006, doi: 10.1109/TKDE.2006.180.
[21] V. Jakkula, “Tutorial on Support Vector Machine (SVM),” Sch. EECS, Washingt. State Univ., 2006,
[Online]. Available: http://www.ccs.neu.edu/course/cs5100f11/resources/jakkula.pdf.
[22] G. Orellana, B. Arias, M. Orellana, V. Saquicela, F. Baculima, and N. Piedra, “A study on the impact of
pre-processing techniques in Spanish and english text classification over short and large text
documents,” Proc. - 3rd Int. Conf. Inf. Syst. Comput. Sci. INCISCOS 2018, vol. 2018-Decem, pp. 277–
283, 2018, doi: 10.1109/INCISCOS.2018.00047.
[23] Y. T. Zhang, L. Gong, and Y. C. Wang, “Improved TF-IDF approach for text classification,” J. Zhejiang
Univ. Sci., vol. 6 A, pp. 49–55, 2005, doi: 10.1631/jzus.2005.A0049.
[24] S. Qaiser and R. Ali, “Text Mining: Use of TF-IDF to Examine the Relevance of Words to Documents,”
Int. J. Comput. Appl., vol. 181, no. 1, pp. 25–29, 2018, doi: 10.5120/ijca2018917395.
[25] T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector
space,” 1st Int. Conf. Learn. Represent. ICLR 2013 - Work. Track Proc., pp. 1–12, 2013.
[26] D. Herremans and C. H. Chuan, “Modeling musical context using word2vec,” pp. 11–18, 2017.
[27] X. Rong, “word2vec Parameter Learning Explained,” 2014, [Online]. Available:
http://arxiv.org/abs/1411.2738.
[28] J. Lilleberg, Y. Zhu, and Y. Zhang, “Support vector machines and Word2vec for text classification with
semantic features,” Proc. 2015 IEEE 14th Int. Conf. Cogn. Informatics Cogn. Comput. ICCI*CC 2015,
pp. 136–140, 2015, doi: 10.1109/ICCI-CC.2015.7259377.
[29] B. Li, Z. Zhao, T. Liu, P. Wang, and X. Du, “Weighted neural bag-of-n-grams model: New baselines for
text classification,” COLING 2016 - 26th Int. Conf. Comput. Linguist. Proc. COLING 2016 Tech. Pap.,
pp. 1591–1600, 2016.
[30] C. Sammut and G. I. Webb, Encyclopedia of Machine Learning. .
[31] X. Deng, Q. Liu, Y. Deng, and S. Mahadevan, “An improved method to construct basic probability
assignment based on the confusion matrix for classification problem,” Inf. Sci. (Ny)., vol. 340–341, pp.
250–261, 2016, doi: 10.1016/j.ins.2016.01.033.
[32] A. K. Santra and C. J. Christy, “Genetic Algorithm and Confusion Matrix for Document Clustering,” Int.
J. Comput. Sci. Issues, vol. 9, no. 1, pp. 322–328, 2012.
[33] C. Kim, V. Zhu, J. Obeid, and L. Lenert, “Natural language processing and machine learning algorithm
to identify brain MRI reports with acute ischemic stroke,” PLoS One, vol. 14, no. 2, pp. 1–13, 2019, doi:
10.1371/journal.pone.0212778.
