1. Home
  2. JUITA Vol. 11 No. 1, May 2023
  3. Af'idah

Aspect-Based Sentiment Analysis for Indonesian Tourist Attraction Reviews Using Bidirectional Long Short-Term Memory

Dwi Intan Af'idah, Puput Dewi Anggraeni, Muhammad Rizki, Aji Bagus Setiawan, Sharfina Febbi Handayani

Abstract


The tourism sector in Indonesia experienced growth and made a positive contribution to the national economy, but this growth has yet to reach its target. Therefore, the government of Indonesia has implemented a sustainable tourism development program by establishing ten priority tourism destinations. Aspect-based sentiment analysis (ABSA) towards tourist attraction reviews can assist the government in developing potential goals. The ABSA process compares with two deep learning models (LSTM and Bi-LSTM), which are considered to obtain good performance in text analysis. The shortcomings of previous ABSA research should have examined the performance of the aspect classification and sentiment classification models sequentially. This makes the performance obtained from the ABSA task invalid. Thus, this study is conducted to determine the version of the aspect classification model and the sentiment classification model individually and simultaneously. This study aims to develop an aspect-based tourist attraction sentiment analysis as an intelligent system solution for sustainable tourism development by applying the binary relevance mechanism and the best deep learning model from LSTM or Bi-LSTM. The test results showed that Bi-LSTM was superior in aspect and sentiment classification individually and simultaneously. Likewise, the aspect classification and sentiment classification test results sequentially Bi-LSTM outperformed that of LSTM. The average accuracy and f1 score of Bi-LSTM are 92.22% and 71,06%. Meanwhile, LSTM obtained 90,63% of average precision and 70,4% of f1 score.

Keywords


Aspects-Based Sentiment Analysis; LSTM; BiLSTM; Tourism

References


[1] A. Haryana, “Economic and Welfare Impacts of Indonesia’s Tourism Sector,” J. Perenc. Pembang. Indones. J. Dev. Plan., vol. 4, no. 3, pp. 300–311, 2020, doi: 10.36574/jpp.v4i3.127.

[2] D. M. Lemy, F. Teguh, and A. Pramezwary, “Tourism Development in Indonesia,” vol. 11, pp. 91–108, 2019, doi: 10.1108/s2042-144320190000011009.

[3] M. . Dr. M. Agus Cholik, S.E, “the Development of Tourism Industry in Indonesia :,” Eur. J. Res. Reflect. Manag. Sci., vol. 5, no. 1, pp. 49–59, 2017, [Online]. Available: www.idpublications.org

[4] P. Del Vecchio, G. Mele, V. Ndou, and G. Secundo, “Creating value from Social Big Data: Implications for Smart Tourism Destinations,” Inf. Process. Manag., vol. 54, no. 5, pp. 847–860, 2018, doi: 10.1016/j.ipm.2017.10.006.

[5] B. Liu, “Sentiment analysis: Mining opinions, sentiments, and emotions,” Sentim. Anal. Min. Opin. Sentim. Emot., no. May, pp. 1–367, 2015, doi: 10.1017/CBO9781139084789.

[6] S. Wu, Y. Xu, F. Wu, Z. Yuan, Y. Huang, and X. Li, “Aspect-based sentiment analysis via fusing multiple sources of textual knowledge ✩,” vol. 183, p. 104868, 2019, doi: 10.1016/j.knosys.

[7] X. Wang, X. Chen, M. Tang, T. Yang, and Z. Wang, “Aspect-Level Sentiment Analysis Based on Position Features Using Multilevel Interactive Bidirectional GRU and Attention Mechanism,” Discret. Dyn. Nat. Soc., vol. 2020, 2020, doi: 10.1155/2020/5824873.

[8] S. Gojali and M. L. Khodra, “Aspect based sentiment analysis for review rating prediction,” in 2016 International Conference On Advanced Informatics: Concepts, Theory And Application (ICAICTA), 2016, pp. 1–6. doi: 10.1109/ICAICTA.2016.7803110.

[9] D. Ekawati and M. L. Khodra, “Aspect-based sentiment analysis for Indonesian restaurant reviews,” in 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA), 2017, pp. 1–6. doi: 10.1109/ICAICTA.2017.8090963.

[10] M. Al-Smadi, B. Talafha, M. Al-Ayyoub, and Y. Jararweh, “Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews,” Int. J. Mach. Learn. Cybern., vol. 10, no. 8, pp. 2163–2175, Aug. 2019, doi: 10.1007/s13042-018-0799-4.

[11] H. Gandhi and V. Attar, “Extracting Aspect Terms using CRF and Bi-LSTM Models,” in Procedia Computer Science, 2020, vol. 167, pp. 2486–2495. doi: 10.1016/j.procs.2020.03.301.

[12] A. S. Shafie, N. M. Sharef, M. A. A. Murad, and A. Azman, “Aspect Extraction Performance with POS Tag Pattern of Dependency Relation in Aspect-based Sentiment Analysis,” in 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP), 2018, pp. 1–6. doi: 10.1109/INFRKM.2018.8464692.

[13] Z. Fachrina and D. Widyantoro, Aspect-sentiment classification in opinion mining using the combination of rule-based and machine learning. 2017. doi: 10.1109/ICODSE.2017.8285850.

[14] S. Cahyaningtyas, D. Hatta Fudholi, and A. Fathan Hidayatullah, “Deep Learning for Aspect-Based Sentiment Analysis on Indonesian Hotels Reviews,” Kinet. Game Technol. Inf. Syst. Comput. Network, Comput. Electron. Control, Aug. 2021, doi: 10.22219/kinetik.v6i3.1300.

[15] N. Jihan, Y. Senarath, D. Tennekoon, M. Wickramarathne, and S. Ranathunga, “Multi-Domain Aspect Extraction using Support Vector Machines Tamil News Clustering Using Word Embeddings View project Aspect Based Sentiment Analysis of Customer Reviews View project Multi-Domain Aspect Extraction using Support Vector Machines.” [Online]. Available: https://www.researchgate.net/publication/322314286

[16] M. Al-Smadi, O. Qawasmeh, M. Al-Ayyoub, Y. Jararweh, and B. Gupta, “Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews,” J. Comput. Sci., vol. 27, pp. 386–393, Jul. 2018, doi: 10.1016/j.jocs.2017.11.006.

[17] L. P. Manik et al., “Aspect-Based Sentiment Analysis on Candidate Character Traits in Indonesian Presidential Election,” pp. 224–228, 2020.

[18] S. M. E and R. Sunitha, “Survey On Aspect Based Sentiment Analysis Using Machine Learning Techniques,” vol. 07, no. 10, 2020.

[19] K. Shuang, X. Ren, Q. Yang, R. Li, and J. Loo, “AELA-DLSTMs: Attention-Enabled and Location-Aware Double LSTMs for Aspect-level Sentiment Classification,” Neurocomputing, 2018, doi: 10.1016/j.neucom.2018.11.084.

[20] K. Srividya and A. M. Sowjanya, “Materials Today : Proceedings NA-DLSTM – A neural attention based model for context aware Aspect-based sentiment analysis,” Mater. Today Proc., no. xxxx, 2021, doi: 10.1016/j.matpr.2021.01.782.

[21] A. Yadav and D. K. Vishwakarma, “Sentiment analysis using deep learning architectures: a review,” Artif. Intell. Rev., vol. 53, no. 6, pp. 4335–4385, 2020, doi: 10.1007/s10462-019-09794-5.

[22] A. Aziz Sharfuddin, M. Nafis Tihami, and M. Saiful Islam, “A Deep Recurrent Neural Network with BiLSTM model for Sentiment Classification,” 2018 Int. Conf. Bangla Speech Lang. Process. ICBSLP 2018, pp. 1–4, 2018, doi: 10.1109/ICBSLP.2018.8554396.

[23] K. Zhang, W. Song, L. Liu, X. Zhao, and C. Du, “Bidirectional long short-term memory for sentiment analysis of Chinese product reviews,” ICEIEC 2019 - Proc. 2019 IEEE 9th Int. Conf. Electron. Inf. Emerg. Commun., pp. 665–668, 2019, doi: 10.1109/ICEIEC.2019.8784560.

[24] G. Xu, Y. Meng, X. Qiu, Z. Yu, and X. Wu, “Sentiment analysis of comment texts based on BiLSTM,” IEEE Access, vol. 7, no. c, pp. 51522–51532, 2019, doi: 10.1109/ACCESS.2019.2909919.

[25] A. Suciati and I. Budi, “Aspect-Based Sentiment Analysis and Emotion Detection for Code-Mixed Review,” vol. 11, no. 9, pp. 179–186, 2020.

[26] A. Cahyadi and M. L. Khodra, “Aspect-Based Sentiment Analysis Using Convolutional Neural Network and Bidirectional Long Short-Term Memory,” 2018 5th Int. Conf. Adv. Informatics Concept Theory Appl., pp. 124–129, 2018.

[27] M. Theo, A. Bangsa, S. Priyanta, and Y. Suyanto, “Aspect-Based Sentiment Analysis of Online Marketplace Reviews Using Convolutional Neural Network,” vol. 14, no. 2, pp. 123–134, 2020, doi: 10.22146/ijccs.51646.

[28] A. A. Fattahila, F. I. Amorokhman, K. M. Auditama, K. A. Wijaya, and A. Romadhony, “Indonesian Digital Wallet Sentiment Analysis Using CNN And LSTM Method,” in 2021 International Conference on Artificial Intelligence and Big Data Analytics, 2021, pp. 1–6. doi: 10.1109/ICAIBDA53487.2021.9689712.

[29] M. R. Yanuar and S. Shiramatsu, “Aspect Extraction for Tourist Spot Review in Indonesian Language using BERT,” in 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), 2020, pp. 298–302. doi: 10.1109/ICAIIC48513.2020.9065263.

[30] D. Arianto, “Aspect- based Sentiment Analysis on Indonesia ’ s Touris m Destinations Based on Google Maps User Code-Mixed Reviews ( Study Case : Borobudur and Prambanan Temples ),” vol. 2019, 2019.

[31] L. C. Dewi, Meiliana, and A. Chandra, “Social media web scraping using social media developers API and regex,” Procedia Comput. Sci., vol. 157, pp. 444–449, 2019, doi: 10.1016/j.procs.2019.08.237.

[32] S. Symeonidis, D. Effrosynidis, and A. Arampatzis, “A comparative evaluation of pre-processing techniques and their interactions for twitter sentiment analysis,” Expert Syst. Appl., vol. 110, pp. 298–310, 2018, doi: 10.1016/j.eswa.2018.06.022.

[33] J. Asian, H. E. Williams, and S. M. M. Tahaghoghi, “Stemming Indonesian,” Conf. Res. Pract. Inf. Technol. Ser., vol. 38, no. 4, pp. 307–314, 2005, doi: 10.1145/1316457.1316459.

[34] Md Al-Amin, M. S. Islam, and S. Das Uzzal, “Sentiment analysis of Bengali comments with Word2Vec and sentiment information of words,” ECCE 2017 - Int. Conf. Electr. Comput. Commun. Eng., pp. 186–190, 2017, doi: 10.1109/ECACE.2017.7912903.

[35] D. I. Af’idah, R. Kusumaningrum, and B. Surarso, “Long short term memory convolutional neural network for Indonesian sentiment analysis towards touristic destination reviews,” Proc. - 2020 Int. Semin. Appl. Technol. Inf. Commun. IT Challenges Sustain. Scalability, Secur. Age Digit. Disruption, iSemantic 2020, pp. 630–637, 2020, doi: 10.1109/iSemantic50169.2020.9234210.

[36] B. H. Shekar and G. Dagnew, “Grid search-based hyperparameter tuning and classification of microarray cancer data,” 2019 2nd Int. Conf. Adv. Comput. Commun. Paradig. ICACCP 2019, pp. 1–8, 2019, doi: 10.1109/ICACCP.2019.8882943.

[37] C. G. Siji George and B. Sumathi, “Grid search tuning of hyperparameters in random forest classifier for customer feedback sentiment prediction,” Int. J. Adv. Comput. Sci. Appl., vol. 11, no. 9, pp. 173–178, 2020, doi: 10.14569/IJACSA.2020.0110920.

[38] G. Wu, Y. Tian, and C. Zhang, “A unified framework implementing linear binary relevance for multi-label learning,” Neurocomputing, vol. 289, pp. 86–100, 2018, doi: 10.1016/j.neucom.2018.02.010.

[39] S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural Comput., vol. 9, no. 8, pp. 1735–1780, 1997, doi: 10.1162/neco.1997.9.8.1735.

[40] G. Jiang and W. Wang, “Error estimation based on variance analysis of k-fold cross-validation,” Pattern Recognit., vol. 69, pp. 94–106, 2017, doi: 10.1016/j.patcog.2017.03.025.

[41] I. Guyon, “A scaling law for the validation-set training-set size ratio,” AT&T Bell Lab., pp. 1–11, 1997, [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.33.1337&rep=rep1&type=pdf


Full Text: PDF

DOI: 10.30595/juita.v11i1.15341

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

ISSN: 2579-8901