Subject Independent Emotion Recognition Using Electroencephalogram Signals with Continuous Capsule Network Method

Made Agus Panji Sujaya; I Made Agus Wirawan; Gede Indrawan

doi:10.30595/juita.v13i1.24583

Authors

Made Agus Panji Sujaya Universitas Pendidikan Ganesha
I Made Agus Wirawan Universitas Pendidikan Ganesha http://orcid.org/0000-0002-9242-6724
Gede Indrawan Universitas Pendidikan Ganesha

DOI:

https://doi.org/10.30595/juita.v13i1.24583

Keywords:

classification, continuous capsule network, electroencephalogram, emotion.

Abstract

Emotions play an essential role in human reasoning. Researchers have made various efforts to improve emotion classification methods. Based on the several emotion classification methods studied in previous studies, the Continuous Capsule Network method produced the highest accuracy compared to other classification methods. This method can maintain spatial information from electroencephalogram signals so they are not reduced. However, this method has only been tested subject-dependently. Based on this study, the Continuous Capsule Network method will be applied to classify emotions in the Faculty of Engineering and Vocational Studies, Universitas Pendidikan Ganesha students. The number of participants involved in this study was 17 people (10 men and 7 women). Through six subjectindependent test scenarios, the Continuous Capsule Network method produced accuracy, precision, recall, and F1 scores of 99.31%, 99.34%, 99.20%, and 99.27, respectively. At the same time, the loss value was 0.88%. In addition, the Continuous Capsule Network method produced an average training and validation time of 401.17 seconds and an average testing time of 4.67 seconds for the six test scenarios.

References

[1] A. Halik, A. Helwa, and A. Ramadhani, “Penerapan Teknik Expressive Writing Langkah Membantu Siswa Mengelola Emosi,” SEMANGGI : Jurnal Pengabdian kepada Masyarakat, vol. 1, no. 02, pp. 100–110, Oct. 2022, doi: 10.38156/sjpm.v1i02.135.

[2] O. Nurdiawan and A. Faqih, “Optimisasi Model Backpropagation untuk Meningkatkan Deteksi Kejang Epilepsi pada Sinyal Electroencephalogram,” INFORMATION SYSTEM FOR EDUCATORS AND PROFESSIONALS, vol. 9, no. 2, pp. 151–160, Dec. 2024, doi: https://doi.org/10.51211/isbi.v9i2.3187.

[3] A. Kurniawati and H. Akbar, “Pengembangan Mobile Aplikasi untuk Penderita Epilepsi Menggunakan Sinyal EEG dan Sinyal ECG,” Journal of Computer Engineering, Network, and Intelligent Multimedia, vol. 1, no. 1, pp. 28–43, Feb. 2023, doi: 10.59378/jcenim.v1i1.6.

[4] G. M. Zamroni, D. Yulianto, B. Saphira, F. N. Akhmad, and F. A. Zahrah, “Electroencephalogram as a Validation Method in Usability Testing,” JUITA: Jurnal Informatika, vol. 11, no. 1, pp. 97–105, May 2023, doi: 10.30595/juita.v11i1.16000.

[5] S. Gannouni, K. Belwafi, A. Aledaily, H. Aboalsamh, and A. Belghith, "Software Usability Testing Using EEG-Based Emotion Detection and Deep Learning," Sensors, vol. 23, no. 11, Jun. 2023, doi: 10.3390/s23115147.

[6] A. A. Kasim, M. Bakri, and I. Mahmudi, "Artificial Intelligent for Human Emotion Detection with the Mel-Frequency Cepstral Coefficient (MFCC)," JUITA: Jurnal Informatika, vol. 11, no. 1, pp. 47–56, May 2023, doi: 10.30595/juita.v11i1.15435.

[7] I. M. Agus Wirawan, R. Wardoyo, D. Lelono, S. Kusrohmaniah, and S. Asrori, "Comparison of Baseline Reduction Methods for Emotion Recognition Based on Electroencephalogram Signals," in 2021 6th International Conference on Informatics and Computing, ICIC 2021, Institute of Electrical and Electronics Engineers Inc., 2021. doi: 10.1109/ICIC54025.2021.9632948.

[8] I. M. A. Wirawan, R. Wardoyo, D. Lelono, and S. Kusrohmaniah, "Continuous Capsule Network Method for Improving Electroencephalogram-Based Emotion Recognition," Emerging Science Journal, vol. 7, no. 1, pp. 116–134, Feb. 2023, doi: 10.28991/ESJ-2023-07-01-09.

[9] Y. Liu, Y. Ding, C. Li, J. Cheng, R. Song, F. Wan, and X. Chen, "Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network," Comput Biol Med, vol. 123, Aug. 2020, doi: 10.1016/j.compbiomed.2020.103927.

[10] N. Ramdhani, “Adaptasi Bahasa dan Budaya Inventori Big Five,” JURNAL PSIKOLOGI, vol. 39, no. 2, pp. 189–207, 2012, doi: 10.22146/jpsi.6986.

[11] R. Rogoza, J. Cieciuch, and W. Strus, "A three-step procedure for analysis of circumplex models: An example of narcissism located within the circumplex of personality metatraits," Pers Individ Dif, vol. 169, p. 109775, Feb. 2021, doi: 10.1016/J.PAID.2019.109775.

[12] Y. F. Zakariya, "Cronbach's alpha in mathematics education research: Its appropriateness, overuse, and alternatives in estimating scale reliability," Front Psychol, vol. 13, Dec. 2022, doi: 10.3389/fpsyg.2022.1074430.

[13] J. Rabinowitz, J. B. W. Williams, N. Hefting, A. Anderson, B. Brown, D. J. Fu, B. Kadriu, A. Kott, A. Mahableshwarkar, J. Sedway, D. Williamson, C. Yavorsky, and N. R. Schooler, "Consistency checks to improve measurement with the Hamilton Rating Scale for Anxiety (HAM-A)," J Affect Disord, vol. 325, pp. 429–436, Mar. 2023, doi: 10.1016/J.JAD.2023.01.029.

[14] S. Sabour, N. Frosst, and G. E. Hinton, "Dynamic Routing Between Capsules," in Advances in Neural Information Processing Systems 30, 2017.

[15] T. Eldor, "Capsule Neural Networks – Part 2: What is a Capsule?" Accessed: Feb. 21, 2021. [Online]. Available: https://towardsdatascience.com/capsule-neural-networks-part-2-what-is-a-capsule-846d5418929f