{"id":3011,"date":"2026-04-09T22:56:42","date_gmt":"2026-04-09T14:56:42","guid":{"rendered":"https:\/\/iweb20wp-b205b.url.tku.edu.tw\/jase\/?post_type=tkuisotope&p=3011"},"modified":"2026-06-08T21:00:20","modified_gmt":"2026-06-08T13:00:20","slug":"emotion-recognition-based-on-electroencephalogram-signals-using-deep-learning-network","status":"publish","type":"tkuisotope","link":"\/jase\/?tkuisotope=emotion-recognition-based-on-electroencephalogram-signals-using-deep-learning-network","title":{"rendered":"Emotion recognition based on electroencephalogram signals using deep learning network"},"content":{"rendered":"\n
\n
\n

<\/i> 2024<\/a><\/p>\n<\/div>\n\n\n\n

\n

<\/i> Volume 27, Issue 1<\/a><\/p>\n<\/div>\n\n\n\n

\n
\n
\n
\n

Bin Wu<\/i><\/a><\/p>\n\n\n\n

School of Computer and Artificial Intelligence, Chaohu University, Chaohu 238000, China<\/p>\n<\/div>\n\n\n\n

\n

Received:\u00a0March 26, 2022
Accepted:\u00a0May 6, 2023
Publication Date:\u00a0April 9, 2026<\/p>\n<\/div>\n<\/div>\n\n\n\n

\"\u4e0a\u50b3\u5716\u7247\"\n\n\n

The result of regression analysis for multi-layer deep neural network<\/p>\n<\/div>\n<\/div>\n\n\n\n

<\/i> Copyright <\/strong>The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0)<\/a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.<\/p>\n\n\n\n

Download Citation:\u00a0 BibTeX <\/a>| http:\/\/dx.doi.org\/10.6180\/jase.202401_27(1).0014<\/a>\u00a0\u00a0<\/p>\n\n\n\n

Download PDF<\/a><\/p>\n\n\n\n

<\/div>\n\n\n\n

Deep learning networks have a high calculation volume, which is one of their problems. To solve this defect, the data of intrinsic modes obtained from the application of empirical mode decomposition to Electroencephalograph signals were used for the first time in this study. The present paper presents a method for emotion recognition using a deep learning network and electroencephalogram signal. Based on the non-stationary nature of the electroencephalogram, the intrinsic mode functions are extracted using empirical mode decomposition before selecting the first three intrinsic mode functions. Then, electrode positions are converted into pixel positions in images using suitable mapping, and the extracted features are interpreted as pixel color components. Using a deep learning network, all generated images are input into the network to determine whether they belong to the high or low valence class. Similarly, the class of arousal has been determined using the same method. This method was evaluated using the DEAP database to assess its efficiency. The results show that by selecting the image with the size of 17 \u00d7 17, the proposed method can detect valence and arousal emotions with an accuracy of 82.3% and 78.4%, respectively, which is an acceptable superiority compared to previous research.<\/p>\n\n\n\n

Keywords:\u00a0Deep learning network, electroencephalogram signal, intrinsic mode functions, empirical mode decomposition, emotion recognition.<\/em><\/p>\n\n\n\n

<\/div>\n\n\n\n
\n
    \n
  1. [1] S. Karim, A. Qadir, U. Farooq, M. Shakir, and A. Laghari, (2022) \u201cHyperspectral Imaging: A Review and Trends towards Medical Imaging” Current Medical Imaging:<\/li>\n
  2. [2] E. Eslami, (2022) \u201cAnalytical Study of Deep Learning Methods for Road Condition Assessment”:<\/li>\n
  3. [3] E. Eslami and H.-B. Yun, (2022) \u201cImprovement of Multiclass Classification of Pavement Objects Using Intensity and Range Images” Journal of Advanced Transportation:<\/li>\n
  4. [4] E. Eslami and H.-B. Yun, (2021) \u201cAttention-based multiscale convolutional neural network (A+ MCNN) for multi-class classification in road images” Sensors 21(15): 5137.<\/li>\n
  5. [5] L. Wang, Y. Shoulin, H. Alyami, A. Laghari, M. Rashid, J. Almotiri, H. Alyamani, and F. Alturise, (2022) \u201cA novel deep learning-based single shot multibox detector model for object detection in optical remote sensing images”:<\/li>\n
  6. [6] A. Laghari, H. He, M. Shafiq, and A. Khan, (2018) \u201cAssessment of quality of experience (QoE) of image compression in social cloud computing” Multiagent and Grid Systems 14(2): 125\u2013143.<\/li>\n
  7. [7] A. Laghari and S. Yin, (2022) \u201cHow to Collect and Interpret Medical Pictures Captured in Highly Challenging Environments that Range from Nanoscale to Hyperspectral Imaging” Current Medical Imaging:<\/li>\n
  8. [8] Z.-M. Wang, J.-W. Zhang, Y. He, and J. Zhang, (2022) \u201cEEG emotion recognition using multichannel weighted multiscale permutation entropy” Applied Intelligence 52(10): 12064\u201312076.<\/li>\n
  9. [9] N. S. Suhaimi, J. Mountstephens, and J. Teo, (2022) \u201cA dataset for emotion recognition using virtual reality and EEG (DER-VREEG): emotional state classification using low-cost wearable VR-EEG headsets” Big Data and Cognitive Computing 6(1): 16.<\/li>\n
  10. [10] M. M. Hassan, K. T. Hasan, I. A. Tonoy, M. M. Rahman, and M. A. B. Abedin. \u201cStudent Attention Base Facial Emotion State Recognition Using Convolutional Neural Network\u201d. In: Proceedings of International Conference on Data Science and Applications: ICDSA 2022, Volume 1. Springer, 2023.<\/li>\n
  11. [11] G. Li, D. Ouyang, Y. Yuan, W. Li, Z. Guo, X. Qu, and P. Green, (2022) \u201cAn EEG data processing approach for emotion recognition” IEEE Sensors Journal 22(11): 10751\u201310763.<\/li>\n
  12. [12] T. Tuncer, S. Dogan, M. Baygin, and U. R. Acharya, (2022) \u201cTetromino pattern based accurate EEG emotion classification model” Artificial Intelligence in Medicine 123: 102210.<\/li>\n
  13. [13] X. Li, Y. Zhang, P. Tiwari, D. Song, B. Hu, M. Yang, Z. Zhao, N. Kumar, and P. Marttinen, (2022) \u201cEEG based emotion recognition: A tutorial and review” ACM Computing Surveys 55(4): 1\u201357.<\/li>\n
  14. [14] Z. Xie, J. Pan, S. Li, J. Ren, S. Qian, Y. Ye, and W. Bao, (2022) \u201cMusical Emotions Recognition Using Entropy Features and Channel Optimization Based on EEG” Entropy 24(12): 1735.<\/li>\n
  15. [15] M. Chernykh, B. Vodianyk, I. Seleznov, D. Harmatiuk, I. Zyma, A. Popov, and K. Kiyono, (2022) \u201cDetrending Moving Average, Power Spectral Density, and Coherence: Three EEG-Based Methods to Assess Emotion Irradiation during Facial Perception” Applied Sciences 12(15): 7849.<\/li>\n
  16. [16] O. Almanza-Conejo, D. L. Almanza-Ojeda, J. L. Contreras-Hernandez, and M. A. Ibarra-Manzano, (2023) \u201cEmotion recognition in EEG signals using the continuous wavelet transform and CNNs” Neural Computing and Applications 35(2): 1409\u20131422.<\/li>\n
  17. [17] F. Zheng, B. Hu, X. Zheng, C. Ji, J. Bian, and X. Yu, (2022) \u201cDynamic differential entropy and brain connectivity features based EEG emotion recognition” International Journal of Intelligent Systems:<\/li>\n
  18. [18] V. Kanuboyina, T. Shankar, and R. Penmetsa, (2022) \u201cElectroencephalography based human emotion state classification using principal component analysis and artificial neural network” Multiagent and Grid Systems 18(3-4): 263\u2013278.<\/li>\n
  19. [19] Q. Li, Y. Liu, Y. Shang, Q. Zhang, and F. Yan, (2022) \u201cDeep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition” Entropy 24(9): 1187.<\/li>\n
  20. [20] X. Li, D. Song, P. Zhang, G. Yu, Y. Hou, and B. Hu. \u201cEmotion recognition from multichannel EEG data through convolutional recurrent neural network\u201d. In: 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE. 2016, 352\u2013357.<\/li>\n
  21. [21] M. Yu, S. Xiao, M. Hua, H. Wang, X. Chen, F. Tian, and Y. Li, (2022) \u201cEEG-based emotion recognition in an immersive virtual reality environment: From local activity to brain network features” Biomedical Signal Processing and Control 72: 103349.<\/li>\n
  22. [22] A. Topic, M. Russo, M. Stella, and M. Saric, (2022) \u201cEmotion Recognition Using a Reduced Set of EEG Channels Based on Holographic Feature Maps” Sensors (Basel) 22(9): 3248.<\/li>\n
  23. [23] M. Malathi, G. A. A. Mary, J. Kumar, P. Sinthia, and M. Nalini. \u201cAn estimation of PCA feature extraction in EEG-based emotion prediction with support vector machines\u201d. In: Proceedings of Data Analytics and Management: ICDAM 2021, Volume 1. Springer. 2022, 1\u20137.<\/li>\n
  24. [24] A. D. Wibawa, B. S. Y. Mohammad, M. A. K. Fata, F. A. Nuraini, A. Prasetyo, and Y. Pamungkas. \u201cComparison of EEG-Based Biometrics System Using Naive Bayes, Neural Network, and Support Vector Machine\u201d. In: 2022 International Conference on Electrical and Information Technology (IEIT). IEEE. 2022, 1\u20136.<\/li>\n
  25. [25] Y. Wang, S. Qiu, D. Li, C. Du, B.-L. Lu, and H. He, (2022) \u201cMulti-modal domain adaptation variational autoencoder for eeg-based emotion recognition” IEEE\/CAA Journal of Automatica Sinica 9(9): 1612\u20131626.<\/li>\n
  26. [26] \u0141. Furman, W. Duch, L. Minati, and K. To\u0142pa, (2023) \u201cShort-time Fourier transform and embedding method for recurrence quantification analysis of EEG time series” The European Physical Journal Special Topics 232(1): 135\u2013149.<\/li>\n
  27. [27] E. Hancer and A. Subasi, (2022) \u201cEEG-based emotion recognition using dual tree complex wavelet transform and random subspace ensemble classifier” Computer Methods in Biomechanics and Biomedical Engineering: 1\u201313.<\/li>\n
  28. [28] B.-D. Barkana, Y. Ozkan, and J. A. Badara, (2022) \u201cAnalysis of working memory from EEG signals under different emotional states” Biomedical Signal Processing and Control 71: 103249.<\/li>\n
  29. [29] S. Karim, Y. Zhang, S. Yin, A. A. Laghari, and A. A. Brohi, (2019) \u201cImpact of compressed and down-scaled training images on vehicle detection in remote sensing imagery” Multimedia Tools and Applications 78: 32565\u201332583.<\/li>\n
  30. [30] S. Karim, Y. Zhang, A. A. Laghari, and A. Memon. \u201cImage processing based proposed drone for detecting and controlling street crimes.\u201d In: 2017 IEEE International Conference on Communication Technology (ICCT). IEEE. 2017, 1\u20135.<\/li>\n
  31. [31] S. Karim, H. He, A. A. Laghari, A. H. Magsi, and R. A. Laghari, (2021) \u201cQuality of service (QoS): measurements of image formats in social cloud computing” Multimedia Tools and Applications 80(23): 4507\u20134532.<\/li>\n
  32. [32] M. Norouzi, M. Hashemi, and Z. Pouri, (2021) \u201cThe Question of Global Society in Post-Corona Time: Towards a Paradigm Shift” International Journal of Community Well-Being 4(3): 339\u2013343.<\/li>\n
  33. [33] N. Farsaeivahid, C. Grenier, S. Nazarian, and M. L. Wang, (2022) \u201cA Rapid Label-Free Disposable Electrochemical Salivary Point-of-Care Sensor for SARS-CoV-2 Detection and Quantification” Sensors 23(1): 433.<\/li>\n
  34. [34] F. Salahshour, M.-M. Mehrabinejad, M. N. Toosi, M. Gity, H. Ghanaati, M. Shakiba, S. Nosrat Sheybani, H. Komaki, and S. Kolahi, (2021) \u201cClinical and chest CT features as a predictive tool for COVID-19 clinical progress: introducing a novel semi-quantitative scoring system” European radiology 31: 5178\u20135188.<\/li>\n
  35. [35] R. Rezapour-Nasrabad, (2021) \u201cFeasibility of providing Namaste managed care to the elderly with Alzheimer\u2019s disease” Archivos Venezolanos de Farmacologia y Terap\u00e9utica 40(4): 455\u02d8463.<\/li>\n
  36. [36] F. Salahshour, M.-M. Mehrabinejad, A. Zare Dehnavi, A. Alibakhshi, H. Dashti, M.-A. Ataee, and N. Ayoobi Yazdi, (2020) \u201cPancreatic neuroendocrine tumors (pNETs): the predictive value of MDCT characteristics in the differentiation of histopathological grades” Abdominal Radiology 45: 3155\u20133162.<\/li>\n
  37. [37] B. Maas, E. Zabeh, and S. Arabshahi. \u201cQuickTumorNet: fast automatic multi-class segmentation of brain tumors\u201d. In: 2021 10th International IEEE\/EMBS Conference on Neural Engineering (NER). IEEE. 2021, 1\u20134.<\/li>\n
  38. [38] E. Ghafourian, F. Samadifam, H. Fadavian, P. Jerfi Canatalay, A. Tajally, and S. Channumsin, (2023) \u201cAn Ensemble Model for the Diagnosis of Brain Tumors through MRIs” Diagnostics 13(3): 561.<\/li>\n
  39. [39] A. Aggarwal, A. Srivastava, A. Agarwal, N. Chahal, D. Singh, A. A. Alnuaim, A. Alhadlaq, and H.-N. Lee, (2022) \u201cTwo-way feature extraction for speech emotion recognition using deep learning” Sensors 22(6): 2378.<\/li>\n
  40. [40] A. Mert and A. Akan, (2018) \u201cEmotion recognition from EEG signals by using multivariate empirical mode decomposition” Pattern Analysis and Applications 21: 81\u201389.<\/li>\n
  41. [41] M. Chen, J. Han, L. Guo, J. Wang, and I. Patras. \u201cIdentifying valence and arousal levels via connectivity between EEG channels\u201d. In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE. 2015.<\/li>\n
  42. [42] S. Jirayucharoensak, S. Pan-Ngum, and P. Israsena, (2014) \u201cEEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation” The Scientific World Journal 2014:<\/li>\n
  43. [43] F. Bahari and A. Janghorbani. \u201cEEG-based emotion recognition using recurrence plot analysis and k nearest neighbor classifier\u201d. In: 2013 20th Iranian Conference on Biomedical Engineering (ICBME). IEEE. 2013.<\/li>\n
  44. [44] P. Arnau-Gonz\u00e1lez, M. Arevalillo-Herr\u00e1ez, and N. Ramzan, (2017) \u201cFusing highly dimensional energy and connectivity features to identify affective states from EEG signals” Neurocomputing 244: 81\u201389.<\/li>\n
  45. [45] Z. Liang, S. Oba, and S. Ishii, (2019) \u201cAn unsupervised EEG decoding system for human emotion recognition” Neural Networks 116: 257\u2013268.<\/li>\n
  46. [46] A. Olamat, P. Ozel, and S. Atasever, (2022) \u201cDeep learning methods for multi-channel EEG-based emotion recognition” International Journal of Neural Systems 32(05): 2250021.<\/li>\n
  47. [47] H. Cizmeci and C. Ozcan, (2023) \u201cEnhanced deep capsule network for EEG-based emotion recognition” Signal, Image and Video Processing 17(2): 463\u2013469.<\/li>\n
  48. [48] S. Koelstra, C. Muhl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras, (2011) \u201cDEAP: A database for emotion analysis; using physiological signals” IEEE transactions on affective computing 3(1): 18\u201331.<\/li>\n
  49. [49] F. Sharbrough, (1991) \u201cAmerican Electroencephalographic Society guidelines for standard electrode position nomenclature” J clin Neurophysiol 8: 200\u2013202.<\/li>\n
  50. [50] R. Oostenveld and P. Praamstra, (2001) \u201cThe five percent electrode system for high-resolution EEG and ERP measurements” Clinical neurophysiology 112(4): 713\u2013719.<\/li>\n
  51. [51] D. Slayback, S. Abdali, J. Brooks, W. D. Hairston, and P. Groves. \u201cNovel methods for eeg visualization and visualization\u201d. In: 2018 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE. 2018, 1\u20135.<\/li>\n
  52. [52] M. D. Zeiler and R. Fergus. \u201cVisualizing and understanding convolutional networks\u201d. In: Computer Vision\u2013ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part I. 13. Springer. 2014.<\/li>\n
  53. [53] S. Wager, S. Wang, and P. S. Liang, (2013) \u201cDropout training as adaptive regularization” Advances in neural information processing systems 26: 45\u201367.<\/li>\n
  54. [54] X. Glorot and Y. Bengio. \u201cUnderstanding the difficulty of training deep feedforward neural networks\u201d. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics. 9. JMLR Workshop and Conference Proceedings. 2010, 249\u2013256.<\/li>\n
  55. [55] D. Naser and G. Saha. \u201cRecognition of emotions induced by music videos using DT-CWPT\u201d. In: 2013 Indian Conference on Medical Informatics and Telemedicine (ICMIT). IEEE. 2013, 1\u20135.<\/li>\n<\/ol>\n<\/div>\n\n\n\n

    <\/p>\n","protected":false},"author":3,"template":"wp-custom-template-detail-4-aricles","meta":{"_uag_custom_page_level_css":""},"categories":[10,6,515],"tags":[540],"acf":[],"uagb_featured_image_src":[],"uagb_author_info":{"display_name":"\u6797\u923a\u6db5","author_link":"\/jase\/?author=3"},"uagb_comment_info":0,"uagb_excerpt":" Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited. Download Citation:\u00a0 BibTeX | http:\/\/dx.doi.org\/10.6180\/jase.202401_27(1).0014\u00a0\u00a0 Download PDF Deep learning networks have a high calculation volume, which is one…","_links":{"self":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope\/3011"}],"collection":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope"}],"about":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/types\/tkuisotope"}],"author":[{"embeddable":true,"href":"\/jase\/index.php?rest_route=\/wp\/v2\/users\/3"}],"wp:attachment":[{"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3011"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3011"},{"taxonomy":"post_tag","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3011"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}