{"id":9689,"date":"2026-08-05T21:56:55","date_gmt":"2026-08-05T13:56:55","guid":{"rendered":"\/jase\/?post_type=tkuisotope&p=9689"},"modified":"2026-08-21T14:59:15","modified_gmt":"2026-08-21T06:59:15","slug":"jase-202611-34-019","status":"publish","type":"tkuisotope","link":"\/jase\/?tkuisotope=jase-202611-34-019","title":{"rendered":"Virtual Reality Simulations for Immersive Training in Cross- Cultural Communication for Bilingual Broadcasters"},"content":{"rendered":"\n
\n
\n

<\/i> 2026<\/a><\/p>\n<\/div>\n\n\n\n

\n

<\/i> Volume 34<\/a><\/p>\n<\/div>\n\n\n\n

\n
\n
\n
\n

Luyang Xu<\/i><\/a><\/p>\n\n\n\n

School of International Communication, Communication University of China, Nanjing 211172, Jiangsu, China<\/p>\n<\/div>\n\n\n\n

\n

Received: May 20, 2026
Accepted: June 27, 2026
Publication Date: August 05, 2026<\/p>\n<\/div>\n<\/div>\n\n\n\n

\"\u4e0a\u50b3\u5716\u7247\"\n\n\n

Architecture of the Multimodal Transformer for Cross-Cultural Emotion Recognition<\/p>\n<\/div>\n<\/div>\n\n\n\n

<\/i> Copyright <\/strong>The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0)<\/a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.<\/p>\n\n\n\n

Download Citation:  BibTeX <\/a>| http:\/\/dx.doi.org\/10.6180\/jase.202611_34.019<\/a>  <\/p>\n\n\n\n

Download PDF<\/a><\/p>\n\n\n\n

<\/div>\n\n\n\n

Cross-cultural awareness and communication training for bilingual broadcasters should place the emphasis on high-engagement, tailored and transactive learning environments that support multilingual communication, socio-contextual processing, and cultural awareness. The objective is to establish an artificial intelligence (AI)-based virtual reality (VR) solution for immersive bilingual communication by utilizing multimodal emotion
analysis and real-time dynamic feedback. The proposed framework combines two publicly available multimodal datasets CAMEO and MELD with a systematically controlled human study dataset at the core collected from 110 bilingual speakers. In general, the procedures for this study are multimodal data acquisition, MFCC based speech feature extraction, multilingual BERT (mBERT) text embedding, bilingual code-switch processing, emotion encoding, and stratified data splitting. A multimodal transformer based on attention to jointly represent text and speech data for contextual emotion recognition and bilingual interaction assessment. The framework includes cross-cultural adaptation and AI-based real-time feedback in the immersive VR communication settings. Simulation results indicate that the proposed model achieves the best performance with an Accuracy of 98.63%,
a Precision of 98.62%, a Recall of 98.62%, and an F1-Score of 98.62%. The results suggest that the proposed framework surpass both the CNN, the BiLSTM, the transformer encoder, as well as other existing multimodal methods in the task of emotion recognition. In this work we report on real-time inference with an average response latency of 8.37ms that facilitates natural immersive interaction.<\/p>\n\n\n\n

Keywords: Virtual Reality, Multimodal Transformer, Mel-Frequency Cepstral Coefficients, Bilingual Broadcasting, Bidirectional Encoder Representations from Transformers<\/em><\/p>\n\n\n\n

<\/div>\n\n\n\n
\n
    \n
  1. [1] Y.-J. Wu, T.-J. Ding, J.-C. Hsu, K.-L. Ou, and W. Tarng, (2025) \u201cExploratory Learning of Amis Indigenous Culture and Local Environments Using Virtual Reality and Drone Technology\u201d ISPRS International Journal of Geo-Information 14(11): 441. DOI: 10.3390\/ijgi14110441.<\/li>\n
  2. [2] Z. Yang, (2025) \u201cDesign of a Visual Communication System for Animated Characters in Virtual Reality Using Sobel Edge Detection and Motion Capture\u201d Journal of Applied Science and Engineering 29(1): 235\u2013243. DOI: 10.6180\/jase.202601_29(1).0023.<\/li>\n
  3. [3] A. K. Jumani, K. Kumar, and M. A. Chhajro, (2021) \u201cSystematic Analysis of Virtual Reality & Augmented Reality\u201d International Journal of Information Engineering & Electronic Business 13(1): 1\u201312. DOI: 10.5815\/ijieeb.2021.01.04.<\/li>\n
  4. [4] A. A. Laghari, V. V. Estrela, H. Li, Y. Shoulin, A. A. Khan, M. S. Anwar, A. Wahab, and K. Bouraqia, (2024) \u201cQuality of Experience Assessment in Virtual\/Augmented Reality Serious Games for Healthcare: A Systematic Literature Review\u201d Technology and Disability 36(1\u20132): 17\u201328. DOI: 10.3233\/TAD-230035.<\/li>\n
  5. [5] A. K. Jumani, J. Shi, A. A. Laghari, V. V. Estrela, G. A. Sampedro, A. Almadhor, N. Kryvinska, and A. U. Nabi, (2024) \u201cQuality of Experience That Matters in Gaming Graphics: How to Blend Image Processing and Virtual Reality\u201d Electronics 13(15): 2998. DOI: 10.3390\/electronics13152998.<\/li>\n
  6. [6] A. K. Jumani, J. Shi, A. A. Laghari, M. A. Amin, A. U. Nabi, K. Narwani, and Y. Zhang, (2025) \u201cQuality of Experience (QoE) in Cloud Gaming: A Comparative Analysis of Deep Learning Techniques via Facial Emotions in a Virtual Reality Environment\u201d Sensors 25(5): 1594. DOI: 10.3390\/s25051594.<\/li>\n
  7. [7] A. A. Laghari, S. Shahid, R. Yadav, S. Karim, A. Khan, H. Li, and Y. Shoulin, (2023) \u201cThe State of Art and Review on Video Streaming\u201d Journal of High Speed Networks 29(3): 211\u2013236. DOI: 10.3233\/JHS-222087.<\/li>\n
  8. [8] M. R. Sareddy and V. Kumar. \u201cVirtual Reality Meets AI: Revolutionizing Physical Education with LiDAR and RL\u201d. In: 2025 8th International Conference on Electronics, Materials Engineering & Nano-Technology (IEMEnTech). IEEE, 2025, 1\u20136. DOI: 10.1109\/IEMEnTech65115.2025.10959637.<\/li>\n
  9. [9] M. Maciejewski, J. Koco\u0144, W. Oleksy, M. Kope\u0107, and W. Kazienko. amu-cai\/CAMEO Dataset. Accessed: May 9, 2026. 2026.<\/li>\n
  10. [10] S. Poria, D. Hazarika, N. Majumder, G. Naik, E. Cambria, and R. Mihalcea. \u201cMELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations\u201d. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2019. DOI: 10.18653\/v1\/P19-1050.<\/li>\n
  11. [11] B. Xie, M. Sidulova, and C. H. Park, (2021) \u201cRobust Multimodal Emotion Recognition from Conversation with Transformer-Based Crossmodality Fusion\u201d Sensors 21(14): 4913. DOI: 10.3390\/s21144913.<\/li>\n
  12. [12] C. Qu et al., (2025) \u201cEnhancing Emotion Recognition in Virtual Reality: A Multimodal Dataset and a Temporal Emotion Detector\u201d Frontiers in Psychology 16(2): 1709943. DOI: 10.3389\/fpsyg.2025.1709943.<\/li>\n
  13. [13] H. Wang and M. Wang, (2026) \u201cSubject-Independent Multimodal Interaction Modeling for Joint Emotion and Immersion Estimation in Virtual Reality\u201d Symmetry 18(3): 451. DOI: 10.3390\/sym18030451.<\/li>\n<\/ol>\n<\/div>\n\n\n\n

    <\/p>\n","protected":false},"author":3,"template":"wp-custom-template-detail-4-aricles","meta":{"_uag_custom_page_level_css":""},"categories":[12,1682,6],"tags":[1701],"acf":[],"uagb_featured_image_src":[],"uagb_author_info":{"display_name":"\u6797\u923a\u6db5","author_link":"\/jase\/?author=3"},"uagb_comment_info":0,"uagb_excerpt":" Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited. Download Citation:  BibTeX | http:\/\/dx.doi.org\/10.6180\/jase.202611_34.019   Download PDF Cross-cultural awareness and communication training for bilingual broadcasters should place the…","_links":{"self":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope\/9689"}],"collection":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope"}],"about":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/types\/tkuisotope"}],"author":[{"embeddable":true,"href":"\/jase\/index.php?rest_route=\/wp\/v2\/users\/3"}],"wp:attachment":[{"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9689"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9689"},{"taxonomy":"post_tag","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9689"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}