{"id":865,"date":"2026-03-08T01:10:10","date_gmt":"2026-03-07T17:10:10","guid":{"rendered":"https:\/\/iweb20wp-b205b.url.tku.edu.tw\/jase\/?post_type=tkuisotope&#038;p=865"},"modified":"2026-03-26T19:00:25","modified_gmt":"2026-03-26T11:00:25","slug":"hybrid-self-attention-with-lightweight-gating-for-chineseenglish-neural-machine-translation","status":"publish","type":"tkuisotope","link":"\/jase\/?tkuisotope=hybrid-self-attention-with-lightweight-gating-for-chineseenglish-neural-machine-translation","title":{"rendered":"Hybrid Self-Attention with Lightweight Gating for ChineseEnglish Neural Machine Translation"},"content":{"rendered":"\n<div class=\"wp-block-tkuwpbs5-bs5-row row article-info\">\n<div class=\"wp-block-tkuwpbs5-bs5-column col-md-3 align-self-start\">\n<p><i class=\"fa fa-folder\" aria-hidden=\"true\"><\/i>&nbsp;<a href=\"\/jase\/?page_id=807\" data-type=\"page\" data-id=\"807\">2026<\/a><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-tkuwpbs5-bs5-column col-md-3 align-self-start\">\n<p><i class=\"fa fa-folder-open\" aria-hidden=\"true\"><\/i>&nbsp;<a href=\"\/jase\/?page_id=817\" data-type=\"page\" data-id=\"817\">Volume 30<\/a><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-tkuwpbs5-bs5-column col-md-6 align-self-start\">\n<div class=\"wp-block-tkuwpbs5-bs5-div dv_publish\" data-aos=\"normal\"><div class=\"wp-block-post-date\"><time datetime=\"2026-03-08T01:10:10+08:00\">2026-03-08<\/time><\/div><\/div>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-tkuwpbs5-bs5-row row\">\n<div class=\"wp-block-tkuwpbs5-bs5-column col-md-5 align-self-start\">\n<div class=\"wp-block-tkuwpbs5-bs5-div au-ol\" data-aos=\"normal\">\n<p>Zhibin Xu<sup>1<\/sup>, Chuanye He<sup>2<\/sup>, Hailin Chen<sup>1<\/sup>, and Meng Lei<sup>3<\/sup><a href=\"mailto:lmsiee@cumt.edu.cn\"><i class=\"fa fa-envelope\"><\/i><\/a><\/p>\n\n\n\n<p style=\"font-size:14px\"><sup>1<\/sup>China Certification &amp; Inspection Group Hebei Co., Ltd., Shijiazhuang 050071, Hebei, China<\/p>\n\n\n\n<p style=\"font-size:14px\"><sup>2<\/sup>School of Software, Dalian University of Technology, Dalian 116620, Liaoning, China<\/p>\n\n\n\n<p style=\"font-size:14px\"><sup>3<\/sup>School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, Jiangsu, China<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-tkuwpbs5-bs5-div\" style=\"margin-top:var(--wp--preset--spacing--40)\" data-aos=\"normal\">\n<p>Received:\u00a0November 11, 2025<br>Accepted:\u00a0November 24, 2025<br>Publication Date:\u00a0March 8, 2026<\/p>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-tkuwpbs5-bs5-column col-md-7 align-self-start\"><img decoding=\"async\" src=\"\/jase\/wp-content\/uploads\/2026\/03\/30_035.jpg\" class=\"img-fluid img-fluid mx-auto d-block\" alt=\"\u4e0a\u50b3\u5716\u7247\">\n\n\n<p class=\"has-text-align-center img_caption\">Comparison of model-predicted Mad values with true values across the sample sequence (sorted by true labels)<\/p>\n<\/div>\n<\/div>\n\n\n\n<p class=\"has-small-font-size\"><i class=\"fab fa-creative-commons\"><\/i>&nbsp;<strong>Copyright&nbsp;<\/strong>The Author(s). This is an open access article distributed under the terms of the&nbsp;<a rel=\"noreferrer noopener\" href=\"https:\/\/creativecommons.org\/licenses\/by\/4.0\/\" target=\"_blank\">Creative Commons Attribution&nbsp;License (CC BY 4.0)<\/a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.<\/p>\n\n\n\n<p>Download Citation:\u00a0 <a rel=\"noreferrer noopener\" href=\"\/jase\/wp-content\/uploads\/2026\/01\/jase-202509-28-09-0006.pdf\" data-type=\"link\" data-id=\"\/jase\/wp-content\/uploads\/2026\/01\/jase-202509-28-09-0006.pdf\" target=\"_blank\">RIS<\/a> | <a rel=\"noreferrer noopener\" href=\"\/jase\/wp-content\/uploads\/2026\/01\/jase-202509-28-09-0006.pdf\" data-type=\"link\" data-id=\"\/jase\/wp-content\/uploads\/2026\/01\/jase-202509-28-09-0006.pdf\" target=\"_blank\">BibTeX <\/a>| <a href=\"http:\/\/dx.doi.org\/10.6180\/jase.202607_30.035\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/dx.doi.org\/10.6180\/jase.202607_30.035<\/a>\u00a0\u00a0<\/p>\n\n\n\n<p class=\"btn btn-primary article-btn\"><a href=\"\/jase\/wp-content\/uploads\/2026\/03\/035_2025_1748.pdf\" data-type=\"attachment\" data-id=\"926\" target=\"_blank\" rel=\"noreferrer noopener\">Download PDF<\/a><\/p>\n\n\n\n<div style=\"height:24px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>Near-Infrared Spectroscopy (NIRS) has become one of the most widely used non-destructive techniques for rapid coal quality assessment due to its efficiency, low cost, and suitability for on-site industrial deployment. However, NIRS data collected under different measurement conditions often exhibit significant spectral distribution shifts, which substantially weaken the cross-domain generalization ability of conventional prediction models. To address this challenge, this paper proposes a multi-source spectral learning method tailored for NIRS-based coal analysis. The method integrates a unified multi-source domain adaptation framework, a dual-regression-head architecture, and a performance-driven dynamic weighting strategy, enabling effective cross-domain learning without requiring target-domain data. Experiments conducted on real coal NIRS datasets demonstrate that the proposed approach consistently outperforms existing baselines across multiple measurement scenarios, highlighting its strong potential for accurate and robust rapid coal quality detection.<\/p>\n\n\n\n<p><em>Keywords:\u00a0Coal quality assessment; multi-source domain adaptation; cross-domain generalization; transfer learning<\/em><\/p>\n\n\n\n<div style=\"height:2rem\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-tkuwpbs5-bs5-div ref_ol\" data-aos=\"normal\">\n<ol>\n<li>[1] Q. Wang, D. Zhang, Y. Dou, Q. Wang, and Y. Wang, (2025) \u201cAdvanced Multi-Parameter Prediction of Coal Quality Using LIBS and Ensemble Machine Learning Techniques&#8221; ACS Omega 10(33): 37574\u201337582.<\/li>\n<li>[2] L. Zou, J. Qiao, X. Yu, X. Chen, and M. Lei, (2023) \u201cIntelligent proximate analysis of coal based on near-infrared spectroscopy and multioutput deep learning&#8221; IEEE Trans. Artif. Intell. 5(3): 1398\u20131410.<\/li>\n<li>[3] J. Li, R. Gao, Y. Zhang, L. Zhang, L. Dong, W. Ma, W. Yin, and S. Jia, (2025) \u201cResearch on accurate analysis of coal quality using NIRS-XRF fusion spectroscopy in complex coal type scenarios&#8221; Opt. Laser Technol. 181: 111734.<\/li>\n<li>[4] J. Tian, M. Li, X. Zhang, M. Lei, L. Ke, and L. Zou, (2024) \u201cEnhancing Moisture Detection in Coal Gravels: A Deep Learning Based Adaptive Microwave Spectra Fusion Method&#8221; Spectrochim. Acta Part A Mol. Biomol. Spectrosc. 313: 124147.<\/li>\n<li>[5] L. Zou, S. Kou, Z. Xu, Z. Tan, and M. Lei, (2025) \u201cSimultaneous prediction of bauxite quality parameters using TC-Unet and near-infrared spectroscopy&#8221; Memetic Computing 17(2): 25.<\/li>\n<li>[6] B. Hu and J. Wang, (2022) \u201cA weighted multi-source domain adaptation approach for surface defect detection&#8221; IET Image Process. 16(8): 2210\u20132218.<\/li>\n<li>[7] A. J. Parrott, A. C. McIntyre, M. Holden, G. Colquhoun, Z.-P. Chen, D. Littlejohn, and A. Nordon, (2022) \u201cCalibration model transfer in mid-infrared process analysis with in situ attenuated total reflectance immersion probes&#8221; Anal. Methods 14(19): 1889\u20131896.<\/li>\n<li>[8] A. Gretton, K. M. Borgwardt, M. J. Rasch, B. Sch\u00f6lkopf, and A. Smola, (2012) \u201cA kernel two-sample test&#8221; J. Mach. Learn. Res. 13(1): 723\u2013773.<\/li>\n<li>[9] B. Sun and K. Saenko. \u201cDeep coral: Correlation alignment for deep domain adaptation\u201d. In: Eur. Conf. Comput. Vis. 2016, 443\u2013450.<\/li>\n<li>[10] M. Hassan Pour Zonoozi, V. Seydi, and M. Deypir, (2025) \u201cAn unsupervised adversarial domain adaptation based on variational auto-encoder&#8221; Mach. Learn. 114(5): 1\u201326.<\/li>\n<li>[11] S. Zhao, G. Wang, S. Zhang, Y. Gu, Y. Li, Z. Song, P. Xu, R. Hu, H. Chai, and K. Keutzer. \u201cMulti-source distilling domain adaptation\u201d. In: Proc. AAAI Conf. Artif. Intell. 34. 07. 2020, 12975\u201312983.<\/li>\n<li>[12] X. Peng, Q. Bai, X. Xia, Z. Huang, K. Saenko, and B. Wang. \u201cMoment matching for multi-source domain adaptation\u201d. In: Proc. IEEE\/CVF Int. Conf. Comput. Vis. 2019, 1406\u20131415.<\/li>\n<li>[13] H. Zhao, S. Zhang, G. Wu, J. M. F. Moura, J. P. Costeira, and G. J. Gordon. \u201cAdversarial multiple source domain adaptation\u201d. In: Adv. Neural Inf. Process. Syst. 31. 2018.<\/li>\n<li>[14] L. Yang, Y. Balaji, S.-N. Lim, and A. Shrivastava. \u201cCurriculum manager for source selection in multi-source domain adaptation\u201d. In: Eur. Conf. Comput. Vis. 2020, 608\u2013624.<\/li>\n<li>[15] L. Zhao, X. Wang, Z. Liu, Z. Wang, and Z. Chen, (2024) \u201cLearnable Graph Guided Deep Multi-view Representation Learning via Information Bottleneck&#8221; IEEE Trans. Circuits Syst. Video Technol. 35(4): 3303\u20133314.<\/li>\n<li>[16] L. Zhao, Q. Xie, Z. Li, S. Wu, and Y. Yang, (2024) \u201cDynamic Graph Guided Progressive Partial View-Aligned Clustering&#8221; IEEE Trans. Neural Netw. Learn. Syst. 36(5): 9370\u20139382.<\/li>\n<li>[17] S. Ma, L. Zhao, M. Lu, Y. Guo, and B. Xu. ConsistencyAware Padding for Incomplete Multi-Modal Alignment Clustering Based on Self-Repellent Greedy Anchor Search. [Preprint]. 2025.<\/li>\n<li>[18] L. Zhao, P. Huang, T. Chen, C. Fu, Q. Hu, and Y. Zhang, (2023) \u201cMulti-sentence complementarily generation for text-to image synthesis&#8221; IEEE Trans. Multimed. 26: 8323\u20138332.<\/li>\n<li>[19] C. Cortes and M. Mohri. \u201cDomain adaptation in regression\u201d. In: Int. Conf. Algorithmic Learn. Theory. 2011, 308\u2013323.<\/li>\n<li>[20] I. Nejjar, Q. Wang, and O. Fink. \u201cDare-gram: Unsupervised domain adaptation regression by aligning inverse gram matrices\u201d. In: Proc. IEEE\/CVF Conf. Comput. Vis. Pattern Recognit. 2023, 11744\u201311754.<\/li>\n<li>[21] H.-R. Yang, C.-X. Ren, and Y.-W. Luo. \u201cCod: Learning conditional invariant representation for domain adaptation regression\u201d. In: Eur. Conf. Comput. Vis. 2024, 108\u2013125.<\/li>\n<li>[22] Y. Wu, G. Parmigiani, and B. Ren. Multi-source domain adaptation for regression. [Preprint]. 2023.<\/li>\n<li>[23] Y. Zhang, G. Yan, G. Zhao, S. Ma, Z. Liu, and G. Zhao, (2024) \u201cA Dynamic Domain Adaptation Regression Method for Multiple Working Conditions Based on Continual Learning&#8221; Ind. Eng. Chem. Res. 63(40): 17252\u201317265.<\/li>\n<li>[24] Y. Mansour, M. Mohri, and A. Rostamizadeh. \u201cDomain adaptation with multiple sources\u201d. In: Adv. Neural Inf. Process. Syst. 21. 2008.<\/li>\n<li>[25] R. Xu, Z. Chen, W. Zuo, J. Yan, and L. Lin. \u201cDeep cocktail network: Multi-source unsupervised domain adaptation with category shift\u201d. In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 2018, 3964\u20133973.<\/li>\n<li>[26] K. Saito, K. Watanabe, Y. Ushiku, and T. Harada. \u201cMaximum classifier discrepancy for unsupervised domain adaptation\u201d. In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 2018, 3723\u20133732.<\/li>\n<li>[27] Y. Zuo, H. Yao, and C. Xu, (2021) \u201cAttention-based multi-source domain adaptation&#8221; IEEE Trans. Image Process. 30: 3793\u20133803.<\/li>\n<li>[28] Y. Ganin and V. Lempitsky. \u201cUnsupervised domain adaptation by backpropagation\u201d. In: Int. Conf. Mach. Learn. 2015, 1180\u20131189.<\/li>\n<li>[29] M. Long, Z. Cao, J. Wang, and M. I. Jordan. \u201cConditional adversarial domain adaptation\u201d. In: Adv. Neural Inf. Process. Syst. 31. 2018.<\/li>\n<li>[30] Z. Pei, Z. Cao, M. Long, and J. Wang. \u201cMultiadversarial domain adaptation\u201d. In: Proc. AAAI Conf. Artif. Intell. 32. 1. 2018.<\/li>\n<li>[31] R. Xu, G. Li, J. Yang, and L. Lin. \u201cLarger norm more transferable: An adaptive feature norm approach for unsupervised domain adaptation\u201d. In: Proc. IEEE\/CVF Int. Conf. Comput. Vis. 2019, 1426\u20131435.<\/li>\n<li>[32] Y. Zhang, T. Liu, M. Long, and M. I. Jordan. \u201cBridging theory and algorithm for domain adaptation\u201d. In: Int. Conf. Mach. Learn. 2019, 7404\u20137413.<\/li>\n<li>[33] J. Liang, D. Hu, and J. Feng. \u201cDo we really need to access the source data? source hypothesis transfer for unsupervised domain adaptation\u201d. In: Int. Conf. Mach. Learn. 2020, 6028\u20136039.<\/li>\n<li>[34] E. Tzeng, J. Hoffman, K. Saenko, and T. Darrell. \u201cAdversarial discriminative domain adaptation\u201d. In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 2017, 7167\u20137176.<\/li>\n<li>[35] R. Shu, H. H. Bui, H. Narui, and S. Ermon. A dirt-t approach to unsupervised domain adaptation. [Preprint]. 2018.<\/li>\n<\/ol>\n<\/div>\n\n\n\n<p><\/p>\n","protected":false},"author":3,"template":"wp-custom-template-detail-4-aricles","meta":{"_uag_custom_page_level_css":""},"categories":[12,16,6],"tags":[52],"acf":[],"uagb_featured_image_src":[],"uagb_author_info":{"display_name":"\u6797\u923a\u6db5","author_link":"\/jase\/?author=3"},"uagb_comment_info":0,"uagb_excerpt":"&nbsp;Copyright&nbsp;The Author(s). This is an open access article distributed under the terms of the&nbsp;Creative Commons Attribution&nbsp;License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited. Download Citation:\u00a0 RIS | BibTeX | http:\/\/dx.doi.org\/10.6180\/jase.202607_30.035\u00a0\u00a0 Download PDF Near-Infrared Spectroscopy (NIRS) has become one of the most&hellip;","_links":{"self":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope\/865"}],"collection":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope"}],"about":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/types\/tkuisotope"}],"author":[{"embeddable":true,"href":"\/jase\/index.php?rest_route=\/wp\/v2\/users\/3"}],"wp:attachment":[{"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=865"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=865"},{"taxonomy":"post_tag","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=865"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}