Journal of Applied Science and Engineering

Published by Tamkang University Press

ESCI jase impact factor scopus logo open access rate of Scopus journal

A Novel Information-based Multi-view Representation Learning

 2025

 Volume 28, Issue 11

Hongdan Wang1 and Jian Zhang2

1Tieling Normal College, Tieling, 112608, China262737, China

2Liaoning Institute of Science and Engineering, Jinzhou, 121010, China

Received: December 15, 2024;
Accepted: January 19, 2025
Publication Date: April 6, 2026

上傳圖片

Results on Caltech101-20 of IMVRL.

 Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.

Download Citation:  BibTeX | http://dx.doi.org/10.6180/jase.202511_28(11).0008  

Download PDF

Multi-view representation learning methods achieve great performance in various domains via fusing complementary and consistent information of views, which have gained great attention. However, there still exist two issues in current methods. They typically assume strict semantic consistency across views to learn representations of multi-view data. Moreover, they lack a unified theoretical framework in mining patterns of multi-view data, making it difficult to gain a deeper understanding of multi-view representation learning. To this end, a new information-based multi-view representation learning within the encoding-decoding architecture is proposed to aggregate complementary and consistent information for mining patterns (IMVRL). It consists of three mutual information objectives for multi-view representation learning, i.e., concentration learning, consistent learning, and comprehensiveness learning. Three objectives work seamlessly in aggregating complementary and consistent information to mine patterns of multi-view data. Finally, a series of extensive tests across three datasets underscore the advantages and efficacy of IMVRL.

Keywords: Mutual information maximization; multi-view representation learning; deep encoding-decoding architecture

  1. [1] C. Xu, J. Si, Z. Guan, W. Zhao, Y. Wu, and X. Gao. “Reliable conflictive multi-view learning”. In: Proceedings of the AAAI Conference on Artificial Intelligence. 38. 14. 2024, 16129–16137. DOI: 10.1609/aaai.v38i14.29546.
  2. [2] W. Hu, Y. Wu, and Z. Yang, (2024) “An Analysis of Credit Risk Prediction for Small and Micro Enterprises” Journal of Artificial Intelligence Research 1(2): 1–21. DOI: 10.70891/JAIR.2024.110004.
  3. [3] J. Gao, P. Li, A. A. Laghari, G. Srivastava, T. R. Gadekallu, S. Abbas, and J. Zhang, (2024) “Incomplete multiview clustering via semidiscrete optimal transport for multimedia data mining in IoT” ACM Transactions on Multimedia Computing, Communications and Applications 20(6): 1–20. DOI: 10.1145/3625548.
  4. [4] L. Fu, S. Huang, L. Zhang, J. Yang, Z. Zheng, C. Zhang, and C. Chen, (2024) “Subspace-contrastive multi-view clustering” ACM Transactions on Knowledge Discovery from Data 18(9): 1–35. DOI: 10.1145/367483.
  5. [5] Y. Sun, Y. Qin, Y. Li, D. Peng, X. Peng, and P. Hu, (2024) “Robust multi-view clustering with noisy correspondence” IEEE Transactions on Knowledge and
    Data Engineering: DOI: 10.1109/TKDE.2024.3423307.
  6. [6] J. Gao, M. Liu, P. Li, A. A. Laghari, A. R. Javed, N. Victor, and T. R. Gadekallu, (2023) “Deep incomplete multiview clustering via information bottleneck for pattern mining of data in extreme-environment IoT” IEEE Internet of Things Journal: DOI: 10.1109/JIOT.2023.3325272.
  7. [7] S. Shi, F. Nie, R. Wang, and X. Li, (2021) “Multi-view clustering via nonnegative and orthogonal graph reconstruction” IEEE transactions on neural networks and learning systems 34(1): 201–214. DOI: 10.1109/TNNLS.2021.3093297.
  8. [8] W. Yan, Y. Zhang, C. Lv, C. Tang, G. Yue, L. Liao, and W. Lin. “Gcfagg: Global and cross-view feature aggregation for multi-view clustering”. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 19863–19872.
  9. [9] Y. Lin, Y. Gou, X. Liu, J. Bai, J. Lv, and X. Peng, (2022) “Dual contrastive prediction for incomplete multi-view representation learning” IEEE Transactions on Pattern Analysis and Machine Intelligence 45(4): 4447–4461. DOI: 10.1109/TPAMI.2022.3197238.
  10. [10] J. Pu, C. Cui, X. Chen, Y. Ren, X. Pu, Z. Hao, S. Y. Philip, and L. He. “Adaptive Feature Imputation with Latent Graph for Deep Incomplete Multi-View Clustering”. In: Proceedings of the AAAI Conference on Artificial Intelligence. 38. 13. 2024, 14633–14641.
  11. [11] P. Li, A. A. Laghari, M. Rashid, J. Gao, T. R. Gadekallu, A. R. Javed, and S. Yin, (2022) “A deep multimodal adversarial cycle-consistent network for smart
    enterprise system” IEEE Transactions on Industrial Informatics 19(1): 693–702. DOI: 10.1109/TII.2022.3197201.
  12. [12] J. Gao, M. Liu, P. Li, J. Zhang, and Z. Chen, (2024) “Deep Multiview Adaptive Clustering With Semantic Invariance” IEEE Transactions on Neural Networks and Learning Systems 35(9): 12965–12978. DOI: 10.1109/TNNLS.2023.3265699.
  13. [13] P. Zhang, S. Wang, L. Li, C. Zhang, X. Liu, E. Zhu, Z. Liu, L. Zhou, and L. Luo. “Let the data choose: Flexible and diverse anchor graph fusion for scalable multi-view clustering”. In: Proceedings of the AAAI Conference on Artificial Intelligence. 37. 9. 2023, 11262–11269. DOI: 10.1609/aaai.v37i9.26333.
  14. [14] Y. Ren, J. Pu, C. Cui, Y. Zheng, X. Chen, X. Pu, and L. He. “Dynamic weighted graph fusion for deep multiview clustering”. In: Proceedings of the 33rd International Joint Conference on Artificial Intelligence. 2024, 4842–4850.
  15. [15] S.-Y. Li, Y. Jiang, and Z.-H. Zhou. “Partial multi-view clustering”. In: Proceedings of the AAAI conference on artificial intelligence. 28. 1. 2014. DOI: 10.1609/aaai.v28i1.8973.
  16. [16] H. Wang, L. Zong, B. Liu, Y. Yang, and W. Zhou. “Spectral perturbation meets incomplete multi-view data”. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 3677–3683.
  17. [17] C. Luo, J. Xu, Y. Ren, J. Ma, and X. Zhu. “Simple Contrastive Multi-View Clustering with Data-Level Fusion”. In: Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. 2024, 4697–4705.
  18. [18] X. Yang, J. Jiaqi, S. Wang, K. Liang, Y. Liu, Y. Wen, S. Liu, S. Zhou, X. Liu, and E. Zhu. “Dealmvc: Dual contrastive calibration for multi-view clustering”. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 337–346.
  19. [19] J. Chen, H. Mao, W. L. Woo, and X. Peng. “Deep multiview clustering by contrasting cluster assignments”. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023, 16752–16761.