Hybrid Stages Particle Swarm Optimization Learning Fuzzy Modeling Systems Design

Hsuan-Ming Feng

doi:10.6180/jase.2006.9.2.11

Hybrid Stages Particle Swarm Optimization Learning Fuzzy Modeling Systems Design

Computer Science and Information Engineering

Hsuan-Ming Feng This email address is being protected from spambots. You need JavaScript enabled to view it.¹

¹Department of Management Information, National Kinmen Institute of Technology, Kinmen, Taiwan 892, R.O.C.

Received: May 30, 2005
Accepted: November 29, 2005
Publication Date: June 1, 2006

Download Citation: ||https://doi.org/10.6180/jase.2006.9.2.11

ABSTRACT

An innovative hybrid stages particle swarm optimization (HSPSO) learning method, contains fuzzy c-mean (FCM) clustering, particle swarm optimization (PSO) and recursive least-squares, is developed to generate evolutional fuzzy modeling systems to approach three different nonlinear functions. In spite of the adaptive ability of PSO algorithm, its training result is not desirable for the reason of incomplete learning cycles. To actually approximate the desired output of the nonlinear function, the input-output training data is first clustered by FCM algorithm, and then some favorable features of training data will be got as initial population of the PSO. Finally, both recursive least squares and PSO are utilized to quickly regulate adjustable parameters to construct desired fuzzy modeling systems. After the procedure of the FCM, small initial swarms of PSO are not got by random process but direct selected from training patterns. Therefore, the proposed HSPSO-based fuzzy modeling system with small numbers of fuzzy rules and necessary initial population sizes is enough to approach high accuracy within a short training time. Simulation results compared with the standard PSO and other popular methods demonstrate the efficiency of the proposed fuzzy model systems.

Keywords: Fuzzy c-mean, Particle Swarm Optimization, Recursive Least-squares, Fuzzy Modeling Systems

REFERENCES

[1] Dickson, J. A. and Kosko, B., “Fuzzy Function Approximation with Ellipsoidal Rules,” IEEE Trans. Systems, Man and Cybernetics, Vol. 26, pp. 542560, (1996).
[2] Delgado, M., Gomez-Skarmeta, A. F. and Martin, F. A., “Fuzzy Clustering-based Rapid Prototyping for Fuzzy Rule-based Modeling,” IEEE Trans. on Fuzzy Systems, Vol. 5, pp. 223232 (1997).
[3] Thawonmas, R. and Abe, S., “Function Approximation Based on Fuzzy Rules Extracted from Partitioned Numerical Data,” IEEE Trans. Systems, Man and Cybernetics, Vol. 29, pp. 525534 (1999).
[4] Wong, C.-C. and Chen, C.-C., “A Hybrid Clustering and Gradient Descent Approach for Fuzzy Modeling,” IEEE Trans. Systems, Man and Cybernetics, Vol. 29, pp. 686693 (1999).
[5] Wong, C.-C. and Chen, C.-C., “A GA-based Method for Constructing Fuzzy Systems Directly from Numerical Data,” IEEE Trans. Systems, Man and Cybernetics, Vol. 30, pp. 905911 (2000).
[6] Kukolj, D., “Design of Adaptive Takagi-Sugeno-Kang Fuzzy Models,” Applied Soft Computing, Vol. 2, pp. 89103 (2002).
[7] Wang, W.-Y. and Li, W.-H., “Evolutionary Learning of BMF Fuzzy-neural Networks Using a Reduced-form Genetic Algorithm,” IEEE Trans. Systems, Man and Cybernetics, Vol. 33, No. 6, pp. 966976 (2003).
[8] Bezdek, J. C., Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, N.Y., U.S.A. (1981).
[9] Cannon, R. L., Daveand, J. V. and Bezedek, J. C. “Efficient Implementation of the Fuzzy c-mean Clustering Algorithms,” IEEE Trans. Pattern Anal. Machine Intelligence, Vol. 8, pp. 248255 (1986).
[10] Kennedy, J. and Eberhart, R. C., “Particle Swarm Optimization,” in Proc. IEEE Int. Conf. Neural Networks, pp. 19421948, (1995)
[11] Kennedy, J., “The Particle Swarm: Social Adaptation of Knowledge,” in Proc. 1997 Int. Conf. Evolutionary Computation, Indianapolis, pp. 303308 (1997).
[12] Clerc, M. and Kennedy, J., “The Particle Swarm Explosion, Stability, and Sonvergence in a Multidimensional Complex Space,” IEEE Trans. on Evolutionary Computation, Vol. 6, pp. 5873 (2002).
[13] Naka, S., Genji, T., Yura, T. and Fukuyama, Y., “A Hybrid Particle Swarm Optimization for Distribution State Estimation,” IEEE Trans. on Power Systems, Vol. 18, pp. 6068 (2003).
[14] Juang, C.-F., “A Hybrid of Genetic Algorithm and Particle Swarm Optimization for Recurrent Network Design,” IEEE Trans. Systems, Man and Cybernetics, Vol. 34, pp. 9971006 (2003).
[15] Robinson, J. and Rahmat-Samii, Y., “Particle Swarm Optimization in Electromagnetics,” IEEE Trans. on Antennas and Propagation, Vol. 52, No. 2, pp. 397 407 (2004).
[16] Feng, H. M. “Self Generation Fuzzy Modeling Systems Through Hierarchical Recursive-based Particle Swarm Optimization,” Cybernetics and Systems: An International Journal, Vol. 36, pp. 623639 (2005).
[17] Feng, H.-M., “A Self-Tuning Fuzzy Control System Design,” 9th IFSA World Congress and 20th NAFIPS International Conference, Vancouver, pp. 209214, 2528 (2001).
[18] Wang, L. X., A Course in Fuzzy Systems and Control, NJ: Prentice Hall, Inc., Englewood Cliffs, NJ, U.S.A. (1997).
[19] Lee, S.-J. and Ouyang, C.-H., “A Neuro-fuzzy System Modeling with Self-constructing Rule Generation and Hybrid SVD-based Learning,” IEEE Trans. on Fuzzy Systems, Vol. 11, pp. 341353 (2004).
[20] Jang, J-S. R., Sun, C.-T. and Mizutani, E., Neuralfuzzy and soft computing, Prentice Hall, Inc. NJ, U.S.A. (1997).
[21] Wong, C. C. and Chen, C. C., “A clustering-based method for fuzzy modeling,” IEICE Trans. on Information and Systems, Vol. E82-D, pp. 10581065 (1999).