Yin-Tien Wang This email address is being protected from spambots. You need JavaScript enabled to view it.1 and Chia-Hsing Chen1

1Department of Mechanical and Electro-Mechanical Engineering, Tamkang University, Tamsui, Taiwan 251, R.O.C.


 

Received: June 30, 2007
Accepted: July 17, 2008
Publication Date: December 1, 2008

Download Citation: ||https://doi.org/10.6180/jase.2008.11.4.11  


ABSTRACT


In a small-size robot soccer game, the game strategy is implemented by two major procedures, namely, Role Selection Mechanism (RSM) and Action Select Mechanism (ASM). In role-select procedure, a formation is planned for the soccer team and a role is assigned to each individual robot. In action-select procedure, each robot executes an action provided by an action selection mechanism to fulfill its role-playing. The RSM was often designed efficiently by using the geometry approach. However, the ASM developed based on geometry approach will become a very complex procedure. In this paper, a novel ASM for soccer robots is proposed by using the concepts of artificial immune network (AIN). This AIN-based ASM provides an efficient and robust algorithm for robot role select. Meanwhile, a reinforcement learning mechanism is applied in the proposed ASM to enhance the response of the adaptive immune system. Simulation and experiment are carried out in this paper to verify the proposed AIN-based ASM and the results show that the proposed algorithm provide an efficient and applicable algorithm for mobile robots to play soccer game.


Keywords: Action Select Mechanism (ASM), Artificial Immune Network (AIN), Soccer Robot, Reinforcement Learning


REFERENCES


  1. [1] Sethi, I. K., “Entropy Nets: From Decision Trees to Neural Networks,” P. IEEE, pp.16051613 (1990).
  2. [2] Liang, C.-C., “Development of A Multiple-SoccerRobot System,” Ph.D. Dissertation, Department of Mechanical Engineering, National Taiwan University, Taiwan (2000).
  3. [3] Liu, C.-H., “Tactic Design and Formation Control for 5-on-5 Soccer Robot Systems,” (in Chinese) Master Thesis, Department of Mechanical and Electrical Engineering, Tamkang University, Taiwan (2003).
  4. [4] Tsou, T.-Y., Liu, C.-H. and Wang, Y.-T., “Team Formation Control for Soccer Robot Systems,” Proc. IEEE International Conference on Networking, Sensing, and Control (2004).
  5. [5] Roitt, I., Brostoff, J. and Male, D., Immunology, Mosby International Ltd (1998).
  6. [6] Jerne, N. K., “The Immune System,” Sci. Am., Vol. 229, pp. 5260 (1973). 
  7. [7] Farmer, J. D., Packard, N. H. and Perelson, A. S., “The Immune System, Adaptation, and Machine Learning,” Physica D, Vol. 22, pp. 187204 (1986).
  8. [8] Sanchis, A., Isasi, P., Molina, J. M. and Segovia, J., “Applying Classifier Systems to Learn the Reactions in Mobile Robots,” Int. J. Syst. Sci., Vol. 32, pp. 237258 (2001).
  9. [9] de Castro, L. N. and Von Zuben, F. J., “Learning and Optimization Using the Clonal Selection Principle,” IEEE T. Evolut. Comput., Vol. 6, pp. 239251 (2002).
  10. [10] Luh, G.-C. and Cheng, W.-C., “Behavior-Based Intelligent Mobile Robot using An Immunized Reinforcement Adaptive Learning Mechanism,” Adv. Eng. Inform., Vol. 16, pp. 8598 (2002).
  11. [11] FIRA, http://www.fira.net.
  12. [12] Bowling, M. and Veloso, M., “Motion Control in Dynamic Multi-Robot Environments,” Proc. IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp. 168273 (1999).