Design and Implementation of Real-Time Tracking System Based on Vision Servo Control

Ying-Shing Shiao

doi:10.6180/jase.2001.4.1.05

Design and Implementation of Real-Time Tracking System Based on Vision Servo Control

Electrical Engineering

Ying-Shing Shiao¹

¹Institute of Electrical Engineering National Chung-hua University of Education Chung-hua, Taiwan, R.O.C.

Received: January 5, 2001
Accepted: March 20, 2001
Publication Date: March 20, 2001

Download Citation: ||https://doi.org/10.6180/jase.2001.4.1.05

ABSTRACT

This paper presents an adaptive sensing system with visual feedback control, which can detect and track the moving target. The proposal algorithm based on subtraction, projection and correlation operation from a series of sequential images can estimate the motion vectors to control the pan and tilt servo motors which drive the charge coupled device (CCD) camera to track the moving target in real-time. Shift and logic AND operation are used to obtain the size and center position of target. A vision-guided machinery is implemented for demonstration in which the experimental results show that the proposed algorithm is valid to recognize numerous kinds of moving objects.

Keywords: Vision Tracking, Image Processing, Cross-Correlation, Real-Time

REFERENCES

[1] Bradshaw, K. J., Reid, I. D. and Murray, D. W. “The active recovery of 3D motion trajectories and their use in prediction” IEEE Transactions on Pattern Analysis and Machine Intelligence, l9(3), pp. 219 – 234 (1997).
[2] Chaudhury, K. and Mehrotra, R. “A trajectory-based computational model for optical flow estimation”, IEEE Transactions on Robotics and Automation, 11(5), pp. 733 – 742 (1995).
[3] Corke, P. I. and Hutchinson, S. A. “Real-time vision, tracking and control”, Proceeding of the 2000 IEEE International Conference on Robotics & Automation, San Francisco, CA, U.S.A. (2000).
[4] Feddema, J. and Mitchell, O. “Vision-guided servoing with feature-based trajectory generation”, IEEE Transactions on Robotics and Automation, 5, pp. 691 – 700 (1989).
[5] Hwang, J., Ooi, Y. and Ozawa, S. “An advanced on-line video tracking system”, International Conference on Industrial Electronics, Control, and Instrumentation, Maui, HI, U.S.A. (1993).
[6] Koivo, A. J. and Houshangi, N. “Real-time vision feedback for servoing robotic manipulator with self-tuning controller”, IEEE Transactions on Systems, Man and Cybernetics, 21(1), pp. 134 – 142 (1991).
[7] Leese, J. A., Novak, C. S. and Taylor, V. R. “The determination of cloud pattern motions from geosynchronous satellite image data”, Pattern Recognition, 2, pp. 279 – 292 (1970).
[8] Mukundan, R. and Ramakrishnan, K. R. “Moment Function in Image Analysis, Theory and Applications”, World Scientific, New Jersey, U.S.A., pp. 113 – 124 (1998).
[9] Papanikolopoulos, N. P., Nelson, B. J. and Khosla, P. K. “Six degree-of-freedom hand/eye visual tracking with uncertain parameters”, IEEE Transactions on Robotics and Automation, 11(5), pp. 725 – 732 (1995).
[10]Papanikolopoulos, N. P. and Khosla, P. K. “Adaptive robot visual tracking”, IEEE Transactions on Automatic Control, 38(3), pp. 429 – 445 (1993).
[11]Papanikolopoulos, N. P., Khosla, P. K. and Kanade, T. “Visual tracking of a moving target by a camera mounted on a robot: a combination of vision and control”, IEEE Transactions on Robotics and Automation, 9(1), pp. 14 – 35 (1993).
[12]Shu, C. F. and Jain, R. C. “Vector field analysis for oriented patterns”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(9), pp. 946 – 950 (1994).
[13]Tsai, R. Y. and Lenz, R. K. “A new technique for fully autonomous and efficient 3D robotics hand/eye calibration”, IEEE Transactions on Robotics and Automation, 5(3), pp. 345 – 358 (1989).
[14]Tu, H., Chen, C. H., Chen, C. Y. and Fu, L. C. “A System for 3-D Target Trajectory Detection via Stereo Visual Tracking”, Technical Report of Department of Electrical Engineering, National Taiwan University, Taipei, R.O.C. (1997).
[15]Wang, C.C. “Extrinsic calibration of a vision sensor mounted on a robot”, IEEE transactions on Robotics and Automation, 8(2), pp. 161 – 175 (1992).
[16]Wang, C. M. “Moving Target Detection on a Multi-microprocessor System for Image Processing”, M. S. Thesis. Institute of Computer Engineering, National Chiao Tung University, Hsin-chu, R.O.C. (1982).
[17]Westmore, D. B. and Wilson, W. J. “Direct dynamic control of a robot using an end-point mounted camera and Kalman filter position estimation”, IEEE International Conference on Robotics & Automation, pp. 2376 – 2384 (1991).
[18]Yen, H. C. “Moving Target Tracking on a Multi-microprocessor System for Image Processing“, M. S. Thesis. Institute of Computer Engineering, National Chiao Tung University, Hsin-chu, R.O.C. (1982).