Ching-Yi Chen This email address is being protected from spambots. You need JavaScript enabled to view it.1, Ching-Han Chen2 and Hsiao-Ping Ho2

1Department of Information and Telecommunications Engineering, Ming Chuan University, Taoyuan, Taiwan, R.O.C.
2Department of Computer Science and Information Engineering, National Central University, Taoyuan, Taiwan 320, R.O.C.


Received: February 27, 2013
Accepted: June 28, 2013
Publication Date: September 1, 2013

Download Citation: ||  


This paper proposes a new structure for applying to real-time evolutionary face tracking of the streaming images. In the described method, first we use the features such as skin color models and facial proportions to extract the face region and complete the pre-processing, and then track the moving face location with particle swarm optimization algorithm. The experimental results show that the face detection method which we have developed has a higher detection rate and complex backgrounds tolerance than the traditional Viola-Jones detector. Compared to the method of searching the face region in the whole image with the streaming image sequences one by one, the execution effect of searching the face region in the key region images by using the method of evolutionary face tracking system based on particle swarm optimization algorithm has a fast execution speed and better accuracy. Furthermore, in order to achieve the goal of real-time processing, we also complete the software design and verify with the personal computer as well as Nios II embedded processor-based FPGA platform, and analyze the efficiencies of various modules to find the functional module of efficiency bottleneck for the further implementation of a hardware architecture, to improve the overall efficiency of the system through a hardware/software co-design. Experimental results demonstrate that the proposed structure is efficient and robust in face tracking under dynamic environments with real-time performance.

Keywords: Face Tracking, Particle Swarm Optimization, FPGA Platform, Hardware/Software Co-Design


  1. [1] Yang, M. H., Kriegman, D. J. and Ahuja, N., “Detecting Faces in Images: A Survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, pp. 34 58 (2002). doi: 10.1109/34.982883
  2. [2] Berbar, M. A., Kelash, H. M. and Kandeel, A. A., “Faces and Facial Features Detection in Color Images,” Proceedings of the Geometric Modeling and Imaging--New Trends, pp. 209 214 (2006). doi: 10. 1109/GMAI.2006.18
  3. [3] Tabatabaie, Z. S., Rahmat, R. W., Udzir, N. I. B. and Kheirkhah, E., “A Hybrid Face Detection System Using Combination of Appearance-Based and FeatureBased Methods,” International Journal of Computer Science and Network Security, Vol. 9, No. 5, pp. 181 185 (2009).
  4. [4] Yun, J. U., Lee, H. J., Paul, A. K. and Baek, J. H., “Face Detection for Video Summary Using Illumination-Compensation and Morphological Processing,” Pattern Recognition Letters, Vol. 30, No. 9, pp. 856 860 (2009). doi: 10.1016/j.patrec.2009.04.010
  5. [5] Phung, S. L., Bouzerdoum, A. and Chai, D., “Skin Segmentation Using Color Pixel Classification: Analysis and Comparison,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, No. 1, pp. 148 154 (2005). doi: 10.1109/TPAMI.2005.17
  6. [6] Dokladal, P., Enficiaud, R. and Dejnozkova, E., “Contour-Based Object Tracking with Gradient-Based Contour Attraction Field,” IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 17 20 (2004). doi: 10.1109/ICASSP.2004.1326470
  7. [7] Sun, Y. B., Kim, J. T. and Lee, W. H., “Extraction of Face Objects Using Skin Color Information,” IEEE International Conference on Communications, Circuits and Systems and West Sino Expositions, pp. 1136 1140 (2002). doi: 10.1109/ICCCAS.2002. 1178985
  8. [8] Qian, R. J., Sezan, M. I. and Matthews, K. E., “A Robust Realtime Face Tracking Algorithm,” IEEE International Conference on Image Processing, pp. 131 135(1998). doi: 10.1109/ICIP.1998.723443
  9. [9] Juang, C. F. and Chang, S. W., “Fuzzy System-Based Real-Time Face Tracking in a Multi-Subject Environment with a Pan-Tilt-Zoom Camera,” Expert Systems with Applications, Vol. 37, No. 6, pp. 4526 4536 (2010). doi: 10.1016/j.eswa.2009.12.057
  10. [10] Vadakkepat, P., Lim, P., Silva, L. C. D., Jing, L. and Ling, L. L., “Multi-Modal Approach to Human Face Detection and Tracking,” IEEE Transactions on Industrial Electronics, Vol. 55, No. 3, pp. 1385 1393 (2008). doi: 10.1109/TIE.2007.903993
  11. [11] Kennedy, J. and Eberhart, R., “Particle Swarm Optimization,” Proceedings of IEEE International Conference on Neural Networks, Perth, Australia, pp. 1942 1948 (1995). doi: 10.1109/ICNN.1995.488968
  12. [12] Lee, D. R., Jin, S. H., Thien, P. C. and Jeon, J. W., “FPGA Based Connected Component Labeling,” International Conference on Control, Automation and Systems, pp. 2313 2317 (2007). doi: 10.1109/ICCAS. 2007.4406746
  13. [13] Jin, Z., Lou, Z., Yang, J. and Sun, Q., “Face Detection Using Template Matching and Skin-Color Information,” Neurocomputing, Vol. 70, No. 4 6, pp. 794 800 (2007). doi: 10.1016/j.neucom.2006.10.043
  14. [14] Chen, C. H., Kuo, C. M., Chen, C. Y. and Dai, J. H., “The Design and Synthesis Using Hierarchical Robotic Discrete-Event Modeling,” Journal of Vibration and Control (2012). doi: 10.1177/1077546312449645
  15. [15] Adhangale, V. and Daruwala, R. D., “Design and Implementation of Soft Core Processor on FPGA Based on Avalon Bus and SOPC Technology,” International Journal of Computer Applications, Vol. 63, No. 16, pp. 5 10 (2013). doi: 10.5120/10548-4956
  16. [16] Viola, P. and Jones, M. J., “Robust Real-Time Face Detection,” International Journal of Computer Vision, Vol. 57, No. 2, pp. 137 154 (2004). doi: 10.1023/B: VISI.0000013087.49260.fb


42nd percentile
Powered by  Scopus

SCImago Journal & Country Rank

Enter your name and email below to receive latest published articles in Journal of Applied Science and Engineering.