Journal of Applied Science and Engineering

Published by Tamkang University Press


Impact Factor



Chen-Chiung Hsieh This email address is being protected from spambots. You need JavaScript enabled to view it.1, Dung-Hua Liou1 and Wei-Ru Lai2

1Department of Computer Science and Engineering, Tatung University, Taipei, Taiwan 104, R.O.C.
2Department of Communications Engineering, Yuan-Ze University, Chung-Li, Taiwan 320, R.O.C.


Received: August 20, 2010
Accepted: November 30, 2011
Publication Date: June 1, 2012

Download Citation: ||  


Man machine interface by video analysis becomes popular recently. The most frequently adopted body parts for computer interaction are face and hands. Therefore, it is a very important topic to accurately extract face and hand regions from a sequence of images in real time. In this paper, we propose an adaptive skin color model which is based on face detection. Skin colors were sampled from extracted face region where non-skin color pixels like eyebrow or eyeglasses could be excluded. Gaussian distributions of normalized RGB were then used to define the skin color model for the detected person. To demonstrate the robustness of proposed model, experiments under diversified lighting and background were tested. Traditional methods based on RGB, Normalized RGB, and YCbCr were all implemented for comparison. From experimental results, skin color pixels could be detected for each person. The accuracy rate is 95.73% on average and is superior to previously mentioned methods.

Keywords: Skin Color Detection, Adaptive Skin Color Detection, Face Detection, Hand Detection


  1. [1] Jaimes, A. and Sebe, N., “Multimodal Human-Computer Interaction: A Survey,” Computer Vision and Image Understanding, Vol. 108, pp. 116134 (2007).
  2. [2] Rigas, D. and Alsuraihi, M., “A Toolkit for Multimodal Interface Design: An Empirical Investigation,” Lecture Notes in Computer Science, Vol. 4552, pp. 196205 (2007).
  3. [3] Wright, J., Yang, A. Y., Ganesh, A., Sastry, S. S. and Yi, M., “Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, pp. 210227 (2009).
  4. [4] Chang, J. Y. and Chen, J. L., “Automated Facial Expression Recognition System Using Neural Networks,” Journal of the Chinese Institute of Engineers, Vol. 24, pp. 345356 (2001).
  5. [5] Mitra, S. and Acharya, T., “Gesture Recognition: A Survey,” IEEE Trans. on Systems, Man, and CyberneticsPART C: Applications and Reviews, Vol. 37, pp. 311324 (2007).
  6. [6] Lu, Z. M., Li, S. Z. and Burkhardt, H., “A ContentBased Image Retrieval Scheme in JPEG Compressed Domain,” International Journal of Innovative Computing, Information and Control, Vol. 2, pp. 831839 (2006).
  7. [7] Chen, F. S., Fu, C. M. and Huang, C. L., “Hand Gesture Recognition Using a Real-Time Tracking Method and Hidden Markov Models,” Image and Vision Computing, Vol. 21, pp. 745758 (2003).
  8. [8] Rao, V. S. and Mahanta, C., “Gesture Based Robot Control,” Proc. of the Fourth International Conference on Intelligent Sensing and Information Processing, pp. 145148 (2006).
  9. [9] Ouchi, K., Esaka, N., Tamura, Y. and Doi, M., “Magic Wand: An Intuitive Gesture Remote Control for Home Appliances,” Proc. of International Conference on Active Media Technology, p. 241 (2005).
  10. [10] Xie, W., Teoh, E. K., Venkateswarlu, R. and Chen, X., “Hand as Natural Man-Machine Interface in Smart Environments,” Proc. Signal Processing, Pattern Recognition, and Applications, pp. 117122 (2006).
  11. [11] Kakumanu, P., Makrogiannis, S. and Bourbakis, N., “A Survey of Skin-Color Modeling and Detection Methods,” Pattern Recognition, Vol. 40, pp. 1106 1122 (2007).
  12. [12] Vezhnevets, V., Sazonov, V. and Andreeva, A., “A Survey on Pixel-Based Skin Color Detection Techniques,” Proc. Graphicon-2003, September, Moscow, Russia, pp. 8592 (2003).
  13. [13] Soriano, M., Huovinen, S., Martinkauppi, B. and Laaksonen, M., “Using the Skin Locus to Cope with Changing Illumination Conditions in Color-Based Face Tracking,” Proc. of IEEE Nordic Signal Processing Symposium, pp. 383386 (2000).
  14. [14] Kovac, J., Peer, P. and Solina, F., “Human Skin Color Clustering for Face Detection,” International Conference on Computer as a Tool EUROCON 2003, Vol. 2, pp. 144148, Eds. B. Zajc, Ljubljana, Slovenia (2003).
  15. [15] Berbar, M. A., Kelash, H. M. and Kandeel, A. A., “Faces and Facial Features Detection in Color Images,” Geometric Modeling and Imaging--New Trends, 16-18 Aug., pp. 209214 (1993).
  16. [16] Singh, S. K., Chauhan, D. S., Vatsa, M. and Singh, R., “A Robust Skin Color Based Face Detection Algorithm,” Tamkang Journal of Science and Engineering, Vol. 6, pp. 227234 (2003).
  17. [17] Caetano, T. S., Olabarriaga, S. D. and Barone, D. A. C., “Do Mixture Models in Chromaticity Space Improve Skin Detection?” Pattern Recognition, Vol. 36, pp. 30193021 (2003).
  18. [18] Hassanpour, R., Shahbahrami, A. and Wong, S., “Adaptive Gaussian Mixture Model for Skin Color Segmentation,” Proc. of World Academy of Science, Engineering, and Technology, Vol. 31, ISSN 1307- 6884 (2008).
  19. [19] Soriano, M., MartinKauppi, J. B., Huovinen, S. and Lääksonen, M., “Adaptive Skin Color Modeling Using the Skin Locus for Selecting Training Pixels,” Pattern Recognition, Vol. 36, pp. 681690 (2003).
  20. [20] Sigal, L., Sclaroff, S. and Athitsos, V., “Skin ColorBased Video Segmentation under Time-Varying Illumination,” IEEE Trans. Pattern Anal. Mach. Intell., Vol. 26, pp. 862877 (2004).
  21. [21] Wimmer, M. and Radig, B., “Adaptive Skin Color Classificator,” Proc. of the first ICGST International Conference on Graphics, Vision and Image Processing GVIP-05, Cairo, Egypt, Dec. Vol. I, pp. 324327 (2005).
  22. [22] Viola, P. and Jones, M., “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2001, Vol. 1, pp. 511518 (2001).
  23. [23] Liao, W. H. and Chi, Y. H., “Estimation of Skin Color Range Using Achromatic Features,” Proc. of the Eighth International Conference on Intelligent Systems Design and Applications, Vol. 2, pp. 493497 (2008).
  24. [24] Lienhart, R. and Maydt, J., “An Extended Set of HaarLike Features for Rapid Object Detection,” Proc. of 2002 International Conference on Image Processing, Vol. 1, pp. 900903 (2002).



69th percentile
Powered by  Scopus

SCImago Journal & Country Rank

Enter your name and email below to receive latest published articles in Journal of Applied Science and Engineering.