Journal of Applied Science and Engineering

Published by Tamkang University Press

1.30

Impact Factor

1.60

CiteScore

G. Balakrishnan This email address is being protected from spambots. You need JavaScript enabled to view it.1, G. Sainarayanan1 , R. Nagarajan2 and Sazali Yaacob2

1AI Research Group, School of Engineering and Information Technology, Universiti Malaysia Sabah, Locked Bag No. 2073, 88999, Kota Kinabalu, Malaysia
2School of Mechatronics, Northern Malaysia University College of Engineering, 01000 Kangar, Perlis, Malaysia


 

Received: September 12, 2005
Accepted: June 22, 2006
Publication Date: March 1, 2007

Download Citation: ||https://doi.org/10.6180/jase.2007.10.1.08  


ABSTRACT


Visually impaired find their navigation difficult as they often lack the needed information for bypassing obstacles and hazards. Electronic Travel Aids (ETAs) are devices that use sensor technology to assist and improve the blind user’s mobility in terms of safety and speed. Modern ETAs does not provide distance information directly and clearly. This paper proposes a method for determining distance using a stereo matching method to help blind individuals for their navigation. The system developed in this work, named Stereo Vision based Electronic Travel Aid (SVETA), consists of a computing device, stereo cameras and stereo earphones, all molded in a helmet. An improved area based stereo matching is performed over the transformed images to calculate dense disparity image. Low texture filter and left/right consistency check are carried out to remove the noises and to highlight the obstacles. A sonification procedure is proposed to map the disparity image to stereo musical sound, which has information about the features of the scene infront of the user. The sound is conveyed to the blind user through stereo headphones. Experimentations have been conducted and preliminary investigations have proven the viability of this method for applying in real time environment.


Keywords: Stereo Matching, Electronic Travel Aid, Disparity, Stereo Vision, Sonification


REFERENCES


  1. [1] World Health Organization, webpage: http://www. who.int//mipfiles/2400/AllenFoster.pdf
  2. [2] Wong, F., Nagarajan, R., Yaacob, S. and Chekima, A., “Electronic Travel Aids for Visually Impaired  A Guided Tour,” Proceedings of Conference in Engineering in Sarawak, pp. 377382 (2000).
  3. [3] Kay, L., “An Ultrasonic Sensing Probe as a Mobility Aid for the Blind,” Ultrasonics, Vol. 2, pp. 5359 (1964).
  4. [4] Pressey, N., “Mowat Sensor,” Focus 3, pp. 3539 (1977).
  5. [5] Meijer, P., “An Experimental System for Auditory Image Representations,” IEEE Transactions on Biomedical Engineering, Vol. 39, pp. 112121 (1991).
  6. [6] Sainarayanan, G., “On Intelligent Image Processing Methodologies Applied to Navigation Assistance for Visually Impaired,” Ph. D. Thesis, University Malaysia Sabah (2002).
  7. [7] Capp, M. and Picton, P., “The Optophone: An Electronic Blind Aid,” Engineering Science and Education Journal, Vol. 9, pp. 137143(2000).
  8. [8] Zelek, J., Bromley, S., Aamar, D. and Thompson, D., “A Haptic Glove as a Tactile Vision Sensory Substitution for Way Finding,” Journal of Visual Impairment and Blindness, pp. 621632 (2003).
  9. [9] Kawai, Y. and Tomita, F., “A Support System for Visually Impaired Persons to Understand Three-Dimensional Visual Information Using Acoustic Interface,” IEEE 16th Conference on Pattern Recognition, Vol. 3, pp. 974977 (2002).
  10. [10] Brown, Z. and Hager, D., “Advances in Computational Stereo,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 25, pp. 9931008 (2003).
  11. [11] Dhond, U. R. and Aggarwal, J. K., “Structure from Stereo,” IEEE Transaction on Systems, Man and Cybernatics, Vol. 19, pp. 14891510 (1989).
  12. [12] “Camera Calibration”, webpage: http://www.vision. caltech.edu/bouguetj/calib_doc/
  13. [13] Hirschmüller, H., Innocent, P. R. and Garibaldi, J. M., “Real Time Correlation Based Stereo Vision with Reduced Border Errors,” International Journal of Computer Vision, Vol. 47, pp. 229246 (2002).
  14. [14] Fusiello, A., Roberto, V. and Trucco, E., “Efficient Stereo with Multiple Windowing,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 858863 (1997).
  15. [15] Elliott, R., Fundamentals of Music, New Jersey: Prentice-Hall (1971).