{"id":6646,"date":"2026-08-16T22:25:49","date_gmt":"2026-08-16T14:25:49","guid":{"rendered":"\/jase\/?post_type=tkuisotope&p=6646"},"modified":"2026-08-23T16:38:07","modified_gmt":"2026-08-23T08:38:07","slug":"a-reading-assistant-system-based-on-restoring-warped-document-image","status":"publish","type":"tkuisotope","link":"\/jase\/?tkuisotope=a-reading-assistant-system-based-on-restoring-warped-document-image","title":{"rendered":"A Reading Assistant System Based on Restoring Warped Document Image"},"content":{"rendered":"\n
\n
\n

<\/i> 2018<\/a><\/p>\n<\/div>\n\n\n\n

\n

<\/i> Volume 21, Issue 3<\/a><\/p>\n<\/div>\n\n\n\n

\n
\n
\n
\n

Kuo-Ming Hung1<\/sup><\/i><\/a>, Chi-Hsiao Yih2<\/sup>, Cheng-Hsiang Yeh1<\/sup><\/p>\n\n\n\n

1<\/sup>Department of Information Management, Kainan University, Taoyuan, Taiwan 338, R.O.C<\/p>\n\n\n\n

2<\/sup>Department of Electrical and Computer Engineering, Tamkang University, Tamsui, Taiwan 251, R.O.C<\/p>\n<\/div>\n\n\n\n

\n

Received:\u00a0December 25, 2017
Accepted:\u00a0January 18, 2018
Publication Date:\u00a0August 16, 2018<\/p>\n<\/div>\n<\/div>\n\n\n\n

\"\u4e0a\u50b3\u5716\u7247\"\n\n\n

Flowchart of the proposed framework with Microsoft Kinect.<\/p>\n<\/div>\n<\/div>\n\n\n\n

<\/i> Copyright <\/strong>The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0)<\/a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.<\/p>\n\n\n\n

Download Citation:  BibTeX <\/a>| http:\/\/dx.doi.org\/10.6180\/jase.201809_21(3).0019<\/a>  <\/p>\n\n\n\n

Download PDF<\/a><\/p>\n\n\n\n

<\/div>\n\n\n\n

A novel reading assistant system for blind, visually impaired people or children is developed in this paper. The user can choose the region to be read and then receive output via text to speech. We design a helpful system that users can choose the area (on the book) they want to listen when reading and the device can also speak out the entire article. Besides, users can read without distance perception by using this system. The step to construct this system is according to the following: first, this system is used depth images to detect the coordinates of the user’s finger with Kinect, and the book is also input with Kinect. Next, we utilize text preprocessing to remove the border of the book and then take advantage of the common attribute of text height to eliminate images and tables. Beside, we also use a method to combine non-linear and linear compensation for correcting distortions of document images. Experimental results demonstrate that the proposed scheme has good performance and demonstrates robustness. It also provides an effective interactive platform.<\/p>\n\n\n\n

Keywords: Assistant System; Restoring Warped; Text Recognition; Kinect; Depth Image<\/em><\/p>\n\n\n\n

<\/div>\n\n\n\n
\n
    \n
  1. [1] WHO Report: Visual impairment and blindness (2014).<\/li>\n
  2. [2] Araki, M., Shibahara, K. and Mizukami, Y., “Spoken Dialogue System for Learning Braille,” 35th IEEE Annual Computer Software and Applications Conference, pp. 152-156 (2011). doi: 10.1109\/COMPSAC.2011.27<\/li>\n
  3. [3] Arshad, H., Khan, U. S. and Izhar, U., “MEMS Based Braille System,” 2015 IEEE 15th International Conference on Nanotechnology, pp. 1103-1106 (2015). doi: 10.1109\/NANO.2015.7388815<\/li>\n
  4. [4] Matsuda, Y., Isomura, T., Sakuma, I., Kobayashi, E., Jimbo, Y. and Arafune, T., “Finger Braille Teaching System for People who Communicate with Deafblind People,” Proceedings of the 2007 IEEE International Conference on Mechatronics and Automation, pp. 3202-3207 (2007). doi: 10.1109\/ICMA.2007.4304074<\/li>\n
  5. [5] Al-Shamma, S. D. and Fathi, S., “Arabic Braille Recognition and Transcription into Text and Voice,” 5th Cairo International Biomedical Engineering Conference Cairo, pp. 16-18 (2010). doi: 10.1109\/CIBEC.2010.5716095<\/li>\n
  6. [6] Abdul Malik, S. A. S., Ali, E. Z., Yousef, A. S., Khaled, A. H. and Abdul Aziz, O. A. Q., “An Efficient Braille Cells Recognition,” 6th International Conference on Wireless Communications Networking and Mobile Computing (WICOM), pp. 1-4 (2010). doi: 10.1109\/WICOM.2010.5601020<\/li>\n
  7. [7] Onur, K., “Braille-2 Otomatik Yorumlama Sistemi,” Signal Processing and Communications Applications Conference (SIU), pp. 1562-1565 (2015). doi: 10.1109\/SIU.2015.7130146<\/li>\n
  8. [8] Velazquez, R., Preza, E. and Hernandez, H., “Making eBooks Accessible to Blind Braille Readers,” IEEE International Workshop on Haptic Audio Visual Environments and Their Applications, pp. 25-29 (2008). doi: 10.1109\/HAVE.2008.4685293<\/li>\n
  9. [9] Rantala, J., Raisamo, R., Lylykangas, J., Surakka, V., Raisamo, J., Salminen, K., Pakkanen, T. and Hippula, A., “Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback,” IEEE Transactions on Haptics, Vol. 2, No. 1, pp. 28-39 (2009). doi: 10.1109\/TOH.2009.3<\/li>\n
  10. [10] Gaudissart, V., Ferreira, S., Thillou, C. and Gosselin, B., “Mobile Reading Assistant for Blind People,” Proceedings of European Signal Processing Conference, pp. 538-544 (2005).<\/li>\n
  11. [11] Neto, R. and Fonseca, N., “Camera Reading for Blind People,” Procedia Technology, Vol. 16, pp. 1200-1209 (2014). doi: 10.1016\/j.protcy.2014.10.135<\/li>\n
  12. [12] http:\/\/www.u-tran.com\/index.php, visited in May (2016).<\/li>\n
  13. [13] Noguchi, S. and Yamada, M., “Real-time 3D Page Tracking and Book Status Recognition for High-speed Book Digitization Based on Adaptive Capturing,” 2014 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 24-26 (2014).<\/li>\n
  14. [14] Stamatopoulos, N., Gatos, B. and Kesidis, A., “Automatic Borders Detection of Camera Document Images,” Int. Workshop Camera-Based Document Anal. Recognition Conf. (CDBAR), pp. 71-78 (2007).<\/li>\n
  15. [15] Gatos, B., Pratikakis, I. and Perantonis, S. J., “Adaptive Degraded Document Image Binarization,” Pattern Recognition, Vol. 39, pp. 317-327 (2006). doi: 10.1016\/j.patcog.2005.09.010<\/li>\n
  16. [16] Otsu, N., “A Threshold Selection Method from Gray-level Histogram,” IEEE Transactions on Systems, Man, and Cybernetics, Vol. 9, pp. 62-66 (1976). doi: 10.1109\/TSMC.1979.4310076<\/li>\n
  17. [17] Wahl, F. M., Wong, K. Y. and Casey, R. G., “Block Segmentation and Text Extraction in Mixed Text\/Image Documents”, Computer Graphics and Image Processing, Vol. 20, pp. 375-390 (1982). doi: 10.1016\/0146-664X(82)90059-4<\/li>\n
  18. [18] Chang, F., Chen, C. J. and Lu, C. J., “A Linear-time Component-labeling Algorithm Using Contour Tracing Technique,” Computer Vision and Image Understanding, Vol. 93, No. 2, pp. 206-220 (2004). doi: 10.1016\/j.cviu.2003.09.002<\/li>\n
  19. [19] Jiang, H., “Research on the Document Image Segmentation Based on the LDA Model,” Advances in Information Sciences and Service Sciences (AISS), Vol. 4, No. 3, pp. 12-18 (2012). doi: 10.4156\/aiss.vol4.issue3.2<\/li>\n
  20. [20] Xiaoying, Z., “Study on Document Image Segmentation Techniques Based on Improved Partial Differential Equations,” Journal of Convergence Information Technology (JCIT), Vol. 8, No. 5, pp. 821-831 (2013). doi: 10.4156\/jcit.vol8.issue5.96<\/li>\n
  21. [21] Stamatopoulos, N., Gatos, B., Pratikakis, I. and Perantonis, S. J., “Goal-oriented Rectification of Camera-based Document Images,” IEEE Trans. on Image Processing, Vol. 20, No. 4, pp. 910-920 (2011). doi: 10.1109\/TIP.2010.2080280<\/li>\n
  22. [22] Gao, Y., Ai, X., Rarity, J. and Dahnoun, N., “Obstacle Detection with 3D Camera Using U-V Disparity,” Proceedings of the 2011 7th International Workshop on Systems, Signal Processing and Their Applications (WOSSPA), pp. 239-242 (2011). doi: 10.1109\/WOSSPA.2011.5931462<\/li>\n
  23. [23] Huang, H. C., Hsieh, C. T. and Yeh, C. H., “An Indoor Obstacle Detection System Using Depth Information,” Sensors (Basel), Vol. 15, No. 10, pp. 27116-27141 (2015). doi: 10.3390\/s151027116<\/li>\n
  24. [24] Hsieh, C. T., Lee, S. C. and Yeh, C. H., “Restoring Warped Document Image Based on Text Line Correction,” 2013 9th International Conference on Computing Technology and Information Management (ICCM 2013), Vol. 14, pp. 459-464 (2013).<\/li>\n
  25. [25] Hsieh, C. T., Yeh, C. H., Liu, T. T. and Huang, K. C., “Non-visual Document Recognition for Blind Reading Assistant System,” 2013 9th International Conference on Computing Technology and Information Management (ICCM 2013), Vol. 14, pp. 453-458 (2013).<\/li>\n
  26. [26] Tesseract: https:\/\/github.com\/tesseract-ocr, visited in May (2016).<\/li>\n
  27. [27] Text-to-speech: http:\/\/msdn.microsoft.com\/en-us\/library\/ms720163.aspx, visited in May (2016).<\/li>\n<\/ol>\n<\/div>\n\n\n\n

    <\/p>\n","protected":false},"author":3,"template":"wp-custom-template-detail-4-aricles","meta":{"_uag_custom_page_level_css":""},"categories":[1361,6,1364],"tags":[1416],"acf":[],"uagb_featured_image_src":[],"uagb_author_info":{"display_name":"\u6797\u923a\u6db5","author_link":"\/jase\/?author=3"},"uagb_comment_info":0,"uagb_excerpt":" Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited. Download Citation:  BibTeX | http:\/\/dx.doi.org\/10.6180\/jase.201809_21(3).0019   Download PDF A novel reading assistant system for blind, visually impaired people or…","_links":{"self":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope\/6646"}],"collection":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope"}],"about":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/types\/tkuisotope"}],"author":[{"embeddable":true,"href":"\/jase\/index.php?rest_route=\/wp\/v2\/users\/3"}],"wp:attachment":[{"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6646"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6646"},{"taxonomy":"post_tag","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6646"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}