{"id":4171,"date":"2026-05-01T00:11:32","date_gmt":"2026-04-30T16:11:32","guid":{"rendered":"\/jase\/?post_type=tkuisotope&p=4171"},"modified":"2026-06-17T23:00:36","modified_gmt":"2026-06-17T15:00:36","slug":"web-scraping-tool-for-newspapers-and-images-data-using-jsonify","status":"publish","type":"tkuisotope","link":"\/jase\/?tkuisotope=web-scraping-tool-for-newspapers-and-images-data-using-jsonify","title":{"rendered":"Web Scraping tool for Newspapers and Images data using jsonify"},"content":{"rendered":"\n
\n
\n

<\/i> 2023<\/a><\/p>\n<\/div>\n\n\n\n

\n

<\/i> Volume 26, Issue 4<\/a><\/p>\n<\/div>\n\n\n\n

\n
\n
\n
\n

Qingli Niu1<\/sup>, Irfan Ali Kandhro2<\/sup>, Anil Kumar2<\/sup>, Shahnawaz shah3<\/sup>, Muhammad Hasan2<\/sup>, Hifza
Mehfooz Ahmed2<\/sup>, and Fei Liang1<\/sup><\/i><\/a><\/p>\n\n\n\n

1<\/sup>College of Information Engineering, Zhengzhou University of Science & Technology, Zhengzhou 450064, China<\/p>\n\n\n\n

2<\/sup>Department of Computer Science, Sindh Madressatul Islam University, Karachi, Pakistan<\/p>\n\n\n\n

3<\/sup>Department of telecommunication engineering, University of Sindh Jamshoro, Pakistan<\/p>\n<\/div>\n\n\n\n

\n

Received:\u00a0February 28, 2022
Accepted:\u00a0May 8, 2022
Publication Date:\u00a0May 1, 2026<\/p>\n<\/div>\n<\/div>\n\n\n\n

\"\u4e0a\u50b3\u5716\u7247\"\n\n\n

Web scraping VS Web Crawler<\/p>\n<\/div>\n<\/div>\n\n\n\n

<\/i> Copyright <\/strong>The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0)<\/a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.<\/p>\n\n\n\n

Download Citation:  BibTeX <\/a>| http:\/\/dx.doi.org\/10.6180\/jase.202304_26(4).0002<\/a>  <\/p>\n\n\n\n

Download PDF<\/a><\/p>\n\n\n\n

<\/div>\n\n\n\n

Web scraping is the process of extracting data from a website in an efficient and fast way. In such a scenario, python programming can offer useful set of methods that help web editors to improve the quality of the provided service. This scraper contains three steps 1) to understand the structure of web page, 2) design regular expression pattern and finally use that pattern to get certain data. In this paper, we also used Flask, Request, JSONify library to get the data, after processing, the data is transformed into the JSON form and ready for CSV with help of API. After generated all required regex patterns, the system uses these patterns as a set of rules, and with this, designed scraper tool works efficiently, and achieved outstanding results with help of support libraries to storing and extracting the news and web-based information. The proposed Web scraping tool eliminates the time and effort of manually collecting or copying data by automating the process. It is found that this designed scraper is easy and direct approach to extract the newspapers, websites, blogs, and images data.<\/p>\n\n\n\n

Keywords:\u00a0web scraping, extracting, retrieving, Python framework, API, manually collecting data.<\/em><\/p>\n\n\n\n

<\/div>\n\n\n\n
\n
    \n
  1. [1] V. Draxl. \u201cWeb Scraping Data Extraction from websites”. University of Applied Sciences Technikum Wien, 2018.<\/li>\n
  2. [2] B. Manjushree and G. Sharvani, (2020) \u201cSurvey on Web scraping technology” Wutan Huatan Jisuan Jishu 16: 1\u20138.<\/li>\n
  3. [3] L. Junjoewong, S. Sangnapachai, and T. Sunetnanta. \u201cProCircle: A promotion platform using crowdsourcing and web data scraping technique\u201d. In: 2018 Seventh ICT International Student Project Conference (ICTISPC). IEEE. 2018, 1\u20135.<\/li>\n
  4. [4] A. V. Saurkar, K. G. Pathare, and S. A. Gode, (2018) \u201cAn overview on web scraping techniques and tools” International Journal on Future Revolution in Computer Science & Communication Engineering 4(4): 363\u2013367.<\/li>\n
  5. [5] M. El Asikri, S. Krit, and H. Chaib, (2020) \u201cUsing Web Scraping In A Knowledge Environment To Build Ontologies Using Python And Scrapy” European Journal of Molecular & Clinical Medicine 7(03): 2020.<\/li>\n
  6. [6] E. Gallagher, (2018) \u201cScraping Websites for Law Enforcement” School of Computing, Engineering & Intelligent Systems, Computer Science:<\/li>\n
  7. [7] A. Tarango. \u201c307 ChopShop Senior Design Web Scraper”. (phdthesis). University of Wyoming.<\/li>\n
  8. [8] K. Parikh, D. Singh, D. Yadav, and M. Rathod, (2018) \u201cDetection of web scraping using machine learning” Open access international journal of Science and Engineering: 114\u2013118.<\/li>\n
  9. [9] R. Landers, R. Brusso, K. Cavanaugh, and A. Collmus, (2016) \u201cA primer on theory-driven web scraping: Automatic extraction of big data from the internet for use in psychological research” Psychological Methods 21(4): 475\u2013492. DOI: 10.1037\/met0000081.<\/li>\n
  10. [10] B. Ujwal, B. Gaind, A. Kundu, A. Holla, and M. Rungta. \u201cClassification-based adaptive web scraper\u201d. In: 2017-December. cited By 10. 2017, 125\u2013132. DOI: 10.1109\/ICMLA.2017.0-168.<\/li>\n
  11. [11] B. G. Dastidar, D. Banerjee, and S. Sengupta, (2016) \u201cAn intelligent survey of personalized information retrieval using web scraper” International Journal of Education and Management Engineering 6(5): 24\u201331.<\/li>\n
  12. [12] O. Lloyd and C. Nilsson. How to Build a Web Scraper for Social Media. 2019.<\/li>\n
  13. [13] S. Han and C. Anderson, (2021) \u201cWeb Scraping for Hospitality Research: Overview, Opportunities, and Implications” Cornell Hospitality Quarterly 62(1): 89\u2013104. DOI: 10.1177\/1938965520973587.<\/li>\n
  14. [14] W. Liu, X. Meng, and W. Meng, (2010) \u201cViDE: A visionbased approach for deep web data extraction” IEEE Transactions on Knowledge and Data Engineering 22(3): 447\u2013460. DOI: 10.1109\/TKDE.2009.109.<\/li>\n
  15. [15] K. Clark and A. Evert, (2019) \u201cBuilding an Alternative Web Scraper for Big Data Analytics”:<\/li>\n
  16. [16] International Data Corporation.<\/li>\n
  17. [17] S. Chasins, M. Mueller, and R. Bodik. \u201cRousillon: Scraping distributed hierarchical web data\u201d. In: cited By 35. 2018, 963\u2013975. DOI: 10.1145\/3242587.3242661.<\/li>\n
  18. [18] R. Chaulagain, S. Pandey, S. Basnet, and S. Shakya. \u201cCloud Based Web Scraping for Big Data Applications\u201d. In: cited By 23. 2017, 138\u2013143. DOI: 10.1109\/SmartCloud.2017.28.<\/li>\n
  19. [19] N. R. Haddaway et al., (2015) \u201cThe use of web-scraping software in searching for grey literature” Grey J 11(3): 186\u201390.<\/li>\n
  20. [20] V. Singrodia, A. Mitra, and S. Paul. \u201cA Review on Web Scrapping and its Applications\u201d. In: cited By 11. 2019. DOI: 10.1109\/ICCCI.2019.8821809.<\/li>\n
  21. [21] K. Weedman, (2002) \u201cOn the spur of the moment: Effects of age and experience on hafted stone scraper morphology” American Antiquity 67(4): 731\u2013744. DOI: 10.2307\/1593801.<\/li>\n
  22. [22] E. Vargiu and M. Urru, (2013) \u201cExploiting web scraping in a collaborative filtering-based approach to web advertising.” Artif. Intell. Res. 2(1): 44\u201354.<\/li>\n
  23. [23] A. Sundas, S. Badotra, Y. Alotaibi, S. Alghamdi, and O. Khalaf, (2022) \u201cModified bat algorithm for optimal VM s in cloud computing” Computers, Materials and Continua 72(2): 2877\u20132894. DOI: 10.32604\/cmc.2022.025658.<\/li>\n
  24. [24] B. Zhao, (2017) \u201cWeb scraping” Encyclopedia of big data: 1\u20133.<\/li>\n
  25. [25] D. S. Sirisuriya et al., (2015) \u201cA comparative study on web scraping”:<\/li>\n
  26. [26] B. Audeh, M. Beigbeder, A. Zimmermann, P. Jaillon, and C. Bousquet, (2017) \u201cVigi4Med scraper: A framework for web forum structured data extraction and semantic representation” PLoS ONE 12(1): DOI: 10.1371\/journal.pone.0169658.<\/li>\n
  27. [27] A. Khan, A. Laghari, A. Shaikh, S. Bourouis, A. Mamlouk, and H. Alshazly, (2021) \u201cEducational blockchain: A secure degree attestation and verification traceability architecture for higher education commission” Applied Sciences (Switzerland) 11(22): DOI: 10.3390\/app112210917.<\/li>\n
  28. [28] Y. Neil, (2016) \u201cWeb Scraping the Easy Way”:<\/li>\n
  29. [29] R. Egger, M. Kroner, and A. St\u00f6ckl. \u201cWeb scraping\u201d. In: Applied Data Science in Tourism. Springer, 2022, 67\u201382.<\/li>\n
  30. [30] V. Krotov and L. Silva. \u201cLegality and ethics of web scraping\u201d. In: cited By 14. 2018.<\/li>\n
  31. [31] R. Sharma, (2020) \u201cDATA CRAPER”:<\/li>\n
  32. [32] B. Sharma, A. Hashmi, C. Gupta, O. I. Khalaf, G. M. Abdulsahib, and M. M. Itani, (2022) \u201cHybrid Sparrow Clustered (HSC) Algorithm for Top-N Recommendation System” Symmetry 14(4): 793.<\/li>\n
  33. [33] Felix Speckmann, (2021) \u201cWeb Scraping: A Useful Tool to Broaden and Extend Psychological Research” Zeitschrift f\u00fcr Psychologie 229(4): 241\u2013244. DOI: https:\/\/doi.org\/10.1027\/2151-2604\/a000470.<\/li>\n
  34. [34] U. Janniekode, R. Somineni, O. Khalaf, M. Itani, J. Chinna Babu, and G. Abdulsahib, (2022) \u201cA Symmetric Novel 8T3R Non-Volatile SRAM Cell for Embedded Applications” Symmetry 14(4): DOI: 10.3390\/sym14040768.<\/li>\n
  35. [35] D. Go\u00dfen, I. H. Jonker, and I. E. Poll. \u201cDesign and implementation of a stealthy OpenWPM web scraper”. (phdthesis). Master\u2019s thesis, Radboud Universiteit Nijmegen, 2020.<\/li>\n
  36. [36] M. Edeh, O. Khalaf, C. Tavera, S. Tayeb, S. Ghouali, G. Abdulsahib, N. Richard-Nnabu, and A. Louni, (2022) \u201cA Classification Algorithm-Based Hybrid Diabetes Prediction Model” Frontiers in Public Health 10: DOI: 10.3389\/fpubh.2022.829519.<\/li>\n
  37. [37] Hemavathi, S. Akhila, Y. Alotaibi, O. Khalaf, and S. Alghamdi, (2022) \u201cAuthentication and Resource Allocation Strategies during Handoff for 5G IoVs Using Deep Learning” Energies 15(6): DOI: 10.3390\/en15062006.<\/li>\n
  38. [38] X. Wang, J. Liu, X. Liu, Z. Liu, O. I. Khalaf, J. Ji, and Q. Ouyang, (2022) \u201cShip feature recognition methods for deep learning in complex marine environments” Complex & Intelligent Systems: 1\u201317.<\/li>\n
  39. [39] J. Jayapradha, M. Prakash, Y. Alotaibi, O. Khalaf, and S. Alghamdi, (2022) \u201cHeap Bucketization Anonymity – An Efficient Privacy-Preserving Data Publishing Model for Multiple Sensitive Attributes” IEEE Access 10: 28773\u201328791. DOI: 10.1109\/ACCESS.2022.3158312.<\/li>\n
  40. [40] C. Kavitha, V. Mani, S. Srividhya, O. Khalaf, and C. Tavera Romero, (2022) \u201cEarly-Stage Alzheimer\u2019s Disease Prediction Using Machine Learning Models” Frontiers in Public Health 10: DOI: 10.3389\/fpubh.2022.853294.<\/li>\n
  41. [41] T. Puri, M. Soni, G. Dhiman, O. Ibrahim Khalaf, M. alazzam, and I. Raza Khan, (2022) \u201cDetection of Emotion of Speech for RAVDESS Audio Using Hybrid Convolution Neural Network” Journal of Healthcare Engineering 2022: DOI: 10.1155\/2022\/8472947.<\/li>\n
  42. [42] A. A. Khan, A. A. Laghari, and S. A. Awan, (2021) \u201cMachine learning in computer vision: A review” EAI Transactions on Scalable Information Systems: e4.<\/li>\n
  43. [43] A. Khan, Z. Shaikh, L. Belinskaja, L. Baitenova, Y. Vlasova, Z. Gerzelieva, A. Laghari, A. Abro, and S. Barykin, (2022) \u201cA Blockchain and MetaheuristicEnabled Distributed Architecture for Smart Agricultural Analysis and Ledger Preservation Solution: A Collaborative Approach” Applied Sciences (Switzerland) 12(3): DOI: 10.3390\/app12031487.<\/li>\n
  44. [44] A. Khan, Z. Shaikh, L. Baitenova, L. Mutaliyeva, N. Moiseev, A. Mikhaylov, A. Laghari, S. Idris, and H. Alshazly, (2021) \u201cQoS-ledger: Smart contracts and metaheuristic for secure quality-of-service and cost-efficient scheduling of medical-data processing” Electronics (Switzerland) 10(24): DOI: 10.3390\/electronics10243083.<\/li>\n
  45. [45] A. Khan, Z. Shaikh, A. Laghari, S. Bourouis, A. Wagan, and G. Ali, (2021) \u201cBlockchain-aware distributed dynamic monitoring: A smart contract for fog-based drone management in land surface changes” Atmosphere 12(11): DOI: 10.3390\/atmos12111525.<\/li>\n
  46. [46] A. Khan, A. Laghari, D.-S. Liu, A. Shaikh, D.-A. Ma, C.-Y. Wang, and A. Wagan, (2021) \u201cEPS-ledger: Blockchain hyperledger sawtooth-enabled distributed power systems chain of operation and control node privacy and security” Electronics (Switzerland) 10(19): DOI: 10.3390\/electronics10192395.<\/li>\n<\/ol>\n<\/div>\n\n\n\n

    <\/p>\n","protected":false},"author":3,"template":"wp-custom-template-detail-4-aricles","meta":{"_uag_custom_page_level_css":""},"categories":[740,6,744],"tags":[802],"acf":[],"uagb_featured_image_src":[],"uagb_author_info":{"display_name":"\u6797\u923a\u6db5","author_link":"\/jase\/?author=3"},"uagb_comment_info":0,"uagb_excerpt":" Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited. Download Citation:  BibTeX | http:\/\/dx.doi.org\/10.6180\/jase.202304_26(4).0002   Download PDF Web scraping is the process of extracting data from a website…","_links":{"self":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope\/4171"}],"collection":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/tkuisotope"}],"about":[{"href":"\/jase\/index.php?rest_route=\/wp\/v2\/types\/tkuisotope"}],"author":[{"embeddable":true,"href":"\/jase\/index.php?rest_route=\/wp\/v2\/users\/3"}],"wp:attachment":[{"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4171"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4171"},{"taxonomy":"post_tag","embeddable":true,"href":"\/jase\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4171"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}