OptimizedWeb Scraping System Using Multithreading Techniques for Corporate Information Extraction

Abstract

[Abstract] This study aims to automatically identify the various ICT innovations implemented by companies on their websites. To achieve this, web scraping techniques are proposed as the most effective approach. However, the need to process large sets of companies presents challenges in terms of execution time and system performance. To address these issues, our system incorporates multithreading techniques, enabling the concurrent execution of analysis drivers that extract the targeted elements. As a complement to our extraction system, we developed a web application that allows users to visualize the obtained results, organized on a map of Spanish provinces and grouped by the analyzed companies.