The Evolution of the (Hidden) Web and its Hidden Data

Álvarez Díaz, Manuel; Prieto Álvarez, Víctor Manuel; Cacheda, Fidel

doi:10.4018/978-1-4666-8696-0.ch001

Title

The Evolution of the (Hidden) Web and its Hidden Data

Author(s)

Álvarez Díaz, Manuel

Prieto Álvarez, Víctor Manuel

Cacheda, Fidel

Date

2015

Citation

Díaz, M. Á., Álvarez, V. M., & Seijo, F. C. (2015). The Evolution of the (Hidden) Web and its Hidden Data. In S. Hai-Jew (Ed.), Design Strategies and Innovations in Multimedia Presentations (pp. 1-30). IGI Global. https://doi.org/10.4018/978-1-4666-8696-0.ch001

Abstract

This paper presents an analysis of the most important features of the Web and its evolution and implications on the tools that traverse it to index its content to be searched later. It is important to remark that some of these features of the Web make a quite large subset to remain “hidden”. The analysis of the Web focuses on a snapshot of the Global Web for six different years: 2009 to 2014. The results for each year are analyzed independently and together to facilitate the analysis of both the features at any given time and the changes between the different analyzed years. The objective of the analysis are twofold: to characterize the Web and more importantly, its evolution along the time.

Keywords

Web characterization
Web measurement
Web evolution
Search engines
Crawling systems
Hidden web
Hidden data

Description

© 2015. This version of the chapter: Díaz, M. Á., Álvarez, V. M., & Seijo, F. C. (2015). ‘The Evolution of the (Hidden) Web and its Hidden Data’ has been accepted for publication in S. Hai-Jew (Ed.), Design Strategies and Innovations in Multimedia Presentations (pp. 1-30). IGI Global. The Version of Record is available online at https://doi.org/10.4018/978-1-4666-8696-0.ch001.