We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message
80,259 News Articles

The Web is missing links

Web pages lead to cul de sacs

An in depth study undertaken by AltaVista, Compaq, and IBM reveals that not all pages on the World Wide Web are as well connected as we think.

The Web is shaped like a large bow tie with many underconnected sites out on its hard-to-reach fringes, say the researchers, who hope to use their indexed results to design better search engines and help electronic-commerce sites get noticed.

To determine the Web's structure, the companies used the AltaVista search engine and Compaq AlphaServer hardware to perform two massive "crawls" of more than 200 million pages by following the 1.5 billion hyperlinks connecting them.

Search engines normally perform crawls to create the indexes that help speed up searches, says Jim Schissler, an AltaVista spokesperson.

IBM researchers analysed the results and discovered that about a third of all Web sites are in a "strongly-connected core"--the knot of the figurative bow tie.

You can easily travel between those pages via hyperlinks. Meanwhile, one side of the tie, containing about a quarter of all Web pages, consists of "origination" pages that let you eventually get to the core, but can't be reached from it.

Likewise, "termination" pages on the other side of the tie can be reached from the core, but have trouble returning to it. Finally, one-fifth of the pages can't be reached from the core at all, but only from origination or termination pages.


IDG UK Sites

5 reasons Facebook Messenger is terrible, and 5 reasons it's great

IDG UK Sites

Samsung: King of the Androids (or MWC, at least)

IDG UK Sites

Inside Microsoft's universal platform for designing apps that work on PCs, tablets, phones, Xbox...

IDG UK Sites

How to watch Apple's 9 March 'Spring Forward' Apple Watch event live stream, and what to expect: Ap?......