We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message
78,797 News Articles

Google upgrade achieves faster search results

New system brings more up-to-date results

Google has introduced a new web indexing system to provide users with more up-to-date search results.

The new system, called Caffeine, delivers results that are closer to 'live' than Google's previous system, the company said.

Previously, Google would crawl a fraction of the web each night, index it and push it out in its results. With Caffeine, as Google crawls the web and finds new information, it indexes it immediately. "We process it immediately so we can serve it seconds later," said Matt Cutts, the head of Google's webspam team. He unveiled the news at the Search Marketing Expo in Seattle.

When Google started, it would update its index only every four months, he said. Around 2000, it started indexing every month in a process that took a week to 10 days. "The funny thing is, we didn't have enough capacity to update all our data centres at once," he said. That meant that people might get different results when searching for the same term if they were hitting different Google data centres.

Caffeine went live "in the last few days" and is now being used in all Google data centres, he said.

In addition to serving "fresher" results, Caffeine "massively increases our ability to scale up," Cutts said. The company will be able to index many more documents - "on the order of 100 petabytes", he said.

Caffeine adds new information at a rate of hundreds of thousands of gigabytes per day, Google said in a blog post.

The progression in how Google does its indexing mirrors how people increasingly expect to find the very latest information online. Google noticed that after the September 11 attacks on the US, when people were looking for the most up-to-the-minute information possible, Cutts said.


IDG UK Sites

Android One vs Android Silver vs Google Nexus: What is the difference?

IDG UK Sites

2014 Mac mini release date, specs, rumours: When's the new Mac mini coming out?

IDG UK Sites

Long live the internet fridge: the Internet of Things is coming

IDG UK Sites

How Prometheus' colourist Juan Ignacio Cabrera gave a tense, edgy feel to Chosen