Reply to thread

Message: <blockquote data-quote="The Feedster" data-source="post: 536423" data-attributes="member: 259515"><img src="http://mos.techradar.com//images/google-logo-200-200.jpg" alt="" class="fr-fic fr-dii fr-draggable " style="" /> Google's blog has announced that the web has reached at least 1 trillion unique URLs - although the actual number may be much bigger.The search giants' crawlers - the small programs that comb the web in order for it to be accessible to search engines - have hit their 1,000,000,000,000th unique URL, although this doesn't take into account millions more sites that are not linked or deliberately exclude themselves from search engines.Of course - 1 trillion unique URLs does not mean 1 trillion unique web pages, with original content much harder to come by.Replication"Many pages have multiple URLs with exactly the same content or URLs that are auto-generated copies of each other, explains the Google blog."Even after removing those exact duplicates, we saw a trillion unique URLs, and the number of individual web pages out there is growing by several billion pages per day."How many unique pages?The fascinating blog post, by by Jesse Alpert & Nissan Hajaj also acknowledges that there are, technically, infinite unique pages, but that indexing them would be pointless."So how many unique pages does the web really contain? We don't know; we don't have time to look at them all! :-)"Strictly speaking, the number of pages out there is infinite -- for example, web calendars may have a "next day" link, and we could follow that link forever, each time finding a "new" page."We're not doing that, obviously, since there would be little benefit to you. But this example shows that the size of the web really depends on your definition of what's a useful page, and there is no exact answer."<img src="http://rss.feedsportal.com/c/669/f/8513/s/1898b0d/mf.gif" alt="" class="fr-fic fr-dii fr-draggable " style="" /><a href="http://res.feedsportal.com/viral/sendemail2.html?title=http://www.techradar.com/433737&link=Web has 1 trillion unique URLs" target="_blank"><img src="http://rss.feedsportal.com/images/emailthis2.gif" alt="" class="fr-fic fr-dii fr-draggable " style="" /></a><a href="http://res.feedsportal.com/viral/bookmark.cfm?title=http://www.techradar.com/433737&link=Web has 1 trillion unique URLs" target="_blank"><img src="http://rss.feedsportal.com/images/bookmark.gif" alt="" class="fr-fic fr-dii fr-draggable " style="" /></a><a href="http://da.feedsportal.com/r/14585605495/f/8513/c/669/s/25791245/a2.htm" target="_blank"><img src="http://da.feedsportal.com/r/14585605495/f/8513/c/669/s/25791245/a2.img" alt="" class="fr-fic fr-dii fr-draggable " style="" /></a><a href="http://rss.feedsportal.com/c/669/f/8513/s/1898b0d/story01.htm" target="_blank">More...</a></blockquote>

Verification