
In my opinion, the creators of Google, Surgey Brin and Lawrence E. Page are geniuses. Between the two of them, they have made what was initially an academic search engine to become a lifestyle and a household name.
Google, their brain child.
There are many tools provided by google, one of which I will be discussing, is Google Spider. It is an automated software program that travels all over the web network, going from link to link, storing text and keywords from the pages in a database. This process of building lists of key words is called web crawling. The usual starting points of web crawling are lists of webpages with high viewer traffic. The spider will begin with the popular site, indexing the words on its pages and following every link found within it. In this way, the spidering system quickly begins to travel, spreading out across the most widely used portions of the Web.
"Googlebot" is the name of Google's spider software. Through my research on this google tool, I cae across this diagram which sums up the web crawling process.
Some advantages of Googlebot include the ability to generate information for users literally at the blink of an eye. I am not exaggerating. The system was built to use multiple spiders, an average of three at a go. Each spider could keep about 300 connections to Web pages open at a time. At its peak performance, using four spiders, Googlebot could crawl over 100 pages per second, generating around 600 kilobytes of data each second.
A disadvantage of using google spiders is encountered by e-business users. Google spiders contribute to the limited reach of paid Uniform Resource Locator (URL) inclusions which is a service that search engines offer, allowing users’ webpages to be indexed for a fee. However, daily viewer traffic to your site does not depend heavily on the search engines you choose to pay an inclusion fee to. This is because major search engines, some of which are the most widely used ones by netizens such as Yahoo, AOL or Google, do not offer paid URL inclusions. Instead, Google usually updates its index only once a month. Regardless of how many times you update your website, you would have to wait for the Google spider to index your new pages no matter how many other search engines you have paid to update their index daily. It is only after Google updates its index that your pages will show up in Google, Yahoo, or AOL results.
Google, their brain child.


Some advantages of Googlebot include the ability to generate information for users literally at the blink of an eye. I am not exaggerating. The system was built to use multiple spiders, an average of three at a go. Each spider could keep about 300 connections to Web pages open at a time. At its peak performance, using four spiders, Googlebot could crawl over 100 pages per second, generating around 600 kilobytes of data each second.
A disadvantage of using google spiders is encountered by e-business users. Google spiders contribute to the limited reach of paid Uniform Resource Locator (URL) inclusions which is a service that search engines offer, allowing users’ webpages to be indexed for a fee. However, daily viewer traffic to your site does not depend heavily on the search engines you choose to pay an inclusion fee to. This is because major search engines, some of which are the most widely used ones by netizens such as Yahoo, AOL or Google, do not offer paid URL inclusions. Instead, Google usually updates its index only once a month. Regardless of how many times you update your website, you would have to wait for the Google spider to index your new pages no matter how many other search engines you have paid to update their index daily. It is only after Google updates its index that your pages will show up in Google, Yahoo, or AOL results.
In my internet communications class, I also learnt how to make a video clip with Windows Movie Maker. Enjoy the fruits of my labour!
No comments:
Post a Comment