Google's New Web Page Spider
Search engines use automated software programs that crawl the web. These programs called "crawlers" or "spiders" go from link to link and store the text and the keywords from the pages in a database. "Googlebot" is the name of Google's spider software.
Types of Google Spiders:Many webmasters have noticed that there are now two different Google spiders that index their web pages. At least one of them is performing a complete site scan:
• The normal Google spider: 66.249.64.47 - "GET /robots.txt HTTP/1.0" 404 1227 "-" "Googlebot/2.1"
• The additional Google spider: 66.249.66.129 - "GET / HTTP/1.1" 200 38358 "-" "Mozilla/5.0 (compatible; Googlebot/2.1)"
Difference between these two Google spidersThe new Google spider uses a slightly different user agent: "Mozilla/5.0". This means that Googlebot now also accepts the HTTP 1.1 protocol. The new spider might be able to understand more content formats, including compressed HTML.
AdWords Spider Google is using a new crawler software program for their AdWords advertising system that automatically spiders and analyzes the content of advertising landing pages. Google tries to determine the quality of the ad landing pages with the new bot. The content of the landing page will be used for the Quality Score that Google assigns to your ads. Google uses the Quality Score and the amount you are willing to pay to determine the position of your ads. Ads with a high quality score can rank higher even if you pay less than others for the ad.
Purpose of Google Spider Google hasn't revealed the reason for it yet. There are two main theories:
• The first theory is that Google uses the new spider to spot web sites that use cloaking, JavaScript redirects and other dubious web site optimization techniques. As the new spider seems to be more powerful than the old spider, this sounds plausible.
• The second theory is that Google's extensive crawling might be a panic reaction because the index needs to be rebuilt from the ground up in a short time period. The reason for this might be that the old index contains too many spam pages.
What does this mean to your web site? If you use questionable techniques such as cloaking or JavaScript redirects, you might get into trouble. If Google really uses the new spider to detect spamming web sites, it's likely that these sites will be banned from the index. To obtain long-term results on search engines, it's better to use ethical search engine optimization methods. General information about Google's web page spider can be found here.
Receive Email When Google Spiders Your PageA search engine spider is an automated software program that locates and collects data from web pages for inclusion in a search engine's database. The name of Google's spider is "Googlebot". If you have a web site that allows you to use PHP code then your web pages can inform you when Google's spider has indexed them. This little piece of PHP code recognizes Googlebot if it visits the web page, and it informs you by email when Googlebot has been there.
For more details on Google's Spider visit at www.halfvalue.com and www.halfvalue.co.uk
For more Books information visit at www.lookbookstores.com
Source: Free Articles from ArticlesFactory.com
Related Tags: new, web, page, spider, googles
Vinay Choubey
SEO Manager
Your Article Search Directory : Find in ArticlesRecent articles in this category:
- What is the Google PageRank: An Easy to Understand Introduction
THE GOOGLE PAGERANK EXPLAINED SIMPLYA common question amongst website owners is, "How is the G - 3 Easy Way to Get Edu Baclinks
Education websites are the most trusted websites on the internet and if you've got backlinks on thes - How to Launch Your Own SEO Company
Having knowledge and experience about search engine optimization doesn't really mean it's goin - Ethical SEO optimization always pays stable search engine rankings
Normal 0 false false false MicrosoftInternetExplorer4 /* Sty - Five Easy to Make Mistakes That Keep Search Engine Robots Away From Your Website
Search engine robots are very simple software programs. If an indexing robot cannot find the conten - Generate an Intelligent Set of Link Building Services
Link building can be best defined as the most suitable way of promoting a website, however, at the - It's Time to Develop Intelligent SEO Content Writing
Creating appropriate, value content is significant for a website to get listed on the search engine - Does Your Website Have No or the Wrong Sitelinks in Google?
What are Sitelinks? Sitelinks are additional links below the description and the URL of a web page - Search Engine Optimization and Spam - How Will You Know That?
There is a fine line between proper search engine optimization, and what a search engine will consi - 9 Steps for Making Money Online
I've outlined a step by step marketing process flow, and more, on how to setup an online Money Mark
Most viewed articles in this category:
- Free Search Engine Optimization Tools on the Internet
As I run across tools and websites that I find particularly useful for software and high tech compan - SEO Explained
Search engine optimization is part science and part art. How well it is done has a lot to do with t - SEO - Choosing Blog Fonts and Colors
Part of having a cohesive blog design is to choose one or two fonts and two to four colors and stick - How "Blog-and-Ping" Can Boost Your PageRank
"Blog and Ping" is a term that refers to a technique where you make a post on your blog, and using y - Top Ranking SEO Secret
Most web programmers and designers now have a good idea of how to optimize their site using on-site - Affordable Seo: Where Do I Start To Optimize My Website?
The Starting point is clear. Understand what your main competitors are doing. That is Right! If you - Off Page SEO: The Importance Of Incoming Links And Search Engine Optimization
Off page SEO: The importance of incoming links and search engine optimization Off page seo an in - Stop Chasing the Search Engines and Get Better Traffic
Search engines are mysterious and unpredictable. One day you might be on the top of the SERPs and t - How To Get Search Engine Traffic From Kenya in Africa
Traffic from Kenya and Kenyans via search engines like Google basically means unlimited traffic and - Why Search Engine Fail
Imagine asking a stranger for directions to a clothing store. Chances are, the stranger will