The "Big Four" Now Support Auto-Discovery for Sitemap Files

by Daryl H. Bryant - Date: 2007-04-13 - Word Count: 455 Share This!

There is some great news in the SEO world that will change the way webmaster process and submit Sitemaps to Google, Yahoo!, MSN and the newest member Ask. The four search players announced on April 11, 2007, that there is a new way to let the search engines know about your Sitemap file. The new process is being referred to as the “Auto-Discovery” of Sitemaps.

How to specify the Sitemap location in your robots.txt file

You can specify the location of the Sitemap using a robots.txt file. To do this, simply add the following line: Sitemap:

The should be the complete URL to the Sitemap, such as:

The following is a short snippet from each of their statements:

Google states, “Second, it's now easier for you to tell us where your Sitemaps live. We wondered if we could make it so easy that you wouldn't even have to tell us and every other search engine that supports Sitemaps. But how? Well, every website can have a robots.txt file in a standard location, so we decided to let you tell us about your Sitemap in the robots.txt file.” Yahoo states, “Please provide the complete URL for your Sitemap on this line. We will pick it up wherever you put it in your robots.txt file. This directive is not specific to user-agent. If you have multiple Sitemaps, you can point to your Sitemap index file on this line. Details about the Sitemaps protocol including this addition are available on the protocol website --”

MSN states, “Although we aren't ready to start consuming sitemaps quite yet, I encourage you to build a sitemap and add the "sitemap" directive to your robots.txt. As soon as we roll out support (before the end of the year), we will be able to start crawling your sitemap files immediately. If you want more detail on the sitemaps protocol, including auto-discovery, check out” states, “In addition, is now supporting submission of Sitemaps via

Of course, neither auto-discovery nor manual submission guarantee pages will be added to the index. The pages must meet our quality criteria for inclusion in the index. And use of these submission methods does not influence ranking.”

Click the following links to view their full announcements: Google, Yahoo, Microsoft and Ask. Even though this new auto-discovery process can make a webmasters job easier, I still think it's extremely useful to submit your Sitemap through Google Webmaster tools and Yahoo Site Explorer so you can make sure that the Sitemap was processed without any issues and you can get additional statistics about your site.

Will MSN and be creating a similar type of Sitemap submission section so webmasters can track and view more detailed statistics about their websites? Only time will tell!

Related Tags: google, yahoo, msn, sitemap, ask,, autodiscovery, auto discovery, sitemap file, sitemap location

Click here to automate your Google and Yahoo! Sitemaps today using the new XML protocol standard.

Hudson Horizons is an e-business product, solution and marketing company specializing in creating highly sophisticated customized websites, web-based software applications and providing e-marketing services for small and mid-sized businesses.

Our vision and ultimate ambition as a company is to always strive to be "The New Light for e-Business."

By offering new, innovative and extremely competitive products and solutions to our clients, we provide better ways to run and operate their business online.

Your Article Search Directory : Find in Articles

© The article above is copyrighted by it's author. You're allowed to distribute this work according to the Creative Commons Attribution-NoDerivs license.

Recent articles in this category:

Most viewed articles in this category: