Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

TeamSkeet, MYLF to Launch New Website FamilyStrokes.com

Sister studios TeamSkeet and MYLF are launching a new website, FamilyStrokes.com.

AV Bulletin: Age Verification Hits the Mainstream, Ofcom Sets a Date

Industry stakeholders and free speech advocates have anxiously been awaiting the Supreme Court’s decision in Free Speech Coalition v. Paxton, which could significantly impact state age verification laws around the country. In the meantime, state legislatures continue to weigh and pass AV bills, AV tech providers continue to tout their services, and legal challenges continue to play out in the courts — with some cases on hold pending the SCOTUS ruling in Paxton.

Segpay Names Kristi Greer VP of Sales

Segpay has promoted long-time employee Kristi Greer to the position of vice president of sales.

BranditScan Names Subgirl Newest Brand Ambassador

BranditScan has named content creator Subgirl its newest brand ambassador.

Arcom Reports Age Verification Enforcement Actions Against 5 Adult Sites

French media regulator Arcom released a statement Tuesday detailing recent actions to enforce age verification rules as set forth under France’s Security and Regulation of the Digital Space (SREN) law.

Pineapple Support, Clips4Sale to Host Performers' Partners Support Group

Pineapple Support and Clips4Sale are hosting a free online support group for partners and family members of adult industry professionals.

FSC Mourns the Loss of Board Director Emeritus Mark Kernes

Free Speech Coalition has released a statement regarding the passing of Board Director Emeritus Mark Kernes.

Alexa Creed Launches New Paysite

Creator Alexa Creed has launched a new membership site through MyMember.site.

Choice Talent Management Launches Fan Platform 'ChoiceFilmz'

Choice Talent Management CEO Chris Crisco has launched a new fan platform called ChoiceFilmz.

Dredd to Launch Official Site

Dredd has announced his new website OfficialDreddXXX.com, launching April 20.

Show More