Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Brady Mills Agency to Launch 'AgeWallet' Verification Solution

Brady Mills Agency has officially announced that its age verification solution, AgeWallet, will launch in November.

EU Advocate General: France Can Require Foreign Sites to Implement AV

An advocate general of the European Union’s Court of Justice on Thursday advised the court to rule that France may require pornographic websites based in other EU states to implement age verification in accordance with French law.

Hentaied Founder Romero 'Mr. Alien' on Fetish, Fantasy and Finding Order in Chaos

A sharp sting pierces the woman’s skin. Something foreign slips beneath the surface. Eggs, maybe. She doesn’t know it yet, but soon her body will become a vessel, a hive, a source of contamination.

AEBN Publishes Popular Searches for July, August

AEBN has published the top search terms for the months of July and August from its straight and gay theaters in all 50 states and the District of Columbia.

The Guardian Devotes Feature Article to XBIZ Amsterdam

British newspaper The Guardian sent a reporter to cover XBIZ Amsterdam earlier this month, resulting in a lengthy article about the annual European adult industry conference.

Pineapple Support Taps Char Borley as Brand Ambassador

Pineapple Support has named Char Borley as its newest brand ambassador.

Michigan Legislators Propose Online Porn Ban

Michigan lawmakers have introduced a bill that would make it illegal to distribute pornography via the internet in the state.

Florida AG Sues Aylo, Segpay Over State AV Law

Florida Attorney General James Uthmeier filed lawsuits against Aylo and Segpay on Monday with the 12th Judicial Circuit Court of Florida for noncompliance with HB3, the state's age verification law.

Colombian Court Sides with Performer Esperanza Goméz Over IG Suspensions

Colombia’s Constitutional Court last week ruled in favor of adult performer Esperanza Gómez in her legal battle against Meta over repeated suspensions of her Instagram account.

Missouri AG Announces Age Verification Rule to Take Effect Nov. 30

Newly appointed Missouri Attorney General Catherine Hanaway announced Friday that the state's recently approved age verification regulation for adult websites will go into effect on Nov. 30.

Show More