Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2026 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

FSC, Texas Ask for Summary Judgment in AV Law 'Health Warnings' Case

Both sides in a lawsuit challenging the “health warning” requirements of Texas’ age verification law for adult websites have motioned for summary judgment in the case.

AEBN Publishes Popular Searches for September, October

AEBN has published the top search terms for September and October from its straight and gay theaters in all 50 states and the District of Columbia.

BranditScan Launches Black Friday Creator Promo

BranditScan has launched its annual Black Friday promotion, offering creators a 69% discount for the first month to creators signing up for the DMCA leak protection and takedown anti-piracy subscription service.

Ofcom Proposes Requiring Adult Sites Hosting UGC to Use Hash Matching Tech

U.K. media regulator Ofcom on Monday asked Parliament to approve proposed new codes that would, among other changes, require adult platforms hosting user-generated content to implement hash matching technology in order to detect CSAM.

Flirt4Free Wins Trademark Infringement Case Against Copycat Website

The World Intellectual Property Organization (WIPO) has ruled in favor of Flirt4Free in a case against a copycat website using an infringing domain.

Irish PM Affirms Plan for UK-Style Ban on 'Extreme' Content

Ireland’s prime minister on Wednesday confirmed that his government is moving ahead with plans to introduce legislation criminalizing possession and distribution of “extreme” pornography, which he hopes to see passed by early 2027.

UK Parliamentary Group Calls for Outlawing Cam Platforms

The U.K. Parliament’s All-Party Parliamentary Group (APPG) on Commercial Sexual Exploitation has published a report in which it calls for banning adult livestreaming platforms.

Ofcom Escalates Sun Social, Superb Convert Investigations

U.K. media regulator Ofcom has ramped up its ongoing Online Safety Act (OSA) compliance investigations into PlayVids/PeekVids operator Sun Social Media and PimpBunny operator Superb Convert.

Centrobill Integrates Apple Pay, Google Pay

Centrobill has added Apple Pay and Google Pay options for merchants.

Judge Preliminarily Approves Pornhub Class Action Settlement

A U.S. District Court judge on Monday granted preliminary approval to a settlement between Aylo and the plaintiffs in two class-action lawsuits over allegations that former Pornhub parent company MindGeek knowingly allowed and profited from CSAM on its sites.

Show More