Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Pre-Nominations Now Open for 2026 TEAs

The pre-nomination period for the 2026 Trans Erotica Awards (TEAs) is now open.

FSC Releases Updated Age-Verification Toolkit

The Free Speech Coalition (FSC) has announced the release of its updated age verification toolkit.

Duke Tax Joins Pineapple Support as Supporter-Level Sponsor

Duke Tax has joined the ranks of over 70 adult businesses and organizations committing funds and resources to Pineapple Support.

UK Moving Ahead with Plan to Outlaw 'Choking' Content

The U.K. government has announced its intent to follow through on criminalizing “choking” content, a plan that was announced earlier this year.

Italy to Require Age Verification for Adult Sites

Italian media regulator AGCOM has announced that all sites and platforms hosting adult content will be required to implement age verification systems starting Nov. 12 to prevent access by users under 18.

'MILFlicious' Launches Through YourPaysitePartner

MILFlicious.com has officially launched through YourPaysitePartner (YPP).

Op-Ed: The Guardian's XBIZ Amsterdam Podcast Dismisses Creators' Experiences

British newspaper The Guardian’s podcast coverage of XBIZ Amsterdam 2025 purports to investigate the power dynamics of today’s online adult industry. Instead, it ignores creators’ voices, airs tired and outdated preconceptions about the business, and rehashes the unsupported claims of anti-pornography crusaders.

Eva Maxim, BranditScan Launch 'Killer' Promo

Eva Maxim and BranditScan have partnered for the Killer Creator Giveaway promotion.

2026 XBIZ Exec Awards Nominees for Online Industry Announced

XBIZ is pleased to announce the nominees for the online industry edition of the 2026 XBIZ Exec Awards, set to be presented as part of the annual XBIZ Honors ceremony on Wednesday, Jan. 14 in conjunction with the XBIZ 2026 digital media conference.

AEBN Publishes Report on POV Trends

AEBN has published a report on POV and gonzo categories from its straight and gay theaters.

Show More