Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Trump Administration Issues Executive Order Against 'Debanking'

The White House on Thursday issued an executive order limiting financial institutions’ ability to restrict access to financial services for people or groups involved in lawful industries, a longtime goal of adult industry advocates and stakeholders.

Go.cam Launches Free Age Verification Solution, Anti-Fraud Features

Go.cam has announced that its age verification solution is now free with updated anti-fraud and identity protection features.

Florida AG Sues EU-Based Adult Companies for Failing to Age-Verify Users

Florida Attorney General James Uthmeier filed a lawsuit Monday with the 12th Judicial Circuit Court of Florida against five EU-based adult companies for allegedly failing to require age verification before allowing access to adult content.

SkyPrivate Launches 'Telegram Pay-Per-Minute' Feature

SkyPrivate has launched a new pay-per-minute (PPM) private show option on Telegram.

Pineapple Support to Host 'Money and Mental Health' Online Event

Pineapple Support is hosting a free, online event to help performers balance financial wellbeing with mental health, Aug. 18-19.

Arcom Warns 5 Adult Sites Over Age Verification

French media regulator Arcom has sent enforcement notices to the operators of five adult websites that the agency says have failed to implement age verification as required under France’s Security and Regulation of the Digital Space (SREN) law.

MojoHost Debuts NVIDIA Blackwell-Powered Hosting

MojoHost has announced the launch of NVIDIA Blackwell-powered hosting featuring RTX 6000 Pro MaxQ GPUs.

FSC: Identity Theft Targeting Adult Performers

The Free Speech Coalition has put out an alert warning of an individual found to be targeting adult performers for identity theft.

Assylum.com Implements New Age Verification System

Assylum.com has introduced an age verification system across its member sites.

European Commission to Assess Pornhub, XVideos, XNXX Compliance With Digital Services Act

The European Commission plans to conduct a study to determine how well adult sites Pornhub, XVideos and XNXX are addressing illegal content and other potential harms under the EU’s Digital Services Act.

Show More