Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2026 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Pineapple Support Names Ny Ny Lew Brand Ambassador

Pineapple Support has named Ny Ny Lew as its newest brand ambassador.

Federal AV Proposal Passes House, Faces Senate Opposition

The U.S. House of Representatives on Monday passed the Kids Internet and Digital Safety (KIDS) Act, which includes provisions to make age verification by adult websites federal law, but the bill still faces tough going in the Senate.

Devin Drills Launches New Paysite

Creator Devin Drills has launched an official website through PAYSITE.

AV Bulletin: Midyear Roundup

Since the U.S. Supreme Court’s decision in Free Speech Coalition v. Paxton, more state age verification laws have been enacted around the United States, as well as proposed at the federal level and in other countries. Meanwhile, lawsuits resulting from AV laws have begun to play out in the courts. This roundup provides an update on the latest news and developments on the age verification front as it impacts the adult industry.

Judge Dismisses Last NCOSE-Backed Suit Over Kansas AV Law

A federal judge on Monday dismissed a lawsuit alleging that adult site SuperPorn violated Kansas’ age verification law, citing lack of jurisdiction after similarly dismissing two related cases earlier this year.

ASACP Updates 'Restricted to Adults' Labeling Resource Page

The Association of Sites Advocating Child Protection (ASACP) has updated its Restricted to Adults (RTA) labeling resource page.

Federal AV Proposal Scores Minor Win in House but Remains in Doubt

A newly announced bipartisan agreement in the U.S. House of Representatives Committee on Energy and Commerce may soon bring a proposed federal age verification law before the full House, but the measure continues to face an uphill battle.

Arizona Governor Vetoes 'Protect Act' With New Consent Provisions

Arizona Governor Kate Hobbs on Friday vetoed HB 2133, the “Protect Act,” which would have imposed new requirements for adult content uploaded online.

Brazil Begins Monitoring 18 Adult Sites for AV Compliance

Brazil’s National Data Protection Authority (ANPD) is now monitoring 18 high-traffic adult websites for compliance with the country’s Digital Statute for Children and Adolescents (Digital ECA), which requires such sites to age-verify users located in Brazil.

Ofcom Fines First Time Videos $100,000 for AV Noncompliance

U.K. media regulator Ofcom on Thursday imposed a fine of 80,000 pounds (more than $100,000) against First Time Videos, which operates FTVGirls.com and FTVMilfs.com, for failing to implement age checks required for compliance with the Online Safety Act.

Show More