Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2026 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

UK Government May Limit 'Step' Porn Ban With New Amendments

The U.K. Ministry of Justice on Friday revealed new government amendments to the pending Crime and Policing Bill, potentially limiting a pending ban on “step” content to apply only if adult performers role-play as minors.

Arizona Senate Removes 'Catch-22' Provision From Consent Bill

The Arizona State Senate has amended a bill that would impose new requirements for adult content uploaded online, removing a seemingly contradictory provision that could have effectively made it impossible for adult sites to operate in the state.

Climaxx Media Launches Networking Platform

Climaxx Media has officially launched its new networking platform.

Italian Court in Aylo Case Limits International Reach of AV Rules

An Italian administrative court has ruled that Italy’s recently-enacted age verification rules for adult content may not currently be enforced against sites based in other EU member states, pending further procedural action under the EU’s Directive on Electronic Commerce.

OCC, FDIC Prohibit Use of 'Reputation Risk' by Regulators

The Office of the Comptroller of the Currency (OCC) and the Federal Deposit Insurance Corporation (FDIC) on Tuesday issued a final rule codifying the elimination of ‘reputation risk’ as a criterion in their supervision of financial institutions.

Wisconsin Governor Vetoes Age Verification Bill

Gov. Tony Evers on Friday vetoed AB 105, an age verification bill that would have allowed anyone to sue adult content providers for damages over alleged failure to age-verify users in Wisconsin, with penalties of up to $10,000 per violation.

FSC Releases Statement on Wisconsin Governor Vetoing AV Bill

The Free Speech Coalition has released a statement on Wisconsin Governor Tony Evers' veto of the state's age verification legislation.

AV Bulletin: West Virginia Enacts AV Law, Ohio 'Innocence Act' Advances

This roundup provides an update on the latest news and developments on the age verification front as it impacts the adult industry.

Woodhull Survey Reveals Concern Among Sex Educators Over AV Laws' Impact on Access

A national survey of sex educators by the Woodhull Freedom Foundation found that a majority of sex educators and sexual health professionals are concerned that age verification (AV) laws will negatively impact access to information and resources.

Clips4Sale Wins Trademark Infringement Case Against Fraudulent Domain

The World Intellectual Property Organization (WIPO) has ruled in favor of content platform Clips4Sale in a case against a website using a similar domain to impersonate the site.

Show More