educational

SEO Spam: The Facts About Cloaking

Cloaking is the technique of returning different pages according to who or what is requesting them; e.g. a surfer would receive the actual page whereas a search engine spider would receive a different page, but would assume that it is the actual page that surfers see. Here's a look at some of the details:

The purposes of cloaking for search engine optimization are to hide highly optimized pages from people, so that they can't be stolen, and to provide search engine spiders with highly optimized pages that wouldn't look particularly good in browsers.

There are three ways of cloaking. One is "IP delivery", where the IP addresses of spiders are recognized at the server and handled accordingly; another is "User-Agent delivery", where the spiders' User-Agents are recognized, and the third is the first two combined.

Is cloaking ethical?
Let me put it this way: Search engines do it all the time. For instance, Google delivers different pages according to where in the world the surfer is located. People in the UK receive AdWord advertisements that are relative to the UK, and people in the U.S. receive AdWords that are relative to the U.S. Google delivers different pages according to the surfer's IP address. That's IP delivery, and that's cloaking.

Also, from time to time, search engines prevent certain people from gaining access to their .com versions. Instead, by checking the surfers' IP addresses, they redirect people to their localized versions - even when the surfers really do want to go to the .com version! Again, that's IP delivery, and that's cloaking.

Because the search engines do it, it is clear that cloaking isn't intrinsically unethical or wrong. If it's ok for the search engines to do it, then it must be ok for everyone else to do it. So what is it about cloaking that some people are dead against?

There is no sensible answer to that. The general idea is that serving people one page and serving the search engines a different page is simply wrong, because the engines are ranking the page according to what they believe it to be and not according to what it actually is. That idea is purely a matter of principle, and nothing at all to do with common sense.

The common sense view is that, if a page is ranked correctly, according to its topic, then surfers will find it in the search results, click on it and go to exactly where they expect to go to from reading the listing in the search results. It doesn't matter how the page came to be ranked in that position, and it doesn't matter if another page took its place when the engine was evaluating it. As long as it is ranked correctly, according to its topic, surfers are perfectly happy.

The fact that cloaking can be used to send people to sites and topics that they did not expect to go to when clicking on a listing in the search results, is an excellent reason to be against the misuse of cloaking, but it is no reason at all to be against the cloaking technique in general.

How Cloaking Actually Helps Google
Google's crawlers won't spider pages that have anything that looks like Session IDs in their URLs. If they did, they run the risk of spidering a potentially infinite number of pages, because each page that is requested would contain links to other pages, and the link URLs would contain the current session ID, which makes them different URLs than the last time the page was requested. And so it would go on and on and on, producing a vast number of unique URLs to spider and index.

It means that Google won't spider most of the pages on some websites. But Google actually wants to spider most or all of each website's pages. The solution is to cloak the pages. By spotting page requests from the Google spiders, and delivering modified pages without the normal Session IDs in the link URLs, Google is able to spider all of a site's pages. This is precisely what Google wants, it's what the website owner wants and, if asked, it would be what surfers want. It helps everybody and harms no-one.

This example alone demonstrates that cloaking is not intrinsically wrong or unethical. The technique can be used unethically, but it has various perfectly ethical uses.

How is cloaking done?
A simple way of doing it on an Apache server is by using the .htaccess file with the mod_rewrite module. With an .htaccess file in place, every file request is subject to it.

The .htaccess file has many uses but, for cloaking purposes, it employs Apache's mod_rewrite module to check for the search engine spiders' IP addresses, User-Agents, or both. If a spider is detected, then mod_rewrite is used to return a page that has been specially designed for spiders. If the requester is not a spider, then the request goes through as normal and the normal page is returned. Spiders are not aware of the switch. As far as they are concerned, they are getting the page that they requested.

Fantomas is widely recognized as the best cloaking software around. Information about it can be found here.

Stay tuned for our next installment, "auto-redirection"...

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More Articles

profile

WIA Profile: Lexi Morin

Lexi Morin’s journey into the adult industry began with a Craigslist ad and a leap of faith. In 2011, fresh-faced and ambitious, she was scrolling through job ads on Craigslist when she stumbled upon a listing for an assistant makeup artist.

Women In Adult ·
profile

Still Rocking: The Hun Celebrates 30 Years in the Game

In the ever-changing landscape of adult entertainment, The Hun’s Yellow Pages stands out for its endurance. As one of the internet’s original fixtures, literally nearly as old as the web itself, The Hun has functioned as a living archive for online adult content, quietly maintaining its relevance with an interface that feels more nostalgic than flashy.

Jackie Backman ·
opinion

Digital Desires: AI's Emerging Role in Adult Entertainment

The adult industry has always been ahead of the curve when it comes to embracing new technology. From the early days of dial-up internet and grainy video clips to today’s polished social media platforms and streaming services, our industry has never been afraid to innovate. But now, artificial intelligence (AI) is shaking things up in ways that are exciting but also daunting.

Steve Lightspeed ·
opinion

More Than Money: Why Donating Time Matters for Nonprofits

The adult industry faces constant legal battles, societal stigma and workplace challenges. Fortunately, a number of nonprofit organizations work tirelessly to protect the rights and well-being of adult performers, producers and industry workers. When folks in the industry think about supporting these groups, donating money is naturally the first solution that comes to mind.

Corey D. Silverstein ·
opinion

Consent Guardrails: How to Protect Your Content Platform

The adult industry takes a strong and definite stance against the creation or publication of nonconsensual materials. Adult industry creators, producers, processors, banks and hosts all share a vested interest in ensuring that the recording and publication of sexually explicit content is supported by informed consent.

Lawrence G. Walters ·
opinion

Payment Systems: Facilitator vs. Gateway Explained

Understanding and selecting the right payment platform can be confusing for anyone. Recently, Segpay launched its payment gateway. Since then, we’ve received numerous questions about the difference between a payment facilitator and a payment gateway. Most merchants want to know which type of platform best meets their business needs.

Cathy Beardsley ·
opinion

Reinventing Intimacy: A Look at AI's Implications for Adult Platforms

The adult industry has long revolved around delivering pleasure and entertainment, but now it’s moving into new territory: intimacy, connection and emotional fulfillment. And AI companions are at the forefront of that shift.

Daniel Keating ·
profile

WIA: Sara Edwards on Evolving Clip Culture and Creator Empowerment

Though she works behind the scenes, Sara Edwards has had a front-row seat to the evolution of adult content creation. Having been immersed in the sector since 1995, she has a unique perspective on the industry.

Jackie Backman ·
profile

Segpay Marks 20 Years of High-Risk Triumphs

Payment processors are behind-the-scenes players in the world of ecommerce, yet their role is critical. Ensuring secure, seamless transactions while navigating a rapidly changing regulatory landscape requires both technological expertise and business acumen.

Jackie Backman ·
opinion

The SCREEN Test: How to Prepare for Federal Age Verification

For those who are counting, there are now 20 enacted state laws in the United States requiring age verification for viewing online adult content, plus numerous proposed laws in the works. This ongoing barrage has been exhausting for many in the adult industry — and it may be about to escalate in the form of a potential new AV law, this time at the federal level.

Corey D. Silverstein ·
Show More