How to Keep Your Site off Google

There are tons of great articles for getting your site indexed by Google and other search engines. But what if you, for some reason, just don’t want something to be plastered across peoples search results? Maybe it’s a login page or even just a personal website of yours that has no reason to be on a search engine.

Let’s get down to business. Create a new blank text file called robots.txt in the root directory of your site. Put the following text into it exactly as you see it below.

User-agent: * Disallow: /

This should keep all search engine bots from indexing all pages past that point. If your site is already indexed though, it might become more problematic.

This entry was posted on Friday, October 23rd, 2009 at 5:30 pm and is filed under Technology. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

Leave a Reply

 

NO-WWW