Editing Noindex (section)

== Noindexing entire pages ==
<syntaxhighlight lang="html">
<html>
<head>
  <meta name="robots" content="noindex">
  <title>Don't index this page</title>
</head>
</syntaxhighlight>

Possible values for the meta tag content are: "none", "all", "index", "noindex", "nofollow", and "follow". A combination of the values is also possible,<ref name="W3spec" /> for example:
<syntaxhighlight lang="html">
<meta name="robots" content="noindex, follow">
</syntaxhighlight>
	
=== Bot-specific directives ===
The noindex directive can be restricted only to certain bots by specifying a different "name" value in the meta tag.
For example, to specifically block Google's bot,<ref name="google_noindex">[http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=93710 Using meta tags to block access to your site], Google Webmasters Tools Help</ref> specify: 
<syntaxhighlight lang="html">
<meta name="googlebot" content="noindex">
</syntaxhighlight>

Or, to block Bing's bot, specify: 
<syntaxhighlight lang="html">
<meta name="bingbot" content="noindex">
</syntaxhighlight>

Or, to block Baidu's bot, specify: 
<syntaxhighlight lang="html">
<meta name="baiduspider" content="noindex">
</syntaxhighlight>

=== robots.txt file ===
A [[Robots exclusion standard|robots.txt]] file can be used to block crawling.