The meta robots tag is an HTML element in a page's <head> that gives search engines indexing and link-following instructions such as noindex or nofollow.
The is an element in a page's <head>. It tells search engines whether a page may be and whether links on the page should be followed.
Example:
<meta name="robots" content="noindex, follow">
Common values are index/noindex (allow or prevent indexing) and follow/nofollow (follow links or not). Multiple values should ideally be combined into a single tag to avoid conflicts.
The meta robots tag is suited to normal HTML pages. For search engines to read it, the page must be ; blocking it via robots.txt prevents this. For non-HTML files such as PDFs, the in the header is used instead.