Robots.txt Plugin

A robots.txt file is a simple text file placed on a website that tells search engine robots (like Googlebot) which parts of the website they can crawl and index. It's like a set of instructions for these bots, guiding them on what to access and what to avoid.

We recognise that this is a valuable tool for website owners who want to control how their site is crawled and indexed by search engines. Hence, we provide both a public and paid version of the plugin.