The Robots.txt file is what tells the search engines which pages to access and index on your website and which pages not to.

You may need to use the full-screen option to see the video more clearly.

Step By Step Guide

In The Toolkit , go to Search Engines and then Robots.

Paste in your 'Custom Robots.txt'.

For any extra information regarding the syntax of Robots.txt files feel free to view the following page below.
Find Out More

Related Articles

© Copyright 2023 Toolkit Websites LtdWeb Design By Toolkit Websites