how to optimize robot

How to set up WordPress robots txt using yoast robots

For this purpose to understand this method we create this post to How to set up WordPress robots txt

using yoast robots Robots. txt file is use to direct search engine that which page or post can be crawl or not crawl.

There are many seo plugins that use to enhance your site seo like All in One Seo and   Yoast Seo Plugin.

You also check our article how to add plugin in WordPress, After read this article you will be

able to install a plugin in WordPress site.

 

1. Go to Yoast Seo

First login on your WordPress dashboard, For this purpose we create an article

how to login WordPress admin panel. check this article you will be learn some useful things about your wp site.

After you login on your wp dashboard and go to yoast seo plugin click on tools as show in

below pic.

yoast seo robots
yoast seo robots

 

2. Click on File Editor.

After click on tools you will be goes to tools page, In which a word is

showing File Editor, Click on that file editor to open the main robots txt wordpress seo yoast as show in

below snap.

yoast robots
yoast robots

 

3. Main Robots File.

                                            Robots file is use to understand the search engine to which page is crawl and

not which post is not crawl. When site is grow some time the admin want that some pages or not index.

This ways that you block your admin pages or other unnecessary pages to not crawl by search engine

that crawl quota of your site is save and its utilized to your other most important pages that you want to

crawl by search engine.  

Check the below pic.

robots txt wordpress seo yoast
robots txt wordpress seo yoast

 

4. Save your Changes.

As shown in the above pic change your robots. txt file and than save

your info. In this article we try to understand you how to set up WordPress robots txt using yoast robots.

 

how to setup wordpress robots txt
how to setup wordpress robots txt

Thanks for reading and share this article.