This could be because the page is unavailable or blocked by robots.txt

I am not submit my website robots.txt to Google search console
my robots.txt file are
ser-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: http://****.com/sitemap_index.xml

Help me pls any one

Where is this robots.txt file exactly? Would you mind sharing the full URL of the file?

1 Like