Hello!
I tried adding a “robots.txt” to the “htdocs” folder of my website, so Google can crawl it. However, when I try accessing it, like domain.cf/robots.txt it keeps redirecting me to my 404 page.
This should be the URL to my robots.txt file: https://strangertime.cf/robots.txt
This is my website URL: https://strangertime.cf/
I am trying to index my website into Google and it kept rejecting it, so I thought it might be because of the robots.txt.
Not sure if I am doing something wrong or it is an error.