Search engine bots cannot read my URLs

[plusultra]

https://erfolg-mit-franchise.ml

(please specify the website or account you are asking about)

Error Message

“The inspected URL is known to Bing but has some issues which are preventing indexation.”

With bing search console, Live URL test, I am informed that Bing sees the following content, rather than the HTML I am serving for the same URL:

This site requires Javascript to work, please enable Javascript in your browser or use a browser with Javascript support

Other Information

I have successfully verified my site in Bing Search Console (and also in Google Search Console).

The same URL successfully shows the intended HTML when I open it in the web browser.

In the infinityfree forum I found a hint that the URLs require javascript, but can be accessed by search engine crawlers:

Ensuring only web browsers can access your website

InfinityFree is a website hosting service. That means that the hosting accounts we provided are intended for hosting websites. Websites contain pages that are accessed through web browsers. InfinityFree is not intended to be used for file sharing, API hosting, database hosting or background tasks/tools. To help enforce this, free hosting enforces a security system that makes sure that anyone trying to access your website is using a normal web browser. This is done by checking whether the web br…

However, none of my URLs is indexed by Google and Bing, they both tell me that they cannot access my URLs which are hosted at infinityfree.

[Oxy]

Hi and welcome to the forum

• https://search.google.com/test/rich-results/result?id=D37H-v5VxjN106PU-Mzffg

As far as I can see, Google succeeds in everything
Can you tell us exactly what was listed as an error in the google search console?

Bing webmaster tools is “poorly made”
bot is not separated from other MS services (ASN)
and I also believe that the live preview does not directly use BOT
but some other engine (again a different mix IP address) while in fact, the real bot has access to this hosting. You just need to be patient until the bing bot decides to start crawling.

---

I am also interested in whether you have any custom .htaccess ?

because let’s say if I request any .txt file
your site offers that zero-byte file as a download (non-existent), and that’s not good behavior!

• https://erfolg-mit-franchise.ml/robots.txt

Or

• https://erfolg-mit-franchise.ml/.txt

Or

• https://erfolg-mit-franchise.ml/whatever.txt

---

The problem is also because your XML sitemap file
instead of opening in the browser - download is forced !

[plusultra]

Thank you very much for your detailed and helpful answer. I have fixed the issues you mentioned. Plus in the meantime Google Search Console also tells me that it successfully retrieves the URLs. So indeed, the observation in Bing appears to be an issue on the side of Bing.

[Oxy]

You still need to solve this https://erfolg-mit-franchise.ml/sitemap.xml

The downloads is forced instead of serving the XML file (possible problems with some of the search engines because of this), only when I download that file and open it
I see URLs/links from your sitemaps.