For starters, SSL certificates cannot be deleted. Once they are issued, they are recorded permanently in the Certificate Transparency Logs, which is a public database containing all SSL certificates. We can hide them in our panel, or it’s possible to revoke the certificate, but actually deleting the certificate is impossible.
And it’s impossible for this to affect your website. The fact that a certificate exists doesn’t affect how your website works, only the certificate that’s actually installed on your site can affect this, which can only be one.
So in short, you cannot delete your certificate. And if you could, it wouldn’t fix your website.
The link @wackyblackie provided is most likely the explanation for this. Let’s Encrypt changed some stuff last year which caused Let’s Encrypt certificates to be considered invalid on older operating systems.
This affects all kinds of operating systems. MacOS, iOS, Android, Windows, Linux all saw errors on older versions. Many of those operating systems quickly got updates, but if your operating system or device is end of life, you’re out of luck.
So your website works fine on most mobile devices, just not your mobile device because the software on it is too old.
Ideally, you should update the software on your phone, or if the manufacturer doesn’t provide updates, get a new phone that’s still being maintained. Because you’ll see this issue with many sites using Let’s Encrypt certificates, and if this hasn’t been fixed, there are likely other security problems on it that haven’t been fixed either.
Alternatively, you can get a certificate from GoGetSSL or ZeroSSL, which both don’t have this issue.