No, don’t change it to byet.org nameservers. It will cause random errors with infinity free. Even you changed, you didn’t save it perhaps or some other error. You should try contacting your domain registrar.
Judging by the nameservers saying VERIFY and your domain being registered about two weeks ago, I suspect your domain registrar has suspended your domain name because you did not complete the registrant verification in time.
When you register a new domain name, your registrar is required to validate your registrant contact email. If you don’t do this within two weeks, they must suspend your domain.
So please check this with your domain provider. They should be able to check why your nameserver settings are not taking effect, or guide you through the registrant verification if required.