When routers communicate with HTTPS, how is their identity confirmed?

It use a so-name "self signed certificate", yes, it can be insecure. BUT if you "permanently accept" it when you are physical wired to you router, after that, you can always trust your router as long as it don't want to set another certificate.