Invalid response from .well-known/acme-challenge/<token>

This was fixed by adding the following into my nginx config:

listen 80;
listen [::]:80;

It works flawlessly now.