Ubuntu 18.04 minimal server has two IP addresses!
I have struggled with this exact same problem and every search comes up with several others experiencing the same issue with no resolution.
FINALLY, here is what solved it for me:
ip addr flush dev <your_adapter_id>
for me it was
ip addr flush dev enp0s4
This kills the secondary IP.