"That" vs "those" with multiple singular nouns
It's true that "address and phone number" are plural, but "those" is not correct here. "That address and phone number are correct." is correct, and is the same as saying "That address and that phone number are correct."
There are similar situations where you could use "those". For example, "Those, the address and phone number, are correct."