It's "1 degrees" or is it "1 degree" outside?

No it is not correct. 1 is a singular unit, so at 1 degree you are one unit above your zero point.

You can have 1 or -1 degree outside. Anything else should be plural.