Is "minus your points" a valid phrase?

It is an unfortunate but not an uncommon use of the word. In environments where math is done and spoken of casually such corruptions are not unusual. They should have some of their points minused themselves.