Correct use of 'with' or 'at' when talking about percentages?

Use 'with' if you are reporting the percentage as a fraction of the whole. Use 'at' if you are reporting the percentage as a target or score.

"William won the school election, with 62% of the votes."

"The polls indicated that William's approval rating was at 73%."