Applications of Probability Theory in pure mathematics
The topic of Probabilistic Combinatorics. See http://en.wikipedia.org/wiki/Probabilistic_method
This is a powerful way of giving non-constuctive existence proofs for lots of different (finite) mathematical structures and determining their properties.
I found this the highlight of all my undergraduate probability courses. If you are interested in learning more I would recommend: "The Probabilistic Method" by Alon and Spencer.
The Erdős–Kac theorem shows that the (log of the log of the) prime factors of a number are Poisson/normally distributed.