How do mathematicians think about the existence of numbers?
Solution 1:
The famous British mathematical physicist Roger Penrose wrote an entire book on this subject: The Road to Reality: A Complete Guide to the Laws of the Universe (Knopf, 2005). In fact you can get a very good idea of his version of the Platonic theory just from Chapter 1, pages 7-24. He sees a tripartite world, divided into physical, mental, and mathematical domains. It's an interesting approach, and perhaps deserves special attention due to his prominence within both mathematics and physics. The book itself is just over a thousand pages long, and requires some mathematical maturity to comprehend. If you have what it takes, then it is well worth the effort.
Solution 2:
Number is a property of collections.
Imagine a very long train passes before you, with each car containing two objects and the contents of each car open to plain view: [two goats]--[two light bulbs]--[two shoes]--[one dolphin, one boat]--[one rock, one picture]--[one book, one dish]--, so on so forth. Eventually, it will strike you that the contents of these cars are all couples. That is to say, two is one of the common properties of the contents of all these cars. This is the psychological foundation why humans can sense numbers. It is the same as why humans can understand words like red, yellow, blue. No one ever saw colour independent of other properties such as shape, area, etc. When you see a red apple, red towel, red roof and a red shoe, you will notice that red is what these things have is common, although red has never been seen alone.
The longer the train, the fewer properties the contents of those cars have in common. As the train grows longer, eventually the contents of those cars will have only their number in common. Thus, one is what ALL singles have in common; two is what ALL couples have in common; three is what ALL triples have in common; so on so forth.
Technically, a number is a class whose members are also classes that are similar to each other but not with any classes outside of the parent class.* By "similar" we mean one-one relation. Notice that we can't say "all classes of the same size," because size is a number and number is what we are trying to define at this point. This definition of number is called ostensive definition, as opposed to dictionary definition.
For example: two is the class of all couples: { {foo, bar}, {a, b}, {c, d}, {Kramer, Seinfeld}, {Elaine, George}, {a goat, a truck}, ... }
For precise definition, see Introduction to Mathematical Philosophy, "Definition of Number", by Bertrand Russell.
*This limitation only applies to one particular type. Of course, a member class can always have similar classes from a different type, but it is meaningless to group these similar classes of different type within one parent class.