What can I invest in with my excess of Caps?

Solution 1:

Try the Thorn out by Westside, you can set up custom fights for a few hundred caps.
Also, if you are looking for good weapons you can bet caps on, I would suggest looking for custom weapons and modding them. For example, the Ratslayer is a fully modded varmin rifle in the broc flower cave.