IPSec software that can use multiple CPU cores

Solution 1:

hifn based crypto accelerator hardware has been in use in BSD for while now; quick Google shows Linux drivers as well. The Express DX 1845 card boasts 25Gbps throughput on their brochure, but YMMV, and obviously I'd want to talk to a product/sales engineer first to see if it would work for your purposes.