Ubuntu 14.04 getting ping: sendmsg: Operation not permitted

Solution 1:

IPtables sometimes gets a little...wonky and there's many rules that don't get removed or get left befind.

Try iptables --flush to delete all your iptables rules.