Add static ARP entries when network is brought up
Take a look at the scripts in /etc/network/if-up.d. Those are called every time an interface goes to up state. You can create a script with the needed commands and put it
there.
/etc/ethers
This file must contain:
mac ip-address