How to stop endermen from taking blocks without cheats
Solution 1:
As on the minecraft wiki,
Endermen can pick up these blocks, if you build your walls out of something not listed here, such as Cobblestone, they can't pick it up. Just remember they are able to teleport into your base through the wall.