Should you recruit every trainer in Pokemon Conquest?

I haven't played conquest in a while but when I played I always played with the max amount of trainers and I did check to see if having less would do anything to exp I didn't really notice much of a difference so I'd say just find the strongest and use them and don't worry about the weaker ones (yes I realize this is a really late answer)