Can you finish the game siding with Caesar as a woman?
Solution 1:
Yes.
You will be talked down to, insulted, barred from fighting in the arena, and may be locked out of the occasional unmarked quest, but it is entirely possible to side with the Legion with a Female character.
Why you'd want to on the other hand...