If a base goes without power long enough will all my plants/fish die?

Plants and the aquariums do not require power. They therefore will be fine should the power cut out.

Plants don't require oxygen to survive, and fish inside the aquarium do not need oxygen either. So even if the base ran completely out of oxygen, they will be fine.