What exactly is a countable union?
Solution 1:
Yes. Countable union means the index set over which one is taking the union is countable. In this case it is $\mathbb{N}$, which is countable.
Incidentally, in this case, each of the $A_{i}$'s also happen to be countable, so what you have is a countable union of countable sets.