Yes, using the natural notion of convergence for formal power series, the stated sum does indeed converge to the Cauchy product. One should beware - as exemplified in this thread - that there is widespread confusion about formal vs. functional power series - even by some experts (in other fields). Rota frequently told jokes in his lectures about certain distinguished mathematicians who published complete nonsense based on such confusion (Indiscrete Thoughts!)

In any case the basic ideas are quite simple if you merely take off your analyst hat and, instead, put on your algebraist or combinatorist hat. In particular, you should be able to find a correct discussion of convergence of formal power series in almost any good book on combinatorics or generating functions, e.g. here is an excerpt from Stanley's classic $\: $ Enumerative Combinatorics I.

enter image description hereenter image description hereenter image description here