how to understand $\log\zeta(s)$ (Riemann zeta function)?
Solution 1:
Is $\zeta(s)$ defined in a simple connected region? If not, how shall I understand $\log\zeta(s)$?
Since you restrict $s$ to the half-plane $\Re(s) > 1$, it is indeed the case. The result that you state then tells you that there exists some analytic function $g$ defined on $\Re(s) > 1$ and such that $\exp \circ g = \zeta$ on $\Re(s) > 1$. Such a function is called a logrithm of $\zeta$ on $\Re(s) > 1$. Remark that for every $k\in\mathbb{Z}$, the function $g + i2k\pi$ is still a logarithm of $\zeta$ since $e^{i2\pi}=1$. In fact, it is the only possibility: if $g_1$ and $g_2$ are two logarithms of $\zeta$ on $\Re(s) > 1$, then there is some integer $k\in\mathbb{Z}$ such that $g_2 - g_1 = i2k\pi$.
With this understanding of the logarithm, you will only know (with the proof of user58512) that the identity $$ \log \zeta(s) = -\sum_p\log(1-p^{-s}) $$ is true modulo $i2\pi$ for every $\Re(s)>1$.
Principal value of the logarithm
The function $z\mapsto z$ is analytic on $\mathbb{C}$ but vanishes at $z = 0$. To overcome this issue, we restrict ourselves to $\mathbb{C}\setminus\mathbb{R}_-$ which is a open and simply connected domain where $z$ does not vanish. Hence, it admits logarithms and we could chose any one of them... but it would wonderfull if our complex logarithm coincides on $(0;\infty)$ with the usual real logarithm . This is possible! We call this one principal value of the complex logarithm.
Proof of the identity
Let us take $\log \zeta$ to be the logarithm of $\zeta$ on $\Re(s) > 1$ such that $\log\zeta(s)$ coincides with the real logarithm $\log(\zeta(s))$ when $s$ is real (so that it will be the principal value).
The identity $$ \log\zeta(s) = - \sum_p \log(1-p^{-s}) $$ is easy to get from Euler's product formula when $s \in (1;\infty)$ is a real number. But both sides of this equation extend analyticaly to $\Re(s) > 1$, so that according to the analytic continuation theorem, they are equal on $\Re(s)>1$.