Monoid as a single object category
No, that's not the way to view it. In order to view a monoid as a category, you have a single object $\mathsf{Andreas}$, and each element of the monoid is one morphism $\mathsf{Andreas}\to\mathsf{Andreas}$ in the category. The monoid operation is the composition in the category.
So for the integers, you don't have a morphism "add 1", but a morphism that is simply called $1$. And composition in the category works such that $1$ composed with $1$ is the morphism called $2$.
This is an example of a category where the morphisms are not functions.
You already know that a monoid $M$ is a set with a unit $e$ and a binary operation. More precisely, if $a,b,c\in M$ then $$a\circ b\in M$$ $$(a\circ b)\circ c=a\circ (b\circ c)$$ $$e\circ a=a\circ e=a$$
Now, take any category $C$ with one object, $c$. Since $C$ is a category, we need to say what the arrows are. That is, what the morphisms $c\rightarrow c$ are. There must be a unit $1_{c}:c\rightarrow c$, the arrows must be composeable and the composition must be associative. More precisely, if $f,g$ and $h$ are arrows, then $$f\circ g\in Morph(C)$$ $$(f\circ g)\circ h= f\circ (g\circ h)$$ $$1_{c}\circ f=f\circ 1_{c}=f$$Notice we are $\textit not$ talking about sets here. Just objects and arrows, in the abstract.
But now if we just observe that the operations on $M$ are $\textit exactly$ the same as the operations on $Morph(C)$, we may regard the category $C$ as the monoid $M$. This correspondence is reversible: given category $C=\left \{ c \right \}$ we obtain a monoid $M$ whose elements are the arrows of $C$.
Thus the two descriptions are equivalent.
All this works because the binary operations are the same for both structures.
In addition to Henning Makholm's crisp and clear answer, you might find the opening six pages of my Notes on Category Theory helpful. They too give the example of a monoid as a category, but also give some other examples of categories where the arrows are not functions in any ordinary sense. Another important illustration is the case of a posets treated as a category.
In fact these examples suggest why we might well prefer to talk of 'arrows' rather than 'morphisms' (because the very term 'morphism' comes with baggage, and almost inevitably makes us think of a function -- but to repeat, arrows need not be functions).