In this sentence, what does "starting to forget" mean?
I take "starting to forget" as meaning something like "occasionally unable to remember".
Forgetting doesn't happen all at once. Rather, the number of times to try to remember, and can't, goes up with time. At other times, the memory comes back to you.