"Muss man dabei gewesen sein" in English
German has an idiom,
(Da) muss man dabei gewesen sein
I'd say it means
You cannot understand the emotion/memory if you weren't present when it happened.
I couldn't find an equivalent English idiom, so I'm counting on your knowledge.
The English saying is
You had to be there!