Does it make sense to say "to be cross over something" with cross meaing annoyed?

Yes, according to https://www.oxfordlearnersdictionaries.com/us/definition/english/cross_3#:~:text=cross

​cross (with somebody): annoyed or quite angry

I was cross with him for being late.

Please don't get cross. Let me explain.