"I'm not crowding you, am I?" figuratively

In Persian, when we are criticized for our presence somewhere, we sometimes say "I'm not crowding you, am I?" It is used figuratively to mean "Why should you feel uncomfortable about my presence?" For example:

A: Who told you to be here? Leave at once!

B: I'm not crowding you, am I?

I wonder if there is something like that in English.

Probably in the way conveys the meaning you are referring to:

If you say that someone gets in the way or is in the way, you are annoyed because their presence or their actions stop you doing something properly.

• 'We wouldn't get in the way,' Suzanne promised. 'We'd just stand quietly in a corner.'

(Collins)