I'm falling out with you
Solution 1:
The idiom in the doghouse can apply in this situation:
In trouble with someone due to one's misdeeds or blunders.
I'll be in the doghouse if I come into work late again this week.
You've been in the doghouse with Maria ever since you forgot her birthday.
The Free Dictionary by FARLEX