My follower attacks me when I pick up stolen items in my house
The follower's action is not a bug. Some followers are morally conscious and will report any crime you commit while others may not care as much.
You can look up whether or not a follower cares about crime in this UESP page.
The other thing you can do is to 'launder' your items to remove their 'stolen' status.
Not a bug. Technically you are "re-stealing" the item. It doesn't matter what the item's location is, if it's marked as stolen and you pick it up, you just stole something.
Some followers are morally good and will attack you if you steal anything.