Use of 'Could' in the Past Tense
All of them make sense except, I would suggest, the first one.
If he was invited and came one would say 'He came yesterday'. If however he was invited, indicated he could come, but nonetheless declined, one would say 'He could have come yesterday'.
'He could not come yesterday' would indicate that he had been invited, but had been unable to come.
& 4. These would be the perfectly usual ways of indicating whether or not someone would have been able to come, had they been invited.