Fall for:

informal
1 fall in love with:

Hard:

5 very potent, powerful, or intense

Putting them together, fell hard for would mean that Mr. Frazier fell intensely in love with the house which reminded him of a space ship.