Alternatives to "Or so I thought"?

Solution 1:

You can use at first glance, which has one less syllable.

when first considering something, before having a chance to look at it carefully

At first glance the deal looked wonderful, but after reading the fine print he wasn’t so sure.

Cambridge