"Every-day" in Past Tense

every day can be used in any tense. You asked for examples:

In Summer, I go swimming every day. [simple present]

When the holidays arrive, I shall go swimming every day. [future]

When I stayed with my friends by the coast, I went swimming every day. [simple past]

I have been swimming every day this week in order to improve my fitness. [present perfect]

I thought I had been swimming every day but I hadn't -- I blame the drugs. [past perfect]

By next Thursday evening I will have been swimming every day for a whole year. [future perfect]

I would have gone swimming every day, but for my broken wrist. [past conditional perfect (or something)]

To go swimming every day is my goal for 2016. [infinitive]

It seems perfectly correct to me. It refers to a habit in the past and it might be used in sentences like "When I was a kid I went skating every day". Another way to refer to a habit in the past is the use of the modal verb WOULD as in "When I was a kid I'd (would) go skating every day".