Dangling modifiers in sentences involving "Looking back"
Solution 1:
They do have the appearance of a 'dangling modifier', but are probably acceptable.
The participial's subject is usually understood to be that of the main clause.
Looking back, I think I treated them badly.
Here the subject of the main clause is also that of the participial looking back.
However, the subjects of the main clauses in the example sentences given - not learning cycling at an early age in the first sentence, and my biggest regret in the second - would be impossible to interpret as the subject of looking back. So even though these may be classified as 'dangling modifiers', there would be no ambiguity or confusion in the interpretation.
Another example of a participial that might be classified as a 'dangling modifier', but seems acceptable:
Looking back, three relatively recent events signaled the depth of the problems that have overwhelmed the company. (GM AND ME, ALEX TAYLOR III, Fortune, Vol. 158, Iss. 11; pg. 92)