Adjectival step by step

grammar hyphenation orthography compound-adjectives

According to Wiktionary, step by step is the adverbial form, whereas step-by-step is the adjectivial. So your second example is the correct one.

Related

"in for a penny, in for a pound"
"Can" vs. "could" in asking a question [duplicate]
What is a good convention for expressing different currencies?
Difference between "cross with you" and "angry with you"
What is it called when a single word is offset by commas?
What was the original sound of rh?
Confusing meanings of "inexorable" and "unstoppable"
Etymology of "what gives"?
Why names such as Hastings-on-Hudson?
To lose someone something
Pronouns: a word class or a subclass of nouns?
Would anyone use "ramp down" as the opposite to "ramp up"