Does sending human settlers to Graygarden affect anything?

No, there is no impact on the main story but obviously having additional people and further developments on site will aid in any "protect this settlement" mission as they come up.

Graygarden settlement has a lot of area to build in as there is a section of elevated highway within the settlement that you can build both on and under.