Is it possible to not have too many shards?

Having to many shards only effects if you get the bad or good ending.

To get the bad ending you need to get the Zangetsu sword and fight Gebel.

While fighting Gebel with the sword wait until the moon turns red, jump up, strike the moon, and then you completed the battle and get the good ending. You can then explore the next two chambers.