Can really big folder (more than one million files) slow Nginx down?

Solution 1:

Yes, the big folder can slow everything down.

It would depend on your filesystem, and there's a lot of good pointers and some advice here: Filesystem large number of files in a single directory