Recommendations for USB flash drive fast at writing small files [closed]

Solution 1:

I had the same problem: backing up source directories. After trying several USB flash drives I settled on the Sandisk Extreme which has done a fantastic job and is currently the best (sensibly priced) 4K writer by miles

The above scores show its performance (on a USB 3.0 port) compared to 8 leading flash drives. There is a full review at: http://www.whoratesit.com/SanDisk-Extreme-USB-30-16GB/Rating/1301

The Sandisk Extreme is also the value leader in this USB 3.0 flash drive comparison which includes 27 flash drive lab tests.

Solution 2:

I'm surprised no one has talked about the underlying technology. Most newer, larger flash drives use multi-level cell (MLC) flash technology, while older drives use single-level cell (SLC). Small-file performance is much, much better with SLC-based disks.

MLC flash drives are much more dense, and drive firmwares deal with the density by using very large blocks for storing data (not the typical 512-sector blocks that a conventional spindle disk would use). The block size may range from 32 KiB all the way up to 1 MiB. This architecture kills small-file write performance.

SLC flash drives, in short, don't have this problem. Unfortunately SLC drives are more expensive, and also much less dense (typically less than 4 GB).

There are a lot of filesystem optimizations you can do to optimize for MLC's large block sizes, but it is a lot of work since typically you don't know the block size the flash disk is using (they always reports 512-byte sectors, for compatibility reasons). I don't know about Windows, but with Linux there is a lot of tuning you can do optimize writes with ext4 (stride and stride-width) and XFS (su and sw). Generally finding the best parameters is completely empirical—you need to experiment till you find what works best.

I'm not sure whether you can still find SLC-based flash drives on the market (MLC is much cheaper), but a Corsair Flash Voyager 4 GB that I bought in 2007 I believe is SLC instead of MLC, and the small-file performance is superb with it (check benchmarks of it at the time).

Solution 3:

Unfortunately, from my experience, I've never found a flash drive that can write small files at a reasonable speed. This seems to be a curse with flash drives.

One other thing I've noticed: my 16GB Corsair Voyager GT is far slower at writing than the 8 GB model (which is a highly recommended flash drive). This is not only my pesonal experience; it's something I heard from a lot of owners. I can't even use Windows ReadyBoost because the write speed is considered too low.

Solution 4:

Sandisk's Contour & Contour Extreme flash drive product lines cost a little more, but do not lose as much performance with small files (small block writes) versus comparable high-performance drives. I purchased one, and I have to say that the design is elegant and good at protecting the drive. The small file performance is quite good, although oddly the bulk write speed is not as high as advertised.

In this case, it's all in the controller electronics -- the flash itself is nearly identical across drives, although the OCZ high-speed drives use multiple I/O channels, which improves bulk read/write. They degrade the worst with small files, because this comes at the cost of smarter control electronics.

I did a lot of research before purchasing my drive, and my goal was the same as yours -- I did find a couple sites that did benchmarks with files of several kB, but I can't find the links now. They may provide specific figures.

Solution 5:

OCZ Rally 2 Turbo is the fastest I have come across. Still looking for something faster but cant find it!!

http://www.pendrivereviews.com/ocz-rally-2-turbo/