Slow sequential speeds on 9x7-drive raidz2 (ZFS ZoL 0.8.1)

Solution 1:

Good question.

  • I think your sparse zvol block size should be 128k.
  • Your ZIO scheduler settings should all be higher, like minimum 10 and max 64.
  • zfs_txg_timeout should be much longer. I do 15 or 30s on my systems.
  • I think the multiple RAIDZ3's (or was that a typo) are overkill and play a big part in the performance. Can you benchmark with RAIDZ2?

Edit: Install Netdata on the system and monitor utilization and ZFS stats.

Edit2: This is for a Veeam repository. Veeam support Linux as a target, and works wonderfully with ZFS. Would you consider benchmarking that with your data? zvols aren't an ideal use case for what you're doing, unless the NIC's offload is a critical part of the solution.