Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The HDF5 group indicated that variable length performance would be poor. However, I see it outperform fixed size in most cases. Variable length writing is significantly faster for both chunking cases and reading 1024 element chunked data. Fixed size reading for 16 element chunks is about 10% faster than variable length. All cases are compared to benchmark results for the drive (Intel DC P3520 formatted with ext4) using fread() and fwrite() to binary data.

 

 

Chunk caching

The read performance in this usage case 20-50% less than what we see from dd (~600 MB/s). It could use some improvement.

...