I also tested extending an HDF5 dataset by 2 bytes at a time, up to a limit of one million elements, for fixed and variable length datatypes. I measured the writing and read speeds as a function of chunk size.

The overall performance is poor, in the range of a few MB/s.

 

Fixed datatype

 

Variable length datatype

  • No labels