Page History

Fixed chunk size

The test scripts are stored here.

...

I evaluated the performance of HDF5 read/write with lots of small appends. The test scripts write a 32 GB file by appending a single 1 MB element at a time. The file is then read back in, again one element at a time. I tested both HDF5's fixed integer and variable length datatypes. i also used For comparison, I repeated the test with analogous calls to fread()/fwrite() to a binary file format. The reads/writes are done sequentially with a single core.

...