Page History

Versions Compared

Key

This line was added.
This line was removed.
Formatting was changed.

...

Code Block
dset = f.create_dataset("BigDataset", (1000,1000), dtype='f', compression="gzip") >>> dset.compression 'gzip' >>> dset.compression_opts 9

GZIP features:

Works with all HDF5 types
Built into HDF5 and available everywhere
Moderate to slow speed compression
Performance can be improved by also using SHUFFLE

...

Works with all HDF5 types
Fast compression and decompression
Is only available in Python (ships with h5py); C source available

SHUFFLE

Code Block
>>> dset = myfile.create_dataset("Data", (1000,), compression="gzip", shuffle=True)

References