|
1 | 1 | classdef DataPipe < handle |
2 | | - %DATAPIPE Summary of this class goes here |
3 | | - % Detailed explanation goes here |
| 2 | + %DATAPIPE gives advanced write directions to HDF5 for a dataset for |
| 3 | + %chunking, compression, and iterative write. |
| 4 | + % DATAPIPE directs HDF5 to use chunking and GZIP compression when |
| 5 | + % saving the dataset. The chunk size is automatically determined and |
| 6 | + % the compression level is 3 by default. |
| 7 | + % |
| 8 | + % DATAPIPE(..., 'data', DATA) Preload DATA in the Dataset. This can |
| 9 | + % be omitted if the DATA will be appended later |
| 10 | + % |
| 11 | + % DATAPIPE(..., 'maxSize', MAXSIZE) Sets the maximum size of the HDF5 |
| 12 | + % Dataset. To append data later, use the MAXSIZE of the full |
| 13 | + % dataset. Inf on any axis will allow the Dataset to grow without |
| 14 | + % limit in that dimension. If not provided, MAXSIZE is infered from |
| 15 | + % the DATA. An error is thrown if neither MAXSIZE nor DATA is provided. |
| 16 | + % |
| 17 | + % DATAPIPE(..., 'axis', AXIS) Set which axis to increment when |
| 18 | + % appending more data. Default is 1. |
| 19 | + % |
| 20 | + % DATAPIPE(..., 'dataType', DATATYPE) Sets the numerical data type. |
| 21 | + % This should be set if DATA is omitted. If DATA is provided and |
| 22 | + % DATATYPE is not, the data type is inferred from the provided DATA. |
| 23 | + % |
| 24 | + % DATAPIPE(..., 'chunkSize', CHUNKSIZE) Sets chunk size. Must be less |
| 25 | + % than MAXSIZE. If not provided, the CHUNKSIZE will be automatically |
| 26 | + % determined. |
| 27 | + % |
| 28 | + % DATAPIPE(..., 'compressionLevel', COMPRESSIONLEVEL) sets a |
| 29 | + % GZIP compression level. Default is 3. |
| 30 | + % |
| 31 | + % DATAPIPE(..., 'offset', OFFSET) Axis offset of dataset to append. |
| 32 | + % May be used to overwrite data. |
| 33 | + % |
| 34 | + % DATAPIPE(..., 'hasShuffle', HASSHUFFLE) controls whether bit |
| 35 | + % shuffling is turned on during compression. This is lossless and |
| 36 | + % tends to save space without much cost to performance. Default is |
| 37 | + % False |
| 38 | + % |
| 39 | + % DATAPIPE('filename', FILENAME, 'path', PATH) load a pre-existing |
| 40 | + % HDF5 Dataset directly using the FILENAME of the file and the PATH |
| 41 | + % of the dataset within that file. These arguments cannot be used |
| 42 | + % with any of the above arguments, which are for setting up a new |
| 43 | + % DataPipe. |
4 | 44 |
|
5 | 45 | properties (SetAccess = private) |
6 | 46 | internal; |
|
0 commit comments