Skip to content

Fix 4GB part size limit in hori_buffer_len#9

Open
draimundo wants to merge 3 commits intoChristianSteger:mainfrom
draimundo:main
Open

Fix 4GB part size limit in hori_buffer_len#9
draimundo wants to merge 3 commits intoChristianSteger:mainfrom
draimundo:main

Conversation

@draimundo
Copy link
Copy Markdown

When building HORAYZON on my 64-bit machine according to the README, the int are interpreted as int32_t.

This is not an issue for most variables, however for the buffer length specified by hori_buffer_size_max in horayzon.horizon.horizon_gridded, which then gets used to specify the sizes of the parts in bits, this means I am limited to (2^31-1) bits, which is about 4GB. In some usecases (including mine), this means generating hundreds of files, which is unwanted.

I propose specifying the type of hori_buffer_len to avoid this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant