Unable to allocate memory

[stanleyjs]

Hi,

I am trying to open an RData file with pyreadr. I receive a librdata error for memory allocation. The file opens to 23.1gb in R. I have 64gb of memory (about 55gb free showing in top when I try to import the data in Python).

Here is the traceback

---------------------------------------------------------------------------
LibrdataError                             Traceback (most recent call last)
<ipython-input-4-580e0186f0c1> in <module>
----> 1 result = pyreadr.read_r(path)

~/.local/lib/python3.8/site-packages/pyreadr/pyreadr.py in read_r(path, use_objects, timezone)
     46     if not os.path.isfile(path):
     47         raise PyreadrError("File {0} does not exist!".format(path))
---> 48     parser.parse(path)
     49 
     50     result = OrderedDict()

~/.local/lib/python3.8/site-packages/pyreadr/librdata.pyx in pyreadr.librdata.Parser.parse()

~/.local/lib/python3.8/site-packages/pyreadr/librdata.pyx in pyreadr.librdata.Parser.parse()

LibrdataError: Unable to allocate memory

Pyreadr is install from git using pip install git+https://github.com/ofajardo/pyreadr.git.

I pulled the latest bz, lzma, and other dependencies from aptitude on Jan 27, 2020.

Thanks

[ofajardo]

@evanmiller any thoughts on this? I don't understand very well how librdata manages memory.