Skip to content

Temp files created from LOBs not cleaned up until program shutdown #638

Description

@seso-kdrs

@luis100 I also noticed millions of files in /tmp with names such as dbptk15571006134030973464lob

It seems like cleanResources() is not called until DBPTK quits, causing the /tmp directory to grow to 100's of gigabytes during indexing. This is not strictly related to mime detection, would you like a seperate issue for this?

Our workaround was the following cron job while indexing SIARD files with a large number of LOBs:
*/2 * * * * root docker exec <container> find /tmp -name "dbptk*" -type f -mmin +1 -delete

Originally posted by @seso-kdrs in #636

Seems to be caused by this line:

TemporaryPathInputStreamProvider temporaryPathInputStreamProvider = (TemporaryPathInputStreamProvider) binaryCell .getInputStreamProvider();

Where cleanResources() is not called on the TemporaryPathInputStreamProvider until program shutdown.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions