[Bug] Refactor archive creation to support nested structures

[pulsargranular]

Description

LTS system prefers archive files of a certain size that are optimal to write and read. Our current implementation creates a uncompressed TAR file which adds files to an archive file as long as it is smaller than the optimum size.

However, the implementation has some limitations:

• it's self-made and might contain bugs or cannot handle certain edge-cases
• the archive files are not compressed
• the archive files are unencrypted
• if the source file is bigger than the optimal archive size, the file is not split into chunks

Solution proposals
There are commercial and non-commercial solutions available that offer such archiving functionalities, such as

• RAR
• 7Zip

Definition of Done

• files of any size are bundled into archive files
• these archive files have fixed size that is most suitable for the LTS system
• optional encryption can be added

[phwissmann]

7z a test.zip \../split -r -mx=0 -v200M seems to be a useful command line