Follow up to #1547: Analyze the performance of LAPIS after switching to communication with SILO via the Arrow format.
Did it become faster? The initial analysis in the PR showed that most of it didn't become significantly faster. Analysis in SILO showed that streaming data from SILO became quite a bit faster with Arrow. Do we lose performance somewhere else in LAPIS? In serializing or deserializing?
Follow up to #1547: Analyze the performance of LAPIS after switching to communication with SILO via the Arrow format.
Did it become faster? The initial analysis in the PR showed that most of it didn't become significantly faster. Analysis in SILO showed that streaming data from SILO became quite a bit faster with Arrow. Do we lose performance somewhere else in LAPIS? In serializing or deserializing?