Comunica Performance Assets

This repository contains assets for different benchmarks within comunica projects.

Assets

• ldbc-snb-01.tar.gz: The LDBC SNB Interactive dataset and queries generated at scale 0.1 (4 028 513 triples, dataset.nt is 706 549 048 bytes (674 MiB) uncompressed, the tarball is 37 128 573 bytes (35 MiB)). Collected via jbr 6.2.0 with @jbr-experiment/ldbc-snb 6.2.0, using the rubensworks/ldbc_snb_datagen@sha256:5905733b091ca2cc2cf55b43600644d5682d6357d759c9c69934d1b79087e057 image it pins, with scale "0.1", queryCount 2, querySeed 12345, hadoopMemory "4G" and generateHdt false. Contains generated/dataset.nt, generated/queries/ (21 templates with 2 instantiations each) and generated/parameters-*.csv; the raw datagen output (generated/out-snb) and generated/params.ini were removed. Collected using tar --no-xattrs --exclude=".*" -zcf ldbc-snb-01.tar.gz generated/*. Can be untarred using curl -s -L https://github.com/comunica/comunica-performance-assets/raw/master/ldbc-snb-01.tar.gz?download= | tar --exclude=".*" -xz.
• ldbc-snb-03.tar.gz: The LDBC SNB Interactive dataset and queries generated at scale 0.3 (12 399 302 triples, dataset.nt is 2 174 366 791 bytes (2.0 GiB) uncompressed, the tarball is 118 215 808 bytes (113 MiB)). Collected via jbr 6.2.0 with @jbr-experiment/ldbc-snb 6.2.0, using the rubensworks/ldbc_snb_datagen@sha256:5905733b091ca2cc2cf55b43600644d5682d6357d759c9c69934d1b79087e057 image it pins, with scale "0.3", queryCount 5, querySeed 12345, hadoopMemory "4G" and generateHdt false. Contains generated/dataset.nt, generated/queries/ (21 templates with 5 instantiations each) and generated/parameters-*.csv; the raw datagen output (generated/out-snb) and generated/params.ini were removed. Collected using tar --no-xattrs --exclude=".*" -zcf ldbc-snb-03.tar.gz generated/*. Can be untarred using curl -s -L https://github.com/comunica/comunica-performance-assets/raw/master/ldbc-snb-03.tar.gz?download= | tar --exclude=".*" -xz.
• solidbench-01.tar.gz: The SolidBench dataset generate at scale 0.1. Collected via jbr using tar --no-xattrs --exclude=".*" -zcf generated.tar.gz generated/*. Can be untarred using curl -s -L https://github.com/comunica/comunica-performance-assets/raw/master/solidbench-01.tar.gz?download= | tar --exclude=".*" -xz.
• watdiv-10.zip: The WatDiv dataset generated at scale 10.
• watdiv-100.zip: The WatDiv dataset generated at scale 100 (11 014 612 triples), with the HDT conversion and index included. Collected via jbr with queryCount 5 and queryRecurrence 1, using the same comunica/watdiv and rdfhdt/hdt-cpp images jbr pins. Can be unzipped using curl -s -L https://github.com/comunica/comunica-performance-assets/raw/master/watdiv-100.zip?download= > watdiv-100.zip && unzip watdiv-100.zip -d generated/.