Commit 23780b9
Yuma Ichikawa
Wire setup_discs_data.sh to the pre-converted HF Hub dataset
The Hugging Face dataset Yuma-Ichikawsa/discs-co-bench now hosts the
already-converted `.gpickle` + `manifest.jsonl` tree (~3.9 GB, 15486
instances across 32 subsets), so users no longer need to download the
6.7 GB raw tarball and run the converter when starting from a clean
checkout.
Changes:
* fix the default HF_REPO_ID to the actual namespace
(`Yuma-Ichikawsa/discs-co-bench`).
* `fetch_hf` now snapshots straight into `data/discs/` (DST) using
`allow_patterns` to fetch only the four problem trees + manifests,
and skips `convert_discs_to_qqa.py` entirely.
* the gdrive code path is unchanged and still does
download + extract + convert for users who explicitly opt out of the
Hub.
Verified end-to-end with a fresh `snapshot_download` of the
mis/satlib subset (500 .gpickle + 1 manifest.jsonl) into a tempdir,
which loads correctly via `pickle.load` -> networkx.Graph.1 parent 9e9b46a commit 23780b9
1 file changed
Lines changed: 15 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
34 | 34 | | |
35 | 35 | | |
36 | 36 | | |
37 | | - | |
| 37 | + | |
38 | 38 | | |
39 | 39 | | |
40 | 40 | | |
| |||
69 | 69 | | |
70 | 70 | | |
71 | 71 | | |
72 | | - | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
73 | 76 | | |
74 | 77 | | |
75 | 78 | | |
| 79 | + | |
76 | 80 | | |
77 | 81 | | |
78 | 82 | | |
79 | | - | |
80 | | - | |
| 83 | + | |
| 84 | + | |
81 | 85 | | |
82 | 86 | | |
83 | 87 | | |
| |||
116 | 120 | | |
117 | 121 | | |
118 | 122 | | |
119 | | - | |
120 | | - | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
121 | 130 | | |
122 | 131 | | |
123 | 132 | | |
| |||
0 commit comments