Skip to content

Commit 2525ec4

Browse files
committed
fixup! Parquet to BigQuery import for GCP-backed AnVIL snapshots (#6355)
1 parent 5b89fc2 commit 2525ec4

File tree

4 files changed

+8
-5
lines changed

4 files changed

+8
-5
lines changed

UPGRADING.rst

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -25,8 +25,11 @@ have too many entries in this file.
2525

2626
The ``mksrc`` function has been updated to include a parameter specifying the
2727
type of each source (either "parquet" or "bigquery"). For each of your personal
28-
deployments, specify "bigquery" for all sources. As always, use the sandbox
29-
deployment's ``environment.py`` as a model when upgrading personal deployments.
28+
deployments, specify "bigquery" for all sources, except for source
29+
``ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732`` for any personal deployments
30+
colocated with ``anvildev``, which should use "parquet". As always, use the
31+
sandbox deployment's ``environment.py`` as a model when upgrading personal
32+
deployments.
3033

3134

3235
#6446 Base image of Azul image is not pinned to digest

deployments/anvilbox/environment.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ def mkdict(previous_catalog: dict[str, str],
7373

7474

7575
anvil_sources = mkdict({}, 3, mkdelta([
76-
mksrc('bigquery', 'datarepo-dev-e53e74aa', 'ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732', 6804),
76+
mksrc('parquet', 'datarepo-dev-e53e74aa', 'ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732', 6804),
7777
mksrc('bigquery', 'datarepo-dev-42c70e6a', 'ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520', 28),
7878
mksrc('bigquery', 'datarepo-dev-97ad270b', 'ANVIL_CMG_Sample_1_20230225_ANV5_202302281509', 25)
7979
]))

deployments/anvildev/environment.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ def mkdict(previous_catalog: dict[str, str],
6464

6565

6666
anvil_sources = mkdict({}, 3, mkdelta([
67-
mksrc('bigquery', 'datarepo-dev-e53e74aa', 'ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732', 6804),
67+
mksrc('parquet', 'datarepo-dev-e53e74aa', 'ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732', 6804),
6868
mksrc('bigquery', 'datarepo-dev-42c70e6a', 'ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520', 28),
6969
mksrc('bigquery', 'datarepo-dev-97ad270b', 'ANVIL_CMG_Sample_1_20230225_ANV5_202302281509', 25)
7070
]))

deployments/tempdev/environment.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ def mkdict(previous_catalog: dict[str, str],
6464

6565

6666
anvil_sources = mkdict({}, 3, mkdelta([
67-
mksrc('bigquery', 'datarepo-dev-e53e74aa', 'ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732', 6804),
67+
mksrc('parquet', 'datarepo-dev-e53e74aa', 'ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732', 6804),
6868
mksrc('bigquery', 'datarepo-dev-42c70e6a', 'ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520', 28),
6969
mksrc('bigquery', 'datarepo-dev-97ad270b', 'ANVIL_CMG_Sample_1_20230225_ANV5_202302281509', 25)
7070
]))

0 commit comments

Comments
 (0)