integration test against bespoke ledger & temporary BigQuery dataset (#1479)

- loading and setup

- exporting from PG, importing into BQ

- needs ledger operations

* tests depend on google-cloud-bigquery 2.53.0 Java lib

* split BigQuery so it doesn't get run by an existing runner

* use stream API

- has better support for JSON columns

* text-array convert to JSON special case

* detailed report of serialization errors

* Any is a great type; fixes JSON as JSON

* account for zero mints

- nonsensical in practice, but possible in this test

* tests pass

* skip ACL setting

* split minted out to #1713

* split daily run out to #1730

* add separate path check for total supply

- suggested by @isegall-da; thanks

---------

Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>

Author: stephencompall-DA

apps/app/src/test/resources/total-supply-bigquery.sql

@@ -160,15 +160,17 @@ CREATE TEMP FUNCTION minted(
     migration_id int64
   ) RETURNS bignumeric AS ((
   SELECT
-    SUM(PARSE_BIGNUMERIC(JSON_VALUE(e.result,
+    COALESCE(SUM(
+      PARSE_BIGNUMERIC(JSON_VALUE(e.result,
                                     -- .inputAppRewardAmount
                                     TransferResult_summary(0)))
       + PARSE_BIGNUMERIC(JSON_VALUE(e.result,
                                     -- .inputValidatorRewardAmount
                                     TransferResult_summary(1)))
       + PARSE_BIGNUMERIC(JSON_VALUE(e.result,
                                     -- .inputSvRewardAmount
-                                    TransferResult_summary(2))))
+                                    TransferResult_summary(2)))),
+      0)
   FROM
     mainnet_da2_scan.scan_sv_1_update_history_exercises e
   WHERE