Skip to content

Latest commit

 

History

History
105 lines (87 loc) · 7.39 KB

bigquery.md

File metadata and controls

105 lines (87 loc) · 7.39 KB
warning title excerpt extension repo docs extension_star_count extension_star_count_pretty extension_download_count extension_download_count_pretty image layout
DO NOT CHANGE THIS MANUALLY, THIS IS GENERATED BY https://github/duckdb/community-extensions repository, check README there
bigquery
DuckDB Community Extensions Integrates DuckDB with Google BigQuery, allowing direct querying and management of BigQuery datasets
name description version language build license excluded_platforms vcpkg_commit requires_toolchains maintainers
bigquery
Integrates DuckDB with Google BigQuery, allowing direct querying and management of BigQuery datasets
0.2.2
C++
cmake
MIT
wasm_mvp;wasm_eh;wasm_threads;windows_amd64_rtools;windows_amd64_mingw;osx_amd64;linux_arm64
e01906b2ba7e645a76ee021a19de616edc98d29f
parser_tools
hafenkran
github ref
hafenkran/duckdb-bigquery
d2e6c8d38c97df6ba69a96e6ebd901e0fb28312e
hello_world extended_description
-- Attach to your BigQuery Project D ATTACH 'project=my_gcp_project' AS bq (TYPE bigquery, READ_ONLY); -- Show all tables in all datasets in the attached BigQuery project D SHOW ALL TABLES; ┌──────────┬──────────────────┬──────────┬──────────────┬───────────────────┬───────────┐ │ database │ schema │ name │ column_names │ column_types │ temporary │ │ varchar │ varchar │ varchar │ varchar[] │ varchar[] │ boolean │ ├──────────┼──────────────────┼──────────┼──────────────┼───────────────────┼───────────┤ │ bq │ quacking_dataset │ duck_tbl │ [i, s] │ [BIGINT, VARCHAR] │ false │ | bq | barking_dataset | dog_tbl | [i, s] | [BIGINT, VARCHAR] │ false | └──────────┴──────────────────┴──────────┴──────────────┴───────────────────┴───────────┘ -- Select data from a specific table in BigQuery D SELECT * FROM bq.quacking_dataset.duck_tbl; ┌───────┬────────────────┐ │ i │ s │ │ int32 │ varchar │ ├───────┼────────────────┤ │ 12 │ quack 🦆 │ │ 13 │ quack quack 🦆 │ └───────┴────────────────┘
The DuckDB BigQuery Extension integrates DuckDB with Google BigQuery, allowing direct querying and management of BigQuery datasets. For detailed setup and usage instructions, visit the [extension repository](https://github.com/hafenkran/duckdb-bigquery).
104
104
24860
24.9k
/images/community_extensions/social_preview/preview_community_extension_bigquery.png
community_extension_doc

Installing and Loading

INSTALL {{ page.extension.name }} FROM community;
LOAD {{ page.extension.name }};

{% if page.docs.hello_world %}

Example

{{ page.docs.hello_world }}```
{% endif %}

{% if page.docs.extended_description %}
### About {{ page.extension.name }}
{{ page.docs.extended_description }}
{% endif %}

### Added Functions

<div class="extension_functions_table"></div>

|    function_name     | function_type |                                       description                                        | comment |                                                         examples                                                          |
|----------------------|---------------|------------------------------------------------------------------------------------------|---------|---------------------------------------------------------------------------------------------------------------------------|
| bigquery_attach      | table         | Attach to a BigQuery project.                                                            | NULL    | [ATTACH 'project=my_gcp_project' as bq (TYPE bigquery);]                                                                  |
| bigquery_scan        | table         | Scan a single table directly from BigQuery.                                              | NULL    | [SELECT * FROM bigquery_scan('my_gcp_project.quacking_dataset.duck_tbl');]                                                |
| bigquery_query       | table         | Run a custom GoogleSQL query in BigQuery and read the results.                           | NULL    | [SELECT * FROM bigquery_query('bq', 'SELECT * FROM quacking_dataset.duck_tbl WHERE duck_id = 123');]                      |
| bigquery_execute     | table         | Execute an arbitrary GoogleSQL query in BigQuery.                                        | NULL    | [CALL bigquery_execute('bq', 'CREATE SCHEMA deluxe_dataset OPTIONS(location="us", default_table_expiration_days=3.75);')] |
| bigquery_jobs        | table         | List jobs in a BigQuery project.                                                         | NULL    | [SELECT * FROM bigquery_jobs('bq');]                                                                                      |
| bigquery_clear_cache | table         | Clear the internal caches to refetch the most current project information from BigQuery. | NULL    | [CALL bigquery_clear_cache();]                                                                                            |

### Added Settings

<div class="extension_settings_table"></div>

|              name               |                                                                description                                                                 | input_type | scope  |
|---------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------|------------|--------|
| bq_curl_ca_bundle_path          | Path to the CA bundle for curl                                                                                                             | VARCHAR    | GLOBAL |
| bq_debug_show_queries           | DEBUG SETTING: print all queries sent to BigQuery to stdout                                                                                | BOOLEAN    | GLOBAL |
| bq_default_location             | Default location for BigQuery queries                                                                                                      | VARCHAR    | GLOBAL |
| bq_experimental_filter_pushdown | Whether to use filter pushdown (currently experimental)                                                                                    | BOOLEAN    | GLOBAL |
| bq_experimental_use_info_schema | Whether to fetch table infos from BQ information schema (currently experimental). Can be significantly faster than fetching from REST API. | BOOLEAN    | GLOBAL |
| bq_query_timeout_ms             | Timeout for BigQuery queries in milliseconds                                                                                               | BIGINT     | GLOBAL |