Deploy dbt-docs with Metabase references (exposures)

[erikamov]

Description

There is always a question about where dbt models have been used in Metabase. When working on synchronizing Metabase, @ohrite and I learned about "exposures" in dbt-metabase.

This PR creates a workflow that extracts exposures from Metabase and generate dbt-docs to be visualized in Cal-ITP dbt docs.

The workflow runs every Monday at 8am UTC (1am PST) or when there is any changes on model merged to the main branch.

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Documentation

How has this been tested?

It was tested running locally and then through the workflow.

Post-merge follow-ups

• No action required
• Actions required (specified below)

[vevetron]

Can we update the pyproject.toml to use dbt-metabase=1.5.0. My install was using 0.10.3 and throwing errors.

Also, how do we authenticate?
I'm getting an error:

INFO     2025-03-28 18:35:48 -0700 — Metabase session established                                                           metabase.py:61
ERROR    2025-03-28 18:35:49 -0700 — HTTP request failed: Unauthenticated                                                   metabase.py:88
Traceback (most recent call last):
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/bin/dbt-metabase", line 8, in <module>
    sys.exit(cli())
             ^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/__main__.py", line 189, in wrapper
    return func(
           ^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/__main__.py", line 398, in exposures
    core.extract_exposures(
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/_exposures.py", line 94, in extract_exposures
    d["id"]: dbname(d["details"]) for d in self.metabase.get_databases()
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/metabase.py", line 100, in get_databases
    return list(self._api("get", "/api/database"))
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/dbtmetabase/metabase.py", line 86, in _api
    response.raise_for_status()
  File "/Users/vivek/Library/Caches/pypoetry/virtualenvs/calitp-warehouse-1QJyB9-Z-py3.11/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://dashboards.calitp.org/api/database

[erikamov]

@vevetron You need a metabase API key. Evan has access to it.