docker image bruin:latest dependency error, missing libodbc.so.2 for pyodbc

[byte-opps]

[16:48:09] [burin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/sqlalchemy/connectors/pyodbc.py", line 43, in dbapi
[16:48:09] [burin.sql_server_versions] >>     return __import__("pyodbc")
[16:48:09] [burin.sql_server_versions] >>            ^^^^^^^^^^^^^^^^^^^^
[16:48:09] [burin.sql_server_versions] >> ImportError: libodbc.so.2: cannot open shared object file: No such file or directory
[16:48:11] Failed: burin.sql_server_versions (9.962s)

when trying to use a postgresql database.

From a quick google, I tried to use the below in CD/CI, but it wont install the packages as user bruin and can't use sudo and don't know root password. So can you add it to the image please? if its the correct thing to fix the issue.

...
image: ghcr.io/bruin-data/bruin:latest
  script:
    - apt update
    - apt install unixodbc
    - apt install libodbc2
...

[karakanb]

Does this happen in a Docker image or somewhere else that you take a run in? It seems like GitLab CI but not exactly sure.

[byte-opps]

yes I used gitlab cd/ci to run docker image, one asset as

name: bruin.sql_server_versions
type: ingestr
description: Imported table dbo.SqlServerVersions
connection: TM

parameters:
  source_connection: ms-db01
  source_table: dbo.sqlserverversions
  destination: postgres

$bruin connections list
Environment: default
+----------+-------------+
| TYPE     | NAME        |
+----------+-------------+
| postgres | TM          |
| mssql    | ms-db01 |
+----------+-------------+

start of error message

[19:40:23] [burin.sql_server_versions] >> Initiated the pipeline with the following:
[19:40:23] [burin.sql_server_versions] >>   Source: mssql / dbo.sqlserverversions
[19:40:23] [burin.sql_server_versions] >>   Destination: postgresql / bruin.sql_server_versions
[19:40:23] [burin.sql_server_versions] >>   Incremental Strategy: replace
[19:40:23] [burin.sql_server_versions] >>   Incremental Key: None
[19:40:23] [burin.sql_server_versions] >>   Primary Key: None
[19:40:23] [burin.sql_server_versions] >>   Pipeline ID: ac67f8fc640b1abee0c499c1dd0cfd073e39945d5e2280ac185be7f236d05317

[byte-opps]

same issue.

$ bruin connections test -n ms-db01
Successfully tested connection 'ms-db01' in environment: default
$ bruin connections test -n TM
Successfully tested connection 'TM' in environment: default
$ bruin run ./pipe3 --environment default
Analyzed the pipeline 'my-first-pipeline' with 1 assets.
Pipeline: my-first-pipeline (.)
  No issues found
✓ Successfully validated 1 assets across 1 pipeline, all good.
Interval: 2025-12-01T00:00:00Z - 2025-12-01T23:59:59Z
Starting the pipeline execution...
[20:22:39] Running:  bruin.sql_server_versions
[20:22:55] [bruin.sql_server_versions] >> 2025-12-02 20:22:55,309|[WARNING]|111|137207420913472|dlt|reference.py|__init__:74|When initializing destination factory of type dlt.destinations.postgres, argument dest_table is not a valid field in PostgresClientConfiguration or destination capabilities
[20:22:55] [bruin.sql_server_versions] >> 2025-12-02 20:22:55,310|[WARNING]|111|137207420913472|dlt|reference.py|__init__:74|When initializing destination factory of type dlt.destinations.postgres, argument staging_bucket is not a valid field in PostgresClientConfiguration or destination capabilities
[20:22:55] [bruin.sql_server_versions] >> 
[20:22:55] [bruin.sql_server_versions] >> Initiated the pipeline with the following:
[20:22:55] [bruin.sql_server_versions] >>   Source: mssql / dbo.sqlserverversions
[20:22:55] [bruin.sql_server_versions] >>   Destination: postgresql / bruin.sql_server_versions
[20:22:55] [bruin.sql_server_versions] >>   Incremental Strategy: replace

this is the end of the long error msg.

[20:22:55] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/sqlalchemy/connectors/pyodbc.py", line 43, in dbapi
[20:22:55] [bruin.sql_server_versions] >>     return __import__("pyodbc")
[20:22:55] [bruin.sql_server_versions] >>            ^^^^^^^^^^^^^^^^^^^^
[20:22:55] [bruin.sql_server_versions] >> ImportError: libodbc.so.2: cannot open shared object file: No such file or directory
[20:22:56] Failed: bruin.sql_server_versions (16.872s)
==================================================
FAIL bruin.sql_server_versions 
bruin run completed with failures in 16.872s
 ✗ Assets executed      1 failed
1 assets failed
└── bruin.sql_server_versions
    └── exit status 1
Cleaning up project directory and file based variables
00:05
ERROR: Job failed: exit code 1

[byte-opps]

Also same with mssql as destination using the docker container. looks like both mssql and postgres, use odbc and a dependency is missing on the docker image?

✓ Successfully validated 1 assets across 1 pipeline, all good.
Interval: 2025-12-02T00:00:00Z - 2025-12-02T23:59:59Z
Starting the pipeline execution...
[12:45:10] Running:  bruin.sql_server_versions
[12:45:20] [bruin.sql_server_versions] >> Traceback (most recent call last):
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/bin/ingestr", line 10, in <module>
[12:45:20] [bruin.sql_server_versions] >>     sys.exit(main())
[12:45:20] [bruin.sql_server_versions] >>              ^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/ingestr/main.py", line 783, in main
[12:45:20] [bruin.sql_server_versions] >>     app()
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/typer/main.py", line 342, in __call__
[12:45:20] [bruin.sql_server_versions] >>     raise e
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/typer/main.py", line 325, in __call__
[12:45:20] [bruin.sql_server_versions] >>     return get_command(self)(*args, **kwargs)
[12:45:20] [bruin.sql_server_versions] >>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
[12:45:20] [bruin.sql_server_versions] >>     return self.main(*args, **kwargs)
[12:45:20] [bruin.sql_server_versions] >>            ^^^^^^^^^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/typer/core.py", line 738, in main
[12:45:20] [bruin.sql_server_versions] >>     return _main(
[12:45:20] [bruin.sql_server_versions] >>            ^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/typer/core.py", line 197, in _main
[12:45:20] [bruin.sql_server_versions] >>     rv = self.invoke(ctx)
[12:45:20] [bruin.sql_server_versions] >>          ^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/click/core.py", line 1697, in invoke
[12:45:20] [bruin.sql_server_versions] >>     return _process_result(sub_ctx.command.invoke(sub_ctx))
[12:45:20] [bruin.sql_server_versions] >>                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
[12:45:20] [bruin.sql_server_versions] >>     return ctx.invoke(self.callback, **ctx.params)
[12:45:20] [bruin.sql_server_versions] >>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/click/core.py", line 788, in invoke
[12:45:20] [bruin.sql_server_versions] >>     return __callback(*args, **kwargs)
[12:45:20] [bruin.sql_server_versions] >>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/typer/main.py", line 707, in wrapper
[12:45:20] [bruin.sql_server_versions] >>     return callback(**use_params)
[12:45:20] [bruin.sql_server_versions] >>            ^^^^^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/ingestr/main.py", line 451, in ingest
[12:45:20] [bruin.sql_server_versions] >>     dlt_dest = destination.dlt_dest(
[12:45:20] [bruin.sql_server_versions] >>                ^^^^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/ingestr/src/destinations.py", line 281, in dlt_dest
[12:45:20] [bruin.sql_server_versions] >>     cls = build_mssql_dest()
[12:45:20] [bruin.sql_server_versions] >>           ^^^^^^^^^^^^^^^^^^
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/ingestr/src/destinations.py", line 214, in build_mssql_dest
[12:45:20] [bruin.sql_server_versions] >>     from dlt.destinations.impl.mssql.mssql import (
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/dlt/destinations/impl/mssql/mssql.py", line 15, in <module>
[12:45:20] [bruin.sql_server_versions] >>     from dlt.destinations.impl.mssql.sql_client import PyOdbcMsSqlClient
[12:45:20] [bruin.sql_server_versions] >>   File "/home/bruin/.local/share/uv/tools/ingestr/lib/python3.11/site-packages/dlt/destinations/impl/mssql/sql_client.py", line 6, in <module>
[12:45:20] [bruin.sql_server_versions] >>     import pyodbc
[12:45:20] [bruin.sql_server_versions] >> ImportError: libodbc.so.2: cannot open shared object file: No such file or directory
[12:45:21] Failed: bruin.sql_server_versions (10.506s)
==================================================
FAIL bruin.sql_server_versions 
bruin run completed with failures in 10.506s
 ✗ Assets executed      1 failed
1 assets failed
└── bruin.sql_server_versions
    └── exit status 1
Cleaning up project directory and file based variables
00:05
ERROR: Job failed: exit code 1