Overview

This repository contains materials for a blog post demonstrating the integration between Unity Catalog and DuckDB. The examples provided showcase how to use DuckDB with Unity Catalog

Prerequisites

• Docker
• Docker Compose

Setup

• Clone the repository:

git clone <repository-url>

Usage

To run the example, execute the following command:

docker compose up --build -d 

After starting the Docker containers, you can access the Jupyter notebooks at jupiter notebooks. The notebooks demonstrate how to use DuckDB with Unity Catalog for data management and querying.

Open the notebooks:

• Navigate to notebooks/dbt.ipynb to see dbt operations with DuckDB and Unity Catalog.
• Navigate to notebooks/duckdb.ipynb to see SQL operations with DuckDB and Unity Catalog.

You can reach the Unity Catalog at unity-catalog api You can reach the Unity Catalog UI at unity catalog ui