Microsoft Fabric Accelerator

Welcome to the fabric-accelerator repository!

This accelerator helps you build a complete modern data platform with Microsoft Fabric. Whether you’re a data engineer, contributor, or simply exploring, this README provides everything you need to get started.

Check out the video for an overview of Fabric Accelerator.

Table of Contents

• Features
• Getting Started
• Collaborate
• Contact

Features

• Medallion architecture for both batch and real-time workloads ¹.
• Metadata-driven orchestration using ELT Framework ²
• Reusable Data Factory Pipelines that can be readily deployed with configuration changes ³
• Reusable Spark notebooks for common transformations ⁴
• Reusable Real-Time Intelligence (RTI) items ⁵
• Automated monitoring and optimization of Lakehouses ⁶
• Real-time Observability ⁷
• Real-time Insights into batch jobs ⁸
• Automated Deployment ⁹
• Reference documentation to assist your implementation.

Getting Started

To get started follow these steps:

• Fork the repository: https://github.com/bennyaustin/fabric-accelerator.git
• Follow the instructions in the set-up guide.

Collaborate

You can collaborate in various ways, including:

• Pull Requests
• Update/Enrich Wiki documentation
• Raise issues when you spot one
• Answer questions in the discussion forum

Please contact me to be added as a contributor.

Contact

If you have any questions or need support, please contact the maintainer:

• Benny Austin

Deployment

This repo has GitHub Actions defined to support deployment - see deploy-fabric-accelerator.yaml. It relies on hard-coded GUID references for "OLD" ids that are replaced with new IDs following deployment to a new workspace. Currently, each OLD ID must have existing references or the deployment will fail. This is to ensure that a bad ID isn't overlooked.

The deployment process utilizes the Fabric CLI. If you want to troubleshoot Fabric CLI commands locally, you can install the Fabric CLI within your local VS Code environment. This assumes you already have the Python extension for VS Code installed. You may also want Git Bash installed since the actions use bash syntax. The recommended steps are:

• In VS Code, create a new python environment:
  • Hit F1, seach for Python: Create Environment. (Can choose default Venv option)
  • Select python interpreter
• Open a new Terminal window, you may choose to use a bash or PowerShell terminal
  • This should attempt to activate the environment automatically.
  • If this fails, you may need to Set-ExecutionPolicy
• pip install ms-fabric-cli
• type "fab --version" to verify successful installation