You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -62,7 +65,7 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
62
65
- SQL Analytics endpoint
63
66
- Dataflow Gen2
64
67
- Data Pipeline: data factory drag and drop, refine data.
65
-
-https://aka.ms/fabric-lakehouse
68
+
-[Lab:](https://aka.ms/fabric-lakehouse)
66
69
- OneLake Security
67
70
- Permission (Workspace)
68
71
- Admin, Contributor, Member, Viewer
@@ -83,7 +86,7 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
83
86
- Visualize data by using built-in notebooks charts, pandas
84
87
- Dataframes in Spark are similar to Pandas dataframes in Python, and provide a common structure for working with data in rows and columns.
85
88
- Spark supports multiple coding languages, including Scala, Java, and others. In this exercise, we'll use PySpark, which is a Spark-optimized variant of Python. PySpark is one of the most commonly used languages on Spark and is the default language in Fabric notebooks.
86
-
-
89
+
87
90
## 4. Work with Delta Lake tables
88
91
- Relational tables that support querying and data modification
89
92
- Support for ACID transactions.
@@ -101,10 +104,7 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
101
104
- External Tables: create external tables for which the schema metadata is defined in the metastore for the lakehouse, but the data files are stored in an external location.
102
105
103
106
## 5. Secure a Fabric lakehouse
104
-
105
-
106
107
## 6. Ingest Data with Dataflow Gen 2 in Fabric
107
-
108
108
- Low code GUI envi. for defining ETL Solutions.
109
109
- Similar to Power Query in PBI
110
110
- Extract data from multiple sources, transform, load into a destination.
@@ -119,7 +119,7 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
## 7. Use Data Factory Pipelines in Microsoft Fabric
125
125
- A data lakehouse is a common analytical data store for cloud-scale analytics solutions. One of the core tasks of a data engineer is to implement and manage the ingestion of data from multiple operational data sources into the lakehouse. In Microsoft Fabric, you can implement extract, transform, and load (ETL) or extract, load, and transform (ELT) solutions for data ingestion through the creation of pipelines.
@@ -130,9 +130,8 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
130
130
- Activities (copy data, Data transformation & Control flow (if conditon, ForEach))
131
131
- Parameters
132
132
- Pipeline runs
133
-
- How to Send Email: https://learn.microsoft.com/en-us/azure/data-factory/how-to-send-email
134
-
-https://esi.learnondemand.net/Class/605391
135
-
133
+
-[How to Send Email: ](https://learn.microsoft.com/en-us/azure/data-factory/how-to-send-email)
## 8. Ingest data with Spark and Microsoft Fabric notebooks
138
137
- Fabric shortcuts offer easy connection to external sources.
@@ -142,12 +141,10 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
142
141
- Use Delta format for durability and scale
143
142
- Optimize read and write with V-Order and optimized write options.
144
143
145
-
146
144
## 9. Organize a lakehouse using medalliion architechture
147
145
- Medallion Arch is creating data in rich format that can be used in PBI.
148
146
- Load data Raw (Bronze) > Validate and Clean data like remove nulls/duplicates (Silver) >Enriched like join, Aggreated date (Gold) as report/semantic model ready
149
147
150
-
151
148
## 10. Get Started with data warehouse in Microsoft Fabric
152
149
- Data warehouse provides a relational database for large-scale analytics. Unlike the default read-only SQL endpoint for tables defined in a lakehouse, a data warehouse provides full SQL semantics; including the ability to insert, update, and delete data in the tables.
153
150
- A relational data warehouse typically consists of fact and dimension tables. The fact tables contain numeric measures you can aggregate to analyze business performance (for example, sales revenue), and the dimension tables contain attributes of the entities by which you can aggregate the data (for example, product, customer, or time). In a Microsoft Fabric data warehouse, you can use these keys to define a data model that encapsulates the relationships between the tables.
@@ -156,16 +153,16 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
156
153
- Choose between warehouse and lakehouse
157
154
- Warehouse (Structured, Multi-table transactions, High performance, expansive security(objec-level, DDL/DML, dynamic data masking), T-SQL, Spark)
158
155
- Lakehouse (Semi-structured or unstructured data, scalable and cost effective, Supports Delta Lake features, T-SQL security (row/table level), T-SQL, Spark)
-[Futher Reading on Lakehouse vs Data Warehouse:](https://blog.fabric.microsoft.com/en-us/blog/lakehouse-vs-data-warehouse-deep-dive-into-use-cases-differences-and-architecture-designs?trk=public_post_comment-text)
157
+
-[Decision Guide Data Store](https://learn.microsoft.com/en-us/fabric/get-started/decision-guide-data-store)
161
158
- Semintic Model: Fabri automatically creates a default semantic model for PBI user to use for reports.
162
159
- Visualize data: Can create PBI reports directly from within the Fabric warehouse.
- In Microsoft Fabric, a data warehouse provides a relational database for large-scale analytics. Unlike the default read-only SQL endpoint for tables defined in a lakehouse, a data warehouse provides full SQL semantics; including the ability to insert, update, and delete data in the tables.
167
164
- Stating of data, full vs incremental data load.
168
-
-
165
+
169
166
170
167
## 12. Query a warehouse
171
168
- In Microsoft Fabric, a data warehouse provides a relational database for large-scale analytics. The rich set of experiences built into Microsoft Fabric workspace enables customers to reduce their time to insights by having an easily consumable, always connected semantic model that is integrated with Power BI in DirectLake mode.
@@ -184,15 +181,14 @@ Notes taken from the Microsoft four days ESI class for the Fabric DP-600 trainin
- Exam Cram for DP-600: How to pass Exam DP-600: https://learn.microsoft.com/en-us/shows/learn-live/exam-cram-for-dp-600-ep101-how-to-pass-exam-dp-600-implementing-analytics-solutions-using-microsoft-fabric-beta-pacific?WT.mc_id=academic-116720-lbugnion
222
-
- Microsoft Fabric exercises :https://aka.ms/dp600labs
223
-
- Implement Real-Time Analytics with Microsoft Fabric:https://learn.microsoft.com/en-us/training/paths/explore-real-time-analytics-microsoft-fabric/
224
-
- Practice Assessments for Microsoft Certifications: aka.ms/examprep
225
-
- Study guide for Exam DP-600: Implementing Analytics Solutions Using Microsoft Fabric: https://learn.microsoft.com/en-us/credentials/certifications/resources/study-guides/dp-600
226
-
- Microsoft Fabric Learn Together: https://aka.ms/learntogether
227
-
- Exam duration and exam experience: https://learn.microsoft.com/en-us/credentials/support/exam-duration-exam-experience
215
+
-[ Practice Exam: ](https://aka.ms/DP600-practice)
-[Exam Cram for DP-600: How to pass Exam DP-600: ](https://learn.microsoft.com/en-us/shows/learn-live/)exam-cram-for-dp-600-ep101-how-to-pass-exam-dp-600-implementing-analytics-solutions-using-microsoft-fabric-beta-pacific?WT.mc_id=academic-116720-lbugnion
-[Implement Real-Time Analytics with Microsoft Fabric:](https://learn.microsoft.com/en-us/training/paths/explore-real-time-analytics-microsoft-fabric/)
220
+
-[Practice Assessments for Microsoft Certifications: ](https://aka.ms/examprep)
221
+
-[Study guide for Exam DP-600: Implementing Analytics Solutions Using Microsoft Fabric: ](https://learn.microsoft.com/en-us/credentials/certifications/resources/study-guides/dp-600)
0 commit comments