Skip to content

Commit a1a55d4

Browse files
author
Zach Olinske
committed
Add Fabric compatibility notes across all docs
- New-FinOpsTestData: compatible with both ADX and Fabric RTI paths - Remove-FinOpsTestData: does not manage Fabric data (clean up separately) - Updated PS1 inline docs, MS Learn pages, README, and changelog
1 parent 7df0e2e commit a1a55d4

File tree

5 files changed

+14
-6
lines changed

5 files changed

+14
-6
lines changed

docs-mslearn/toolkit/changelog.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -43,8 +43,8 @@ The following section lists features and enhancements that are currently in deve
4343
### [PowerShell module](powershell/powershell-commands.md) v14
4444

4545
- **Added**
46-
- Added [New-FinOpsTestData](powershell/data/New-FinOpsTestData.md) to generate synthetic, multi-cloud FOCUS-compliant cost data for Azure, AWS, GCP, and on-premises providers. Supports FOCUS versions 1.0-1.3 with version-specific column sets, commitment discounts, Azure Hybrid Benefit, tag variation, and inline budget scaling. Includes `-Seed` for reproducibility and upload to Azure storage. Generated manifests include a `_ftkTestData` watermark for safe cleanup identification.
47-
- Added [Remove-FinOpsTestData](powershell/data/Remove-FinOpsTestData.md) to purge test data from Azure Data Explorer tables, storage containers, and local test-data folders for a clean reset. Includes multi-layer safety features: local-only cleanup by default, targeted storage deletion (scans manifests for `_ftkTestData` marker and removes only test-data folders — production data is preserved), and ADX cleanup requires `-Force` because `.clear table` removes all rows. Supports optional ADF trigger management and ADX update policy verification.
46+
- Added [New-FinOpsTestData](powershell/data/New-FinOpsTestData.md) to generate synthetic, multi-cloud FOCUS-compliant cost data for Azure, AWS, GCP, and on-premises providers. Compatible with both Azure Data Explorer and Microsoft Fabric Real-Time Intelligence ingestion paths. Supports FOCUS versions 1.0-1.3 with version-specific column sets, commitment discounts, Azure Hybrid Benefit, tag variation, and inline budget scaling. Includes `-Seed` for reproducibility and upload to Azure storage. Generated manifests include a `_ftkTestData` watermark for safe cleanup identification.
47+
- Added [Remove-FinOpsTestData](powershell/data/Remove-FinOpsTestData.md) to purge test data from Azure Data Explorer tables, storage containers, and local test-data folders for a clean reset. Does not manage Microsoft Fabric data (clean up Fabric resources separately). Includes multi-layer safety features: local-only cleanup by default, targeted storage deletion (scans manifests for `_ftkTestData` marker and removes only test-data folders — production data is preserved), and ADX cleanup requires `-Force` because `.clear table` removes all rows. Supports optional ADF trigger management and ADX update policy verification.
4848

4949
<br>
5050

docs-mslearn/toolkit/powershell/data/New-FinOpsTestData.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ ms.reviewer: micflan
1515

1616
# New-FinOpsTestData command
1717

18-
The **New-FinOpsTestData** command generates synthetic, multi-cloud FOCUS-compliant cost data for Azure, AWS, GCP, and on-premises providers. Use it to populate a FinOps hub with realistic test data for validation, demos, and development.
18+
The **New-FinOpsTestData** command generates synthetic, multi-cloud FOCUS-compliant cost data for Azure, AWS, GCP, and on-premises providers. Use it to populate a FinOps hub with realistic test data for validation, demos, and development. Generated data is compatible with both Azure Data Explorer and Microsoft Fabric Real-Time Intelligence ingestion paths.
1919

2020
The generated data includes:
2121

docs-mslearn/toolkit/powershell/data/Remove-FinOpsTestData.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,9 @@ ms.reviewer: micflan
1717

1818
The **Remove-FinOpsTestData** command purges test data generated by [New-FinOpsTestData](New-FinOpsTestData.md) from Azure Data Explorer, Azure Storage, and the local test-data folder. By default only the local folder is cleaned. Pass `-StorageAccountName` and/or `-AdxClusterUri` to also clean cloud resources.
1919

20+
> [!NOTE]
21+
> This command does not manage Microsoft Fabric Real-Time Intelligence data. If your hub uses Fabric, clean up Fabric data separately. Test data generated by `New-FinOpsTestData` is compatible with both ADX and Fabric ingestion paths.
22+
2023
### Safety features
2124

2225
This command includes multiple safety layers to prevent accidentally deleting production data:
@@ -26,7 +29,7 @@ This command includes multiple safety layers to prevent accidentally deleting pr
2629
- **ADX requires `-Force`** – Because `.clear table` removes **all** data (production and test), the command refuses to run ADX cleanup unless `-Force` is specified. There is no way to selectively delete test rows from ADX.
2730

2831
> [!IMPORTANT]
29-
> Do not ingest test data into an Azure Data Explorer cluster that also contains production data. Unlike storage (where only test-data folders are deleted), ADX `.clear table` removes **every row**. If you accidentally mix test and production data in ADX, clear the tables and re-ingest production data from storage. Production exports in storage are preserved by the targeted deletion.
32+
> Do not ingest test data into an Azure Data Explorer cluster that also contains production data. Unlike storage (where only test-data folders are deleted), ADX `.clear table` removes **every row**. If you accidentally mix test and production data in ADX, clear the tables and re-ingest production data from storage. Production exports in storage are preserved by the targeted deletion. For Microsoft Fabric, clean up data directly in your Fabric workspace — this command does not modify Fabric resources.
3033
3134
Steps performed:
3235

src/powershell/Public/Remove-FinOpsTestData.ps1

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,11 @@
1111
folder is cleaned. Pass -StorageAccountName and/or -AdxClusterUri to also
1212
clean cloud resources.
1313
14+
Note: This command does not manage Microsoft Fabric Real-Time Intelligence.
15+
If your hub uses Fabric, clean up Fabric data separately. Test data
16+
generated by New-FinOpsTestData is compatible with both ADX and Fabric
17+
ingestion paths.
18+
1419
Safety features:
1520
- Local-only cleanup by default (no cloud params = no cloud deletion).
1621
- Storage deletion is targeted: the command scans every manifest in the

src/templates/finops-hub/test/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ This directory contains test data generation utilities for validating FinOps Hub
44

55
## New-FinOpsTestData
66

7-
Generates synthetic multi-cloud cost data in [FOCUS format](https://focus.finops.org/) for Azure, AWS, GCP, and on-premises data center scenarios.
7+
Generates synthetic multi-cloud cost data in [FOCUS format](https://focus.finops.org/) for Azure, AWS, GCP, and on-premises data center scenarios. Generated data is compatible with both Azure Data Explorer and Microsoft Fabric Real-Time Intelligence ingestion paths.
88

99
This command is part of the [FinOps toolkit PowerShell module](../../../powershell/). The source is located at [`src/powershell/Public/New-FinOpsTestData.ps1`](../../../powershell/Public/New-FinOpsTestData.ps1).
1010

@@ -90,7 +90,7 @@ The `Remove-FinOpsTestData` command performs a targeted cleanup for re-testing:
9090

9191
All cloud parameters are optional. By default only local files are deleted. Pass `-StorageAccountName` for storage cleanup and `-AdxClusterUri -Force` for ADX cleanup.
9292

93-
> **Important:** Do not ingest test data into an ADX cluster that also contains production data. Storage cleanup is targeted (only test-data folders are removed), but ADX `.clear table` removes **all** rows. If you accidentally mix test and production data in ADX, clear the tables and re-ingest production data from storage.
93+
> **Important:** Do not ingest test data into an ADX cluster that also contains production data. Storage cleanup is targeted (only test-data folders are removed), but ADX `.clear table` removes **all** rows. If you accidentally mix test and production data in ADX, clear the tables and re-ingest production data from storage. This command does not manage Microsoft Fabric data — clean up Fabric resources separately if applicable.
9494
9595
Uses `ConfirmImpact = 'High'` so PowerShell will prompt for confirmation unless `-Confirm:$false` is passed.
9696

0 commit comments

Comments
 (0)