Skip to content

ExecuteDataFlowActivity- dataflow reference is everytime null #39402

Open
@gerald-csapo

Description

@gerald-csapo

When process activities for a pipeline and process objects with instance ExecuteDataFlowActivity the dataflow is evertime null

I created pipeline and dataflow on Data Factory portal; published everything.

image

When running follwing I would expect to get the DataFlowReference...

		Factories factories = manager.factories();
		for (Factory factory : factories.listByResourceGroup(scannerConfig.getResourceGroupName())) {
			Pipelines pipelines = manager.pipelines();
			for (PipelineResource pipelineResource : pipelines.listByFactory(scannerConfig.getResourceGroupName(), factory.name())) {
				List<Activity> activities = pipelineResource.activities();
				for (Activity activity1 : activities) {
					if (activity1 instanceof ExecuteDataFlowActivity) {
						ExecuteDataFlowActivity activity = (ExecuteDataFlowActivity) activity1;
						if (((ExecuteDataFlowActivity) activity).dataFlow() == null) { // reference is null
							System.out.println("-- pipeline " + pipelineResource.name());
							System.out.println(JsonHandler.INSTANCE.beanToPrettyJsonString(activity));
						}
					}
				}
			}
		}

Output:
-- pipeline pipeline1

{
  "type" : "ExecuteDataFlow",
  "name" : "run Data flow1",
  "description" : null,
  "state" : null,
  "onInactiveMarkAs" : null,
  "dependsOn" : [ ],
  "userProperties" : [ ],
  "linkedServiceName" : null,
  "policy" : {
    "timeout" : "0.12:00:01",
    "retry" : 0,
    "retryIntervalInSeconds" : 30,
    "secureInput" : false,
    "secureOutput" : false
  },
  "typeProperties" : {
    **"dataFlow" : null,**
    "staging" : {
      "linkedService" : null,
      "folderPath" : null
    },
    "integrationRuntime" : null,
    "compute" : {
      "computeType" : "General",
      "coreCount" : 8
    },
    "traceLevel" : "Coarse",
    "continueOnError" : null,
    "runConcurrently" : true,
    "sourceStagingConcurrency" : null
  }
}

Setup:

  • OS: Win10
  • IDE: EclipseIDE
  • Library/Libraries:
  • com.azure:azure-identity 1.11.4
  • com.azure:azure-core 1.47.0
  • com.azure:azure-core-management 1.12.0
  • com.azure.resourcemanager:azure-resourcemanager-datafactory 1.0.0-beta.27

Metadata

Metadata

Labels

ARMMgmtThis issue is related to a management-plane library.customer-reportedIssues that are reported by GitHub users external to the Azure organization.needs-team-attentionWorkflow: This issue needs attention from Azure service team or SDK teamquestionThe issue doesn't require a change to the product in order to be resolved. Most issues start as that

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions