Update the "run templates" designs for the new "snapshots"

[znegrin]

[znegrin]

@htahir1 I started updating the snapshot overview, and I have a question: Should we also include a tab with all the configurations, or should we show them only when editing the snapshot? I am not sure, as we currently don't show them, but maybe it is useful to see the current status without having to edit it. I am also not sure if "Run snapshot" is the best CTA for this button. Maybe it should be "Edit and Run" or "New Snapshot" or something similar to make it more obvious? I guess we can also add a panel with deployment information in case it is deployed.

https://www.figma.com/design/iSZe3mLiEnYcjNV98IfH6l/ZenML---Dashboard?node-id=18108-88707&t=F1K9b17HmDC9XSig-11

[znegrin]

@htahir1 @Cahllagerfeld @schustmi I've been thinking about ways to improve the snapshots screens and I was considering the option to show the schema in multiple tabs instead of a full page, separating it into the ones that would make more sense, keeping the most relevant ones in the first tab, and making the most advanced -less commonly edited- options a bit more hidden.

I also was thinking on separating the two edit options (schema and YAML code) as two tabs, keeping the structure visible and having a larger space to edit the code, so it is more obvious and usable:

Additionally, I was thinking that we need to go individually over specific elements (like tags) to make the interface more usable. I guess we can hide some options to make them code-only and keep the schema alternative cleaner and easier to edit. For example, I think for the key-value pairs that are not already set, we can instead of showing all of them empty in a list, we could allow users to add one, and then include autocomplete in the value field, so users can easily select one of the existing options or add a new one.

Then, for elements like tags, I think we can use the same approach we have for tags everywhere instead of the current UI. We can aim to hide some options that users can still change in the code, to keep the schema simple. A first step would be to know how far can we go with this approach and know what can we display and how to order it in the UI, so it makes sense and users know where to go.

[Cahllagerfeld]

The first thing that comes to my mind is that, if we split the form into different tabs, we basically need to hard-code everything. From just the schema, we cannot determine in which section the config needs to go dynamically anymore

[znegrin]

@Cahllagerfeld, I see many options that are empty if you activate them in the form. Once you activate a dropdown, most of them show the same key-value pairs that appear to be empty, like in this example.

Do you have an example of the whole schema we are using for this? It can help me to analyze and understand.

[Cahllagerfeld]

See https://github.com/zenml-io/zenml-cloud-ui/issues/1003 as reference

[Cahllagerfeld]

@znegrin I was more referring to general, stack, etc...
We need to know the properties ahead of time that need to go in which category.

The following is an example schema for kubernetes

{
		"$defs": {
			"CachePolicy": {
				"description": "Cache policy.",
				"properties": {
					"include_step_code": {
						"default": true,
						"description": "Whether to include the step code in the cache key.",
						"title": "Include Step Code",
						"type": "boolean"
					},
					"include_step_parameters": {
						"default": true,
						"description": "Whether to include the step parameters in the cache key.",
						"title": "Include Step Parameters",
						"type": "boolean"
					},
					"include_artifact_values": {
						"default": true,
						"description": "Whether to include the artifact values in the cache key. If the materializer for an artifact doesn't support generating a content hash, the artifact ID will be used as a fallback if enabled.",
						"title": "Include Artifact Values",
						"type": "boolean"
					},
					"include_artifact_ids": {
						"default": true,
						"description": "Whether to include the artifact IDs in the cache key.",
						"title": "Include Artifact Ids",
						"type": "boolean"
					},
					"ignored_inputs": {
						"anyOf": [
							{
								"items": {
									"type": "string"
								},
								"type": "array"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "List of input names to ignore in the cache key.",
						"title": "Ignored Inputs"
					}
				},
				"title": "CachePolicy",
				"type": "object"
			},
			"ColorVariants": {
				"description": "All possible color variants for frontend.",
				"enum": [
					"grey",
					"purple",
					"red",
					"green",
					"yellow",
					"orange",
					"lime",
					"teal",
					"turquoise",
					"magenta",
					"blue"
				],
				"title": "ColorVariants",
				"type": "string"
			},
			"ExecutionMode": {
				"description": "Enum that represents the execution mode of a pipeline run.",
				"enum": [
					"fail_fast",
					"stop_on_failure",
					"continue_on_failure"
				],
				"title": "ExecutionMode",
				"type": "string"
			},
			"KubernetesOrchestratorSettings": {
				"additionalProperties": true,
				"description": "Settings for the Kubernetes orchestrator.\n\nConfiguration options for how pipelines are executed on Kubernetes clusters.\nField descriptions are defined inline using Field() descriptors.",
				"properties": {
					"synchronous": {
						"default": true,
						"description": "Whether to wait for all pipeline steps to complete. When `False`, the client returns immediately and execution continues asynchronously.",
						"title": "Synchronous",
						"type": "boolean"
					},
					"service_account_name": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Kubernetes service account for the orchestrator pod. If not specified, creates a new account with 'edit' permissions.",
						"title": "Service Account Name"
					},
					"step_pod_service_account_name": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Kubernetes service account for step execution pods. Uses the default service account if not specified.",
						"title": "Step Pod Service Account Name"
					},
					"privileged": {
						"default": false,
						"description": "Whether to run containers in privileged mode with extended permissions.",
						"title": "Privileged",
						"type": "boolean"
					},
					"pod_settings": {
						"anyOf": [
							{
								"$ref": "#/$defs/KubernetesPodSettings"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Pod configuration for step execution containers."
					},
					"orchestrator_pod_settings": {
						"anyOf": [
							{
								"$ref": "#/$defs/KubernetesPodSettings"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Pod configuration for the orchestrator container that launches step pods."
					},
					"job_name_prefix": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Prefix for the job name.",
						"title": "Job Name Prefix"
					},
					"max_parallelism": {
						"anyOf": [
							{
								"exclusiveMinimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Maximum number of step pods to run concurrently. No limit if not specified.",
						"title": "Max Parallelism"
					},
					"successful_jobs_history_limit": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Number of successful scheduled jobs to retain in history.",
						"title": "Successful Jobs History Limit"
					},
					"failed_jobs_history_limit": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Number of failed scheduled jobs to retain in history.",
						"title": "Failed Jobs History Limit"
					},
					"ttl_seconds_after_finished": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Seconds to keep finished jobs before automatic cleanup.",
						"title": "Ttl Seconds After Finished"
					},
					"active_deadline_seconds": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Job deadline in seconds. If the job doesn't finish within this time, it will be terminated.",
						"title": "Active Deadline Seconds"
					},
					"backoff_limit_margin": {
						"default": 0,
						"description": "The value to add to the backoff limit in addition to the step retries. The retry configuration defined on the step defines the maximum number of retries that the server will accept for a step. For this orchestrator, this controls how often the job running the step will try to start the step pod. There are some circumstances however where the job will start the pod, but the pod doesn't actually get to the point of running the step. That means the server will not receive the maximum amount of retry requests, which in turn causes other inconsistencies like wrong step statuses. To mitigate this, this attribute allows to add a margin to the backoff limit. This means that the job will retry the pod startup for the configured amount of times plus the margin, which increases the chance of the server receiving the maximum amount of retry requests.",
						"minimum": 0,
						"title": "Backoff Limit Margin",
						"type": "integer"
					},
					"orchestrator_job_backoff_limit": {
						"default": 3,
						"description": "The backoff limit for the orchestrator job.",
						"minimum": 0,
						"title": "Orchestrator Job Backoff Limit",
						"type": "integer"
					},
					"fail_on_container_waiting_reasons": {
						"anyOf": [
							{
								"items": {
									"type": "string"
								},
								"type": "array"
							},
							{
								"type": "null"
							}
						],
						"default": [
							"InvalidImageName",
							"ErrImagePull",
							"ImagePullBackOff",
							"CreateContainerConfigError"
						],
						"description": "List of container waiting reasons that should cause the job to fail immediately. This should be set to a list of nonrecoverable reasons, which if found in any `pod.status.containerStatuses[*].state.waiting.reason` of a job pod, should cause the job to fail immediately.",
						"title": "Fail On Container Waiting Reasons"
					},
					"job_monitoring_interval": {
						"default": 3,
						"description": "The interval in seconds to monitor the job. Each interval is used to check for container issues for the job pods.",
						"exclusiveMinimum": 0,
						"title": "Job Monitoring Interval",
						"type": "number"
					},
					"job_monitoring_delay": {
						"default": {
							"source": "0.0",
							"parsedValue": 0
						},
						"description": "The delay in seconds to wait between monitoring active step jobs. This can be used to reduce load on the Kubernetes API server.",
						"exclusiveMinimum": 0,
						"title": "Job Monitoring Delay",
						"type": "number"
					},
					"interrupt_check_interval": {
						"default": {
							"source": "1.0",
							"parsedValue": 1
						},
						"description": "The interval in seconds to check for run interruptions.",
						"exclusiveMinimum": 0,
						"minimum": 0.5,
						"title": "Interrupt Check Interval",
						"type": "number"
					},
					"pod_failure_policy": {
						"anyOf": [
							{
								"additionalProperties": true,
								"type": "object"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The pod failure policy to use for the job that is executing the step.",
						"title": "Pod Failure Policy"
					},
					"prevent_orchestrator_pod_caching": {
						"default": false,
						"description": "Whether to disable caching optimization in the orchestrator pod.",
						"title": "Prevent Orchestrator Pod Caching",
						"type": "boolean"
					},
					"always_build_pipeline_image": {
						"default": false,
						"description": "If `True`, the orchestrator will always build the pipeline image, even if all steps have a custom build.",
						"title": "Always Build Pipeline Image",
						"type": "boolean"
					},
					"pod_stop_grace_period": {
						"default": 30,
						"description": "When stopping a pipeline run, the amount of seconds to wait for a step pod to shutdown gracefully.",
						"exclusiveMinimum": 0,
						"title": "Pod Stop Grace Period",
						"type": "integer"
					},
					"timeout": {
						"anyOf": [
							{
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Timeout"
					},
					"stream_step_logs": {
						"anyOf": [
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Stream Step Logs"
					},
					"pod_startup_timeout": {
						"anyOf": [
							{
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Startup Timeout"
					},
					"pod_failure_max_retries": {
						"anyOf": [
							{
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Failure Max Retries"
					},
					"pod_failure_retry_delay": {
						"anyOf": [
							{
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Failure Retry Delay"
					},
					"pod_failure_backoff": {
						"anyOf": [
							{
								"type": "number"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Failure Backoff"
					},
					"pod_name_prefix": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Name Prefix"
					}
				},
				"title": "KubernetesOrchestratorSettings",
				"type": "object"
			},
			"KubernetesPodSettings": {
				"additionalProperties": true,
				"description": "Kubernetes Pod settings.\n\nAttributes:\n    node_selectors: Node selectors to apply to the pod.\n    affinity: Affinity to apply to the pod.\n    tolerations: Tolerations to apply to the pod.\n    resources: Resource requests and limits for the pod.\n    annotations: Annotations to apply to the pod metadata.\n    volumes: Volumes to mount in the pod.\n    volume_mounts: Volume mounts to apply to the pod containers.\n    host_ipc: Whether to enable host IPC for the pod.\n    scheduler_name: The name of the scheduler to use for the pod.\n    image_pull_secrets: Image pull secrets to use for the pod.\n    labels: Labels to apply to the pod.\n    env: Environment variables to apply to the container.\n    env_from: Environment variables to apply to the container.\n    additional_pod_spec_args: Additional arguments to pass to the pod. These\n        will be applied to the pod spec.",
				"properties": {
					"node_selectors": {
						"additionalProperties": {
							"type": "string"
						},
						"default": {},
						"title": "Node Selectors",
						"type": "object"
					},
					"affinity": {
						"additionalProperties": true,
						"default": {},
						"title": "Affinity",
						"type": "object"
					},
					"tolerations": {
						"default": [],
						"items": {
							"additionalProperties": true,
							"type": "object"
						},
						"title": "Tolerations",
						"type": "array"
					},
					"resources": {
						"additionalProperties": {
							"additionalProperties": {
								"type": "string"
							},
							"type": "object"
						},
						"default": {},
						"title": "Resources",
						"type": "object"
					},
					"annotations": {
						"additionalProperties": {
							"type": "string"
						},
						"default": {},
						"title": "Annotations",
						"type": "object"
					},
					"volumes": {
						"default": [],
						"items": {
							"additionalProperties": true,
							"type": "object"
						},
						"title": "Volumes",
						"type": "array"
					},
					"volume_mounts": {
						"default": [],
						"items": {
							"additionalProperties": true,
							"type": "object"
						},
						"title": "Volume Mounts",
						"type": "array"
					},
					"host_ipc": {
						"default": false,
						"title": "Host Ipc",
						"type": "boolean"
					},
					"scheduler_name": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Scheduler Name"
					},
					"image_pull_secrets": {
						"default": [],
						"items": {
							"type": "string"
						},
						"title": "Image Pull Secrets",
						"type": "array"
					},
					"labels": {
						"additionalProperties": {
							"type": "string"
						},
						"default": {},
						"title": "Labels",
						"type": "object"
					},
					"env": {
						"default": [],
						"items": {
							"additionalProperties": true,
							"type": "object"
						},
						"title": "Env",
						"type": "array"
					},
					"env_from": {
						"default": [],
						"items": {
							"additionalProperties": true,
							"type": "object"
						},
						"title": "Env From",
						"type": "array"
					},
					"additional_pod_spec_args": {
						"additionalProperties": true,
						"default": {},
						"title": "Additional Pod Spec Args",
						"type": "object"
					}
				},
				"title": "KubernetesPodSettings",
				"type": "object"
			},
			"KubernetesStepOperatorSettings": {
				"additionalProperties": true,
				"description": "Settings for the Kubernetes step operator.",
				"properties": {
					"pod_settings": {
						"anyOf": [
							{
								"$ref": "#/$defs/KubernetesPodSettings"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Pod configuration for step execution containers."
					},
					"service_account_name": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Kubernetes service account for step pods. Uses default account if not specified.",
						"title": "Service Account Name"
					},
					"privileged": {
						"default": false,
						"description": "Whether to run step containers in privileged mode with extended permissions.",
						"title": "Privileged",
						"type": "boolean"
					},
					"job_name_prefix": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Prefix for the job name.",
						"title": "Job Name Prefix"
					},
					"ttl_seconds_after_finished": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Seconds to keep finished jobs before automatic cleanup.",
						"title": "Ttl Seconds After Finished"
					},
					"active_deadline_seconds": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Job deadline in seconds. If the job doesn't finish within this time, it will be terminated.",
						"title": "Active Deadline Seconds"
					},
					"fail_on_container_waiting_reasons": {
						"anyOf": [
							{
								"items": {
									"type": "string"
								},
								"type": "array"
							},
							{
								"type": "null"
							}
						],
						"default": [
							"InvalidImageName",
							"ErrImagePull",
							"ImagePullBackOff",
							"CreateContainerConfigError"
						],
						"description": "List of container waiting reasons that should cause the job to fail immediately. This should be set to a list of nonrecoverable reasons, which if found in any `pod.status.containerStatuses[*].state.waiting.reason` of a job pod, should cause the job to fail immediately.",
						"title": "Fail On Container Waiting Reasons"
					},
					"pod_startup_timeout": {
						"anyOf": [
							{
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Startup Timeout"
					},
					"pod_failure_max_retries": {
						"anyOf": [
							{
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Failure Max Retries"
					},
					"pod_failure_retry_delay": {
						"anyOf": [
							{
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Failure Retry Delay"
					},
					"pod_failure_backoff": {
						"anyOf": [
							{
								"type": "number"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"deprecated": true,
						"description": "DEPRECATED/UNUSED.",
						"title": "Pod Failure Backoff"
					}
				},
				"title": "KubernetesStepOperatorSettings",
				"type": "object"
			},
			"Model": {
				"description": "Model class to pass into pipeline or step to set it into a model context.\n\nname: The name of the model.\nlicense: The license under which the model is created.\ndescription: The description of the model.\naudience: The target audience of the model.\nuse_cases: The use cases of the model.\nlimitations: The known limitations of the model.\ntrade_offs: The tradeoffs of the model.\nethics: The ethical implications of the model.\ntags: Tags associated with the model.\nversion: The version name, version number or stage is optional and points model context\n    to a specific version/stage. If skipped new version will be created. `version`\n    also supports placeholders: standard `{date}` and `{time}` and any custom placeholders\n    that are passed as substitutions in the pipeline or step decorators.\nsave_models_to_registry: Whether to save all ModelArtifacts to Model Registry,\n    if available in active stack.",
				"properties": {
					"name": {
						"title": "Name",
						"type": "string"
					},
					"license": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "License"
					},
					"description": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Description"
					},
					"audience": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Audience"
					},
					"use_cases": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Use Cases"
					},
					"limitations": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Limitations"
					},
					"trade_offs": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Trade Offs"
					},
					"ethics": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Ethics"
					},
					"tags": {
						"anyOf": [
							{
								"items": {
									"type": "string"
								},
								"type": "array"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Tags"
					},
					"version": {
						"anyOf": [
							{
								"$ref": "#/$defs/ModelStages"
							},
							{
								"type": "integer"
							},
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Version"
					},
					"save_models_to_registry": {
						"default": true,
						"title": "Save Models To Registry",
						"type": "boolean"
					},
					"model_version_id": {
						"anyOf": [
							{
								"format": "uuid",
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Model Version Id"
					},
					"suppress_class_validation_warnings": {
						"default": false,
						"title": "Suppress Class Validation Warnings",
						"type": "boolean"
					}
				},
				"required": [
					"name"
				],
				"title": "Model",
				"type": "object"
			},
			"ModelStages": {
				"description": "All possible stages of a Model Version.",
				"enum": [
					"none",
					"staging",
					"production",
					"archived",
					"latest"
				],
				"title": "ModelStages",
				"type": "string"
			},
			"ResourceSettings": {
				"description": "Hardware resource settings.\n\nDeployers and deployed pipelines can also use the following settings:\n\n* min_replicas and max_replicas allow expressing both fixed scaling and\nautoscaling range. For a fixed number of instances, set both to the same\nvalue (e.g. 3). If min_replicas=0, it indicates the service can scale down\nto zero instances when idle (if the platform supports it) most serverless\nplatforms do. If max_replicas is None or 0, it will be interpreted as\n“no specific limit” (use platform default behavior, which might be unlimited\nor a high default cap). Otherwise, max_replicas puts an upper bound on\nscaling.\n\n* autoscaling_metric and autoscaling_target describe when to scale. For\nexample, autoscaling_metric=\"cpu\", autoscaling_target=75.0 means keep CPU\naround 75% - a Kubernetes integration would create an HPA with target CPU\n75%, whereas a Knative integration might ignore this if it's using\nconcurrency-based autoscaling. Similarly, \"concurrency\" with a target of,\nsay, 50 means the system should try to ensure each instance handles ~50\nconcurrent requests before spawning a new instance. The integration code for\neach platform will translate these generically: e.g. Cloud Run doesn't allow\nchanging the CPU threshold (fixed ~60%), so it might ignore a custom CPU\ntarget; Knative supports concurrency and RPS metrics via annotations\nso those would be applied if specified.\n\n* max_concurrency is a per-instance concurrency limit. This is particularly\nuseful for platforms that allow configuring a concurrency cap (Knative's\ncontainerConcurrency, Cloud Run's concurrency setting, App Runner's max\nconcurrent requests, Modal's max_inputs in the concurrent decorator). If\nset, this indicates “do not send more than this many simultaneous requests\nto one instance.” The autoscaler will then naturally create more instances\nonce this limit is hit on each existing instance. If\nautoscaling_metric=\"concurrency\" and no explicit target is given, one could\nassume the target is equal to max_concurrency (or a certain utilization of\nit). In some cases, platforms use a utilization factor - for simplicity, we\nlet the integration decide (some might use 80% of max concurrency as the\ntrigger to scale, for example, if that platform does so internally). If\nmax_concurrency is not set, it implies no fixed limit per instance (the\nservice instance will take as many requests as it can, scaling purely on\nthe chosen metric like CPU or an internal default concurrency).\n\nAttributes:\n    cpu_count: The amount of CPU cores that should be configured.\n    gpu_count: The amount of GPUs that should be configured.\n    memory: The amount of memory that should be configured.\n    min_replicas: Minimum number of container instances (replicas).\n        Use 0 to allow scale-to-zero on idle. Only relevant to\n        deployed pipelines.\n    max_replicas: Maximum number of container instances for autoscaling.\n        Set to 0 to imply \"no explicit limit\". Only relevant to deployed\n        pipelines.\n    autoscaling_metric: Metric to use for autoscaling triggers.\n        Options: \"cpu\", \"memory\", \"concurrency\", or \"rps\". Only relevant\n        to deployed pipelines.\n    autoscaling_target: Target value for the autoscaling metric (e.g. 70.0\n        for 70% CPU or 20 for concurrency). Only relevant to deployed\n        pipelines.\n    max_concurrency: Maximum concurrent requests per instance (if supported\n        by the platform). Defines a concurrency limit for each container.\n        Only relevant to deployed pipelines.",
				"properties": {
					"cpu_count": {
						"anyOf": [
							{
								"exclusiveMinimum": 0,
								"type": "number"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Cpu Count"
					},
					"gpu_count": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Gpu Count"
					},
					"memory": {
						"anyOf": [
							{
								"pattern": "^[0-9]+(KB|KiB|MB|MiB|GB|GiB|TB|TiB|PB|PiB)$",
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Memory"
					},
					"min_replicas": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Min Replicas"
					},
					"max_replicas": {
						"anyOf": [
							{
								"minimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Max Replicas"
					},
					"autoscaling_metric": {
						"anyOf": [
							{
								"enum": [
									"cpu",
									"memory",
									"concurrency",
									"rps"
								],
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Autoscaling Metric"
					},
					"autoscaling_target": {
						"anyOf": [
							{
								"exclusiveMinimum": 0,
								"type": "number"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Autoscaling Target"
					},
					"max_concurrency": {
						"anyOf": [
							{
								"exclusiveMinimum": 0,
								"type": "integer"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Max Concurrency"
					}
				},
				"title": "ResourceSettings",
				"type": "object"
			},
			"Settings": {
				"properties": {
					"resources": {
						"anyOf": [
							{
								"$ref": "#/$defs/ResourceSettings"
							},
							{
								"type": "null"
							}
						],
						"default": null
					},
					"orchestrator.kubernetes": {
						"anyOf": [
							{
								"$ref": "#/$defs/KubernetesOrchestratorSettings"
							},
							{
								"type": "null"
							}
						],
						"default": null
					},
					"step_operator.kubernetes": {
						"anyOf": [
							{
								"$ref": "#/$defs/KubernetesStepOperatorSettings"
							},
							{
								"type": "null"
							}
						],
						"default": null
					}
				},
				"title": "Settings",
				"type": "object"
			},
			"StepOperators": {
				"enum": [
					"kubernetes_aws"
				],
				"title": "StepOperators",
				"type": "string"
			},
			"StepRetryConfig": {
				"description": "Retry configuration for a step.\n\nDelay is an integer (specified in seconds).",
				"properties": {
					"max_retries": {
						"default": 1,
						"exclusiveMinimum": 0,
						"title": "Max Retries",
						"type": "integer"
					},
					"delay": {
						"default": 0,
						"minimum": 0,
						"title": "Delay",
						"type": "integer"
					},
					"backoff": {
						"default": 0,
						"minimum": 0,
						"title": "Backoff",
						"type": "integer"
					}
				},
				"title": "StepRetryConfig",
				"type": "object"
			},
			"Steps": {
				"properties": {
					"noop": {
						"anyOf": [
							{
								"$ref": "#/$defs/noop"
							},
							{
								"type": "null"
							}
						],
						"default": null
					}
				},
				"title": "Steps",
				"type": "object"
			},
			"Tag": {
				"description": "A model representing a tag.",
				"properties": {
					"name": {
						"title": "Name",
						"type": "string"
					},
					"color": {
						"anyOf": [
							{
								"$ref": "#/$defs/ColorVariants"
							},
							{
								"type": "null"
							}
						],
						"default": null
					},
					"exclusive": {
						"anyOf": [
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Exclusive"
					},
					"cascade": {
						"anyOf": [
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Cascade"
					}
				},
				"required": [
					"name"
				],
				"title": "Tag",
				"type": "object"
			},
			"noop": {
				"properties": {
					"enable_cache": {
						"anyOf": [
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Whether to enable cache for the step.",
						"title": "Enable Cache"
					},
					"enable_artifact_metadata": {
						"anyOf": [
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Whether to store metadata for the output artifacts of the step.",
						"title": "Enable Artifact Metadata"
					},
					"enable_artifact_visualization": {
						"anyOf": [
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Whether to enable visualizations for the output artifacts of the step.",
						"title": "Enable Artifact Visualization"
					},
					"enable_step_logs": {
						"anyOf": [
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Whether to enable logs for the step.",
						"title": "Enable Step Logs"
					},
					"settings": {
						"anyOf": [
							{
								"$ref": "#/$defs/Settings"
							},
							{
								"type": "null"
							}
						],
						"default": null
					},
					"environment": {
						"anyOf": [
							{
								"additionalProperties": {
									"type": "string"
								},
								"type": "object"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The environment for the step.",
						"title": "Environment"
					},
					"secrets": {
						"anyOf": [
							{
								"items": {
									"anyOf": [
										{
											"format": "uuid",
											"type": "string"
										},
										{
											"type": "string"
										}
									]
								},
								"type": "array"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The secrets for the step.",
						"title": "Secrets"
					},
					"extra": {
						"anyOf": [
							{
								"additionalProperties": true,
								"type": "object"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "Extra configurations for the step.",
						"title": "Extra"
					},
					"failure_hook_source": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The failure hook source for the step.",
						"title": "Failure Hook Source"
					},
					"success_hook_source": {
						"anyOf": [
							{
								"type": "string"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The success hook source for the step.",
						"title": "Success Hook Source"
					},
					"model": {
						"anyOf": [
							{
								"$ref": "#/$defs/Model"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The model to use for the step."
					},
					"retry": {
						"anyOf": [
							{
								"$ref": "#/$defs/StepRetryConfig"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The retry configuration for the step."
					},
					"substitutions": {
						"anyOf": [
							{
								"additionalProperties": {
									"type": "string"
								},
								"type": "object"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The substitutions for the step.",
						"title": "Substitutions"
					},
					"cache_policy": {
						"anyOf": [
							{
								"$ref": "#/$defs/CachePolicy"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"description": "The cache policy for the step."
					},
					"step_operator": {
						"anyOf": [
							{
								"$ref": "#/$defs/StepOperators"
							},
							{
								"type": "boolean"
							},
							{
								"type": "null"
							}
						],
						"default": null,
						"title": "Step Operator"
					}
				},
				"title": "noop",
				"type": "object"
			}
		},
		"properties": {
			"run_name": {
				"anyOf": [
					{
						"type": "string"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The name of the pipeline run.",
				"title": "Run Name"
			},
			"enable_cache": {
				"anyOf": [
					{
						"type": "boolean"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "Whether to enable cache for all steps of the pipeline run.",
				"title": "Enable Cache"
			},
			"enable_artifact_metadata": {
				"anyOf": [
					{
						"type": "boolean"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "Whether to enable metadata for the output artifacts of all steps of the pipeline run.",
				"title": "Enable Artifact Metadata"
			},
			"enable_artifact_visualization": {
				"anyOf": [
					{
						"type": "boolean"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "Whether to enable visualizations for the output artifacts of all steps of the pipeline run.",
				"title": "Enable Artifact Visualization"
			},
			"enable_step_logs": {
				"anyOf": [
					{
						"type": "boolean"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "Whether to enable logs for all steps of the pipeline run.",
				"title": "Enable Step Logs"
			},
			"enable_pipeline_logs": {
				"anyOf": [
					{
						"type": "boolean"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "Whether to enable pipeline logs for the pipeline run.",
				"title": "Enable Pipeline Logs"
			},
			"environment": {
				"anyOf": [
					{
						"additionalProperties": true,
						"type": "object"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The environment for all steps of the pipeline run.",
				"title": "Environment"
			},
			"secrets": {
				"anyOf": [
					{
						"items": {
							"anyOf": [
								{
									"format": "uuid",
									"type": "string"
								},
								{
									"type": "string"
								}
							]
						},
						"type": "array"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The secrets for all steps of the pipeline run.",
				"title": "Secrets"
			},
			"tags": {
				"anyOf": [
					{
						"items": {
							"anyOf": [
								{
									"type": "string"
								},
								{
									"$ref": "#/$defs/Tag"
								}
							]
						},
						"type": "array"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "Tags to apply to the pipeline run.",
				"title": "Tags"
			},
			"extra": {
				"anyOf": [
					{
						"additionalProperties": true,
						"type": "object"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "Extra configurations for the pipeline run.",
				"title": "Extra"
			},
			"model": {
				"anyOf": [
					{
						"$ref": "#/$defs/Model"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The model to use for the pipeline run."
			},
			"retry": {
				"anyOf": [
					{
						"$ref": "#/$defs/StepRetryConfig"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The retry configuration for all steps of the pipeline run."
			},
			"failure_hook_source": {
				"anyOf": [
					{
						"type": "string"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The failure hook source for all steps of the pipeline run.",
				"title": "Failure Hook Source"
			},
			"init_hook_source": {
				"anyOf": [
					{
						"type": "string"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The init hook source for the pipeline run.",
				"title": "Init Hook Source"
			},
			"init_hook_kwargs": {
				"anyOf": [
					{
						"additionalProperties": true,
						"type": "object"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The init hook args for the pipeline run.",
				"title": "Init Hook Kwargs"
			},
			"cleanup_hook_source": {
				"anyOf": [
					{
						"type": "string"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The cleanup hook source for the pipeline run.",
				"title": "Cleanup Hook Source"
			},
			"success_hook_source": {
				"anyOf": [
					{
						"type": "string"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The success hook source for all steps of the pipeline run.",
				"title": "Success Hook Source"
			},
			"substitutions": {
				"anyOf": [
					{
						"additionalProperties": {
							"type": "string"
						},
						"type": "object"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The substitutions for the pipeline run.",
				"title": "Substitutions"
			},
			"cache_policy": {
				"anyOf": [
					{
						"$ref": "#/$defs/CachePolicy"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The cache policy for all steps of the pipeline run."
			},
			"execution_mode": {
				"anyOf": [
					{
						"$ref": "#/$defs/ExecutionMode"
					},
					{
						"type": "null"
					}
				],
				"default": null,
				"description": "The execution mode for the pipeline run."
			},
			"settings": {
				"anyOf": [
					{
						"$ref": "#/$defs/Settings"
					},
					{
						"type": "null"
					}
				],
				"default": null
			},
			"steps": {
				"anyOf": [
					{
						"$ref": "#/$defs/Steps"
					},
					{
						"type": "null"
					}
				],
				"default": null
			}
		},
		"title": "Result",
		"type": "object"
	}