You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/docs/dagster-basics-tutorial/6-custom-components.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ If we think about the code for our three assets (`customers`, `orders`, and `pay
10
10
11
11
These assets are a great candidate for a [custom component](/guides/build/components/creating-new-components). Components generate `Definitions` through a configuration layer. There are built-in components that let you integrate with common workflows (such as turning Python scripts into assets), or dynamically generate `Definitions` for tools like [dbt](/integrations/libraries/dbt) or [Fivetran](/integrations/libraries/fivetran). With custom components, you can define your own specific use cases.
12
12
13
-
In this step, you will use a custom component to streamline the development of similar assets and replace their `Definitions` in your project with a Component that can generate them from a a YAML configuration file instead.
13
+
In this step, you will use a custom component to streamline the development of similar assets and replace their `Definitions` in your project with a Component that can generate them from a YAML configuration file instead.
Job execution flows through several parts of the Dagster system. The following table describes runs launched by the UI, specifically the components that handle execution and the order in which they are executed.
|[Run coordinator](/deployment/execution/run-coordinators)| The run coordinator is a class invoked by the webserver process when runs are launched from the Dagster UI. This class can be configured to pass runs to the daemon via a queue. | Instance |
53
-
|[Run launcher](/deployment/execution/run-launchers)| The run launcher is a class invoked by the daemon when it receives a run from the queue. This class initializes a new run worker to handle execution. Depending on the launcher, this could mean spinning up a new process, container, Kubernetes pod, etc. | Instance |
54
-
| Run worker | The run worker is a process which traverses a graph and uses the executor to execute each op. | n/a |
55
-
|[Executor](/guides/operate/run-executors)| The executor is a class invoked by the run worker for running user ops. Depending on the executor, ops run in local processes, new containers, Kubernetes pods, etc. | Run config |
|1 |[Run coordinator](/deployment/execution/run-coordinators)| The run coordinator is a class invoked by the webserver process when runs are launched from the Dagster UI. This class can be configured to pass runs to the daemon via a queue. | Instance|
53
+
|2 |[Run launcher](/deployment/execution/run-launchers)| The run launcher is a class invoked by the daemon when it receives a run from the queue. This class initializes a new run worker to handle execution. Depending on the launcher, this could mean spinning up a new process, container, Kubernetes pod, etc. | Instance|
54
+
|3 |Run worker | The run worker is a process which traverses a graph and uses the executor to execute each op. | n/a|
55
+
|4 |[Executor](/guides/operate/run-executors)| The executor is a class invoked by the run worker for running user ops. Depending on the executor, ops run in local processes, new containers, Kubernetes pods, etc. | Run config|
56
56
57
57
Additionally, note that runs launched by schedules and sensors go through the same flow, but the first step is called by the [Dagster daemon](/deployment/execution/dagster-daemon) instead of the webserver.
Copy file name to clipboardExpand all lines: docs/docs/guides/build/projects/workspaces/workspace-yaml.md
-10Lines changed: 0 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,16 +32,6 @@ To accommodate incrementally migrating from `@repository` to `Definitions`, code
32
32
33
33
:::
34
34
35
-
## Location of workspace.yaml
36
-
37
-
Dagster command-line tools (like `dg`) look for workspace files in the current directory when invoked. This allows you to launch from that directory without the need for command line arguments
38
-
39
-
To load the workspace.yaml file from a different folder, use the -w argument:
40
-
41
-
```bash
42
-
dg dev -w path/to/workspace.yaml
43
-
```
44
-
45
35
## File structure
46
36
47
37
The `workspace.yaml` file uses the following structure:
0 commit comments