Skip to content

Commit 1d65cfb

Browse files
committed
refactor: Update pipeline configuration in Readme.MD
1 parent c104ae3 commit 1d65cfb

File tree

1 file changed

+16
-17
lines changed

1 file changed

+16
-17
lines changed

Readme.MD

+16-17
Original file line numberDiff line numberDiff line change
@@ -156,23 +156,22 @@ The rules can be embedded into the YAML configuration for pipelines:
156156

157157
```yaml
158158
pipeline:
159-
- name: "CSV to Firebase Pipeline"
160-
input:
161-
type: "CSV"
162-
source: "/data/input.csv"
163-
validation:
164-
rules: |
165-
FIELD("age") TYPE(INT) RANGE(18, 65)
166-
FIELD("email") MATCHES(EMAIL_REGEX)
167-
transformation:
168-
rules: |
169-
RENAME("old_field", "new_field")
170-
IF FIELD("age") > 50 THEN ADD_FIELD("senior_discount", TRUE)
171-
output:
172-
type: "Firebase"
173-
destination: "firebase://project_name/collection"
174-
error_handling: |
175-
ON_ERROR(LOG_AND_CONTINUE)
159+
error-handling:
160+
strategy: LOG_AND_CONTINUE
161+
inputconfig:
162+
csvsourcefilename: sample.csv
163+
inputmethod: CSV
164+
outputconfig:
165+
csvdestinationfilename: test.csv
166+
outputmethod: CSV
167+
cronjob:
168+
repetition_interval: "1h"
169+
monitoring:
170+
job_status:"pending"
171+
transformations:
172+
-ADD_FIELD("processed_at", CURRENT_TIME())
173+
validations:
174+
-FIELD("age") RANGE(30,35)
176175
```
177176

178177
---

0 commit comments

Comments
 (0)