Skip to content

Latest commit

 

History

History
 
 

README.md

Data Engineering

Challenges focused on data warehouse migration, ETL pipeline modernization, data quality validation, and analytics platform transitions.

Job titles: Data Engineer, Analytics Engineer, Data Architect, ETL Developer

Modules

Module Difficulty Time
DW Migration: Teradata to Snowflake Intermediate–Advanced 60 min
Data Source Migration Intermediate 60 min
ETL Pipeline Modernization Intermediate–Advanced 60 min
Data Quality & Validation Intermediate 45 min
SAS to Python/Snowflake Intermediate–Advanced 60 min
Informatica PowerCenter Analysis Intermediate 45 min
Informatica PowerCenter to Snowflake Migration Advanced 75 min
COBOL Copybook to PySpark/JSON Intermediate 45 min
SAS Migration Analysis Intermediate–Advanced 75 min
SAS CI/CD & Operationalization Intermediate–Advanced 60 min

Repositories

Repository Compatible Modules
uc-dw-migration-teradata-to-snowflake DW Migration: Teradata to Snowflake, ETL Pipeline Modernization, Data Quality & Validation
uc-data-source-migration-jdbc-normalization Data Source Migration
ts-informatica-powercenter Informatica PowerCenter Analysis, Informatica PowerCenter to Snowflake Migration
ts-cobol-carddemo COBOL Copybook to PySpark/JSON
ts-sas-legacy-analytics SAS to Python/Snowflake, SAS Migration Analysis, SAS CI/CD & Operationalization
uc-data-migration-sas-to-snowflake SAS to Python/Snowflake
uc-data-migration-sas-to-databricks SAS Migration Analysis, SAS CI/CD & Operationalization

When to Use This Category

  • Data-focused audiences (data engineering, analytics, BI teams)
  • Workshops showing Devin's ability to understand and transform data schemas, queries, and pipelines
  • DW Migration and SAS to Python/Snowflake are particularly relevant for enterprises migrating off legacy analytics platforms
  • Data Quality & Validation pairs well with any data migration module as a validation step
  • The uc-dw-migration-teradata-to-snowflake repo was specifically curated for these challenges
  • Informatica PowerCenter modules are ideal for enterprises migrating from on-prem Informatica ETL to cloud-native Snowflake architectures
  • The SAS Migration Analysis module includes a Programmatic Context Loop section — prescriptive guidance on configuring DeepWiki, Knowledge notes, MCP servers, and environment blueprints so Devin can iteratively build understanding during migration analysis. Use this as a reference for any migration module where programmatic resource access is part of the workflow