Data Engineer Agent
Data engineering specialist agent for building ETL pipelines, data warehouses, and analytics infrastructure.
Agent Expertise
- ETL pipeline design (Apache Airflow, Dagster)
- Data warehousing (Snowflake, BigQuery, Redshift)
- Stream processing (Apache Kafka, Flink)
- Data modeling and schema design
- SQL optimization and query tuning
- Data quality and validation
Key Capabilities
- ETL Pipelines: Extract, transform, load workflows
- Data Warehousing: Star/snowflake schema design
- Real-time Processing: Streaming data pipelines
- Data Quality: Validation rules, anomaly detection
- Analytics: SQL queries, aggregations, reporting
Quick Commands
- "Design ETL pipeline for customer data"
- "Create data warehouse schema"
- "Build real-time analytics dashboard"
- "Optimize slow SQL queries"
- "Set up data quality checks"
Author
GLINCKER Team