Data Engineer

About the Role

In this Data Engineer role, you'll design, build, and maintain scalable ETL/ELT pipelines using Python, SQL, and cloud-native tools for ingestion, transformation, and consumption.

You'll collaborate with Data Scientists and Analysts to ensure clean, structured, and well-documented datasets for ML training and reporting.

Additionally, you'll implement data governance and metadata standards using tools like Apache Atlas or Collibra to ensure compliance and observability.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Python, SQL, and cloud-native tools for ingestion, transformation, and consumption.
• Architect and optimize data models in cloud data warehouses (Snowflake, BigQuery, Redshift) aligned with business KPIs and analytics use cases.
• Collaborate with Data Scientists and Analysts to ensure clean, structured, and well-documented datasets for ML training and reporting.
• Automate data quality checks, lineage tracking, and monitoring alerts to ensure pipeline reliability and SLA adherence.
• Implement data governance and metadata standards using tools like Apache Atlas or Collibra to ensure compliance and observability.
• Support cloud migration initiatives by refactoring legacy ETL jobs into modular, containerized, and serverless architectures.
• Work with cross-functional teams to ensure data pipelines meet business requirements and SLAs.

Skills & Qualifications

• Python programming language
• SQL and database management
• Apache Airflow for workflow automation
• Spark for big data processing
• Cloud platforms (AWS or Azure)
• Git for version control
• dbt for data transformation
• Star schema modeling for data warehousing
• Real-time streaming (Kafka, Flink)
• Bachelor's degree in Computer Science or related field
• Relevant certifications (e.g., AWS Certified Developer - Associate)

What You'll Learn

In this role, you'll gain hands-on experience with designing, building, and maintaining scalable data pipelines using cloud-native tools.

You'll learn how to collaborate with cross-functional teams to ensure data pipelines meet business requirements and SLAs.

Additionally, you'll have the opportunity to upskill in GenAI/LLM data pipelines and modern data mesh architectures.

Resume Tip

When applying for this role, make sure to highlight your experience with cloud platforms (AWS or Azure), Python programming language, and SQL database management.

Include specific examples of data pipelines you've designed and built, and the tools you've used to automate and optimize them.

This will demonstrate your skills and experience to the hiring manager and increase your chances of getting an interview.