Senior Manager
Oversee data engineering solutions at an organizational level. Lead high-impact data initiatives. Ensure alignment of data practices with organizational goals. Provide executive-level strategic guidance.
Key Responsibilities
- Design, build, and maintain robust, scalable data pipelines using AWS services.
- Develop and optimize ETL/ELT processes to ingest, transform, and load large datasets from multiple sources.
- Work with structured and unstructured data, ensuring high data quality and integrity.
- Implement and manage data lakes and data warehouses using AWS technologies.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions.
Key Responsibilities
- Design, build, and maintain robust, scalable data pipelines using AWS services.
- Develop and optimize ETL/ELT processes to ingest, transform, and load large datasets from multiple sources.
- Work with structured and unstructured data, ensuring high data quality and integrity.
- Implement and manage data lakes and data warehouses using AWS technologies.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions.
- Monitor, troubleshoot, and optimize data workflows and queries for performance and cost efficiency.
- Implement infrastructure as code (IaC) practices using Terraform.
- Integrate CI/CD pipelines and DevOps practices using Azure DevOps.
- Ensure data security, governance, and compliance best practices are followed.
- Document data architecture, processes, and standards.
Graduate in Computer Science, Data Science, or related field. 6-8 years of experience in data engineering or related field.
Required Skills & Experience
- 10+ years of experience in Data Engineering or related roles with a least 5+ of these building solutions in AWS.
- Hands-on expertise with key AWS services:
- S3, Lambda, Glue, Redshift, Athena, Step Functions, EventBridge, SQS, SNS, IAM, Cloudwatch, VPC
- Solid understanding of data warehousing and data lake architectures
- Expertise in the design and development of data marts, including dimensional modeling (star/snowflake schemas) and building optimized, business-focused data models for analytics and reporting
- Strong expertise with SQL, Python and Spark.
- Experience with creating of AWS resources using Infrastructure as Code (IaC), preferably through Terraform.
- Familiarity with DevOps practices and tools, such as Azure DevOps.
- Experience with version control systems (e.g., Git).
- Strong problem-solving skills and attention to detail.