Data Platform Engineering Manager

Job Description \u2013 Data Platform Engineering Manager<\/span><\/span><\/span>
<\/span><\/span><\/span>Experience: 10+yrs<\/span><\/span><\/span>
<\/span><\/span><\/span>Location: Bengaluru<\/span><\/span><\/span>
<\/span><\/span><\/span>Notice Period: Immediate joiner<\/span><\/span><\/span> <\/span><\/span><\/span><\/span><\/span><\/div><\/div>

Role Overview<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

We are<\/span> <\/span><\/span>seeking<\/span> <\/span><\/span>an experienced and highly motivated Data Platform Engineering Manager to lead the design, development, scalability, and operations of a modern cloud\-native data platform. This role will drive the architecture and execution of large\-scale data processing systems, analytics infrastructure, ML enablement frameworks, and DevOps best practices that power business intelligence, advanced analytics, and rapid product innovation.<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

As a hands\-on engineering leader, you will manage and mentor a high\-performing team of Data Engineers, DevOps Engineers, and Cloud Platform Engineers while collaborating closely with Product, Engineering, Analytics, and Data Science teams.<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

Key Responsibilities<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

Data Platform & Engineering<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

Architect, build, and manage scalable, secure, and high\-performance data platforms using technologies such as Apache Hadoop, Hive, Spark, Kafka, Airflow, and Delta Lake.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Design and<\/span> <\/span><\/span>optimize<\/span> <\/span><\/span>batch and real\-time ETL/ELT pipelines to support analytics, reporting, machine learning, and operational use cases.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Develop scalable data models, ingestion frameworks, and streaming workflows for enterprise\-scale data processing.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Optimize<\/span> <\/span><\/span>cloud\-native data storage and compute solutions using AWS services such as S3, EMR, Glue, Redshift, Athena, and Lambda.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Integrate and manage modern data stack tools including<\/span> <\/span><\/span><\/span>dbt<\/span><\/span>, Snowflake,<\/span> <\/span><\/span><\/span>BigQuery<\/span><\/span>,<\/span> <\/span><\/span><\/span>Fivetran<\/span><\/span>, or custom\-built connectors.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Establish strong data governance practices including data quality, lineage, cataloging, metadata management, and observability using tools like Apache Atlas, Great Expectations, and Amundsen.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Partner with Product, Engineering, Analytics, and Data Science teams to deliver reliable,<\/span> <\/span><\/span>accurate, and actionable data solutions.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
<\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
ML & Advanced Analytics Enablement<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
Support AI/ML and Data Science teams by<\/span> <\/span><\/span>maintaining<\/span> <\/span><\/span>scalable model training, experimentation, and deployment infrastructure.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Build and manage<\/span> <\/span><\/span><\/span>MLOps<\/span><\/span> <\/span><\/span>pipelines and frameworks using<\/span> <\/span><\/span><\/span>MLflow<\/span><\/span>, SageMaker,<\/span> <\/span><\/span><\/span>PyTorch<\/span><\/span>, TensorFlow, or similar technologies.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Enable model versioning, metadata tracking, automated retraining, and real\-time inference workflows.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Ensure scalable and production\-ready deployment pipelines for machine learning applications.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
<\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
DevOps & Platform Engineering<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
Lead the implementation of robust CI/CD pipelines, automated testing frameworks, release management, and<\/span> <\/span><\/span><\/span>GitOps<\/span><\/span> <\/span><\/span>practices.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Implement Infrastructure as Code (<\/span><\/span>IaC<\/span><\/span>) using Terraform, Ansible, or<\/span> <\/span><\/span><\/span>Pulumi<\/span><\/span>.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Manage containerization and orchestration platforms including Docker and Kubernetes (EKS preferred).<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Own cloud infrastructure management including networking, security, governance, compliance, and cost optimization initiatives.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Implement platform monitoring, logging, alerting, and observability using Prometheus, Grafana, ELK Stack,<\/span> <\/span><\/span><\/span>DataDog<\/span><\/span>, or equivalent tools.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Drive Site Reliability Engineering (SRE) practices including incident management, root cause analysis, retrospectives, and on\-call operations.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
<\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
Leadership & Team Management<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
Lead, mentor, and grow a team of 8\u201312 Data Engineers, DevOps Engineers, and Platform Engineers.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Define team<\/span> <\/span><\/span>objectives, performance metrics, and engineering best practices.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Foster a culture of ownership, operational excellence, innovation, and continuous learning.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Collaborate with cross\-functional stakeholders to translate business requirements into scalable and reliable engineering solutions.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
Drive engineering execution, sprint planning, prioritization, and delivery management.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
<\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
Infrastructure Reliability & Optimization<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>
Own platform reliability, scalability, and operational excellence across data and infrastructure systems.<\/span> <\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/li><\/ul><\/div><\/span>