Data Platform Engineering Manager

Job Description \u2013 Data Platform Engineering Manager<\/span><\/span><\/span>
<\/span><\/span><\/span>Experience: 10+yrs<\/span><\/span><\/span>
<\/span><\/span><\/span>Location: Bengaluru<\/span><\/span><\/span>
<\/span><\/span><\/span>Notice Period: Immediate joiner<\/span><\/span><\/span> <\/span><\/span><\/span><\/span><\/span><\/div><\/div>

Role Overview<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

We are<\/span> <\/span><\/span>seeking<\/span> <\/span><\/span>an experienced and highly motivated Data Platform Engineering Manager to lead the design, development, scalability, and operations of a modern cloud\-native data platform. This role will drive the architecture and execution of large\-scale data processing systems, analytics infrastructure, ML enablement frameworks, and DevOps best practices that power business intelligence, advanced analytics, and rapid product innovation.<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

As a hands\-on engineering leader, you will manage and mentor a high\-performing team of Data Engineers, DevOps Engineers, and Cloud Platform Engineers while collaborating closely with Product, Engineering, Analytics, and Data Science teams.<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

Key Responsibilities<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

Data Platform & Engineering<\/span><\/span><\/span> <\/span><\/span><\/span>
<\/span><\/span><\/span><\/p><\/div>

  • Architect, build, and manage scalable, secure, and high\-performance data platforms using technologies such as Apache Hadoop, Hive, Spark, Kafka, Airflow, and Delta Lake.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
    <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
    • Design and<\/span> <\/span><\/span>optimize<\/span> <\/span><\/span>batch and real\-time ETL/ELT pipelines to support analytics, reporting, machine learning, and operational use cases.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
      <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
      • Develop scalable data models, ingestion frameworks, and streaming workflows for enterprise\-scale data processing.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
        <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
        • Optimize<\/span> <\/span><\/span>cloud\-native data storage and compute solutions using AWS services such as S3, EMR, Glue, Redshift, Athena, and Lambda.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
          <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
          • Integrate and manage modern data stack tools including<\/span> <\/span><\/span><\/span>dbt<\/span><\/span>, Snowflake,<\/span> <\/span><\/span><\/span>BigQuery<\/span><\/span>,<\/span> <\/span><\/span><\/span>Fivetran<\/span><\/span>, or custom\-built connectors.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
            <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
            • Establish strong data governance practices including data quality, lineage, cataloging, metadata management, and observability using tools like Apache Atlas, Great Expectations, and Amundsen.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
              <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
              • Partner with Product, Engineering, Analytics, and Data Science teams to deliver reliable,<\/span> <\/span><\/span>accurate, and actionable data solutions.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>

                <\/span><\/span><\/span>
                <\/span><\/span><\/span><\/p><\/div>

                ML & Advanced Analytics Enablement<\/span><\/span><\/span> <\/span><\/span><\/span>
                <\/span><\/span><\/span><\/p><\/div>

                • Support AI/ML and Data Science teams by<\/span> <\/span><\/span>maintaining<\/span> <\/span><\/span>scalable model training, experimentation, and deployment infrastructure.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                  <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                  • Build and manage<\/span> <\/span><\/span><\/span>MLOps<\/span><\/span> <\/span><\/span>pipelines and frameworks using<\/span> <\/span><\/span><\/span>MLflow<\/span><\/span>, SageMaker,<\/span> <\/span><\/span><\/span>PyTorch<\/span><\/span>, TensorFlow, or similar technologies.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                    <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                    • Enable model versioning, metadata tracking, automated retraining, and real\-time inference workflows.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                      <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                      • Ensure scalable and production\-ready deployment pipelines for machine learning applications.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                        <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>

                        <\/span><\/span><\/span>
                        <\/span><\/span><\/span><\/p><\/div>

                        DevOps & Platform Engineering<\/span><\/span><\/span> <\/span><\/span><\/span>
                        <\/span><\/span><\/span><\/p><\/div>

                        • Lead the implementation of robust CI/CD pipelines, automated testing frameworks, release management, and<\/span> <\/span><\/span><\/span>GitOps<\/span><\/span> <\/span><\/span>practices.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                          <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                          • Implement Infrastructure as Code (<\/span><\/span>IaC<\/span><\/span>) using Terraform, Ansible, or<\/span> <\/span><\/span><\/span>Pulumi<\/span><\/span>.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                            <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                            • Manage containerization and orchestration platforms including Docker and Kubernetes (EKS preferred).<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                              <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                              • Own cloud infrastructure management including networking, security, governance, compliance, and cost optimization initiatives.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                                • Implement platform monitoring, logging, alerting, and observability using Prometheus, Grafana, ELK Stack,<\/span> <\/span><\/span><\/span>DataDog<\/span><\/span>, or equivalent tools.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                  <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                                  • Drive Site Reliability Engineering (SRE) practices including incident management, root cause analysis, retrospectives, and on\-call operations.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                    <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>

                                    <\/span><\/span><\/span>
                                    <\/span><\/span><\/span><\/p><\/div>

                                    Leadership & Team Management<\/span><\/span><\/span> <\/span><\/span><\/span>
                                    <\/span><\/span><\/span><\/p><\/div>

                                    • Lead, mentor, and grow a team of 8\u201312 Data Engineers, DevOps Engineers, and Platform Engineers.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                      <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                                      • Define team<\/span> <\/span><\/span>objectives, performance metrics, and engineering best practices.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                        <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                                        • Foster a culture of ownership, operational excellence, innovation, and continuous learning.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                          <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                                          • Collaborate with cross\-functional stakeholders to translate business requirements into scalable and reliable engineering solutions.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                            <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>
                                            • Drive engineering execution, sprint planning, prioritization, and delivery management.<\/span> <\/span><\/span><\/span><\/span> <\/span><\/span><\/span>
                                              <\/span><\/span><\/span><\/span><\/li><\/ul><\/div>

                                              <\/span><\/span><\/span>
                                              <\/span><\/span><\/span><\/p><\/div>

                                              Infrastructure Reliability & Optimization<\/span><\/span><\/span> <\/span><\/span><\/span>
                                              <\/span><\/span><\/span><\/p><\/div>

                                              • Own platform reliability, scalability, and operational excellence across data and infrastructure systems.<\/span> <\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/li><\/ul><\/div><\/span>