Data Engineering Manager

You will lead and grow a data engineering team, balancing hands-on technical work with people management. You will design, build, and operate scalable batch and streaming data pipelines using Databricks and Spark on AWS, implement dbt transformations and Airflow orchestration, enforce CI/CD and testing best practices, monitor system reliability and performance, and collaborate with product, analytics, and infrastructure stakeholders to deliver production data solutions.

Responsibilities

  • Partner with business lines to build and enhance a reliable and scalable data platform
  • Drive execution of the data engineering roadmap aligned with business priorities
  • Lead and mentor a team of data engineers, supporting their growth and ensuring high-quality delivery
  • Design, build, and maintain scalable batch and streaming data pipelines
  • Develop and operate high-throughput low-latency data processing systems
  • Implement and support Databricks and Spark for large-scale data workloads
  • Build and maintain cloud-native data solutions on AWS
  • Leverage dbt for transformation data modeling testing and documentation
  • Use Airflow or similar orchestration tools to manage and schedule data workflows
  • Establish and enforce best practices around code quality testing CI/CD monitoring and reliability
  • Collaborate with product analytics and infrastructure teams to deliver impactful data solutions
  • Contribute to technical design decisions and continuously improve system performance and developer productivity

Requirements

  • Bachelor's or Master's degree in Computer Science Engineering or related field
  • 8+ years of experience in data engineering or distributed systems
  • 4+ years of experience managing or mentoring engineers
  • Hands-on experience with AWS Databricks and Spark
  • Experience building and operating both batch and streaming data pipelines
  • Hands-on experience with dbt for transformations and Airflow for orchestration
  • Strong understanding of modern data architectures data modeling data quality and production data systems

Benefits

  • Paid time off
  • Company-paid health and protective benefits for employees and eligible dependents
  • Free virtual coaching sessions through Headspace
  • Great office location in central Mumbai (BKC)

Similar jobs