FreeHire

lbg

Senior Data Engineer

Show

End Date

Sunday 28 June 2026

We Support Flexible Working – Click here for more information on flexible working options

Flexible Working Options

Hybrid Working

Job Description Summary

Senior Data Engineer with 8–12 years of experience, strong in GCP ecosystem with expertise in Python, PySpark, BigQuery, Kafka, Terraform, DBT, Kubernetes, SQL, CI/CD and ETL pipelines.
Experienced in building scalable, high‑performance data pipelines and streaming solutions on GCP, ensuring data quality, optimisation, and reliable delivery across cross‑functional teams

Job Description

  • Position: Senior Data Engineer

    Location: Hyderabad

    Years of experience: 8 – 12 years

    We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform.

    Must have:

    Python, PySpark, Big Query, GCP & Kafka, Terraform, DBT, Kubernetes, SQL, Big query, Ci/Cd, ETL Pipelines

    Key Responsibilities:

  • Build and maintain data pipelines on GCP (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage).
  • Develop scalable data processing solutions using Python and SQL.
  • Work with batch and streaming data ingestion frameworks.
  • Implement data quality checks, performance tuning, and optimisation.
  • Collaborate with cross‑functional teams to deliver high‑quality data products.
  • Ensure best practices in security, reliability, cost management, and documentation.

  • Required Skills

  • Strong hands‑on experience in GCP services: BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, Composer/Airflow.
  • Excellent Python programming skills (PySpark is a plus).
  • Strong SQL and experience with data modelling.
  • Experience with CI/CD, Git, and basic DevOps workflows.
  • Good understanding of data warehousing concepts.
  • Ability to work independently and mentor junior engineers.

  • Good to Have

  • Experience with Kubernetes/Docker.
  • Exposure to Terraform or other IaC tools.
  • Experience with Kafka or other messaging tools.
  • GCP Professional Data Engineer certification.

  • Education

  • Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.