Data Engineer

Job Title: Junior Data Engineer

Experience: 2–4 Years
Location: Remote / Hybrid
Notice Period: Immediate Joiner

Job Summary

We are looking for a motivated Junior Data Engineer with 2–4 years of experience to join our growing data engineering team. The ideal candidate should have hands-on experience in building and maintaining data pipelines, working with cloud-based data platforms, and developing scalable ETL/ELT solutions. You will collaborate with senior data engineers, data analysts, and business stakeholders to deliver reliable and efficient data solutions.

Key Responsibilities

  • Develop, maintain, and optimize ETL/ELT pipelines for data integration and processing.
  • Build data processing applications using Python and PySpark.
  • Ingest data from multiple sources, including APIs, databases, flat files, and streaming platforms.
  • Write efficient, optimized, and scalable SQL queries for data transformation and reporting.
  • Monitor, troubleshoot, and enhance the performance of existing data pipelines.
  • Perform data quality validation and support data governance initiatives, including data lineage.
  • Work with Azure Data Factory, Azure Data Lake, and Azure Databricks to develop cloud-native data solutions.
  • Participate in Agile ceremonies, sprint planning, code reviews, and continuous improvement activities.
  • Collaborate with cross-functional teams to understand business requirements and deliver data solutions.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • 2–4 years of hands-on experience in Data Engineering.
  • Experience working with cloud platforms, preferably Microsoft Azure.
  • Strong understanding of data integration, transformation, and pipeline development.
  • Excellent SQL and analytical problem-solving skills.
  • Good communication and collaboration skills.
  • Ability to work independently as well as in a team-oriented Agile environment.

Preferred Skills

  • Exposure to streaming data processing frameworks.
  • Understanding of data warehousing concepts.
  • Knowledge of data governance and data quality practices.
  • Familiarity with DevOps practices and deployment automation.



Requirements


Required Technical Skills

  • Strong programming skills in Python
  • Proficiency in SQL for querying and data transformation
  • Hands-on experience with PySpark
  • Experience with Azure Data Factory (ADF)
  • Knowledge of Azure Data Lake
  • Basic working knowledge of Azure Databricks
  • Experience with Git version control
  • Basic understanding of Apache Kafka
  • Basic knowledge of CI/CD pipelines
  • Good understanding of ETL/ELT architecture and best practices