Data Engineer

Show

Data Engineering & Architecture<\/span><\/span><\/b><\/span><\/span>
<\/p>

Design, develop, and maintain <\/span><\/span><\/span><\/span>scalable, high\-performance data pipelines<\/span><\/span><\/b><\/span><\/span>
<\/p><\/li>
Work extensively with <\/span><\/span><\/span><\/span>Azure Data Factory<\/span><\/span><\/b><\/span><\/span> and <\/span><\/span><\/span><\/span>Microsoft Fabric<\/span><\/span><\/b><\/span><\/span>
<\/p><\/li>
Build robust <\/span><\/span><\/span><\/span>ETL/ELT frameworks<\/span><\/span><\/b><\/span><\/span> using <\/span><\/span><\/span><\/span>Python<\/span><\/span><\/b><\/span><\/span>
<\/p><\/li>
Design and optimize <\/span><\/span><\/span><\/span>Lakehouse / Data Warehouse architectures<\/span><\/span><\/b><\/span><\/span>
<\/p><\/li>
Handle <\/span><\/span><\/span><\/span>large\-scale datasets<\/span><\/span><\/b><\/span><\/span> efficiently (high volume and throughput)<\/span><\/span><\/span><\/span>
<\/p><\/li>
Write and optimize complex <\/span><\/span><\/span><\/span>SQL queries<\/span><\/span><\/b><\/span><\/span> for performance and reliability<\/span><\/span><\/span><\/span>
<\/p><\/li>
Integrate data from multiple sources including APIs, transactional systems, and external platforms<\/span><\/span><\/span><\/span>
<\/p><\/li><\/ul>
Leadership & Delivery (Hands\-on)<\/span><\/span><\/b><\/span><\/span>
<\/p>
- Lead and mentor a team of data engineers while remaining actively involved in <\/span><\/span><\/span><\/span>coding and solution design<\/span><\/span><\/b><\/span><\/span>
  <\/p><\/li>
- Perform <\/span><\/span><\/span><\/span>hands\-on development<\/span><\/span><\/b><\/span><\/span> for critical pipelines, complex transformations, and performance optimisation.<\/span><\/span><\/span><\/span>
  <\/p><\/li>
- Conduct code reviews and enforce <\/span><\/span><\/span><\/span>best practices, design patterns, and coding standards<\/span><\/span><\/b><\/span><\/span>
  <\/p><\/li>
- Act as the technical owner for data engineering deliverables<\/span><\/span><\/span><\/span>
  <\/p><\/li><\/ul>
  Quality, Performance & Reliability<\/span><\/span><\/b><\/span><\/span>
  <\/p>
  - Implement <\/span><\/span><\/span><\/span>data quality checks, validations, and monitoring<\/span><\/span><\/b><\/span><\/span>
    <\/p><\/li>
  - Optimize pipelines for <\/span><\/span><\/span><\/span>performance, scalability, and cost<\/span><\/span><\/b><\/span><\/span>
    <\/p><\/li>
  - Ensure reliability, fault tolerance, and error handling in production systems<\/span><\/span><\/span><\/span>
    <\/p><\/li>
  - Follow <\/span><\/span><\/span><\/span>data security, access control, and compliance<\/span><\/span><\/b><\/span><\/span> best practices<\/span><\/span><\/span><\/span>
    <\/p><\/li>
  - Lead troubleshooting, root\-cause analysis, and production issue resolution<\/span><\/span><\/span><\/span>
    <\/p><\/li><\/ul>
    Collaboration & Continuous Improvement<\/span><\/span><\/b><\/span><\/span>
    <\/p>
    - Work closely with BI, analytics, product, and business teams<\/span><\/span><\/span><\/span>
      <\/p><\/li>
    - Translate business requirements into scalable technical solutions<\/span><\/span><\/span><\/span>
      <\/p><\/li>
    - Stay up to date with <\/span><\/span><\/span><\/span>modern data engineering tools, technologies, and techniques<\/span><\/span><\/b><\/span><\/span>
      <\/p><\/li>
    - Proactively suggest architectural and process improvement<\/span><\/span><\/span><\/span>
      <\/p><\/li><\/ul>
      <\/div><\/span>
      Requirements<\/h3>
      3\-6 years<\/span><\/span><\/b> of experience in the Data Engineering field.<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Strong hands\-on experience in <\/span><\/span>Python for data engineering, including building and maintaining production\-grade, large\-scale data pipelines<\/span><\/span><\/b><\/span><\/span>
      <\/p><\/li>
      Advanced experience with Azure Data Factory and Azure\-based data platforms for orchestration, integration, and scalable data processing<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Working experience with <\/span><\/span>Microsoft Fabric, <\/span><\/span><\/b>including Lakehouse and data engineering workloads, along with a strong understanding of <\/span><\/span>ETL/ELT and data warehousing concepts<\/span><\/span><\/b><\/span><\/span>
      <\/p><\/li>
      Expert\-level SQL skills<\/span><\/span><\/b> covering complex query development, optimization, indexing, and partitioning for high\-performance systems<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Proven experience handling large\-volume, high\-throughput data and distributed processing environment.<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Experience with analytics and visualization platforms such as Power BI<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Knowledge of Delta Lake, Spark, and distributed data processing frameworks<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Experience implementing CI/CD practices for data pipelines and data engineering workflows<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Exposure to data governance, lineage, metadata management, and compliance\-driven environments such as fintech or high\-transaction systems<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Hands\-on leadership mindset with strong ownership and accountability for outcomes<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Ability to mentor, guide, and grow junior engineers while leading by example<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Clear and effective communication with technical and non\-technical stakeholders<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Strong problem\-solving, analytical reasoning, and decision\-making skills<\/span><\/span><\/span><\/span>
      <\/p><\/li><\/ul>
      
      <\/div><\/span>
      Benefits<\/h3>
      Working hours: <\/span><\/span>10:00 AM \u2013 7:00 PM<\/span><\/span><\/b><\/span><\/span>
      <\/p><\/li>
      Working days: <\/span><\/span>5 days a week<\/span><\/span><\/b> (plus 1st & 3rd Saturdays working)<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Medical Insurance<\/span><\/span><\/b> coverage for employees<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Provident Fund (PF)<\/span><\/span><\/b> facility<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Quarterly parties and yearly outings/trips<\/span><\/span><\/b> for team bonding<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Regular check\-ins<\/span><\/span><\/b> with leadership for growth and feedback<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Recognition awards<\/span><\/span><\/b> to celebrate high performance<\/span><\/span><\/span><\/span>
      <\/p><\/li>
      Fun activities<\/span><\/span><\/b> and team engagement sessions throughout the year<\/span><\/span><\/span><\/span>
      <\/p><\/li><\/ul>
      
      <\/div><\/span>