Lumiq.AI-AWS DE Tech Lead
Job Title: AWS Data Engineering Tech Lead
Experience: 5–7 Years
Location: Noida (Work from Office )
Company-Lumiq.AI - https://lumiq.ai/
Job Summary
We are looking for an experienced AWS Data Engineering Tech Lead to design, build, and lead scalable data solutions on the AWS cloud. The ideal candidate will have strong hands-on expertise in AWS, PySpark, Spark, SQL, ETL, Python, and Hadoop, along with leadership experience in guiding data engineering teams and delivering high-quality data pipelines.
Key Responsibilities
-
Lead the design and development of scalable data pipelines and ETL processes on AWS
-
Architect and implement big data solutions using PySpark, Spark, and Hadoop
-
Develop and optimize data processing workflows using Python and SQL
-
Work closely with stakeholders to understand data requirements and translate them into technical solutions
-
Ensure data quality, reliability, performance, and security across data platforms
-
Mentor and guide junior data engineers, conduct code reviews, and enforce best practices
-
Optimize existing ETL jobs for performance and cost efficiency
-
Collaborate with DevOps, analytics, and business teams for end-to-end data solutions
Required Skills
-
Strong experience with AWS services (e.g., S3, EMR, Glue, Redshift, Athena, Lambda – as applicable)
-
Hands-on expertise in PySpark and Apache Spark
-
Strong proficiency in SQL and performance tuning
-
Solid experience in ETL design and development
-
Advanced knowledge of Python for data engineering
-
Experience working with Hadoop ecosystem
-
Understanding of data warehousing and big data architecture
Desired Skills (Good to Have)
-
Experience with orchestration tools (Airflow, Step Functions, etc.)
-
Knowledge of CI/CD pipelines for data engineering
-
Exposure to real-time data processing (Kafka, Kinesis, etc.)
-
Experience working in Agile/Scrum environments
Qualifications
-
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
-
5–7 years of experience in data engineering, with at least 1–2 years in a technical lead role
Location
📍 Noida