Azure Data Engineering Advanced: Senior Lead Data Engineer
Job requirements
Role - Data Engineer / Sr. Data Engineer:
Location – Bangalore
World's Edge Studios is looking for a Data Engineer to join the Data Science team. As a member of the team, you will get to live on the front edge of modern technology by building on things like Azure Synapse Analytics and Azure Data Explorer while building ETLs and process in pyspark and Data Factory.
You will help build state of the art pipelines and data models that are at the heart of the studio decision-making process. You will be working on large-scale lakehouse and warehouse analytics systems that process data feeds in real-time and batch processes.
Your customers will be the business, design, test and development teams and they will look to you to help shape how we capture data to improve our test-driven methodologies and build a culture around data driven development.
The successful candidate will bring an attention to detail along with modern engineering practices and help us build and support a high quality, modern data architecture at scale.
Qualifications:
• 7+ years’ experience designing and implementing scalable ETL processes including data movement (Azure data factory) and quality tools.
• 7+ years’ experience with modern Big Data Analytics using Data Lake, Spark and formats like Parquet.
• 7+ years’ experience building cloud hosted data systems. Azure highly preferred.
• Strong experience in architecture, design and implementation of data solutions in Azure and/or other cloud platforms • Building data pipelines in Azure Data Factory/Synapse Analytics/Spark. • Worked with data in delta lake format and from Azure Data Explorer/Kusto
• 7+ years’ Hands on experience on SQL performance and tuning
• 3+ years’ experience in PowerBI reports with extensive hands on Data Model and DAX.
• Excellent presentation, written and verbal communication skills required.
• Good team player with interpersonal skills
• Knowledge in setting up datalake solutions
• Ability to write and design technical business process documentation
• Excellent relationship building and organizational skills Preferred:
• Working with Azure Devops for CICD. • Played Age of Empires Games.
