Data Engineering- Azure Databricks- Manager

Industry/Sector

Not Applicable

Specialism

Product Innovation

Management Level

Manager

Job Description & Summary

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Job Title:

• Manager – Data Engineering (Azure & Databricks)
• At PwC AC, as a Manager in Data Engineering, you will play a pivotal role in leading the design, architecture, and end-to-end implementation of enterprise-grade cloud data solutions. You will lead cross-functional teams to deliver scalable Azure-based data ecosystems, bridging the gap between business strategy and technical execution. Beyond hands-on technical guidance, you will be responsible for defining architectural roadmaps, ensuring delivery excellence, managing stakeholder expectations, and driving innovation within our cloud data practice.
• This role requires a blend of deep technical expertise in the Azure Databricks stack and strong leadership capabilities to manage complex, multi-stream data migration and engineering programs.

Years of Experience

8–13 years

Position Requirements:

Must Have:

Technical Leadership:

Extensive experience leading teams in the design and delivery of Azure-based data platforms utilizing ADLS, Databricks, Data Factory, and Synapse.

Architectural Expertise:

Demonstrated ability to design robust, scalable, and secure data architectures. You should be capable of defining technical standards and best practices for data modeling and data management.

Cloud Proficiency:

Advanced understanding of Big Data frameworks; deep hands-on and architectural experience with Spark and Hadoop ecosystems.

Data Lifecycle Ownership:

Comprehensive knowledge of the Data Warehousing (DW) lifecycle. Proven experience in leading the creation of high-level and detail-level design documents, and defining strategy for Unit/Integration/UAT plans.

Delivery Management:

Strong track record of owning end-to-end delivery of data migration projects, including scope management, risk mitigation, and resource planning.

Technical Proficiency:

Mastery of advanced SQL, complex data transformations, and performance tuning. Proficiency in Python and Unix/Shell scripting for automation.

DevOps & CI/CD:

Strategic understanding of DevOps implementation (Git, Jenkins, GitLab, Azure DevOps) to automate pipelines and ensure high-quality code delivery.

Stakeholder & Team Management:

Excellent communication skills with the ability to advise senior client stakeholders, manage onsite/offshore teams, and mentor junior associates/engineers.

Operational Excellence:

Experience in setting up operational frameworks, defining KPIs for data quality, and leading the transition to production (Operations Hand-off).

Good to Have:

Certifications:

Azure Data Engineer (DP-203) or Databricks Certified Data Engineer Professional.

Advanced Analytics:

Knowledge of Big Data ML toolkits (SparkML, H2O) and experience building real-time stream-processing systems.

Serverless Architectures:

Practical experience with Azure Functions and event-driven data architectures.

Strategic Consulting:

Experience in pre-sales support, RFP responses, or presenting technical roadmaps to C-level or Director-level business stakeholders.

Professional and Educational Background:

BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MB

The Opportunity

• When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.
• As part of the Data Engineering team you lead the design, architecture, and implementation of enterprise-grade cloud data solutions. As a Manager, you motivate and inspire teams to deliver exceptional results while managing complex data migration programs and driving innovation within our cloud data practice. This role offers the chance to bridge business strategy with technical execution, making a significant impact on our clients and the firm.

Responsibilities

• Oversee and guide data engineering projects from inception to completion
• Collaborate with cross-functional teams to deliver innovative data solutions
• Mentor and develop junior engineers to enhance their skills and performance
• Analyze complex data systems to identify areas for improvement
• Manage project timelines and deliverables to meet client expectations
• Foster a culture of continuous learning and knowledge sharing
• Uphold quality standards and compliance with industry regulations
• Leverage technology to drive efficiency and effectiveness in data processes

What You Must Have

• Bachelor's Degree
• 8 years of experience
• Oral and written proficiency in English required

What Sets You Apart

• Bachelor's Degree in Engineering, Computer Science, or related field preferred
• Azure Data Engineer or Databricks Certified Data Engineer Professional preferred
• Leading teams in Azure-based data platform design
• Designing scalable and secure data architectures
• Managing end-to-end data migration projects
• Mastering advanced SQL and data transformations
• Understanding DevOps implementation for automation
• Advising senior client stakeholders effectively
• Knowledge of Big Data ML toolkits and real-time systems

Travel Requirements

Not Specified

Job Posting End Date