Data Engineer (Tableau/Big Data)
Responsibilities
- Gather, analyse, and document business and data requirements.
- Enhance data collection and consumption processes through more efficient data integration channels.
- Design, develop, and maintain data pipelines, ETL processes, and reporting solutions to support analytics and business needs.
- Prepare test plans, execute system testing, and support user acceptance testing (UAT).
- Collaborate with technical and business stakeholders to ensure successful deployment and adoption of solutions.
- Monitor, support, and maintain production systems to ensure service reliability and performance.
- Troubleshoot and resolve data, application, and infrastructure-related issues.
Requirements
- 5-7 years of experience with Python, PySpark, Linux, SQL, data modelling, and ETL tools such as Informatica.
- Experience with Hadoop ecosystem technologies such as Hive, Impala, and Cloudera Data Platform (CDP) is advantageous
- Good understanding of data warehousing, analytics platforms, and large-scale data processing.
- Experience delivering projects using Agile and/or Waterfall methodologies
- Familiarity with reporting and visualisation tools such as Tableau and SAP BusinessObjects.
- Experience with data virtualisation platforms such as Denodo and DevOps practices is preferred.
- Strong problem-solving skills with the ability to diagnose issues across infrastructure, data, and application layers.
- Experience designing and supporting highly available, secure, and high-performance systems in on-premises, data centre, or hybrid cloud environments is an advantage.