126 Etl Processes jobs in South Africa

We are seeking an experienced Data Engineering Manager to lead a team of data engineers in designing, building, and optimising robust data pipelines and platforms. The successful candidate will play a critical role in enabling the organisation to become a truly data-driven organisation by ensuring that data is accessible, governed, and trusted across all business units. This role will report to the Head of Data Engineering .

• Lead, mentor, and grow a team of skilled data engineers.

• Drive the design, implementation, and maintenance of scalable data pipelines and data platform solutions.

• Ensure data quality, availability, lineage, and governance across all data assets.

• Collaborate with analytics, AI/ML, and business teams to deliver fit-for-purpose data solutions.

• Oversee technical architecture, cloud-based data infrastructure, and integration frameworks.

• Establish and enforce best practices for data engineering, DevOps, and CI/CD.

• Ensure compliance with security, privacy, and data governance policies.

• Foster a culture of innovation, automation, and continuous improvement within the team.

• Partner with senior leadership to shape and deliver the data engineering roadmap.

• Bachelors or Masters degree in Computer Science, Engineering, Information Systems, or a related field.

• 8+ years experience in data engineering or software engineering roles, with at least 3+ years in a leadership/management capacity.

• Proven track record of delivering enterprise-scale data engineering solutions in production.

• Strong experience with cloud platforms (AWS, Azure, or GCP) and modern data architectures (data lakes, lakehouses, data mesh).

• Proficiency in SQL, Python, and data pipeline frameworks (Spark, Kafka, dbt, Airflow, etc.).

• Solid understanding of data modelling, ETL/ELT, APIs, and integration patterns.

• Experience with data governance, metadata management, and compliance frameworks.

• Experience working in retail, e-commerce, or consumer-focused industries is advantageous.

We are seeking a skilled and motivated
Specialist: Data Engineering
to join our dynamic Financial Services team.

The ideal candidate will play a key role in implementing the company's Data Strategy by driving data awareness, engagement, and monetization while ensuring operational excellence across platforms.

This role involves building and optimizing data pipelines, managing data architectures on both on-premises and cloud environments, ensuring data quality and compliance, and supporting Payments & Ecommerce teams with reliable data solutions.

The position is ideal for a technically strong data engineer with a solid understanding of data frameworks, who is eager to grow in a fast-paced and innovation-driven environment.

Key Responsibilities

Strategy Development & Implementation

• Implement the Data Strategy to drive customer awareness, engagement, experience, and monetization.
• Provide input into data monetization aspects of the Business Plan and cascade to OpCos.
• Drive product revenue growth, operational excellence, and customer satisfaction.

Operational Delivery – Data Platforms

• Support in developing frameworks and technical architectures for Financial Services innovation.
• Assist the Payments & Ecommerce team in achieving annual goals.
• Implement and manage data architectures across multiple platforms (web, mobile, social).
• Ensure continuous alignment of data platforms with Financial Services strategy and evolving business requirements.
• Oversee delivery of data platform services and ensure integration efficiency and quality.

Data Engineering

• Design, build, and maintain ETL/ELT pipelines from multiple data sources.
• Set up and manage centralized data storage systems and warehouses (e.g., Fabric, PrestoDB, Oracle).
• Utilize cloud technologies such as
  Microsoft Azure
  for scalable deployments.
• Implement workflow management tools (Apache Airflow, Prefect, or Dagster).
• Ensure data accuracy, automation, and observability in data flows.
• Optimize pipelines and analytics for performance, scalability, and reliability.

Governance & Reporting

• Participate in strategic and operational meetings, providing technical guidance.
• Support enterprise-wide transformation initiatives related to data management.
• Ensure adequate risk mitigation and compliance with regional data regulations.
• Prepare regular progress and performance reports for management.

Qualifications and Experience

• Bachelor's degree in
  Computer Science, Big Data, Database Administration
  , or a related field.
• Minimum
  3 years' experience
  in
  Advanced Data Engineering
  .
• Proven experience in
  Big Data On-premises and Cloud Data Pipeline (M. Fabric)
  deployment.
• Proficiency in
  SQL, Python, R, and Power BI
  .
• Experience with
  Oracle, Teradata, or Snowflake
  , and cloud platforms such as
  AWS, Azure, or GCP
  .
• Strong stakeholder management and communication skills.
• Experience in
  Telecommunications or Financial Services
  is an advantage.
• Willingness and flexibility to travel within Africa.

Skills and Competencies

• Data pipeline and API development expertise.
• Knowledge of Machine Learning Operations pipeline deployment.
• Strong analytical and problem-solving abilities.
• Agile and digital-first mindset.
• High attention to detail and commitment to quality.
• Excellent relationship-building and presentation skills.

Behavioural Qualities

Analytical and Detail-Oriented | Business-Focused | Self-Driven | Results-Oriented | Collaborative | Emotionally Intelligent

Job Overview

Business Segment: Insurance & Asset Management

Location: ZA, GP, Roodepoort, 4 Ellis Street

Job Type: Full-time

Job Ref ID: A-0001

Date Posted: 10/6/2025

Job Description

To develop and maintain complete data architecture across several application platforms, provide capability across application platforms. To design, build, operationalise, secure and monitor data pipelines and data stores to applicable architecture, solution designs, standards, policies and governance requirements thus making data accessible for the evaluation and optimisation for downstream use case consumption. To execute data engineering duties according to standards, frameworks, and roadmaps

Qualifications

Type of Qualification: First Degree

Field of Study: Business Commerce

Type of Qualification: First Degree

Field of Study: Information Studies

Type of Qualification: First Degree

Field of Study: Information Technology

Experience Required

Software Engineering

Technology

5-7 years

Experience in building databases, warehouses, reporting and data integration solutions. Experience building and optimising big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

8-10 years

Deep understanding of data pipelining and performance optimisation, data principles, how data fits in an organisation, including customers, products and transactional information. Knowledge of integration patterns, styles, protocols and systems theory

8-10 years

Experience in database programming languages including SQL, PL/SQL, SPARK and or appropriate data tooling. Experience with data pipeline and workflow management tools

Additional Information

Behavioural Competencies:

Adopting Practical Approaches

Articulating Information

Checking Things

Developing Expertise

Documenting Facts

Embracing Change

Examining Information

Interpreting Data

Managing Tasks

Producing Output

Taking Action

Team Working

Technical Competencies:

Big Data Frameworks and Tools

Data Engineering

Data Integrity

Data Quality

IT Knowledge

Stakeholder Management (IT)

Please note: All our recruitment processes comply with the applicable local laws and regulations. We will never ask for money or any from of payment as part of our recruitment process. If you experience this, please contact our Fraud line on or