136 Big Data Technologies jobs in South Africa

Overview

Deloitte is a leading global provider of audit and assurance, consulting, financial advisory, risk advisory, tax and related services. Our global network of member firms and related entities in more than 150 countries and territories (collectively, the “Deloitte organisation”) serves four out of five Fortune Global 500 companies. Learn how Deloitte’s approximately 457,000 people make an impact that matters at

Deloitte Consulting — Our Culture

Innovation, transformation and leadership occur in many ways. At Deloitte, our ability to help solve clients’ most complex issues is distinct. We deliver strategy and implementation, from a business and technology view, to help lead in the markets where our clients compete.

Are you a game changer? Do you believe in adding advantage at every level in everything you do? You may be one of us.

Deloitte Consulting is growing, with a focus on developing our already powerful teams across our portfolio of offerings. We are looking for smart, accountable, innovative professionals with technical expertise and deep industry experience insights. The combination of our 6 areas of expertise, our well-developed industry structure and our integrated signature solutions is a unique offering never seen before on the African continent.

Deloitte Consulting - AI & Data

Be at the forefront of the revolution.

AI-enabled technologies are shaking business foundations. Some find this daunting. We see opportunity—for clients, societies, and people.

Deloitte’s AI & Data Specialists partner with clients to leverage AI and reach new levels of organisational excellence. We turn data into insights, into action—at an industrial scale.

Join us as we enable clients to grasp the future and reach new heights. Learn from the best in the field to create solutions blending data science, data engineering, and process engineering with our industry-leading expertise.

Ready to shape the future?

Join us to reimagine what's possible with data. At Deloitte, your engineering leadership will drive outcomes that matter — not just pipelines, but real-world transformation.

At Deloitte, we want everyone to feel they can be themselves and to thrive at work—in every country, in everything we do, every day. We aim to create a workplace where everyone is treated fairly and with respect, including reasonable accommodation for persons with disabilities. We seek to create and leverage our diverse workforce to build an inclusive environment across the African continent.

Join us. Shape the future. Win big

Job Description

As a Data Engineering Manager , you will lead the design, build, and scale of enterprise-grade data infrastructure and pipelines to power advanced analytics, AI solutions, and AI transformations across Tier-1 clients on the African continent. You will work at the intersection of business strategy and technical delivery , guiding multidisciplinary teams to enable data-driven decision-making and measurable business impact.

You will be responsible for:

• Architecting scalable, secure, and high-performance data platforms
• Leading the design and development of robust ingestion, transformation, and governance pipelines
• Managing project timelines and deliverables across diverse industry engagements
• Coaching data engineers and analysts to deliver client-ready solutions
• Collaborating with AI/ML specialists, solution managers, and client stakeholders to translate strategic needs into modern data capabilities

Key Responsibilities

• Lead and own data engineering workstreams across AI transformation, analytics modernisation, and digital core rebuilds
• Design and implement data pipelines using modern architectures (e.g., Delta Lake, Data Mesh, Data Lakehouse)
• Drive data modelling, data quality, and metadata management best practices aligned to business KPIs
• Build, manage, and scale cloud-native data infrastructure (e.g., on AWS, GCP, Azure)
• Mentor junior engineers, oversee code reviews, and ensure delivery quality to tier-1 consulting standards
• Translate business and industry requirements into scalable data engineering solutions
• Partner with AI, strategy, and business consulting teams to deliver end-to-end data value realisation

Qualifications

• Bachelor’s Degree in Data Science, Engineering or related Degree
• Post Grad Degree in Data Science Engineering or related Degree
• Data related Cloud Certifications

Additional Information

• 8–12+ years of experience in data engineering, with at least 2 years in a team leadership or technical management role
• Proficient in building modern ETL/ELT pipelines using tools like Apache Spark, DBT, Kafka, Airflow
• Strong programming skills in Python and SQL (Scala/Java a plus)
• Deep experience with cloud data ecosystems (e.g., AWS Redshift/Glue, GCP BigQuery/Dataflow, Azure Synapse)
• Strong understanding of data warehousing, data lakes, streaming, and batch architecture
• Experience with CI/CD for data , testing frameworks, and infrastructure-as-code (Terraform, etc.)
• Familiarity with data governance and security frameworks in regulated industries (e.g., FSI, healthcare)
• Previous experience in a top-tier consulting environment or client-facing data role
• Exposure to AI/ML deployment pipelines , MLOps, or analytics productisation
• Experience in delivering data modernisation programs at enterprise scale
• Cross-industry knowledge with a focus on FSI, Telco, Consumer, or Healthcare

At Deloitte, we want everyone to feel they can be themselves and to thrive at work—in every country, in everything we do, every day. We aim to create a workplace where everyone is treated fairly and with respect, including reasonable accommodation for persons with disabilities. We seek to create and leverage our diverse workforce to build an inclusive environment across the African continent.

Note: The list of tasks / duties and responsibilities contained in this document is not necessarily exhaustive. Deloitte may ask the employee to carry out additional duties or responsibilities, which may fall reasonably within the ambit of the role profile, depending on operational requirements.

Be careful of Recruitment Scams: Fraudsters or employment scammers often pose as legitimate recruiters, employers, recruitment consultants or job placement firms, advertising false job opportunities through email, text messages and WhatsApp messages. They aim to cheat jobseekers out of money or to steal personal information.

To help you look out for potential recruitment scams, here are some Red Flags:

• Upfront Payment Requests : Deloitte will never ask for any upfront payment for background checks, job training, or supplies.
• Requests for Personal Information : Be wary if you are asked for sensitive personal information, especially early in the recruitment process and without a clear need for it. Fraudulent links or contractual documents may require the provision of sensitive personal data or copy documents (e.g., government issued numbers or identity documents, passports or passport numbers, bank account statements or numbers, parent’s data) that may be used for identity fraud. Do not provide or send any of these documents or data. Please note we will never ask for photographs at any stage of the recruitment process.
• Unprofessional Communication : Scammers may communicate in an unprofessional manner. Their messages may be filled with poor grammar and spelling errors. The look and feel may not be consistent with the Deloitte corporate brand.

If you're unsure, make direct contact with Deloitte using our official contact details. Be careful not to use any contact details provided in the suspicious job advertisement or email.

We are seeking an experienced Data Engineering Manager to lead a team of data engineers in designing, building, and optimising robust data pipelines and platforms. The successful candidate will play a critical role in enabling the organisation to become a truly data-driven organisation by ensuring that data is accessible, governed, and trusted across all business units. This role will report to the Head of Data Engineering .

• Lead, mentor, and grow a team of skilled data engineers.

• Drive the design, implementation, and maintenance of scalable data pipelines and data platform solutions.

• Ensure data quality, availability, lineage, and governance across all data assets.

• Collaborate with analytics, AI/ML, and business teams to deliver fit-for-purpose data solutions.

• Oversee technical architecture, cloud-based data infrastructure, and integration frameworks.

• Establish and enforce best practices for data engineering, DevOps, and CI/CD.

• Ensure compliance with security, privacy, and data governance policies.

• Foster a culture of innovation, automation, and continuous improvement within the team.

• Partner with senior leadership to shape and deliver the data engineering roadmap.

• Bachelors or Masters degree in Computer Science, Engineering, Information Systems, or a related field.

• 8+ years experience in data engineering or software engineering roles, with at least 3+ years in a leadership/management capacity.

• Proven track record of delivering enterprise-scale data engineering solutions in production.

• Strong experience with cloud platforms (AWS, Azure, or GCP) and modern data architectures (data lakes, lakehouses, data mesh).

• Proficiency in SQL, Python, and data pipeline frameworks (Spark, Kafka, dbt, Airflow, etc.).

• Solid understanding of data modelling, ETL/ELT, APIs, and integration patterns.

• Experience with data governance, metadata management, and compliance frameworks.

• Experience working in retail, e-commerce, or consumer-focused industries is advantageous.

Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

The Director, Data Engineering is a leadership role accountable for operationally managing a Data Engineering Team.

The Data Engineering Practice lead will lead the design, development of the enterprise data platform and pipelines.

This role is further responsible for overseeing SAP data migrations, ensuring seamless integration and transformation of legacy systems into modern cloud-based architectures.

The person will drive innovation, scalability, and governance in data engineering practices while managing a high-performing team.

Key Responsibilities:

• Manages a team of Managers and Data Engineers to ensure achievement of team objectives/KPIs and through continuous coaching and mentoring helps the team to understand and apply data to solve business solutions.
• Develop the new Data Platform - Execute the data engineering strategy per the selected platform.
• SAP Data Migration - Lead end-to-endSAP data migrationprojects, including planning, mapping, transformation, and validation.
• Engineering Team Leadership - Build and manage a team of data engineers and technical leads. Foster a culture of innovation, collaboration, and continuous improvement.
• Data Pipeline Development - Oversee development of robust ETL/ELT pipelines usingAzure Data Factory,Databricks,Snowflake Streams/Tasks, andSAP tools. Ensure pipelines are optimized for performance, reliability, and cost-efficiency.
• Data Management - partner with data management practice lead and governance lead to ensure adherence to data quality, lineage, and security standards. Implement monitoring and alerting for data pipeline health and SLA compliance.
• Stakeholder Engagement - Collaborate with business units and the internal analytics teams and IT to align data engineering efforts with strategic goals. Translate business requirements into scalable technical solutions.
• Ensure industry standards best practices are applied to development activities and continuously ensures the team remains abreast of latest technology and tools in the area of data engineering.
• Works across multiple areas on data set to ensure solutions are successfully executed, within agreed upon time frames.

Knowledge and Attributes:

• Excellent ability to thrive in a dynamic, fast-paced environment.
• Strong quantitative and qualitative analysis skills.
• Strong desire to acquire more knowledge to keep up to speed with the ever-evolving field of data science.
• Strong curiosity to sift through data to find answers and more insights.
• Excellent understanding of the information technology industry within a matrixed organization and the typical business problems such organizations face.
• Excellent ability to translate technical findings clearly and fluently to non-technical team business stakeholders to enable informed decision-making.
• Excellent ability to create a storyline around the data to make it easy to interpret and understand.
• Self-driven and able to work independently yet acts as a team player.
• Excellent ability to apply data science principles through a business lens.
• Strong desire to create strategies and solutions that challenge and expand the thinking of peers and senior leadership teams.
• Excellent ability to think strategically about how to use data to drive competitive advantages.
• Excellent management and leadership skills.

Academic Qualifications and Certifications:

• Bachelor’s degree or equivalent in Data Science, Business Analytics, Mathematics, Economics, Engineering, Computer Science or a related field.
• Relevant programming certification preferred.
• Agile certification preferred.

Required experience:

• Significant demonstrable experience with one or more programming languages, statistical packages and database languages.
• Significant demonstrable experience with data warehouse and data lake technical architectures, infrastructure components, ETL/ ELT, and reporting/analytic tools.
• Significant demonstrable experience applying statistical methods to solve business problems.
• Significant demonstrated experience with distributed data platform tools such as MS Azure, SAP Snowflake, Spark, MySQL, etc.
• Significant demonstrated experience in working in micro-services architecture working with APIs development.
• Significant demonstrable experience of full-stack software development with prolific coding abilities.
• Significant demonstrated experience with Agile Development Methodologies and Test-Driven Development.
• Solid line manager experience leading and managing a team of Data Engineering Teams

Workplace type:

About NTT DATA
NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Join to apply for the Data Engineering Practice Lead role at NTT DATA, Inc.

Make an impact with NTT DATA. Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

The Director, Data Engineering is a leadership role accountable for operationally managing a Data Engineering Team. The Data Engineering Practice Lead will lead the design and development of the enterprise data platform and pipelines. This role is responsible for overseeing SAP data migrations, ensuring seamless integration and transformation of legacy systems into modern cloud-based architectures. The person will drive innovation, scalability, and governance in data engineering practices while managing a high-performing team.

• Manages a team of Managers and Data Engineers to ensure achievement of team objectives/KPIs and through continuous coaching and mentoring helps the team to understand and apply data to solve business solutions.
• Develop the new Data Platform - Execute the data engineering strategy per the selected platform.
• SAP Data Migration - Lead end-to-end SAP data migration projects, including planning, mapping, transformation, and validation.
• Engineering Team Leadership - Build and manage a team of data engineers and technical leads. Foster a culture of innovation, collaboration, and continuous improvement.
• Data Pipeline Development - Oversee development of robust ETL/ELT pipelines using Azure Data Factory, Databricks, Snowflake Streams/Tasks, and SAP tools. Ensure pipelines are optimized for performance, reliability, and cost-efficiency.
• Data Management - partner with data management practice lead and governance lead to ensure adherence to data quality, lineage, and security standards. Implement monitoring and alerting for data pipeline health and SLA compliance.
• Stakeholder Engagement - Collaborate with business units and internal analytics teams and IT to align data engineering efforts with strategic goals. Translate business requirements into scalable technical solutions.
• Ensure industry standards best practices are applied to development activities and continuously ensures the team remains abreast of latest technology and tools in the area of data engineering.
• Works across multiple areas on data set to ensure solutions are successfully executed, within agreed upon time frames.

• Excellent ability to thrive in a dynamic, fast-paced environment.
• Strong quantitative and qualitative analysis skills.
• Strong desire to acquire more knowledge to keep up to speed with the ever-evolving field of data science.
• Strong curiosity to sift through data to find answers and more insights.
• Excellent understanding of the information technology industry within a matrixed organization and the typical business problems such organizations face.
• Excellent ability to translate technical findings clearly and fluently to non-technical stakeholders to enable informed decision-making.
• Excellent ability to create a storyline around the data to make it easy to interpret and understand.
• Self-driven and able to work independently yet acts as a team player.
• Excellent ability to apply data science principles through a business lens.
• Strong desire to create strategies and solutions that challenge and expand the thinking of peers and senior leadership teams.
• Excellent ability to think strategically about how to use data to drive competitive advantages.
• Excellent management and leadership skills.

• Bachelor’s degree or equivalent in Data Science, Business Analytics, Mathematics, Economics, Engineering, Computer Science or a related field.
• Relevant programming certification preferred.
• Agile certification preferred.

• Significant demonstrable experience with one or more programming languages, statistical packages and database languages.
• Significant demonstrable experience with data warehouse and data lake technical architectures, infrastructure components, ETL/ELT, and reporting/analytic tools.
• Significant demonstrable experience applying statistical methods to solve business problems.
• Significant demonstrated experience with distributed data platform tools such as MS Azure, SAP Snowflake, Spark, MySQL, etc.
• Significant demonstrated experience in working in micro-services architecture working with APIs development.
• Significant demonstrable experience of full-stack software development with prolific coding abilities.
• Significant demonstrated experience with Agile Development Methodologies and Test-Driven Development.
• Solid line manager experience leading and managing a team of Data Engineering Teams

Hybrid Working

NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

Equal Opportunity Employer

NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

• Director

• Full-time

• Information Technology

• IT Services and IT Consulting

Overview

Join to apply for the Data Engineering Practice Lead role at NTT DATA, Inc.

Make an impact with NTT DATA. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

The Director, Data Engineering is a leadership role accountable for operationally managing a Data Engineering Team. The Data Engineering Practice Lead will lead the design and development of the enterprise data platform and pipelines. This role is responsible for overseeing SAP data migrations, ensuring seamless integration and transformation of legacy systems into modern cloud-based architectures. The person will drive innovation, scalability, and governance in data engineering practices while managing a high-performing team.

• Manages a team of Managers and Data Engineers to ensure achievement of team objectives/KPIs and through continuous coaching and mentoring helps the team to understand and apply data to solve business solutions.
• Develop the new Data Platform - Execute the data engineering strategy per the selected platform.
• SAP Data Migration - Lead end-to-end SAP data migration projects, including planning, mapping, transformation, and validation.
• Engineering Team Leadership - Build and manage a team of data engineers and technical leads. Foster a culture of innovation, collaboration, and continuous improvement.
• Data Pipeline Development - Oversee development of robust ETL/ELT pipelines using Azure Data Factory, Databricks, Snowflake Streams/Tasks, and SAP tools. Ensure pipelines are optimized for performance, reliability, and cost-efficiency.
• Data Management - partner with data management practice lead and governance lead to ensure adherence to data quality, lineage, and security standards. Implement monitoring and alerting for data pipeline health and SLA compliance.
• Stakeholder Engagement - Collaborate with business units and internal analytics teams and IT to align data engineering efforts with strategic goals. Translate business requirements into scalable technical solutions.
• Ensure industry standards best practices are applied to development activities and continuously ensures the team remains abreast of latest technology and tools in the area of data engineering.
• Works across multiple areas on data set to ensure solutions are successfully executed, within agreed upon time frames.

• Excellent ability to thrive in a dynamic, fast-paced environment.
• Strong quantitative and qualitative analysis skills.
• Strong desire to acquire more knowledge to keep up to speed with the ever-evolving field of data science.
• Strong curiosity to sift through data to find answers and more insights.
• Excellent understanding of the information technology industry within a matrixed organization and the typical business problems such organizations face.
• Excellent ability to translate technical findings clearly and fluently to non-technical team business stakeholders to enable informed decision-making.
• Excellent ability to create a storyline around the data to make it easy to interpret and understand.
• Self-driven and able to work independently yet acts as a team player.
• Excellent ability to apply data science principles through a business lens.
• Strong desire to create strategies and solutions that challenge and expand the thinking of peers and senior leadership teams.
• Excellent ability to think strategically about how to use data to drive competitive advantages.
• Excellent management and leadership skills.

• Bachelor’s degree or equivalent in Data Science, Business Analytics, Mathematics, Economics, Engineering, Computer Science or a related field.
• Relevant programming certification preferred.
• Agile certification preferred.

• Significant demonstrable experience with one or more programming languages, statistical packages and database languages.
• Significant demonstrable experience with data warehouse and data lake technical architectures, infrastructure components, ETL/ ELT, and reporting/analytic tools.
• Significant demonstrable experience applying statistical methods to solve business problems.
• Significant demonstrated experience with distributed data platform tools such as MS Azure, SAP Snowflake, Spark, MySQL, etc.
• Significant demonstrated experience in working in micro-services architecture working with APIs development.
• Significant demonstrable experience of full-stack software development with prolific coding abilities.
• Significant demonstrated experience with Agile Development Methodologies and Test-Driven Development.
• Solid line manager experience leading and managing a team of Data Engineering Teams

Hybrid Working

NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Strategic Leadership:

• Define and drive the strategic vision and roadmap for the Data Engineering pillar, aligned to the company's broader business goals.
• Identify emerging technologies, methodologies, and practices that can deliver value to our customers and keep the business at the forefront of the industry.
• Provide architectural oversight and direction for client and internal projects.

• Engage with clients during the early discovery and solution design phases to understand business goals and shape optimal data architectures and most suitable technologies (currently, Qlik Data Integration (QDI), Qlik Talend, and Microsoft technologies).
• Design, develop, implement and showcase demo pipelines in our current technology stack that demonstrate the power and relevance of our platform capabilities.
• Collaborate with other pillars (Sales and Customer) to support marketing, sales, pre-sales, including scoping, solution design, and estimation.

• Lead, mentor and grow the data engineering team, developing both technical and consulting capabilities.
• Drive internal enablement programs to ensure continuous upskilling across all teams on our core platforms: Qlik Data Integration (QDI), Qlik Talend, and Microsoft technologies.
• Champion a culture of learning, experimentation, and collaboration.

• Define and implement best practices and frameworks for data integration, pipeline orchestration, and data architecture.
• Establish and maintain robust project delivery methodologies that ensure repeatable, scalable, and high-quality implementations.
• Work with the other pillar heads to ensure projects are resourced effectively and delivered on time and budget.

• Serve as the thought leader for our key platforms - Qlik Data Integration, Qlik Talend, and Microsoft Azure / Data Factory / Fabric. This may involve interviews, speaking engagements and other marketing activities both internal and external.

• Promote innovative uses of technology to solve customer problems in creative, commercially viable ways.
  Ensure the alignment of short, medium, and long-term technology choices with customer goals and budget realities.

• 8+ years of experience in data engineering or data integration, with at least 3 years in a leadership role.
• Proven experience designing and leading complex data architectures and pipelines across a range of industries.
• Deep understanding of modern data platforms including:
  • Qlik Data Integration (Qlik Replicate, Compose, Enterprise Manager)
  • Qlik Talend (Data Integration, Data Quality, ESB)
  • Microsoft (Azure Synapse, Data Factory, SQL, Power Platform, Fabric)
• Experience in pre-sales, solutioning, and commercial scoping of data projects.
• Familiarity and experience with data governance, data quality, and metadata management best practices.

Skills & Competencies:

• Strong business acumen and the ability to translate between business needs and technical solutions.

• Excellent communication and stakeholder engagement skills with both technical and non-technical audiences.

• Strategic thinker with a hands-on, solutions-oriented approach.

• Collaborative leadership style and ability to work cross-functionally.

• Entrepreneurial mindset with the ability to innovate within constraints.