21 Data Engineering jobs in South Africa
Data Engineering
Posted 7 days ago
Job Viewed
Job Description
Business Segment: Personal & Private Banking
Location: ZA, GP, Johannesburg, Baker Street 30
To design, code, verify, test, document, amend, and secure data pipelines and data stores according to agreed architecture, solution designs, standards, policies, and governance requirements. To monitor and report on own progress and proactively identify issues related to data engineering activities. To collaborate in reviews of work with others where appropriate.
Qualifications- Completed Matric
- 5-7 years' experience understanding of data pipelining and performance optimization, data principles, how data fits in an organization, including customers, products and transactional information. Knowledge of integration patterns, styles, protocols and systems theory.
- 5-7 years' experience in building databases, warehouses, reporting and data integration solutions. Building and optimizing big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- 5-7 years' experience in database programming languages including SQL, PL/SQL, SPARK and or appropriate data tooling. Experience with data pipeline and workflow management tools.
Please note: All our recruitment processes comply with the applicable local laws and regulations. We will never ask for money or any form of payment as part of our recruitment process. If you experience this, please contact our Fraud line on +27 800222050 or
#J-18808-LjbffrData Engineering
Posted today
Job Viewed
Job Description
Business Segment: Personal & Private Banking
Location: ZA, GP, Johannesburg, Baker Street 30
To design, code, verify, test, document, amend, and secure data pipelines and data stores according to agreed architecture, solution designs, standards, policies, and governance requirements. To monitor and report on own progress and proactively identify issues related to data engineering activities. To collaborate in reviews of work with others where appropriate.
Qualifications- Completed Matric
- 5-7 years' experience understanding of data pipelining and performance optimization, data principles, how data fits in an organization, including customers, products and transactional information. Knowledge of integration patterns, styles, protocols and systems theory.
- 5-7 years' experience in building databases, warehouses, reporting and data integration solutions. Building and optimizing big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- 5-7 years' experience in database programming languages including SQL, PL/SQL, SPARK and or appropriate data tooling. Experience with data pipeline and workflow management tools.
Please note: All our recruitment processes comply with the applicable local laws and regulations. We will never ask for money or any form of payment as part of our recruitment process. If you experience this, please contact our Fraud line on +27 800222050 or
#J-18808-LjbffrData Engineering Manager
Posted 4 days ago
Job Viewed
Job Description
Deloitte is a leading global provider of audit and assurance, consulting, financial advisory, risk advisory, tax, and related services.
Our global network of member firms and related entities in more than countries and territories (collectively, the "Deloitte organization") serves four out of five Fortune Global companies.
Learn how Deloitte's approximately , people make an impact that matters. Innovation, transformation, and leadership occur in many ways.
At Deloitte, our ability to help solve clients' most complex issues is distinct.
We deliver strategy and implementation, from a business and technology perspective, to help lead in the markets where our clients compete. Are you a game changer?
Do you believe in adding advantage at every level in everything you do? You may be one of us. Deloitte Consulting is growing, with a focus on developing our already powerful teams across our portfolio of offerings.
We are looking for smart, accountable, innovative professionals with technical expertise and deep industry experience insights.
The combination of our 6 areas of expertise, our well-developed industry structure, and our integrated signature solutions is a unique offering never seen before on the African continent. Be at the forefront of the revolution. AI-enabled technologies are shaking business foundations.
Some find this daunting.
We see opportunity—for clients, societies, and people. Deloitte's AI & Data Specialists partner with clients to leverage AI and reach new levels of organizational excellence.
We turn data into insights, into action—at an industrial scale. Join us as we enable clients to grasp the future and reach new heights.
Learn from the best in the field to create solutions blending data science, data engineering, and process engineering with our industry-leading expertise. Ready to shape the future? Join us to reimagine what's possible with data.
At Deloitte, your engineering leadership will drive outcomes that matter — not just pipelines, but real-world transformation. At Deloitte, we want everyone to feel they can be themselves and to thrive at work—in every country, in everything we do, every day.
We aim to create a workplace where everyone is treated fairly and with respect, including reasonable accommodation for persons with disabilities.
We seek to create and leverage our diverse workforce to build an inclusive environment across the African continent. Join us.
Shape the future.
Job Description: As a Data Engineering Manager, you will lead the design, build, and scale of enterprise-grade data infrastructure and pipelines to power advanced analytics, AI solutions, and AI transformations across Tier-1 clients on the African continent.
You will work at the intersection of business strategy and technical delivery, guiding multidisciplinary teams to enable data-driven decision-making and measurable business impact.
You will be responsible for:
- Architecting scalable, secure, and high-performance data platforms
- Leading the design and development of robust ingestion, transformation, and governance pipelines
- Managing project timelines and deliverables across diverse industry engagements
- Coaching data engineers and analysts to deliver client-ready solutions
- Collaborating with AI / ML specialists, solution managers, and client stakeholders to translate strategic needs into modern data capabilities
Key Responsibilities:
- Lead and own data engineering workstreams across AI transformation, analytics modernization, and digital core rebuilds
- Design and implement data pipelines using modern architectures (e.g., Delta Lake, Data Mesh, Data Lakehouse)
- Drive data modelling, data quality, and metadata management best practices aligned to business KPIs
- Build, manage, and scale cloud-native data infrastructure (e.g., on AWS, GCP, Azure)
- Mentor junior engineers, oversee code reviews, and ensure delivery quality to tier-1 consulting standards
- Translate business and industry requirements into scalable data engineering solutions
- Partner with AI, strategy, and business consulting teams to deliver end-to-end data value realization
Qualifications:
- Bachelor's Degree in Data Science, Engineering, or related field
- Postgraduate Degree in Data Science, Engineering, or related field
- Data-related Cloud Certifications
- 8–12+ years of experience in data engineering, with at least 2 years in a team leadership or technical management role
- Proficient in building modern ETL / ELT pipelines using tools like Apache Spark, DBT, Kafka, Airflow
- Strong programming skills in Python and SQL (Scala / Java a plus)
- Deep experience with cloud data ecosystems (e.g., AWS Redshift / Glue, GCP BigQuery / Dataflow, Azure Synapse)
- Strong understanding of data warehousing, data lakes, streaming, and batch architecture
- Experience with CI / CD for data, testing frameworks, and infrastructure-as-code (Terraform, etc.)
- Familiarity with data governance and security frameworks in regulated industries (e.g., FSI, healthcare)
- Previous experience in a top-tier consulting environment or client-facing data role
- Exposure to AI / ML deployment pipelines, MLOps, or analytics productization
- Experience in delivering data modernization programs at enterprise scale
- Cross-industry knowledge with a focus on FSI, Telco, Consumer, or Healthcare
We aim to create a workplace where everyone can thrive, respecting diversity and inclusion across the African continent. Note: The list of tasks and responsibilities is not exhaustive. Deloitte may ask employees to perform additional duties as needed.
Warning: Beware of recruitment scams. Deloitte will never ask for upfront payments or sensitive personal information early in the recruitment process. Be cautious of unprofessional communication and verify contact details through official channels.
#J-18808-LjbffrManager, Data Engineering
Posted 7 days ago
Job Viewed
Job Description
Business Segment: Insurance & Asset Management
Location: ZA, GP, Roodepoort, Ellis Street 4
To develop and maintain complete data architecture across several application platforms, provide capability across application platforms. To design, build, operationalise, secure and monitor data pipelines and data stores to applicable architecture, solution designs, standards, policies and governance requirements thus making data accessible for the evaluation and optimisation for downstream use case consumption. To execute data engineering duties according to standards, frameworks, and roadmaps.
QualificationsMinimum Qualifications
- Type of Qualification: First Degree
- Field of Study: Business Commerce
- Type of Qualification: First Degree
- Field of Study: Information Studies
- Type of Qualification: First Degree
- Field of Study: Information Technology
Experience Required
- Software Engineering
5-7 years: Experience in building databases, warehouses, reporting and data integration solutions. Experience building and optimising big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - 8-10 years: Deep understanding of data pipelining and performance optimisation, data principles, how data fits in an organisation, including customers, products and transactional information. Knowledge of integration patterns, styles, protocols and systems theory.
- 8-10 years: Experience in database programming languages including SQL, PL/SQL, SPARK and or appropriate data tooling. Experience with data pipeline and workflow management tools.
Please note: All our recruitment processes comply with the applicable local laws and regulations. We will never ask for money or any form of payment as part of our recruitment process. If you experience this, please contact our Fraud line on +27 800222050 or
#J-18808-LjbffrData Engineering Manager
Posted 13 days ago
Job Viewed
Job Description
Deloitte is a leading global provider of audit and assurance, consulting, financial advisory, risk advisory, tax and related services. Our global network of member firms and related entities in more than 150 countries and territories (collectively, the “Deloitte organisation”) serves four out of five Fortune Global 500 companies. Learn how Deloitte’s approximately 457,000 people make an impact that matters at .
Innovation, transformation and leadership occur in many ways. At Deloitte, our ability to help solve clients’ most complex issues is distinct. We deliver strategy and implementation, from a business and technology view, to help lead in the markets where our clients compete.
Are you a game changer? Do you believe in adding advantage at every level in everything you do? You may be one of us.
Deloitte Consulting is growing, with a focus on developing our already powerful teams across our portfolio of offerings. We are looking for smart, accountable, innovative professionals with technical expertise and deep industry experience insights. The combination of our 6 areas of expertise, our well-developed industry structure and our integrated signature solutions is a unique offering never seen before on the African continent.
Be at the forefront of the revolution.
AI-enabled technologies are shaking business foundations. Some find this daunting. We see opportunity—for clients, societies, and people.
Deloitte’s AI & Data Specialists partner with clients to leverage AI and reach new levels of organisational excellence. We turn data into insights, into action—at an industrial scale.
Join us as we enable clients to grasp the future and reach new heights. Learn from the best in the field to create solutions blending data science, data engineering, and process engineering with our industry-leading expertise.
Ready to shape the future?
Join us to reimagine what's possible with data. At Deloitte, your engineering leadership will drive outcomes that matter — not just pipelines, but real-world transformation.
At Deloitte, we want everyone to feel they can be themselves and to thrive at work—in every country, in everything we do, every day.We aim to create a workplace where everyone is treated fairly and with respect, including reasonable accommodation for persons with disabilities. Weseek to create and leverage our diverse workforce to build an inclusive environment across the African continent.
Join us. Shape the future. Win big
Job DescriptionAs a Data Engineering Manager , you will lead the design, build, and scale of enterprise-grade data infrastructure and pipelines to power advanced analytics, AI solutions, and AI transformations across Tier-1 clients on the African continent. You will work at the intersection of business strategy and technical delivery , guiding multidisciplinary teams to enable data-driven decision-making and measurable business impact.
You will be responsible for:
- Architecting scalable, secure, and high-performance data platforms
- Leading the design and development of robust ingestion, transformation, and governance pipelines
- Managing project timelines and deliverables across diverse industry engagements
- Coaching data engineers and analysts to deliver client-ready solutions
- Collaborating with AI/ML specialists, solution managers, and client stakeholders to translate strategic needs into modern data capabilities
Key Responsibilities
- Lead and own data engineering workstreams across AI transformation, analytics modernisation, and digital core rebuilds
- Design and implement data pipelines using modern architectures (e.g., Delta Lake, Data Mesh, Data Lakehouse)
- Drive data modelling, data quality, and metadata management best practices aligned to business KPIs
- Build, manage, and scale cloud-native data infrastructure (e.g., on AWS, GCP, Azure)
- Mentor junior engineers, oversee code reviews, and ensure delivery quality to tier-1 consulting standards
- Translate business and industry requirements into scalable data engineering solutions
- Partner with AI, strategy, and business consulting teams to deliver end-to-end data value realisation
- Bachelor’s Degree in Data Science, Engineering or related Degree
- Post Grad Degree in Data Science Engineering or related Degree,
- Data related Cloud Certifications
- 8–12+ years of experience in data engineering, with at least 2 years in a team leadership or technical management role
- Proficient in building modern ETL/ELT pipelines using tools like Apache Spark, DBT, Kafka, Airflow
- Strong programming skills in Python and SQL (Scala/Java a plus)
- Deep experience with cloud data ecosystems (e.g., AWS Redshift/Glue, GCP BigQuery/Dataflow, Azure Synapse)
- Strong understanding of data warehousing, data lakes, streaming, and batch architecture
- Experience with CI/CD for data , testing frameworks, and infrastructure-as-code (Terraform, etc.)
- Familiarity with data governance and security frameworks in regulated industries (e.g., FSI, healthcare)
- Previous experience in a top-tier consulting environment or client-facing data role
- Exposure to AI/ML deployment pipelines , MLOps, or analytics productisation
- Experience in delivering data modernisation programs at enterprise scale
- Cross-industry knowledge with a focus on FSI, Telco, Consumer, or Healthcare
At Deloitte, we want everyone to feel they can be themselves and to thrive at work—in every country, in everything we do, every day.We aim to create a workplace where everyone is treated fairly and with respect, including reasonable accommodation for persons with disabilities. Weseek to create and leverage our diverse workforce to build an inclusive environment across the African continent.
Note: The list of tasks / duties and responsibilities contained in this document is not necessarily exhaustive. Deloitte may ask the employee to carry out additional duties or responsibilities, which may fall reasonably within the ambit of the role profile, depending on operational requirements.
Be careful of Recruitment Scams: Fraudsters or employment scammers often pose as legitimate recruiters, employers, recruitment consultants or job placement firms, advertising false job opportunities through email, text messages and WhatsApp messages. They aim to cheat jobseekers out of money or to steal personal information.
To help you look out for potential recruitment scams, here are some Red Flags:
- Upfront Payment Requests :Deloitte will never ask for any upfront payment for background checks, job training, or supplies.
- Requests for Personal Information :Be wary if you are asked for sensitive personal information, especially early in the recruitment process and without a clear need for it. Fraudulent links or contractual documents may require the provision of sensitive personal data or copy documents (e.g., government issued numbers or identity documents, passports or passport numbers, bank account statements or numbers, parent’s data) that may be used for identity fraud. Do not provide or send any of these documents or data. Please note we will never ask for photographs at any stage of the recruitment process.
- Unprofessional Communication :Scammers may communicate in an unprofessional manner. Their messages may be filled with poor grammar and spelling errors. The look and feel may not be consistent with the Deloitte corporate brand.
If you're unsure, make direct contact with Deloitte using our official contact details. Be careful not to use any contact details provided in the suspicious job advertisement or email.
#J-18808-LjbffrManager, Data Engineering
Posted today
Job Viewed
Job Description
Business Segment: Insurance & Asset Management
Location: ZA, GP, Roodepoort, Ellis Street 4
To develop and maintain complete data architecture across several application platforms, provide capability across application platforms. To design, build, operationalise, secure and monitor data pipelines and data stores to applicable architecture, solution designs, standards, policies and governance requirements thus making data accessible for the evaluation and optimisation for downstream use case consumption. To execute data engineering duties according to standards, frameworks, and roadmaps.
QualificationsMinimum Qualifications
- Type of Qualification: First Degree
- Field of Study: Business Commerce
- Type of Qualification: First Degree
- Field of Study: Information Studies
- Type of Qualification: First Degree
- Field of Study: Information Technology
Experience Required
- Software Engineering
5-7 years: Experience in building databases, warehouses, reporting and data integration solutions. Experience building and optimising big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - 8-10 years: Deep understanding of data pipelining and performance optimisation, data principles, how data fits in an organisation, including customers, products and transactional information. Knowledge of integration patterns, styles, protocols and systems theory.
- 8-10 years: Experience in database programming languages including SQL, PL/SQL, SPARK and or appropriate data tooling. Experience with data pipeline and workflow management tools.
Please note: All our recruitment processes comply with the applicable local laws and regulations. We will never ask for money or any form of payment as part of our recruitment process. If you experience this, please contact our Fraud line on +27 800222050 or
#J-18808-LjbffrGroup Data Engineering Lead
Posted 10 days ago
Job Viewed
Job Description
Direct message the job poster from AECI Limited
Purpose of the job
- The Group Lead Data Engineer is responsible for architecting, building, and maintaining scalable data pipelines, platforms, and infrastructure that support AECI's enterprise data and analytics strategy.
- This role ensures high-quality data ingestion, transformation, and delivery across various business domains while enforcing engineering best practices.
- The role is pivotal to the successful delivery of AI, analytics, and data democratization initiatives across global operations and requires close collaboration with data scientists, analysts, and technology teams.
- Design and implement robust and scalable data pipelines using Azure-native tools (ADF, Databricks, Synapse).
- Ensure automated and resilient workflows that process structured and unstructured data.
- Translate data needs into modern architectural blueprints.
- Enforce data modelling, engineering, and documentation standards.
- Contribute to AECI's enterprise data architecture in collaboration with enterprise architects.
- Integrate data from diverse sources (SAP, IoT, third-party APIs).
- Enable real-time and batch data streaming using Azure Event Hubs, Kafka, and Databricks.
- Implement CI/CD pipelines for data code. Use infrastructure-as-code for reproducible environments.
- Monitor pipeline health, data freshness, and failures.
- Enforce data security policies, access controls, encryption, and audit trails. Work with Data Governance teams to ensure adherence to policies and regulatory requirements.
- Lead the design and implementation of D&A portfolio frameworks and methodologies across local and global operations,
- Establish and enforce architecture standards, guidelines, and best practices across the development of enterprise D&A.
- Manage and track the number of architecture deviations identified in the D&A lifecycle and to identify and address any deviations, ensuring consistency and maintainability
- Measure the level of documentation completeness and comprehensiveness of the D&A portfolio documentation, ensuring that all stakeholders have access to the necessary information
- Lead the development and foster a culture of innovation and continuous improvement within the team.
- Promote a culture that supports high performance through performance management and employee engagement
- Mentoring, coaching and developing of the Data Engineering team
- Lead and develop the team, ensuring effective communication, training, and development opportunities
- Create a dynamic environment that promotes and rewards high performance
- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Engineering and Information Technology
- Industries Chemical Manufacturing
Referrals increase your chances of interviewing at AECI Limited by 2x
Get notified about new Engineering Group Lead jobs in Woodmead, Gauteng, South Africa .
Chief Information Officer: Business and Commercial BankingJohannesburg, Gauteng, South Africa 1 week ago
Johannesburg, Gauteng, South Africa 6 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrBe The First To Know
About the latest Data engineering Jobs in South Africa !
Senior Manager: Data Engineering | Gauteng
Posted 7 days ago
Job Viewed
Job Description
Join this listed FSP as a Senior Manager: Data Engineering. You will be responsible for leading this company’s enterprise data strategy and data platform. Lead the data engineering function responsible for unlocking value from the company’s data assets. Set data strategy, research, and implementation of new data tools and processes to drive ROI. Be a data thought leader for the company.
Responsibilities: Data and Analytics Strategy:
- Create and execute a long-term strategy for leveraging data and analytics as a key business enabler and competitive differentiator across the business. Research tools to plan, implement, and build all business and technical aspects of different data and analytics systems and platforms.
- Take responsibility for developing and delivering a key element of the organisation’s data management system.
- Translate data and analytics strategy and vision into data architecture, defining and implementing models, rules, and standards for design and governance.
- Lead a collaborative digital product/service design process by gathering input across all product/service portfolios to define a design system that is viable and scalable, and which strengthens the brand. Lead a cross-portfolio, multidisciplinary team that contributes to the evolution of the system.
- Lead the review of existing operations and the implementation of innovation processes across the division or function to ensure the required continuous improvement outcomes are delivered.
- Communicate the function’s strategy and its relationship to the organisation’s mission, vision, and values; clarify the actions needed to implement it within the area of responsibility; motivate people to commit to these and to doing extraordinary things to achieve the organisation’s business goals.
- Manage and report on the performance of the function/business area; set appropriate performance objectives for direct reports and hold them accountable for achieving these; take appropriate corrective action where necessary to ensure the achievement of annual business objectives.
- Manage a portfolio of major projects in line with overall project management strategy.
- Identify and manage stakeholders up to top management level, finding out their needs/issues/concerns and reacting to these by leading and coordinating the development of stakeholder engagement plans to support the communication of business information and decisions.
- Makes sense of complex, high quantity, and sometimes contradictory information to effectively solve problems. Ensures the organization has reliable ways to gather needed information.
- Anticipates and adopts innovations in business-building digital and technology applications. Stays apprised of technology trends and of how they can make a substantial difference.
- Creates new and better ways for the organization to be successful. Fosters a climate that supports and rewards creativity and innovation; removes obstacles to creativity.
- Holds self and others accountable to meet commitments. Emphasizes accountability, measures organizational performance against goals, and addresses poor team performance.
- Consistently achieves results, even under tough circumstances. Eliminates barriers to organizational performance.
- Develops and delivers multi-mode communications that convey a clear understanding of the unique needs of different audiences.
- Builds strong-identity teams that apply their diverse skills and perspectives to achieve common goals.
- Builds partnerships and works collaboratively with others to meet shared objectives.
- Makes good and timely decisions that keep the organization moving forward.
- Adapts approach and demeanor in real time to match the shifting demands of different situations.
- Rebounds from setbacks and adversity when facing difficult situations.
- Operates as a recognized expert to manage projects and monitor applications using enterprise systems and tools.
- Acts as the organisation’s authority and established expert on understanding and using tools in the domain of data engineering.
- Python, Pyspark, Spark, Databricks, SQL, SAS
- Applies expertise to act as the organisational authority on implementing, configuring, and optimizing IT systems and services.
- Acts as the organisational authority and established expert on acquiring, organizing, protecting, and processing data to fulfill business objectives.
- Uses comprehensive knowledge and skills to work independently while providing guidance and training to others on developing, monitoring, interpreting, and understanding policies and procedures.
- Works at an advanced level to extract patterns from large amounts of data.
- Grade 12/SAQA Accredited Equivalent (Essential)
- 3-year degree in Information Technology/Sciences/Informatics/Applied Mathematics/Statistics/Data Mining (Essential)
- Master’s Degree in Information Technology/Sciences/Informatics/Applied Mathematics/Statistics/Data Mining (Advantageous)
- 5 or more years’ experience of leading teams (Essential)
Senior Manager: Data Engineering | Gauteng
Posted today
Job Viewed
Job Description
Join this listed FSP as a Senior Manager: Data Engineering. You will be responsible for leading this company’s enterprise data strategy and data platform. Lead the data engineering function responsible for unlocking value from the company’s data assets. Set data strategy, research, and implementation of new data tools and processes to drive ROI. Be a data thought leader for the company.
Responsibilities: Data and Analytics Strategy:
- Create and execute a long-term strategy for leveraging data and analytics as a key business enabler and competitive differentiator across the business. Research tools to plan, implement, and build all business and technical aspects of different data and analytics systems and platforms.
- Take responsibility for developing and delivering a key element of the organisation’s data management system.
- Translate data and analytics strategy and vision into data architecture, defining and implementing models, rules, and standards for design and governance.
- Lead a collaborative digital product/service design process by gathering input across all product/service portfolios to define a design system that is viable and scalable, and which strengthens the brand. Lead a cross-portfolio, multidisciplinary team that contributes to the evolution of the system.
- Lead the review of existing operations and the implementation of innovation processes across the division or function to ensure the required continuous improvement outcomes are delivered.
- Communicate the function’s strategy and its relationship to the organisation’s mission, vision, and values; clarify the actions needed to implement it within the area of responsibility; motivate people to commit to these and to doing extraordinary things to achieve the organisation’s business goals.
- Manage and report on the performance of the function/business area; set appropriate performance objectives for direct reports and hold them accountable for achieving these; take appropriate corrective action where necessary to ensure the achievement of annual business objectives.
- Manage a portfolio of major projects in line with overall project management strategy.
- Identify and manage stakeholders up to top management level, finding out their needs/issues/concerns and reacting to these by leading and coordinating the development of stakeholder engagement plans to support the communication of business information and decisions.
- Makes sense of complex, high quantity, and sometimes contradictory information to effectively solve problems. Ensures the organization has reliable ways to gather needed information.
- Anticipates and adopts innovations in business-building digital and technology applications. Stays apprised of technology trends and of how they can make a substantial difference.
- Creates new and better ways for the organization to be successful. Fosters a climate that supports and rewards creativity and innovation; removes obstacles to creativity.
- Holds self and others accountable to meet commitments. Emphasizes accountability, measures organizational performance against goals, and addresses poor team performance.
- Consistently achieves results, even under tough circumstances. Eliminates barriers to organizational performance.
- Develops and delivers multi-mode communications that convey a clear understanding of the unique needs of different audiences.
- Builds strong-identity teams that apply their diverse skills and perspectives to achieve common goals.
- Builds partnerships and works collaboratively with others to meet shared objectives.
- Makes good and timely decisions that keep the organization moving forward.
- Adapts approach and demeanor in real time to match the shifting demands of different situations.
- Rebounds from setbacks and adversity when facing difficult situations.
- Operates as a recognized expert to manage projects and monitor applications using enterprise systems and tools.
- Acts as the organisation’s authority and established expert on understanding and using tools in the domain of data engineering.
- Python, Pyspark, Spark, Databricks, SQL, SAS
- Applies expertise to act as the organisational authority on implementing, configuring, and optimizing IT systems and services.
- Acts as the organisational authority and established expert on acquiring, organizing, protecting, and processing data to fulfill business objectives.
- Uses comprehensive knowledge and skills to work independently while providing guidance and training to others on developing, monitoring, interpreting, and understanding policies and procedures.
- Works at an advanced level to extract patterns from large amounts of data.
- Grade 12/SAQA Accredited Equivalent (Essential)
- 3-year degree in Information Technology/Sciences/Informatics/Applied Mathematics/Statistics/Data Mining (Essential)
- Master’s Degree in Information Technology/Sciences/Informatics/Applied Mathematics/Statistics/Data Mining (Advantageous)
- 5 or more years’ experience of leading teams (Essential)
Big Data Specialist
Posted 10 days ago
Job Viewed
Job Description
- Data integration, harmonisation and reporting
- Design and implement efficient data pipelines using Abinitio and Denodo
- Leverage SAP Connecters to seamlessly integrate SAP data
- Data consolidation and harmonisation
- Performance optimisation
- Data Modelling and architecture
- Governance frameworks for data flows
- Collaboration and documentation
- Work closely with data engineers, data scientist and business stakeholders
- Bachelors degree in Finance, Information Systems, Data Management, or related field.
- 3 years of experience in Big Data Technologies, Including Abinitio and Denodo
- Proficience in SAP Connectors and hand-on experience integrating SAP data
- Strong understanding of data modelling, ETL processes and data warehousing concept
- Familarity with cloud based big data platforms (e.g. Azure, GCP) is advantageous
- Deep understanding of SAP on premise, S4Hana, BW4Hana, Denodo
Please note that if you do not hear from us within 3 weeks, consider your application unsuccessful.