448 Big Data jobs in South Africa
Big Data Specialist
Posted 10 days ago
Job Viewed
Job Description
- Data integration, harmonisation and reporting
- Design and implement efficient data pipelines using Abinitio and Denodo
- Leverage SAP Connecters to seamlessly integrate SAP data
- Data consolidation and harmonisation
- Performance optimisation
- Data Modelling and architecture
- Governance frameworks for data flows
- Collaboration and documentation
- Work closely with data engineers, data scientist and business stakeholders
- Bachelors degree in Finance, Information Systems, Data Management, or related field.
- 3 years of experience in Big Data Technologies, Including Abinitio and Denodo
- Proficience in SAP Connectors and hand-on experience integrating SAP data
- Strong understanding of data modelling, ETL processes and data warehousing concept
- Familarity with cloud based big data platforms (e.g. Azure, GCP) is advantageous
- Deep understanding of SAP on premise, S4Hana, BW4Hana, Denodo
Please note that if you do not hear from us within 3 weeks, consider your application unsuccessful.
Data Engineer
Posted today
Job Viewed
Job Description
Looking for an exceptional Data Engineer to join elite teams? Are you a data visionary with a passion for transforming complex data into valuable insights?
Do you thrive in environments where your expertise can shape data architecture, scalable pipelines, and cutting-edge solutions that drive innovation?
If you are a top-tier Data Engineer who enjoys working with data, I want to hear from you!
Why You Should Join My Network- Clients Work on High-Impact Projects: Build the data infrastructure that powers critical decisions, supports business transformation, and influences high-stakes outcomes. Your work will shape the future of how data is used to solve real-world problems.
- Innovative Tech Stack: Leverage the latest technologies in AWS, Azure, Google Cloud, Apache Kafka, Spark, Python, SQL, and NoSQL databases. You'll have the chance to explore and implement cutting-edge tools and methodologies, ensuring you stay ahead of the curve.
- Collaborative Excellence: Work alongside a team of industry-leading Engineers, Data Scientists, and business experts who push the boundaries of what's possible with data.
- Professional Growth: Take your career to the next level. We are committed to your development, providing mentorship, learning opportunities, and room for growth into senior roles or even leadership positions.
- Completed BSc in IT, Mathematics, or a related field.
- At least 3 years of experience as a Data Engineer, designing and building robust, scalable data pipelines.
- Proficient in Python, SQL, ETL processes, and data wrangling techniques.
- Cloud Mastery: Experience with major cloud platforms such as AWS, Azure, or Google Cloud. Familiar with services like S3, Redshift, BigQuery, EMR, and Dataflow.
- Big Data Knowledge: Hands-on experience with distributed data systems like Apache Kafka, Spark, Hadoop, or Flink.
- Comfortable managing large datasets and streamlining data workflows.
- Database Expertise: Knowledge of relational databases (PostgreSQL, MySQL) and NoSQL databases (Cassandra, MongoDB). Understanding of database optimization and management.
- Data Architecture Visionary: Experience designing end-to-end data architectures ensuring scalability, reliability, and efficiency, with seamless integration of multiple data sources.
Apply now to join my database! For more IT jobs, please visit (website). If you do not receive a response within two weeks, please consider your application unsuccessful. For more information, contact: Recruitment Consultant.
Key Skills: Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala
Employment Type: Full-Time
Experience: 3+ years
Vacancy: 1
Create a job alert for this search.
#J-18808-LjbffrData Engineer
Posted today
Job Viewed
Job Description
Time left to apply: End Date : May 31, (4 days left to apply)
Job Requisition ID: R
Job DescriptionProvide support within set processes and procedures to ensure effective movement, collection, integration, storage, and provisioning of data to build solutions and meet business objectives. Collaborate with relevant stakeholders to understand business requirements.
Contribute to cost efficiencies by responsible utilization of resources. Establish relationships with relevant individuals and departments to meet work expectations. Adhere to service level agreements to build trust.
Produce high-quality work by following standards, procedures, and compliance requirements. Maintain operational efficiencies through improved processes. Deliver accurate work to ensure consistent results.
Identify and develop solutions to improve service delivery and quality. Adhere to quality standards, turnaround times, and company policies. Complete administration, reporting, and update information accurately and timely.
Research emerging technologies and recommend implementations to improve cost-effectiveness and system flexibility. Confer with end users, clients, or senior management to understand requirements for complex development or enhancements.
Assist with gap analysis, business cases, and cost/effort analysis. Conduct profiling, documentation, and validation of client requirements. Execute remediation actions, install or update system components, and implement automation frameworks.
Build unit and system tests, manage UAT and signoff, create change scripts, and participate in solution design. Utilize data platform components and tools for service delivery. Design technical architecture and work with senior leadership on technology solutions.
Learn from Subject Matter Experts, support data operations and analytics teams, and develop best practice guidelines. Contribute to team projects, assess and improve personal performance, and promote teamwork and inclusivity.
Job DetailsApplications will not be accepted after the stated deadlines: May 27, May 28, and May 31. All appointments will align with FirstRand Group's Employment Equity plan. The bank supports the recruitment and advancement of individuals with disabilities, who may disclose their information voluntarily. Confidentiality is maintained unless legally required.
For queries, log via MyQ.
About UsFNB serves retail and commercial customers with banking, insurance, savings, investments, and digital solutions. Recognized with awards such as the Strongest Banking Brand in the World, FNB offers diverse opportunities to build a rewarding career and make a meaningful impact.
#J-18808-LjbffrData Engineer
Posted 1 day ago
Job Viewed
Job Description
Imagine being a data and programming guru and understanding the intricacies of banking and insurance. At Monocle, we believe work is more than a job. It is a chance to make a difference in the world of finance. An opportunity to fulfil your potential. To make friendships with ambitious, positive, likeminded people. To gain invaluable industry experience and learn critical skills that will make you a highly sought-after management consultant. Monocle strives to provide our clients with a cradle-tograve implementation approach. This means that we not only propose fit-for-purpose solutions, but we also execute the development and implementation of the technical infrastructure required to realise the full benefit of these solutions.
Monocle is a people-centric, independent consulting firm, specialising in banking and insurance. We understand that our greatest asset is our people and because of this, we do things a bit differently.
Monocle embraces an ongoing and active approach to amplifying the talents of our people, empowering them to unlock their full potential and feel fulfilled in their careers. Our vibrant culture thrives through our shared growth mindset, collaboration, support, and social connection, fostering a space where everyone can flourish. We are committed to continuous learning and provide ongoing technical training, industry certification support, and personal development opportunities through mentorship and executive engagement. Ultimately, we strive to create an environment that nurtures ambition, supports well-being, embraces diversity, upholds integrity, and inspires individuals to make a positive and lasting impact on the world around us.
Monocle Offers:- Unparalleled growth and exposure – Monocle is uniquely positioned in the market to undertake projects across a wide spectrum of critical and exciting areas of the financial services industry. Our managers deliver mission critical projects at the most prestigious banks and insurers in Johannesburg, Cape Town, London and Amsterdam.
- Unlimited training and development – Investment in our people’s development is at the heart of Monocle’s company ethos. That is why we prioritise the upskilling of every employee.
- Unique and vibrant company culture – At Monocle, we believe friends work better together than colleagues. We love nothing more than partaking in a wide variety of activities through our company sponsored clubs.
- Ultra-competitive compensation – At Monocle, we want the best talent to join our team, so we understand that those individuals need to be recognised and rewarded for their true value.
Design and implement scalable data pipelines using Cloud services such as Glue, Redshift, S3, Lambda, EMR, Athena, Microsoft Fabric & Databricks.
Develop and maintain ETLprocesses to transform and integrate data from various sources.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune performance of data pipelines and queries.
Ensure data quality and integrity through robust testing and validation processes.
Implement data security and compliance best practices.
Monitor and troubleshoot data pipeline issues and ensure timely resolution.
Stay updated with the latest developments in Data Engineering technologies and best practices.
The successful candidate must have comprehensive experience in the above, and must also meet the following requirements:Holds a Bachelor’s degree from an accredited university.
Industry experience: A minimum of two years of hands-on experience is required. Prior experience in the financial services industry would be beneficial but not mandatory.
Strong foundation in data engineering: We value hands-on experience and proven skills in building and managing data solutions using on-premises technologies or Cloud. While a Bachelor's degree in Computer Science, Engineering, or a related field is a plus, your ability to demonstrate expertise matters most.
Experience with core Cloud Data Services: Familiarity with Glue, Redshift, S3, Lambda, EMR, Athena, Microsoft Fabric or Databricks.
Experience with Big Data technologies: Knowledge of big data technologies such as Apache Spark, Hadoop, or Kafka.
Scripting & Programming proficiency: Programming skills in Python, Pandas & SQL
Database Management: Experience working with relational databases like AWS RDS, MS SQL, Azure SQL DB or Postgres.
Solid Data Engineering background: Knowledge and experience of data modelling, ETL processes, and data warehousing.
Infrastructure as code (IaC) proficiency: Experience with tools like AWS CloudFormation, Terraform or Azure ARM/Bicep for automating infrastructure provisioning and deployments is crucial.
DevOps fluency: We seek a candidate with experience in CI/CD tools to streamline software development and delivery.
Communication and collaboration: Excellent communication, problem-solving, and analytical skills are key. The ability to present complex technical concepts in a clear and concise way.
Cloud Certification (a plus): While not mandatory, possessing a relevant Cloud certification demonstrates your commitment to professional development and validates your understanding of Cloud services and best practices.
The Ideal Monocle Data Engineer:Strong problem-solving and analytical skills.
Excellent communication and collaboration skills.
Attention to detail and a commitment to data accuracy.
Be eager to learn new approaches and technologies.
Works well under pressure to meet client objectives.
Is sociable and enjoys interacting with others, both at work and at social events.
Works well independently and in a team.
Recruitment Process:During the interview process, you will meet with both People and Culture representatives and Monocle Executives. A critical aspect of the interview process will be determining whether Monocle will be a good fit for you and your career aspirations, so please come prepared with any questions you may have.
If you have a passion for working with people, a relevant qualification, and think you have what it takes to join a team of your smartest and most driven peers, apply to Monocle today!
A 45-Minute, 60-questions, online competency assessment test.
P&C Meet and GreetA personal meeting with People & Culture to get to know you and tell you more about Monocle.
Executive interviewTo discuss your skills, business knowledge, experience, project fit and the role requirements.
C-level InterviewA discussion with either our CEO, COO or CFO on various topics.
A final offer is made by the P&C team to the candidate.
Take your career to the next level at a dynamic and innovative management consulting firm.*Please note that on clicking 'Apply Now' you will be redirected to our third-party career portal.
#J-18808-LjbffrData Engineer
Posted 4 days ago
Job Viewed
Job Description
? Join Our Dynamic Data Engineering Team! ?
Are you ready to take your data engineering career to the next level? We are on the lookout for talented individuals to join our innovative team and work on cutting-edge projects that make a real impact.
? Virtual Recruitment Drive: 24th & 25th July Complete assessments, interviews, and find out the outcome of your application on the same day!
Why Join Us?
Exciting Projects: Work on complex data engineering projects within a niche domain involving patents and intellectual property.
High-Profile Clients: Collaborate with industry giants like Google, Apple, and Tesla.
Innovative Environment: Contribute to the development of a unified data platform that serves as the single source of truth for our business.
Career Growth: Benefit from a mix of experience levels within the team, fostering growth and mentorship.
Collaborative Culture: Be part of a team that values inclusivity and diverse backgrounds.
Work in a Way That Works for You: We promote a healthy work/life balance across the organisation . With numerous wellbeing initiatives, shared parental leave, study assistance , and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. Enjoy working flexible hours, flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Open Positions:
Principal Engineer: Lead technical projects and mentor junior team members. Significant experience with PySpark is essential.
Senior Data Engineer: Tackle complex data engineering tasks with strong skills in SQL, Python, and cloud technologies (preferably AWS).
Intermediate Data Engineer: Support senior engineers with at least 3 years of experience in SQL, Python, and cloud technologies.
Junior Data Engineer: Assist in various data engineering tasks with foundational knowledge in SQL and Python.
What We Offer: We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
Medical Aid
Retirement Plan inclusive of Risk Benefits (Disability, Critical Illness, Life Cover & Funeral Cover)
Modern Family Benefits, including adoption and surrogacy
Study Leave
Ready to Make an Impact? Submit your application today. Should you meet the requirements one of our recruiters will reach out to explain the process and learn more about your experience.
Apply Now and Be Part of Our Journey!
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1- .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
#J-18808-LjbffrData Engineer
Posted 4 days ago
Job Viewed
Job Description
? Join Our Dynamic Data Engineering Team! ?
Are you ready to take your data engineering career to the next level? We are on the lookout for talented individuals to join our innovative team and work on cutting-edge projects that make a real impact.
? Virtual Recruitment Drive: 24th & 25th July Complete assessments, interviews, and find out the outcome of your application on the same day!
Why Join Us?
Exciting Projects: Work on complex data engineering projects within a niche domain involving patents and intellectual property.
High-Profile Clients: Collaborate with industry giants like Google, Apple, and Tesla.
Innovative Environment: Contribute to the development of a unified data platform that serves as the single source of truth for our business.
Career Growth: Benefit from a mix of experience levels within the team, fostering growth and mentorship.
Collaborative Culture: Be part of a team that values inclusivity and diverse backgrounds.
Work in a Way That Works for You: We promote a healthy work/life balance across the organisation . With numerous wellbeing initiatives, shared parental leave, study assistance , and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. Enjoy working flexible hours, flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Open Positions:
Principal Engineer: Lead technical projects and mentor junior team members. Significant experience with PySpark is essential.
Senior Data Engineer: Tackle complex data engineering tasks with strong skills in SQL, Python, and cloud technologies (preferably AWS).
Intermediate Data Engineer: Support senior engineers with at least 3 years of experience in SQL, Python, and cloud technologies.
Junior Data Engineer: Assist in various data engineering tasks with foundational knowledge in SQL and Python.
What We Offer: We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
Medical Aid
Retirement Plan inclusive of Risk Benefits (Disability, Critical Illness, Life Cover & Funeral Cover)
Modern Family Benefits, including adoption and surrogacy
Study Leave
Ready to Make an Impact? Submit your application today. Should you meet the requirements one of our recruiters will reach out to explain the process and learn more about your experience.
Apply Now and Be Part of Our Journey!
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1- .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
#J-18808-LjbffrData Engineer
Posted 4 days ago
Job Viewed
Job Description
Join Our Dynamic Data Engineering Team!
Are you ready to take your data engineering career to the next level? We are on the lookout for talented individuals to join our innovative team and work on cutting-edge projects that make a real impact.
Virtual Recruitment Drive: 24th & 25th July Complete assessments, interviews, and find out the outcome of your application on the same day!
Why Join Us?
- Exciting Projects: Work on complex data engineering projects within a niche domain involving patents and intellectual property.
- High-Profile Clients: Collaborate with industry giants like Google, Apple, and Tesla.
- Innovative Environment: Contribute to the development of a unified data platform that serves as the single source of truth for our business.
- Career Growth: Benefit from a mix of experience levels within the team, fostering growth and mentorship.
- Collaborative Culture: Be part of a team that values inclusivity and diverse backgrounds.
- Work in a Way That Works for You: We promote a healthy work/life balance across the organisation. With numerous wellbeing initiatives, shared parental leave, study assistance, and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. Enjoy working flexible hours, flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Open Positions:
- Principal Engineer: Lead technical projects and mentor junior team members. Significant experience with PySpark is essential.
- Senior Data Engineer: Tackle complex data engineering tasks with strong skills in SQL, Python, and cloud technologies (preferably AWS).
- Intermediate Data Engineer: Support senior engineers with at least 3 years of experience in SQL, Python, and cloud technologies.
- Junior Data Engineer: Assist in various data engineering tasks with foundational knowledge in SQL and Python.
What We Offer: We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
- Medical Aid
- Retirement Plan inclusive of Risk Benefits (Disability, Critical Illness, Life Cover & Funeral Cover)
- Modern Family Benefits, including adoption and surrogacy
- Study Leave
Ready to Make an Impact? Submit your application today. Should you meet the requirements one of our recruiters will reach out to explain the process and learn more about your experience.
Apply Now and Be Part of Our Journey!
#J-18808-LjbffrBe The First To Know
About the latest Big data Jobs in South Africa !
Data Engineer
Posted 4 days ago
Job Viewed
Job Description
? Join Our Dynamic Data Engineering Team! ?
Are you ready to take your data engineering career to the next level? We are on the lookout for talented individuals to join our innovative team and work on cutting-edge projects that make a real impact.
? Virtual Recruitment Drive: 24th & 25th July Complete assessments, interviews, and find out the outcome of your application on the same day!
Why Join Us?
Exciting Projects: Work on complex data engineering projects within a niche domain involving patents and intellectual property.
High-Profile Clients: Collaborate with industry giants like Google, Apple, and Tesla.
Innovative Environment: Contribute to the development of a unified data platform that serves as the single source of truth for our business.
Career Growth: Benefit from a mix of experience levels within the team, fostering growth and mentorship.
Collaborative Culture: Be part of a team that values inclusivity and diverse backgrounds.
Work in a Way That Works for You: We promote a healthy work/life balance across the organisation . With numerous wellbeing initiatives, shared parental leave, study assistance , and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. Enjoy working flexible hours, flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Open Positions:
Principal Engineer: Lead technical projects and mentor junior team members. Significant experience with PySpark is essential.
Senior Data Engineer: Tackle complex data engineering tasks with strong skills in SQL, Python, and cloud technologies (preferably AWS).
Intermediate Data Engineer: Support senior engineers with at least 3 years of experience in SQL, Python, and cloud technologies.
Junior Data Engineer: Assist in various data engineering tasks with foundational knowledge in SQL and Python.
What We Offer: We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
Medical Aid
Retirement Plan inclusive of Risk Benefits (Disability, Critical Illness, Life Cover & Funeral Cover)
Modern Family Benefits, including adoption and surrogacy
Study Leave
Ready to Make an Impact? Submit your application today. Should you meet the requirements one of our recruiters will reach out to explain the process and learn more about your experience.
Apply Now and Be Part of Our Journey!
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1- .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
#J-18808-LjbffrData Engineer
Posted 4 days ago
Job Viewed
Job Description
? Join Our Dynamic Data Engineering Team! ?
Are you ready to take your data engineering career to the next level? We are on the lookout for talented individuals to join our innovative team and work on cutting-edge projects that make a real impact.
? Virtual Recruitment Drive: 24th & 25th July Complete assessments, interviews, and find out the outcome of your application on the same day!
Why Join Us?
Exciting Projects: Work on complex data engineering projects within a niche domain involving patents and intellectual property.
High-Profile Clients: Collaborate with industry giants like Google, Apple, and Tesla.
Innovative Environment: Contribute to the development of a unified data platform that serves as the single source of truth for our business.
Career Growth: Benefit from a mix of experience levels within the team, fostering growth and mentorship.
Collaborative Culture: Be part of a team that values inclusivity and diverse backgrounds.
Work in a Way That Works for You: We promote a healthy work/life balance across the organisation . With numerous wellbeing initiatives, shared parental leave, study assistance , and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. Enjoy working flexible hours, flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Open Positions:
Principal Engineer: Lead technical projects and mentor junior team members. Significant experience with PySpark is essential.
Senior Data Engineer: Tackle complex data engineering tasks with strong skills in SQL, Python, and cloud technologies (preferably AWS).
Intermediate Data Engineer: Support senior engineers with at least 3 years of experience in SQL, Python, and cloud technologies.
Junior Data Engineer: Assist in various data engineering tasks with foundational knowledge in SQL and Python.
What We Offer: We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
Medical Aid
Retirement Plan inclusive of Risk Benefits (Disability, Critical Illness, Life Cover & Funeral Cover)
Modern Family Benefits, including adoption and surrogacy
Study Leave
Ready to Make an Impact? Submit your application today. Should you meet the requirements one of our recruiters will reach out to explain the process and learn more about your experience.
Apply Now and Be Part of Our Journey!
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1- .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
#J-18808-LjbffrData Engineer
Posted 4 days ago
Job Viewed
Job Description
Join to apply for the Data Engineer role at Psybergate (Pty) Ltd
4 days ago Be among the first 25 applicants
Join to apply for the Data Engineer role at Psybergate (Pty) Ltd
Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.
We are looking for a Data Engineer to join our financial services client based in Sandton.
We are looking for a technically skilled Data Engineer with solid hands-on experience in building and maintaining end-to-end data solutions on AWS. The ideal candidate will be comfortable working across the data pipeline - from ingestion to transformation to delivery - while ensuring performance, scalability, and data quality.
What You Will Be Doing
- Collaborate with analysts, developers, architects, and business stakeholders to understand data needs and deliver technical solutions.
- Design, build, and maintain data pipelines and integrations using AWS services such as S3, Glue, Lambda, and Redshift.
- Develop and manage data lakes and data warehouses on AWS.
- Support and maintain production and non-production data environments.
- Optimize data storage and query performance through schema design and efficient data processing.
- Implement CI/CD practices for data infrastructure, including monitoring, logging, and alerting.
- Ensure data quality, security, and governance across all stages of the data lifecycle.
- Document data models, pipelines, and architecture for internal use and knowledge sharing.
- Stay current with AWS data services and best practices.
- Contribute to a culture of continuous improvement and knowledge sharing within the team
- Completed Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).
- 5 - 7 years of experience in data engineering.
- 3 years of hands-on experience with AWS, including:
- S3, Glue, Spark, Athena, Redshift, RDS, Lambda, Lake Formation
- Strong SQL skills and experience with relational databases (e.g., PostgreSQL, Oracle, RDS).
- Proficiency in Python or Scala for data processing.
- Familiarity with infrastructure-as-code tools (e.g., Terraform, CloudFormation).
- Understanding of data governance, security, and compliance in cloud environments.
Desired Skills
- Data Engineering
- SQL
- AWS
- S3
- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Information Technology
- Industries IT Services and IT Consulting
Referrals increase your chances of interviewing at Psybergate (Pty) Ltd by 2x
Get notified about new Data Engineer jobs in Centurion, Gauteng, South Africa .
Centurion, Gauteng, South Africa 2 months ago
Bedfordview, Gauteng, South Africa 2 weeks ago
Junior Full Stack Software Developer - DigicallJohannesburg Metropolitan Area 3 days ago
Sandton, Gauteng, South Africa 2 months ago
Johannesburg Metropolitan Area 4 days ago
Sandton, Gauteng, South Africa 1 month ago
Johannesburg, Gauteng, South Africa 6 months ago
Centurion, Gauteng, South Africa 3 weeks ago
Johannesburg Metropolitan Area 1 week ago
Centurion, Gauteng, South Africa 1 week ago
Johannesburg Metropolitan Area 1 month ago
Johannesburg Metropolitan Area 1 week ago
Centurion, Gauteng, South Africa 3 days ago
Sandton, Gauteng, South Africa 3 weeks ago
Woodmead, Gauteng, South Africa 1 month ago
Sandton, Gauteng, South Africa 5 days ago
Ivory Park, Gauteng, South Africa 1 month ago
Pretoria, Gauteng, South Africa 3 weeks ago
Ivory Park, Gauteng, South Africa 1 month ago
Brakpan, Gauteng, South Africa 2 weeks ago
Johannesburg Metropolitan Area 1 week ago
Ivory Park, Gauteng, South Africa 1 month ago
Johannesburg Metropolitan Area 1 week ago
Centurion, Gauteng, South Africa 2 months ago
Teacher Assistant for Software Engineering Program Freelance Software Developer (Java) - AI TrainerPretoria, Gauteng, South Africa 4 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr