Data Engineer

Job Description

Join our growing team in Durban as a Data Engineer and take charge of our data processing systems. You will work closely with analysts and other stakeholders to ensure seamless data transformation and delivery to various endpoints.

Responsibilities

• Design and construct data pipelines that transform raw data into useful data sets for analysis.
• Collaborate with data scientists to understand data requirements and assist in building robust data solutions.
• Ensure data integrity and quality throughout all stages of processing.
• Monitor performance and troubleshoot data-related issues as they arise.
• Conduct data modeling and architecture planning to optimize dataset storage and retrieval.
• Implement and manage ETL processes with tools like Apache Spark or Talend.
• Create and maintain documentation of data processes and systems.
• Ensure compliance with data governance and data security standards.

Requirements

Education

• Bachelor's degree in Computer Science, Data Science or a related field

Experience

• 3+ years of experience in data engineering or related field

Technical Skills

• SQL
• Python
• Apache Spark
• AWS

Soft Skills

• Analytical thinking
• Team collaboration

Languages

• English: Fluent

Advantageous

• Experience with containerization tools: Familiarity with tools like Docker and Kubernetes for deploying applications.
• Knowledge of machine learning algorithms: Exposure to machine learning concepts and tools for data analysis.

Benefits

• Medical aid and pension contributions
• Flexible working hours
• Work-from-home options available after probation
• Professional development opportunities

Company Culture

• Creativity: We encourage creative solutions and unique problem solving among our teams.
• Supportive Environment: Our company fosters a supportive environment for personal and professional growth.
• Diversity and Inclusion: We value diversity and strive to create an inclusive workplace reflecting our community.