Data Engineer

Job Description

We are seeking a skilled Data Engineer to join our team in Durban. You will play a crucial role in structuring and managing large datasets while ensuring the integrity and usability of data across various platforms. Your expertise in data processing and ETL pipelines will be essential to drive our analytics initiatives.

Responsibilities

• Architect and maintain cloud-based storage solutions for efficient data management.
• Work on improving data retrieval times and the performance of existing data systems.
• Collaborate with IT to ensure data security protocols are effectively implemented.
• Conduct performance tuning and optimization of data workflows.
• Engage in troubleshooting data-related issues and recommending solutions.

Requirements

Education

• Bachelor's degree in a relevant field
• Master's degree in Data Engineering is a plus

Experience

• Minimum of 3 years of experience in a data engineering role

Technical Skills

• ETL tools
• Data Warehousing
• Machine Learning

Soft Skills

• Effective communication
• Proactive approach

Certifications

• AWS Certified Data Analytics
• Certified Data Management Professional (CDMP)

Languages

• English: Fluent

Advantageous

• Experience in data governance and compliance: Understanding of data privacy regulations and best practices.
• Familiarity with data pipeline orchestration tools: Experience with tools like Apache Airflow or Luigi.

Benefits

• Comprehensive health insurance plan
• Retirement savings plan with company match
• Flexible working conditions
• Opportunities for skill development and training

Company Culture

• Innovation: We prioritize innovative solutions and creative problem-solving in our work.
• Collaboration: Teamwork is at the heart of our culture, where ideas are shared and respected.
• Growth and Development: We encourage continuous learning and provide resources to enhance skills.