Data Engineer

Job Description

We are seeking a skilled Data Engineer to join our team in Durban. You will play a crucial role in structuring and managing large datasets while ensuring the integrity and usability of data across various platforms. Your expertise in data processing and ETL pipelines will be essential to drive our analytics initiatives.

Responsibilities

• Architect and maintain cloud-based storage solutions for efficient data management.
• Work on improving data retrieval times and the performance of existing data systems.
• Collaborate with IT to ensure data security protocols are effectively implemented.
• Conduct performance tuning and optimization of data workflows.
• Engage in troubleshooting data-related issues and recommending solutions.

Requirements

Education

• Bachelor's degree in a relevant field
• Master's degree in Data Engineering is a plus

Experience

• Minimum of 3 years of experience in a data engineering role

Technical Skills

• ETL tools
• Data Warehousing
• Machine Learning

Soft Skills

• Effective communication
• Proactive approach

Certifications

• AWS Certified Data Analytics
• Certified Data Management Professional (CDMP)

Languages

• English: Fluent

Advantageous

• Experience in data governance and compliance: Understanding of data privacy regulations and best practices.
• Familiarity with data pipeline orchestration tools: Experience with tools like Apache Airflow or Luigi.

Benefits

• Health, dental, and vision coverage
• 401(k) with generous employer contributions
• Paid time off and holidays
• Professional development opportunities

Company Culture

• Diversity: We value diverse perspectives and backgrounds in our team.
• Supportive Environment: We foster a positive atmosphere for all our employees.
• Work-Life Balance: We believe in promoting a healthy work-life balance for our team members.