Data Engineer

Job Description

We are in search of a skilled Data Engineer to join our team in Durban. The successful candidate will be responsible for developing and maintaining data pipelines, ensuring data integrity and availability for analysis. This role focuses on leveraging big data tools to support business decision-making through insightful data analysis. Candidates should have a robust understanding of data warehousing concepts and a knack for problem-solving.

Responsibilities

• Design, develop, and optimize scalable data pipelines.
• Collaborate with data scientists and analysts to understand data requirements.
• Ensure data integrity and reliability by implementing effective quality checks.
• Monitor and maintain data infrastructure to enhance performance.
• Translate business requirements into technical specifications.
• Implement data storage solutions and optimize data access procedures.

Requirements

Education

• Bachelor's degree in Information Technology, Engineering, or related field
• Master's degree is an advantage

Experience

• 5+ years of experience in data engineering or related fields

Technical Skills

• Apache Spark
• Hadoop

Soft Skills

• Teamwork
• Time Management

Certifications

• Certified Data Management Professional (CDMP)
• AWS Certified Solutions Architect

Languages

• English: Fluent

Advantageous

• Experience with Docker and Kubernetes: Familiarity with container orchestration tools to streamline deployment processes.

Benefits

• Comprehensive health and wellness benefits
• Retirement savings plan with company matching
• Flexible work hours with remote options
• Professional development opportunities

Company Culture

• Innovative Mindset: We encourage innovative thinking and support employees in their creative efforts.
• Diversity and Inclusion: Embracing diversity is key to our success, and we champion varied perspectives.
• Collaborative Environment: We work together to create solutions that benefit our clients and team members.
• Continuous Learning: Commitment to ongoing education and skill development is fundamental to our culture.