Data Engineer

Johannesburg FULL TIME R41,667 - R54,167 / Month
(R500,000 - R650,000 / Year)

Job Description

Join us as a Data Engineer, where you'll design, implement, and maintain efficient data architectures to support our analytics initiatives. The right candidate will be proficient in Python or Java and experienced in working with big data technologies such as Hadoop or Spark. This role is crucial in enabling high-quality data-driven decisions throughout the company.

Responsibilities

  • Architect and build robust data solutions that enhance data collection processes.
  • Collaborate closely with data analysts and data scientists to deliver cohesive data insights.
  • Review and optimize existing data flows for enhanced performance.
  • Implement automated data quality checks and performance logging.
  • Create and maintain documentation for database design and data models.
  • Participate in team meetings to discuss project progress and challenges encountered.
  • Engage in continuous learning of data engineering tools and technologies.
  • Critique code and performance metrics to identify areas for improvement.
  • Develop strategies for archiving and disposing of data in accordance with policies.
  • Participate in troubleshooting sessions for production data issues.

Requirements

Education
  • Bachelor's degree in Data Science, Computer Science, or related field
Experience
  • 3-5 years of experience in data engineering
Technical Skills
  • ETL Tools (Informatica, Talend)
  • NoSQL Databases (MongoDB, Cassandra)
Soft Skills
  • Creative problem-solving
  • Team player
Languages
  • English: Fluent

Advantageous

  • Experience with real-time data processing: Hands-on experience with real-time data processing technologies.
  • Familiarity with containerization (Docker, Kubernetes): Knowledge of container technologies will be beneficial.

Benefits

  • Health and dental insurance
  • Annual performance bonuses
  • Paid time off and sick leave
  • Training and certifications funding

Company Culture

  • Inclusivity: We embrace diversity within our workforce and build an inclusive environment for all.
  • Work-Life Balance: We support work-life balance and offer flexibility to our employees.
  • Community Engagement: We encourage community involvement and provide opportunities for volunteering.
Status: Closing Soon