Data Engineer

Job Description

As a Data Engineer at Data Solutions Ltd., you will work on cutting-edge data infrastructure projects in Johannesburg. You will enhance data workflows and create effective solutions to optimize data processes for our clients.

Responsibilities

• Design and implement data pipelines for data ingestion, storage, and processing.
• Collaborate with data scientists and analysts to enhance data accessibility.
• Ensure data integrity and quality through various validation techniques.
• Assist in data modelling and architecture best practices.
• Monitor data systems to ensure availability and performance.
• Participate in the creation of ETL processes to process data effectively.
• Utilize tools like Apache Spark and SQL for data transformation.
• Optimize existing data workflows for better performance.
• Maintain documentation related to data architecture and processes.
• Support data governance initiatives to ensure compliance with regulations.

Requirements

Education

• Bachelor's degree in Computer Science, Information Technology or related field

Experience

• 3+ years of experience in data engineering or related fields

Technical Skills

• SQL
• Python
• Apache Spark
• ETL Tools

Soft Skills

• Analytical thinking
• Team collaboration

Languages

• English: Fluent

Advantageous

• Experience with AWS or Azure: Knowledge of cloud services for data storage and processing.
• Familiarity with machine learning concepts: Basic understanding of ML and its application in data analysis.

Benefits

• Competitive salary and performance bonuses
• Comprehensive health and wellness benefits
• Flexible working hours and the option for remote work
• Professional development and training programs

Company Culture

• Innovative Environment: We encourage creativity and new ideas, striving for innovation in all that we do.
• Team Collaboration: A strong team culture where collaboration is key to our success.
• Diversity and Inclusion: We celebrate diversity and are committed to inclusive practices throughout our organization.