Data Engineer at Twiga Foods

The Data Engineer will be responsible for finding trends in data sets and developing algorithms to help make raw data more useful to the business. S/he will manage large, curated datasets by developing, maintaining, and testing infrastructures. S/he will manage data models and ETLs that will enable the business access consistent data and metrics.

Key Responsibilities

• Partner with internal backend developers (Tech department) and externa backend developers (third parties) as well as the Analytics & Insights teams to understand data, translate business requirements into technical design of building scalable data pipelines, and develop data integration endpoints.
• Develop and take ownership of BI data pipelines and data warehouse with curated datasets and standardized metrics and business definitions to empower data access and self-service.
• Extract, transform, and load (ETL) data from a wide variety of data sources.
• Architect, implement and manage robust and scalable data models. Develop algorithms to enable easier access to raw data, improving data reliability, efficiency, and quality.
• Architect the data warehouse, including efforts in standardization, design, and deployment of the data architecture.
• Develop process automation solutions for structured data collection and secured data integrity to enable the business to gain insights from data that can be leveraged for strategic and decision making.
• Develop data collection toolkits using e.g., PowerApps or Flutter.
• Create a data lake for the business.
• Troubleshoot data-related technical issues and support data infrastructure needs.
• Develop BI technical documentation – data dictionaries, data flows, database schemas, data model diagrams, Entity Relationship Diagrams (ERDs), etc.
• Create data back-ups.

Minimum Qualifications And Requirements

• Bachelor of Science – Computer Science or Mathematics
• Minimum of 4 years’ experience in a similar role in a fast-paced organization
• Experience in writing complex queries especially Big Query
• Solid knowledge of Python, SQL, and scripting
• Proficiency in Power BI and Data Studio
• Familiarity with PowerApps and/or Flutter
• Open to change and flexible in a fast-paced environment, effectively adapts own approach to suit changing circumstances or requirements
• Experience working in an Agile/Scrum development process
• Time management skills
• Interpersonal and communication skills