Data Engineer at Q-Sourcing Servtec Group

Deliver accurate, complete, and timely data to support and drive business decisions. The key focus of the role is to deliver data pipelines, data lake support, and custom solutions for business-critical requirements. Conduct all aspects of data engineering, from delivery planning, estimating, and analysis, all the way through to data architecture and pipeline design, delivery, and production implementation.

Scope

Developing systems and conducting analysis on data relating to customer behavior, operational performance, and financial performance to enable decision-makers to make decisions to improve business performance

Expected functions/key results:

• Build, own, and maintain systems to extract and present business data.
• Review system design documents and contribute to implementation decisions.
• Investigate internal and external data sources that will contribute to the company’s customer service and decision-making.
• Assist the analytics lead in working with colleagues across the business to understand their data needs.
• Architecting data pipelines to move data from different sources and centralize it in our data lake for analytics
• Maintaining the data pipelines
• Ensuring data integrity on source and destination platforms
• Implement monitoring tools to detect issues and measure the performance of the data pipelines.
• Ensure compliance with data governance and security policies.
• Establish, maintain, and monitor information security controls over data pipelines and data lakes.
• Maintain good knowledge of data processing and analytics technologies and make recommendations to continually improve our analytics stack.

Key Capabilities

• ability to deliver data solutions and pipelines on the AWS Cloud Platform
• Experience with AWS Glue, RDS, Lambda, S3, Athena, and QuickSight
• Knowledge of ETL, ELT, data migration, and cleansing processes
• experience with data lakes, data analytics, and working with large data sets.
• the ability to work independently yet seek advice where required.
• committed to delivering excellence for customers.
• Strong Python and SQL
• Awareness of good practices in information security and data privacy
• Proficient in the Agile development process
• ability to work in a distributed team

EDUCATION

• Degree in Computer Science, Mathematics, or Similar

Previous Relevant Experience

• 2+ years of data analysis or data science
• working experience of at least 2 years in the field
• AWS qualifications are an advantage.