Data Engineer at Food For Education

We're looking for a skilled Data Engineer to help us transform our food service data infrastructure from the ground up. You'll be responsible for building efficient data pipelines that integrate our tap2Eat system with meals data in BigQuery, enabling powerful business insights across the organization. This is a hands-on technical role where you'll design, implement, and optimize our entire data engineering ecosystem.

Key responsibilities:

• Build scalable ETL/ELT pipelines using Apache Airflow to integrate data from various sources including relational databases, Google Sheets, and unstructured data into BigQuery.
• Design and implement an optimized data model for storing and analyzing food service data, with a focus on query performance and cost efficiency.
• Develop transformation scripts that clean, standardize, and enrich our tap2Eat system data with meals nutritional information.
• Engineer partitioning and clustering strategies for BigQuery tables to ensure optimal performance and cost management.
• Create and maintain data quality frameworks to ensure data accuracy, completeness, and reliability.
• Develop automated data pipeline monitoring to proactively identify and resolve issues.
• Optimize SQL queries and views to support the BI team in creating insightful dashboards.
• Document data pipelines and data models to ensure knowledge sharing across teams.
• Collaborate with stakeholders to understand business requirements and translate them into technical implementations.

What You'll Need

Technical Skills:

• 4+ years of experience in data engineering roles.
• Strong proficiency with Python and SQL.
• Experience with Apache Airflow or similar workflow orchestration tools.
• Demonstrated expertise with BigQuery or similar cloud data warehouses.
• Knowledge of data modeling and dimensional design principles.
• Experience with real-time and batch data processing patterns.
• Understanding of data quality best practices and implementation methods.
• Familiarity with version control systems (Git) and CI/CD practices.

Background and Education:

• Bachelor's degree in Computer Science, Information Systems, Statistics, or equivalent practical experience
• Experience working with food service data is a plus, but not required