Senior Data Engineer at Living Goods

Purpose of the role:

• We are looking for a Senior Data Engineer to lead the design, development, and management of our data warehousing infrastructure. This role involves building and maintaining data pipelines, managing both relational and non-relational databases, optimizing queries, and transforming raw data into structured data for analysis and reporting.
• The successful candidate will collaborate closely with the program, MLE, product management, and software engineering teams to understand data requirements and oversee the implementation of suitable solutions to ensure stakeholders’ needs are satisfied.
• Embedded within the Digital Health Team, this role will report to the Senior Manager, Data Engineering & Architecture. The ideal candidate will bring extensive expertise in Transactional Databases, Data Warehouses, and BI reporting systems.

Roles And Responsibilities:

• Develop and implement a scalable, secure data warehousing solution to meet business analytics and reporting requirements.
• Develop and manage data pipelines to integrate data from various sources, transforming raw data into usable formats.
• Serve as the primary database administrator, ensuring optimal performance, integrity, and security of all databases, including relational and non-relational systems.
• Perform complex queries, joins, and data extractions from source systems, ensuring efficient access to data for both operational and analytical purposes.
• Design and maintain data models and database schemas to support the business’s data needs.
• Lead efforts in data warehouse optimization, including query tuning, indexing, and schema adjustments.
• Implement and manage workflows to automate data integration, transformation, and loading processes.
• Ensure the quality, consistency, and reliability of data, maintaining governance and compliance standards.
• Support business intelligence and reporting efforts by ensuring data is well-structured and accessible for use with BI tools.
• Collaborate with stakeholders to gather data requirements and build data solutions aligned with business objectives.

Skills & Competencies:

• 5+ years experience as a Data Engineer.
• Proficiency in SQL & Python for advanced querying, data manipulation, and performance optimization.
• Expertise in cloud-based data warehousing solutions such as AWS Redshift or Snowflake.
• Experience with ETL tools like AWS Glue, Airbyte or Talend for building automated data pipelines.
• Strong knowledge of dbt for data modeling and transformation.
• Hands-on experience with workflow automation tools such as Airflow.
• Expertise in managing CouchDB or PostgreSQL databases, including schema management, performance tuning, and complex queries.
• Extensive data warehouse experience, with skills in performance tuning, query optimization, indexing, and data integrity management.
• Proficiency in using BI tools such as Tableau, Power BI, or Superset for creating reports and dashboards.
• Strong understanding of data governance, security, and compliance best practices in cloud environments.
• Soft Skills: Teamwork, Collaboration, Problem - solving, Strong communication and presentation skills to effectively translate technical concepts to business stakeholders.

Minimum Qualifications:

• A Bachelor’s degree in computer science, Data Science, Statistics, Mathematics, or a related discipline.
• Professional certifications or equivalent experience in data management, ETL processes, data warehousing, data visualization, and managing large and complex datasets.