🏛️ London's Premier Job Portal
Position: Senior Data Engineer
Role Summary:
Responsible for building robust ingestion pipelines and foundational data layers within an Azure and Snowflake environment, while supporting analytics engineering needs.
Key Responsibilities
Ingestion Management:
Build and maintain ELT pipelines using Airbyte or Fivetran across APIs, files, and application databases.
Proactive Testing:
Implement comprehensive unit and integration tests (dbt tests, freshness checks) for every pipeline.
Medallion Implementation:
Create and maintain the Bronze (Raw) and Silver (Cleaned) layers on Snowflake with strict data quality gates.
Cross-Functional Delivery:
Support the creation of Gold-layer Star Schemas and reporting models as capacity requires.
EDW Foundation:
Collaborate with the Architect to build foundational tables that support downstream analysis and the semantic layer.
Legacy Translation:
Interpret legacy scripts to migrate logic into...