SearchLondonJobs.co.uk

🏛️ London's Premier Job Portal

← Back to London Jobs

Data engineer

Company: New York Technology Partners

Location: mexico city, London

Posted: May 29, 2026

Apply for This Position

Submit Application

Position Details

Engineer will be part of the data store-migration Factory team that will be responsible to perform for the end-to end data store migration from on-prem Data Lake to AWS hosted Lake House. Responsibilities of the Engineer include: 1. Pipeline Migration Logic & Scheduling: Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment. Data Transfer: Executing the physical migration of underlying datasets while ensuring data integrity. Stakeholder Engagement: Acting as a technical liaison to internal clients, facilitating hand-off and sign-off conversations with data owners to ensure migrated assets meet business requirements.2. Consumption Pattern Migration Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg. Usage analysis: Understand usage patterns to deliver the required data products. Stakeholder Engagement: Acting as a technic...