SearchLondonJobs.co.uk

🏛️ London's Premier Job Portal

← Back to London Jobs

Data Engineer Pyspark and Azure

Company: Compunnel, Inc.

Location: alton, London

Posted: May 31, 2026

Apply for This Position

Submit Application

Position Details

We are seeking a highly skilled Data Engineer with expertise in PySpark and Azure to lead the improvement of our Investment Reporting System.

This role involves guiding the engineering team, implementing cloud-native solutions, and ensuring adherence to best practices.

Key Responsibilities

  • Lead the development of ETL pipelines and cloud-native architectures using Azure services.
  • Work hands-on with Azure Data Factory, Databricks, Functions, Event Grid, and Service Bus.
  • Collaborate with Solution Architects to translate designs into actionable tasks.
  • Implement DevOps practices, CI/CD pipelines, and infrastructure automation.
  • Provide technical mentorship and problem-solving support to the team.

Required Qualifications

  • Proven experience as a Lead Engineer or similar role.
  • Hands‑on expertise in Azure services and PySpark.
  • Strong experience in ETL development and database migrat...