SearchLondonJobs.co.uk

🏛️ London's Premier Job Portal

← Back to London Jobs

Associate Principal Engineer (India Office)

Company: WESCO

Location: Bangalore, London

Posted: June 15, 2026

Apply for This Position

Submit Application

Position Details

Data professional with experience in building and validating end-to-end data pipelines across Azure Data Factory, Databricks, and ADLS. Skilled in data quality assurance, automation using Python and PySpark, and integrating tests into CI/CD workflows. Adept at large-scale data validation, monitoring data health, and ensuring reliable batch and streaming processes, with additional expertise in developing scalable BI dashboards and reporting solutions.

+ Design and implement end-to-end data validation strategies for pipelines built on Azure Data Factory, Databricks (Delta Lake), and ADLS
+ Perform source-to-target reconciliation across ingestion, transformation, and consumption layers
+ Implement robust checks for Data Quality Dimensions
+ Build scalable data testing frameworks using python, pyspark and good knowledge of automation tools like playwright & pyspark based automation testing.
+ Integrate automated data tests into CI/CD pipelines (Azure DevOps / GitHub Ac...