Overview
Lead creative data engineering projects at the Ministry of Public and Business Service Delivery. This senior DataOps role focuses on cloud solutions and data manipulation using diverse tools and technologies. The Ministry of Public and Business Service Delivery is seeking a Senior DataOps Engineer for a contract from June 1, 2026, to October 5, 2027.
Responsibilities
- Design and implement data lakehouse architectures using Databricks
- Transform data from XLSX, CSV, and JSON formats into usable structures
- Manage data pipelines using AWS S3 and Glue
- Execute ETL processes with Informatica IDMC
Qualifications
- Proficient in data engineering with pandas and pyspark
- Experience with AWS Services, especially Glue and S3
- Knowledge of Databricks and structured/unstructured data
- Solid background in ETL processes and tools
- Ability to work on various data file formats...