Data Engineer - Contract (Stamp 4, Stamp 1G, and EU citizens)

Your new company
My client is a Pharma company with a large base in Ireland with offices spread across Limerick and Cork.

Your new role

Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.

Collaborate with data analysts and data scientists to understand data needs and provide appropriate data solutions.

Optimise existing ETL processes to enhance performance and efficiency.

Ensure data quality by implementing validation and testing procedures.

Work with Big Data technologies and frameworks to manage large datasets.

Assist in data modelling and design of data warehouses to support business intelligence initiatives.

Monitor and troubleshoot data pipeline performance issues.

Participate in code reviews and contribute to best practices and standards in data engineering.

Doc...