Description

Our client is an American video game company.
#LI-JF4

Responsibilities

Migrate current Data pipelines and DAGs from GCP BigQuery stored procedures into AWS Redshift

Perform necessary data backfills and validate the quality and integrity during and post-migration

Design, develop, and maintain data pipelines using AWS services such as Amazon Redshift (or any MPP solution), Amazon S3, dbt and Apache Airflow

Utilize SQL and ETL/ELT solutions to transform and load data from various sources into data warehouses and data lakes

Optimize data workflows and processes to ensure efficiency, scalability, and reliability

Implement auto-updated mechanisms to keep data pipelines and systems up-to-date with the latest data

Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs

Mon...