Join Tata Consultancy Services as a Lead Data Engineer focusing on Databricks. Play a pivotal role in evolving enterprise data platforms and enhancing finance-related analytics.
This position at TCS calls for a seasoned Data Engineer with expertise in both Databricks and cloud object storage. You will be pivotal in modernizing legacy systems while ensuring data integrity and reconciliation. Collaborate with stakeholders to implement best practices for data governance and quality.
Key Responsibilities:
• Redesign data ingest and consume patterns
• Modernize traditional EDW environments into scalable Lakehouse architectures
• Ensure compliance with data security standards and access control
• Manage data lineage and metadata effectively
• Optimize data workloads for performance and efficiency
Requirements:
• Strong hands-on experience with Databricks and PySpark
• Deep understanding of finance and risk data models
• Familiarity with CI/CD and orchestratio...