Role Summary

We are looking for a mid-level Python Developer—NLP, ML, Gen AI with combined experience in Data Engineering and AI/NLP engineering. The candidate will build NLP pipelines using libraries such as Flair, BERT, and LLM frameworks, and will also work on large‑scale data processing using PySpark, Pandas, and related data tools. The role includes developing APIs, integrating with platform services, and supporting CI/CD deployments using GitHub and LightSpeed Enterprise.

Key Responsibilities

• Develop and optimize ETL/data processing jobs using PySpark, Pandas, PyArrow, and related libraries.
• Work with Parquet files using FastParquet or pyarrow.parquet for efficient data processing.
• Implement data parsing and serialization using json, ujson, or orjson for high-performance JSON handling.
• Build and maintain NLP pipelines using Flair, BERT, and LLM‑based models.
• Develop scalable ingestion and data t...