Job Description
Toast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful business insights.
Responsibilities
- Design, build, and maintain backend systems that power LLM-driven and agentic workflows
- Develop retrieval pipelines, orchestration layers, and multi‑step agent architectures that support scalable AI‑powered search experiences
- Lead the evaluation of agentic systems using automated, offline, and human‑in‑the‑loop frameworks to measure relevance, quality, latency, and task success
- Improve retrieval and ranking systems across hybrid retrieval, re‑ranking, query rewriting, and post‑retrieval synthesis
- Optimize LLM‑powered workflows for speed, accuracy, reliability, and production readiness
<...