SearchLondonJobs.co.uk

🏛️ London's Premier Job Portal

← Back to London Jobs

Evaluation Scenario Writer - AI Agent Testing Specialist

Company: Mindrift

Location: estado de méxico, London

Posted: June 03, 2026

Apply for This Position

Submit Application

Position Details

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

Participation isproject-based, not permanent employment.

What This Opportunity Involves

You’ll create challenging coding test cases that push AI coding systems to their limits:

  • Review and refine realistic coding tasks based on provided production codebases with realistic scope, requirements and information sources
  • Write comprehensive functional tests that validate actual end-to-end behavior and edge-cases, not just superficial checks
  • Craft fair but hard challenges where the AI has all the context it needs, but has to work for it (information scattered across files and external sources, complex reasoning required)
  • Analyze AI failures to understand what the model st...