Become a key player at IDC as an AI Engineer specializing in Observability and Quality, focusing on enhancing AI response accuracy. This role is remote and pivotal for establishing quality standards.
In this solo role, you’ll design comprehensive evaluation frameworks that bolster the integrity and performance of our AI platform. Your work will involve developing automated test suites and monitoring tools that facilitate high-quality delivery to users, ensuring our AI systems remain reliable and trusted.
Key Responsibilities:
• Establish evaluation systems for AI response quality
• Develop automated testing frameworks and regression detection
• Create metrics for tracking quality and citation accuracy
• Collaborate with product teams to define quality criteria
• Monitor AI execution for operational effectiveness
Requirements:
• 6+ years in software engineering focused on ML or testing
• Expertise in Python and AI evaluation frameworks
• Independence in ...