Position: LLM – AI Quality Analyst (Personalization) – Finnish
Type: Short-Term Contract (1 month)
Compensation: $11–$15 per hour
Location: Remote
Commitment: Part-time availability required
Role Responsibilities
- Evaluate a personalization feature for Gemini
- Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences
- Assess how effectively the model uses past conversations, Gmail, Google Search, and YouTube activity to generate relevant and helpful responses
- Evaluate model responses based on intent and appropriate personalization
- Analyze responses for grounding issues, including flawed inferences or hallucinations
- Assess integration quality to ensure personal data is incorporated naturally into responses without overnarration
- Perform side-by-side evaluations and stac...