About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position

Bilingual Portuguese Generalist Evaluator Expert

Type

Contract

Compensation

$12–$30/hour

Location

Remote

Duration

2–4 months

Commitment

20+ hours/week

Responsibilities

• Develop detailed prompts in Portuguese and English. Ensure natural phrasing and relevance for users in Portugal and Brazil.
• Establish evaluation standards for responses in Portugal and Brazil. Create rubrics that consider linguistic nuance and cultural conventions.
• Test models with prompts. Assess outputs for accuracy, fluency, and cultural fit in Portuguese.
• Collaborate in QA processes. Ensure consist...