Analytical Evaluator - AI Feedback - AI Trainer
Mercor · United States
The posting
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
Provide structured written feedback to improve AI model outputs .
Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
Write clear, precise, and well-evidenced rationales beyond surface-level observations.
Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
Bachelor's degree from a top-500 globally ranked university preferred.
Strong analytical and written communication skills.
Ability to work independently and follow detailed task guidelines.
Strong critical reading skills.
Native English fluency required.
Preferred
None specified.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiring mercor Originally posted on Himalayas
The PivotHop read
- Careers a data annotator can move intoevery measured route out
- AI Engineer → Data Annotator56% readiness
- Prompt Engineer → Data Annotator48% readiness
- MLOps Engineer → Data Annotator46% readiness
- All open data annotator rolesthe full board
Where these skills also reach
- 600 open research scientist roles36% readiness from data annotator
- 8 open prompt engineer roles32% readiness from data annotator
- 453 open ai engineer roles26% readiness from data annotator
- 600 open qa engineer roles24% readiness from data annotator
More data annotator roles
Video Game Annotation Specialist at MercorGermany · Remote1d agoApply
AI Trainer Image QA Evaluator at iMerit TechnologyRemote$30k–$40k5d agoApply
Italian Audio Evaluations Specialist - Freelance AI Trainer Project at Invisible TechnologiesItaly · Remote6d agoApply
German Audio Evaluations Specialist - Freelance AI Trainer Project at Invisible TechnologiesGermany · Remote6d agoApply
AI Trainer - English-Chinese Bilingual Voice Recording at Toloka AISaudi Arabia · Remote1w agoApply
Backfilled listing, refreshed with the nightly scrape; the employer has not claimed it yet. Are you the employer? Claim this listing and it can be featured to the candidates whose skills already reach it, first month free.