AI Evaluator - Software Expert - AI Trainer
Mercor · United States
Skills in this posting
The posting
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
Evaluate AI-generated artifacts against domain-specific quality rubrics.
Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
Provide clear, structured written feedback to improve AI model outputs .
Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
5+ years of relevant professional experience in Software / AI / IT / data .
Native or professional fluency in English .
Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiring mercor Originally posted on Himalayas
The PivotHop read
- Where data annotators move nextevery measured route out
- All open data annotator rolesthe full board
Where these skills also reach
- 943 open research scientist roles38% readiness from data annotator
- 21 open sound designer roles38% readiness from data annotator
- 8 open conversation designer roles34% readiness from data annotator
- 36 open content moderator roles33% readiness from data annotator
More data annotator roles
AI Tutor - Danish at X.aiDenmark · Remote2d agoApply- Copy of CFD & Aerodynamic Engineer (AI Training & Evaluation) at Lifted (an Upwork Company)Brazil · Remote2d agoApply
- Copy of Senior Structural Engineer (OpenSees | AI Training & Evaluation) at Lifted (an Upwork Company)Brazil · Remote2d agoApply
AI Data Annotator - French (Canada) at Welo GlobalCanada · Remote2d agoApply
AI Tutor - Chinese at X.aiUnited States · Remote2d agoApply
Backfilled listing, refreshed with the nightly scrape; the employer has not claimed it yet. Are you the employer? Claim this listing and it can be featured to the candidates whose skills already reach it, first month free.