waypointjobs

mercor

Analytical Evaluator - AI Feedback

Remote — United States (see country and timezone requirements)

Check who can apply and the requirements below before continuing.

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Generalist Expert

Type:Contract

Compensation:$70/hour

Location:Remote

Role Responsibilities

Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs.

Provide structured written feedback to improve training data quality and downstream performance.

Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.

Ensure consistent and honest judgment, including critical assessments when warranted.

Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

Bachelor's degree from a top-500 globally ranked university preferred.

Strong analytical and written communication skills.

Ability to work independently and follow detailed task guidelines.

Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.

Native English fluency required.

Application Process (Takes 20–30 mins to complete)

Upload resume

AI interview based on your resume

Submit form

Resources & Support

For details about the interview process and platform information, please check:

For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas

Who can apply

Eligible countries: United States. Accepted UTC offsets: UTC-10, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.

Ready for your next step?Apply on the official website
Apply on Himalayas ↗

Explore related searches

Current related jobs

infisical

Jobicy

Senior Full Stack Engineer

Remote — Brazil, Canada, Europe, USA

Salary not specifiedRemote

Infisical is the open source security infrastructure platform that engineers use for secrets management, certificates, and privileged access mana…

Listing review due 2026-10-07View job

Spotify

Jobicy

Data Scientist - Music Mission

Remote — USA

Salary not specifiedRemote

The Music Mission enables music creators to grow, engage, and monetize their fan bases on Spotify. Central to the Music Mission's vision is the d…

Listing review due 2026-10-07View job

Spotify

Jobicy

Data Scientist - Music Promotion

Remote — USA

Salary not specifiedRemote

The Music Mission enables Music creators to grow, engage & monetize their fan bases on Spotify. Central to the Music Mission's vision is the deve…

Listing review due 2026-10-07View job

infisical

Jobicy

Strategic Finance

Remote — Canada, USA

Salary not specifiedRemote

Infisical is the open source security infrastructure platform that engineers use for secrets management, certificates, and privileged access mana…

Listing review due 2026-10-07View job