waypointjobs

mercor

AI Safety Practitioner - Expert Evaluator

Remote — United States (see country and timezone requirements)

Check who can apply and the requirements below before continuing.

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Practitioner

Type:Contract

Compensation:$60–$70/hour

Location:Remote

Role Responsibilities

Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.

Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.

Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.

Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.

Provide structured feedback to improve model alignment and safety performance.

Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.

5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.

Excellent written English, critical thinking, and analytical reasoning skills.

Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.

Familiarity with safety policies, content moderation, or evaluation rubric development.

Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

Upload resume

AI interview based on your resume

Submit form

Resources & Support

For details about the interview process and platform information, please check:

For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas

Who can apply

Eligible countries: United States. Accepted UTC offsets: UTC-10, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.

Ready for your next step?Apply on the official website
Apply on Himalayas ↗

Explore related searches

Current related jobs

Red Wine and Blue

Himalayas

General Interest Application

Remote — United States (see country and timezone requirements)

Salary not specifiedfull timeRemote

WHO THE HECK ARE WE? Red Wine & Blue is a national community of over 600,000 diverse suburban women working together to defeat extremism, one fr…

Listing expires 2026-12-04View job

Carle Health

Himalayas

Finance Systems Analyst

Remote — United States (see country and timezone requirements)

$26.41 – $44.10 per hourfull timeRemote

OverviewThe Finance Systems Analyst assists with supporting assigned finance/accounting applications for the enterprise such as costing, producti…

Listing expires 2026-12-04View job

Kyowa Kirin

Himalayas

Scientific Relations Manager

Remote — Worldwide (see timezone requirements)

Salary not specifiedfull timeRemote

OverviewWE PUSH THE BOUNDARIES OF MEDICINE. LEAPING FORWARD TO MAKE PEOPLE SMILE At Kyowa Kirin International (KKI), our purpose is to make peop…

Listing expires 2026-12-04View job

Belden, Inc

Himalayas

Solution Consultant - Cybersecurity Practice (US)

Remote — United States (see country and timezone requirements)

$125,000.00 – $160,000.00 per yearfull timeRemote

Innovation Starts With YouPropel your career at Belden, where innovation creates possibilities—for our people, our customers, and the communities…

Listing expires 2026-12-04View job