Job description
Role Title: Product Manager / Product Owner
Role Type: Contractor
Location: Remote
We are engaging Product Managers and Product Owners as expert contributors to an advanced customer project focused on AI system development. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
This is strictly an evaluation and analysis opportunity. It does not involve roadmap ownership, delivery management, sprint facilitation, stakeholder leadership, or programme governance. Contributors with backgrounds in project management, programme management, delivery, or scrum leadership should not apply — this engagement requires deep product management and product ownership skills in content and specification evaluation.
Required Skills
Product Management
Product Ownership
Specification Writing
Content Evaluation
Written Communication
Attention to Detail
Critical Analysis
Stakeholder Communication
Independent Work
Virtual Collaboration
Scope of Work
Assess and compare AI-generated responses to a variety of writing prompts, including specifications, release notes, user-facing copy, and stakeholder updates.
Score each response based on clarity, tone, adherence to instructions, and usefulness for the intended audience.
Write detailed rationales explaining the reasoning behind each score, focusing on whether the content meets prompt requirements and audience needs.
Identify and document cases where fluent writing fails to answer the question, or complete responses are unsuitable for users.
Spot factual inaccuracies, inconsistencies, and instances where content exceeds or misses prompt constraints.
Collaborate virtually and asynchronously with project managers and reviewers to ensure consistency and quality in assessments.
Preferred Qualifications
Professional experience as a Product Manager or certified Product Owner, with a strong record in cross-functional product development.
Native-level English fluency and exceptional written communication skills.
Extensive experience authoring and evaluating specifications, PRDs, acceptance criteria, release notes, or decision documents.
Demonstrated ability to judge whether content is appropriately tailored for executives, technical stakeholders, or end users.
Proven skill in providing actionable, written feedback on technical or user-facing documentation.
Attention to detail, critical analysis skills, and the ability to work independently while meeting remote project deadlines.
Familiarity with model evaluation, RLHF, or annotation is a plus, but not required.
Originally posted on Himalayas
Who can apply
The source lists worldwide eligibility. Accepted UTC offsets: UTC-11, UTC-10, UTC-9.5, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC-4, UTC-3.5, UTC-3, UTC-2, UTC-1, UTC+0, UTC+1, UTC+2, UTC+3, UTC+3.5, UTC+4, UTC+4.5, UTC+5, UTC+5.5, UTC+5.75, UTC+6, UTC+6.5, UTC+7, UTC+8, UTC+8.75, UTC+9, UTC+9.5, UTC+10, UTC+10.5, UTC+11, UTC+12, UTC+12.75, UTC+13, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.