About this opportunity
Confidential lists this Software Engineer for AI Training and Evaluation opportunity in Newtonville, Massachusetts. Review the employer’s description below for duties, qualifications and application requirements.
Job description
Apply production software engineering judgment to help evaluate advanced AI systems. Your expertise will inform the standards used to assess AI-generated engineering work.
Role Overview This is an ongoing talent pool for AI training and evaluation projects, not a specific active opening. Projects may begin on short notice, and qualified engineers are contacted when a project aligns with their technical background.
Key Responsibilities Create engineering problems based on systems you have shipped, including requirements, constraints, failure modes, and reference answers used to evaluate model responses.
Review AI-generated code and designs for edge cases, appropriate complexity, and whether tests validate the behavior they claim to cover.
Identify code that may pass review but fail in production because of concurrency, scale, error handling, or operating costs.
Understand that this listing itself does not make acceptance or rejection decisions. Project-specific hiring decisions occur when you are invited to a matching engagement.
Qualifications Professional experience building and shipping software.
Strong written communication skills for explaining technical reasoning.
Comfort working through ambiguous tasks and identifying unclear instructions.
Experience owning production code and addressing its real-world behavior.
Technical Coverage Frontend development, including React, TypeScript, and Next.js; backend development, including Java, Go, and Node.js; and full-stack engineering.
Mobile development for Android and iOS, embedded systems, and IoT.
DevOps, platform, systems, performance, QA, automation, and security engineering.
Work Terms Remote, hourly engagements.
Project invitations specify the rate, hours, client, and other engagement details.
Matching may occur within a week or take several months, depending on available client projects and your specialty.
Compensation Compensation typically ranges from $70 to $150 per hour, with project rates set according to scope and depth.
Eligibility Complete registration once to remain eligible for all qualified expert networks and potential matching projects.
Application Process Submit your resume and confirm your work location.
Complete a short AI interview, approximately 20 minutes.
Your background is verified before you are added to the software engineering talent pool.
Completing the domain-expert interview and joining each network you qualify for can improve your likelihood of being matched.
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.