About this opportunity
Confidential lists this Software Engineer for AI Training and Evaluation opportunity in Lexington, Massachusetts. Review the employer’s description below for duties, qualifications and application requirements.
Job description
Apply your production engineering judgment to help evaluate and improve frontier AI systems. Your expertise will inform the standards used to assess AI-generated software solutions across real-world engineering scenarios.
This is an ongoing talent pool for AI training and evaluation work, not a guaranteed immediate project opening. Projects may begin on short notice, and candidates are contacted when a suitable engagement becomes available.
Key Responsibilities Create engineering problems based on systems you have shipped, including requirements, constraints, failure modes, and reference answers for evaluation.
Review AI-generated code and technical designs for edge-case handling, appropriate complexity, and whether tests validate the behavior they claim to cover.
Identify production risks that may not appear in review, including concerns related to concurrency, scale, error handling, and operating cost.
Qualifications Professional experience building and shipping software.
Strong written communication skills and the ability to clearly explain technical reasoning.
Comfort working through ambiguous tasks and identifying unclear instructions.
Production code ownership and practical experience addressing its real-world behavior are valued more than where you trained.
Technical Areas Frontend engineering, including React, TypeScript, and Next.js.
Backend engineering, including Java, Go, and Node.js, as well as full-stack development.
Mobile engineering for Android and iOS, embedded systems, and IoT.
DevOps, platform engineering, systems and performance engineering.
QA, automation, and security engineering.
Work Terms Remote, hourly engagements.
Specific project invitations identify the applicable rate, hours, and client.
This listing itself does not make acceptance or rejection decisions. A decision is made only for a specific project invitation.
Timing depends on available client projects and may range from about one week to several months.
Compensation Rates for software engineering projects range from $70 to $150 per hour, depending on project scope and depth.
Application Process Submit your resume and confirm your work location.
Complete a short AI interview, approximately 20 minutes total.
Your background will be verified before you are added to the software engineering talent pool.
Completing the domain-expert interview and joining each network for which you qualify can improve your chances of being matched.
Eligibility Registering once makes you eligible to be considered across all networks for which you qualify.
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.