SWE-Bench AI Task Auditor - Freelance AI Trainer Project

Job Application for SWE-Bench AI Task Auditor - Freelance AI Trainer Project at Meridial
Back to jobs
SWE-Bench AI Task Auditor - Freelance AI Trainer Project
World Wide - Remote
Project Overview
We are sourcing experienced technical specialists in Software Engineering (SWE-Bench) to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.
Project Deliverables & Scope
Task Evaluation:
Assess whether software engineering tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
Technical Auditing & Feedback:
Provide clear, actionable feedback on any identified codebase integration issues, test failures, or logic errors within the tasks.
Required Expertise
Demonstrable professional experience and deep technical knowledge in software engineering (including complex codebase navigation, real-world application development, and SWE-Bench standards).
(Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).
Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.
We offer a pay rate of $60 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Employment type:
Freelance Contract
Workplace type:
Remote
Apply for this job
*
indicates a required field
First Name
*
Last Name
*
Email
*
Phone
Country
*
Phone
*
Location (City)
*
Locate me
Resume/CV
*
Attach
Attach
Dropbox
Google Drive
Enter manually
Enter manually
Accepted file types: pdf, doc, docx, txt, rtf
Education
School
Select...
Degree
*
Select...
Discipline
*
Select...
Start date year
*
End date year
*
Add another
What country are you currently a resident of?
*
Select...
If you are currently based in United States, please confirm your current state of residence. If you are based outside of the United States, select "I am not located in the United States".
*
Select...
LinkedIn Profile
*
Please acknowledge that you have read and agree to our Privacy Policy.
*
Yes
By clicking "Submit Application", you agree to Invisible's
Privacy Policy
.
Submit application
Powered by
Greenhouse