SWE-Bench Task Auditor
$70 - $90 per hourTemporary
Gridnaut Recruiting
Gridnaut Recruiting is hiring a remote SWE-Bench Task Auditor contractor (pay $70–$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years professional software engineering; Merged PRs or maintainer in open-source projects; Proficient in Python plus Java, Go, TypeScript, or C++; Experience auditing code, test harnesses, Docker; Familiarity with SWE-Bench or major Python OSS.
Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the SWE-Bench Task Auditor in Remote vacancy
$70 - $90 per hour
...contributors review code, assess model outputs, and evaluate benchmark tasks so AI systems can become more accurate, reliable, and useful... ...model evaluation. The Role OpenTrain is recruiting a SWE-Bench Task Auditor to evaluate repository-level software-engineering benchmark...SuggestedHourly payContract workPart timeFor contractorsRemote workFlexible hours$70 - $90 per hour
...Role Overview Help ensure software engineering benchmark tasks are accurate, reproducible, and resistant to invalid solutions. You... ...TypeScript, or C++. Preferred Qualifications Familiarity with SWE Bench Verified or similar repository based benchmarks. Maintainer...SuggestedHourly payRemote workSaidGig
Remote24 days ago$70 - $90 per hour
Gridnaut Recruiting is hiring a remote SWE-Bench Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years professional software engineering; Merged PRs or maintainer in open-source projects; Proficient...SuggestedTemporary workFor contractorsRemote workGridnaut Recruiting
Remote11 days ago$60 per hour
Meridial is seeking a SWE-Bench Task Auditor for a freelance AI trainer project. The role involves auditing tasks used to train AI systems, ensuring technical rigor, practicality, and accuracy across specialized software engineering domains. You will provide clear feedback...SuggestedRemote jobHourly payFor contractorsFreelance$70 - $90 per hour
...correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab's models. You'll... .../ C++) Preferred Qualifications Familiarity with SWE-Bench (Verified) or similar repository benchmarks Maintainer history...SuggestedContract work$70 - $90 per hour
...SWE-Bench Task Auditor is a remote review track for evaluating AI outputs across audit workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so the modeling team...Remote jobFor contractorsWork experience placement10 hours per week$70 - $90 per hour
Gridnaut Recruiting is hiring a remote Kubernetes Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years production Kubernetes (EKS/GKE/AKS/self-managed); Deep cluster internals knowledge (CNI, DNS,...Temporary workFor contractorsRemote workGridnaut Recruiting
Remote11 days ago$70 - $90 per hour
...Role Overview Assess Kubernetes tasks for quality, technical correctness, and production readiness as they are used to train and evaluate advanced AI models. You will review cluster-operations scenarios, manifest accuracy, and failure-mode troubleshooting, then deliver...Hourly payRemote workSaidGig
Remote24 days ago- ...Evaluate the quality, correctness, and production-readiness of Kubernetes tasks used to train and evaluate a frontier AI lab's models. You'll assess cluster-operations scenarios, manifest correctness, and failure-mode troubleshooting , and provide clear, rubric-based written...Temporary work
Mercor
Remote14 days ago $70 - $90 per hour
Gridnaut Recruiting is hiring a remote AWS Serverless & Infrastructure-as-Code Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years AWS serverless (multi-service) experience; Strong AWS CDK, CloudFormation...Temporary workFor contractorsLocal areaRemote workGridnaut Recruiting
Remote11 days ago$70 - $90 per hour
...Role Overview Help strengthen the applied machine-learning tasks used to train and evaluate advanced AI models. You will assess task quality, correctness, and methodological rigor, with particular attention to experiment design, model-selection reasoning, and evaluation...Hourly payRemote workSaidGig
Remote24 days ago- ...Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness...Temporary workLocal area
Mercor
Remote14 days ago - ...Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology , and provide clear, rubric-based...Temporary work
Mercor
Remote14 days ago $70 - $90 per hour
...Role Overview Review AWS serverless and infrastructure-as-code tasks that support the training and evaluation of advanced AI models. You will assess the quality, technical correctness, and cloud-architecture soundness of multi-service implementations, then deliver clear...Hourly payLocal areaRemote workSaidGig
Remote24 days ago- Meridial is seeking an experienced AWS Serverless and IaC Auditor to independently review AI training tasks and ensure technical rigor. This remote freelance project requires deep expertise in Lambda, Terraform, and CloudFormation to validate pipelines, configurations,...Remote jobFreelance
$60 per hour
Meridial is seeking an experienced specialist to audit AWS Trainium and NKI tasks used for AI training. This remote freelance role focuses on evaluating task accuracy, realism, and reproducibility, with actionable feedback on acceleration inefficiencies and kernel issues...Remote jobHourly payFor contractorsFreelance$40 - $66 per hour
...Coordinate with cross functional departments and work with external auditors as designated by engagement terms, prepare and review responses... ..., approaches and processes is required. -Ability to prioritize tasks and manage projects effectively. Demonstrate accuracy and...Full timePart timeWork experience placementLive inWork from homeRelocationShift workDay shiftSanford Health
Sioux Falls, SD2 days ago- ...Determine proper technical and security configuration of technical systems and operations in infrastructure and IT.Assist outside auditors with tasks to expedite completion.Keep abreast of current technologies and IT best practices.QualificationsBachelor’s degree in MIS,...Full timeContract workWork experience placementRemote workWork from homeWorldwide
$80k - $120k
...prioritize assurance work, strategic initiatives, and required tasks with flexibility to shift with department priorities. Assigned... ...Internal Audit Leadership, Executive Management, and External Auditors. Support responses to regulatory requests.Participate in working...Full timeImmediate startRemote workShift work- ...Make Tomorrow Better.Role Overview:Could you be our next Senior IT Auditor? Globe Life is looking for a Senior IT Auditor to join the team!... ....Assist Audit Management in performing IT risk assessment tasks in preparation and execution of the annual audit plan.Plan and execute...Full timePart timeWork experience placementWork at officeRemote workWork from homeMonday to FridayShift work
$70 - $90 per hour
Gridnaut Recruiting is hiring a remote AI Developer Trace Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years professional software development experience; Used AI coding tools (Cursor, Copilot, Claude...Temporary workFor contractorsRemote workGridnaut Recruiting
Remote11 days ago$89.66k - $134.48k
...more about who we are at Point32Health.Job SummaryThe IT Senior Auditor will report to the Internal Audit IT Senior Manager and provide... ...group of peopleAbility to prioritize work by distinguishing between tasks that are time‑sensitive (urgent) and those that can be scheduled...Full timeWork at officeWork from homeFlexible hours$70 - $90 per hour
Gridnaut Recruiting is hiring a remote ML Challenge Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Remote contractor engagement supporting a leading AI lab.; Remote AI evaluation / expert contributor...Hourly payContract workFor contractorsRemote workFlexible hours- ...Physician Coding Auditor Physician Coding Auditor is responsible for reviewing and accurately... ...necessary to complete all assigned tasks and accomplish their goals. Candidates... ...permanent – no contracts or sitting on a "coding bench" ~ Generous paid time off, holiday pay,...Permanent employmentLocal areaRemote workFlexible hours
MedKoder
United States1 day ago $71.09k - $118.5k
...Get to Know the Opportunity: Position will assist Associate Auditor, Senior Auditor or Audit Manager in the planning and execution of... ...time management and the ability to effectively balance multiple tasks Ability to complete work with limited instructions, yet know...Part timeWork experience placementLocal areaFlexible hours- ...provide professional written interpretations of findings. A flexible, structured, and logical approach; being able to handle multiple tasks, think, and plan ahead and build in contingencies as required. Additional Information MSX International is an Equal Employment...Local areaFlexible hours
MSX International
Madison, WI3 days ago $61.55k - $96.51k
...Premium Auditor The Premium Auditor is responsible for independently conducting detailed audits of policyholders' operations and financial... ...and manage multiple assignments. ~ Effectively multi-task and work in a fast-paced, team-oriented environment ~ Written,...Temporary workWork at officeLocal areaRemote workFlexible hoursThe Silver Lining
Madison, WI4 days ago$53.76k - $56k
...compliance areas of the liquor control laws and regulations. The auditor performs audits and/or reviews the work of the compliance team... ...strength and be able to perform a variety of repetitive physical tasks associated with completing an inventory count including, but not...Work at officeRemote workMonday to FridayState of Missouri
Jefferson City, MO2 days ago$65k - $80k
...based audit plan. The Information Technology/Information Security Auditor will assist the Audit Department in meeting the strategic... ...will work closely with the in-charge auditor, performing specific tasks during the planning, fieldwork, and reporting audit phases. The...Temporary workWork at officeRemote workFlexible hours$4,300 - $4,600 per month
...AUDITOR I Position No.: 125-30972 Salary: $4,300 - $4,600 per month Closing Date: October 16, 2026 Status... ...skills, and demonstrate ability to perform standard office tasks and operate standard office equipment. ~ Successful completion...Full timeWork experience placementWork at officeLocal areaNight shiftState of North Dakota
Bismarck, ND1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SWE-Bench Task Auditor. Be the first to apply!
