SWE-Bench Task Auditor
$70 - $90 per hourTemporary
Gridnaut Recruiting
Gridnaut Recruiting is hiring a remote SWE-Bench Task Auditor contractor (pay $70–$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years professional software engineering; Merged PRs or maintainer in open-source projects; Proficient in Python plus Java, Go, TypeScript, or C++; Experience auditing code, test harnesses, Docker; Familiarity with SWE-Bench or major Python OSS.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the SWE-Bench Task Auditor in Remote vacancy
$70 - $90 per hour
...Role Overview Help ensure software engineering benchmark tasks are accurate, reproducible, and resistant to invalid solutions. You... ...TypeScript, or C++. Preferred Qualifications Familiarity with SWE Bench Verified or similar repository based benchmarks. Maintainer...SuggestedHourly payRemote workSaidGig
Remotea month ago- ...correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab's models. You'll... .../ C++) Preferred Qualifications • Familiarity with SWE-Bench (Verified) or similar repository benchmarks • Maintainer history...SuggestedTemporary work
Mercor
Remotea month ago $70 - $90 per hour
...SWE-Bench Task Auditor is a remote review track for evaluating AI outputs across audit workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so the modeling team...SuggestedRemote jobFor contractorsWork experience placement10 hours per week$70 - $90 per hour
Gridnaut Recruiting is hiring a remote Kubernetes Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years production Kubernetes (EKS/GKE/AKS/self-managed); Deep cluster internals knowledge (CNI, DNS,...SuggestedTemporary workFor contractorsRemote workGridnaut Recruiting
Remotea month ago$70 - $90 per hour
...Role Overview Assess Kubernetes tasks for quality, technical correctness, and production readiness as they are used to train and evaluate advanced AI models. You will review cluster-operations scenarios, manifest accuracy, and failure-mode troubleshooting, then deliver...SuggestedHourly payRemote workSaidGig
Remotea month ago- ...Evaluate the quality, correctness, and production-readiness of Kubernetes tasks used to train and evaluate a frontier AI lab's models. You'll assess cluster-operations scenarios, manifest correctness, and failure-mode troubleshooting , and provide clear, rubric-based written...Temporary work
Mercor
Remotea month ago $70 - $100 per hour
Meridial is seeking an experienced AWS Serverless & IaC Auditor for a Freelance AI Trainer Project. The role is remote worldwide, with duties focusing on auditing tasks used to train and evaluate AI systems, ensuring technical rigor and reproducibility. You will assess...Remote jobHourly payFreelanceWorldwide- ...Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology , and provide clear, rubric-based...Temporary work
Mercor
Remotea month ago $70 - $90 per hour
...Role Overview Help strengthen the applied machine-learning tasks used to train and evaluate advanced AI models. You will assess task quality, correctness, and methodological rigor, with particular attention to experiment design, model-selection reasoning, and evaluation...Hourly payRemote workSaidGig
Remotea month ago- ...Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness...Temporary workLocal area
Mercor
Remotea month ago $70 - $90 per hour
Gridnaut Recruiting is hiring a remote AWS Serverless & Infrastructure-as-Code Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years AWS serverless (multi-service) experience; Strong AWS CDK, CloudFormation...Temporary workFor contractorsLocal areaRemote workGridnaut Recruiting
Remotea month ago$70 - $90 per hour
...Role Overview Review AWS serverless and infrastructure-as-code tasks that support the training and evaluation of advanced AI models. You will assess the quality, technical correctness, and cloud-architecture soundness of multi-service implementations, then deliver clear...Hourly payLocal areaRemote workSaidGig
Remotea month ago- ...Coordinate with cross functional departments and work with external auditors as designated by engagement terms, prepare and review responses... ..., approaches and processes is required. -Ability to prioritize tasks and manage projects effectively. Demonstrate accuracy and...Full timePart timeWork experience placementLive inWork at officeWork from homeShift workDay shift
Black Hills Surgical Hospital
Sioux Falls, SD22 hours ago $80k - $120k
...prioritize assurance work, strategic initiatives, and required tasks with flexibility to shift with department priorities. Assigned... ...Internal Audit Leadership, Executive Management, and External Auditors. Support responses to regulatory requests.Participate in working...Full timeImmediate startRemote workShift workColumbia Bank
Hillsboro, OR5 days ago- ...Determine proper technical and security configuration of technical systems and operations in infrastructure and IT.Assist outside auditors with tasks to expedite completion.Keep abreast of current technologies and IT best practices.QualificationsBachelor’s degree in MIS,...Full timeContract workWork experience placementRemote workWork from homeWorldwide
Transamerica
Cedar Rapids, IA1 day ago - ...Make Tomorrow Better.Role Overview:Could you be our next Senior IT Auditor? Globe Life is looking for a Senior IT Auditor to join the team!... ....Assist Audit Management in performing IT risk assessment tasks in preparation and execution of the annual audit plan.Plan and execute...Full timePart timeWork experience placementWork at officeRemote workWork from homeMonday to FridayShift work
Globe Life
Mckinney, TX3 days ago $89.66k - $134.48k
...more about who we are at Point32Health.Job SummaryThe IT Senior Auditor will report to the Internal Audit IT Senior Manager and provide... ...group of peopleAbility to prioritize work by distinguishing between tasks that are time‑sensitive (urgent) and those that can be scheduled...Full timeWork at officeWork from homeFlexible hoursPoint32Health
Canton, MA5 days ago$70 - $90 per hour
Gridnaut Recruiting is hiring a remote AI Developer Trace Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 3+ years professional software development experience; Used AI coding tools (Cursor, Copilot, Claude...Temporary workFor contractorsRemote workGridnaut Recruiting
Remotea month ago- ...Physician Coding Auditor Physician Coding Auditor is responsible for reviewing and accurately... ...necessary to complete all assigned tasks and accomplish their goals. Candidates... ...permanent – no contracts or sitting on a "coding bench" ~ Generous paid time off, holiday pay,...Permanent employmentLocal areaRemote workFlexible hours
MedKoder
United States5 days ago $22.9 per hour
...Alma Foods is accepting applications for a FSQ Auditor III Lead. This position will work on 3rd shift (9:30PM-5:30AM) Sunday through Thursday... ...to twist and bend the body as necessary to perform job related tasks. The ability to kneel/squat/climb as necessary to complete...Hourly payFull timeTemporary workWork visaShift workNight shiftWeekend work$71.09k - $118.5k
...Get to Know the Opportunity: Position will assist Associate Auditor, Senior Auditor or Audit Manager in the planning and execution of... ...time management and the ability to effectively balance multiple tasks Ability to complete work with limited instructions, yet know...Part timeWork experience placementLocal areaFlexible hours$60k - $75k
...Join AmTrust Insurance’s Premium Auditor Team! The Premium Auditor is responsible for conducting virtual audits of moderate complexity... ...and verbal communication skills. ~ Ability to effectively multi-task and work in a fast-paced, team-oriented environment. Preferred...Work at officeRemote workMonday to FridayFlexible hoursWeekend workAmTrust Financial Services, Inc.
United States1 day ago$90k - $100k
...Senior Internal Auditor - Financial Controls Location: Arlington, VA, US, 22202 VA, US Job ID: 115244 The salary range for this... ...Strong project management skills, with the ability to prioritize tasks and meet deadlines in a timely manner. Excellent communication...Local areaRemote workFlexible hoursLeonardo DRS
Arlington, VA3 days ago$70 - $90 per hour
Gridnaut Recruiting is hiring a remote ML Challenge Task Auditor contractor (pay $70-$90/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Remote contractor engagement supporting a leading AI lab.; Remote AI evaluation / expert contributor...Hourly payContract workFor contractorsRemote workFlexible hours$53.76k - $56k
...compliance areas of the liquor control laws and regulations. The auditor performs audits and/or reviews the work of the compliance team... ...strength and be able to perform a variety of repetitive physical tasks associated with completing an inventory count including, but not...Work at officeRemote workMonday to FridayState of Missouri
Jefferson City, MO6 hours ago$61.55k - $96.51k
...Premium Auditor The Premium Auditor is responsible for independently conducting detailed audits of policyholders' operations and financial... ...and manage multiple assignments. ~ Effectively multi-task and work in a fast-paced, team-oriented environment ~ Written,...Temporary workWork at officeLocal areaRemote workFlexible hoursThe Silver Lining
Madison, WI3 days ago- ...Auditor Date: Oct 2, 2026 Location: Saint Louis, MO, US, 63101 Company: Spire Inc. Summary... ...PCAOB auditing standards Able to quickly learn new processes and tasks Strong critical thinking skills Strong analytical skills...Work at officeLocal areaRemote workMonday to FridayFlexible hours
Spire
Saint Louis, MO5 days ago - ...Group is listed on Euronext Paris. Position-SENIOR INTERNAL AUDITOR Duration-Fulltime Description Position Summary The Senior... ...as well as manage audit teams on assigned missions, including task allocation, on‑the‑job coaching, and continuous knowledge...Full timeRemote workWorldwide
Atos
United States3 days ago - ...Coordinating the backup of data to tape in collaboration with the tape backup engineer • Maintaining written documentation of processes and tasks • Preparing metrics reporting • Assisting in automation of current processes using batch files • Coordination of activities...Hourly payContract workWork at officeLocal areaRemote workWork from homeRelocation
Fortira
Princeton, NJ2 days ago - ...provide professional written interpretations of findings. · A flexible, structured, and logical approach; being able to handle multiple tasks, think, and plan ahead and build in contingencies as required. Additional Information MSX International is an Equal Employment...Local areaFlexible hours
MSX International
Wisconsin5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SWE-Bench Task Auditor. Be the first to apply!
