ML Rigor Auditor for Experimental Tasks
Mercor
Mercor is seeking a reviewer to evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate frontier AI models. You will assess experiment design, model-selection reasoning, and evaluation methodology, and deliver rubric-based written feedback. The role emphasizes careful data-quality practices, critique of ML claims against evidence, and the ability to reproduce results across experiments. #J-18808-Ljbffr Mercor
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Rigor Auditor for Experimental Tasks in San Francisco, CA vacancy
- Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models... .... Basic Qualifications 3+ years hands‑on applied/experimental ML (experiment design, model selection, hyperparameter tuning...Suggested
- Obsidian is seeking an evaluation-focused ML scientist to assess applied ML rigor in frontier AI research settings. You will critique experiment designs, model-selection reasoning, and evaluation methodologies, delivering rubric-based feedback to improve reproducibility...Suggested
$117k - $160.6k
...are too, let's talk.As a Senior IT Internal Auditor, you will serve as a technical lead and... ...requires a practitioner who can move beyond task execution: you will contextualize control... ...efficiency, automate workpapers, and evaluate AI/ML controls and governanceContribute to the...SuggestedWork at officeLocal areaWorldwideFlexible hoursShift work2 days per week- ...certificationExperience auditing SOX-in-scope IT controlsFamiliarity with cloud environments such as AWS, Azure, or GCPExposure to AI/ML governance or model risk conceptsExperience auditing software or product development for financial products (e.g., payments, lending,...SuggestedFull timeWork at officeLocal areaRemote workRelocationFlexible hours
- Overnight Hotel Self Parking Lot Auditor - San Francisco, CA San Francisco, CA, USA Job Description Posted Tuesday, July 28, 2026 at 4:... ...Responsibilities Support evolving business needs by completing other tasks as assigned, attending required meetings and training, and...SuggestedHourly payMinimum wageFull timePart timeLocal areaShift workNight shiftWeekend work
- ...~1-3 years experience preferred Junior Compliance Officer Tasks At a minimum, the Junior Compliance Officer shall perform the... ...queries, prepare spreadsheets, and conduct research. Assist Auditors and Criminal Investigators with evaluation of Employment...Full timeContract workFor contractorsLocal areaRemote workWeekend work
SGI Global
San Francisco, CA3 days ago $54k - $58k
...~ None. Duties/Responsibilities: Analyze reports for detailed findings; coordinate all analytical, technical and research tasks. Manipulate and organize data via Excel. Gather payroll and other data from employers either at their location and/or remotely...Work at officeLocal areaRemote workVisa sponsorshipWork visaFlexible hoursDay shiftMiller Kaplan Arase LLP
San Francisco, CA16 days ago- Evaluate the quality, correctness, and production-readiness of Kubernetes tasks used to train and evaluate a frontier AI lab's models. You'll assess cluster-operations scenarios, manifest correctness, and failure-mode troubleshooting — and provide clear, rubric-based written...
- ...and a commitment to innovation to help clear the way for millions of Americans to achieve more.About the RoleWe are looking for a Sr Auditor who will thrive in a fast-paced environment and adapt easily to change. In this role, you will bring internal audit and financial...Full timeWork at officeLocal areaRemote workRelocationFlexible hours
- ...office location 4 days per week; Lambda’s designated work from home day is currently Tuesday. We are seeking an experienced Senior Auditor - Finance and Operations to join our Internal Audit function, reporting directly to the Head of Internal Audit. This role is calibrated...Contract workWork at officeLocal areaWork from homeFlexible hours
Lambda
San Francisco, CA5 days ago $166k - $170k
...SecurityPal, Inc. San Francisco, CA TITLE: Information Security Auditor DUTIES: Lead a team that provides comprehensive vendor assessments to evaluate security risks and compliance with standards and regulations; Serve as the main point of contact for...Work experience placementRemote work8848M LLC
San Francisco, CA2 days ago$124k - $280k
Industry/SectorNot ApplicableSpecialismBusiness ControlsManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs an IT Audit Controls/SOX - Senior Manager, you will play a pivotal role in delivering comprehensive internal audit services across various industries...Full timeH1b$99k - $232k
Industry/SectorNot ApplicableSpecialismBusiness ControlsManagement LevelManagerJob Description & SummaryThe OpportunityAs an IT Audit Controls/SOX Manager, you will play a pivotal role in delivering comprehensive internal audit services across various industries. Within...Full timeH1b$101k - $155k
...Manager builds and runs Tanium's audit program, leading a team of auditors, developing audit methodology, and driving remediation of... ...work within a defined timeframe and budgetConfident delegating tasks, and consistent in tracking and monitoring progress against milestonesKnowledgeable...Full timeLive inWorldwideFlexible hours$119k - $299.93k
...Bachelor's degree- At least 6 years of experience- At least one of the following: an active CPA license or Certified Information Systems Auditor (CISA) certificationWhat Sets You Apart- Preference for a Bachelor's degree in at least one of the following fields of study:...Full timeH1b- Complify AI is transforming SOX compliance with AI, and we are seeking a client-facing professional to join our fast-growing startup backed by Silicon Valley investors. You’ll work directly with CFOs, CAEs, and audit leaders at public companies to streamline control testing...
$99k - $252.45k
...Bachelor's degree- At least 4 years of experience- At least one of the following: an active CPA license or Certified Information Systems Auditor (CISA) certificationWhat Sets You Apart- Preference for a Bachelor's degree in at least one of the following fields of study:...Full timeH1b$78.68k - $157.88k
Position Summary Audit and Assurance Information Technology Auditor - Senior Consultant Do you thrive in times of disruption? Have a passion for turning challenges and opportunities into long-term competitive advantages? As a Senior Consultant in Deloitte Audit and...Work experience placementWork at officeLocal areaVisa sponsorship- Formic is hiring for a Finance role focused on audit readiness, month-end close, and strong general ledger discipline. You will support audits, maintain reconciliations, and partner cross-functionally to improve financial processes across a fast-paced organization. The...
Blackhornvc
San Francisco, CA2 days ago - ...Job Description Job Description Medical Auditor Job Type: Contractor Location: Remote Job Overview We are seeking experienced Medical Auditors with strong expertise in outpatient professional fee coding and coding audits , preferably within academic medical...For contractorsRemote work
YO AI Labs
San Francisco, CA14 days ago - ...Job Description Job Description Senior Auditor Employment Type: Full Time, Mid-level Department: Financial Services CGS is seeking a Senior Auditor who will assist the district legal staff by conducting medical claims data analysis, forensic investigations...Full timeFlexible hours
Contact Government Services, LLC
San Francisco, CA14 days ago - ...and regulated businesses trust us with the evidence behind their audit and risk decisions. We turn it into reviewable results and auditor-ready workpapers in minutes instead of days. The Opportunity We are hiring Audit & Control Specialists to own how customers deploy...Work at officeShift work
Petual
San Francisco, CA10 days ago - The Union Benefits Auditor is responsible for conducting detailed audits and reconciliations of union benefit records, employee eligibility data, monthly invoices, and benefit-related transactions to ensure accuracy, compliance, and adherence to applicable Collective Bargaining...Contract work
- A leading government services firm in California seeks a Senior Auditor to conduct medical claims data analysis and forensic investigations. The role requires at least 5 years of experience in forensic financial accounting or litigation consulting, with a focus on analyzing...
- UG2 is seeking a Union Benefits Auditor to conduct comprehensive audits of union benefit records, employee eligibility, and monthly invoices. The role involves reconciling data across multiple union and internal systems, investigating discrepancies, and collaborating with...
- auditor sustainable seafood chain of custody Emeryville, California Full Time Audit Coordination Schedule and confirm audit date with... ...written communication experience Strong organization, multi-tasking, and prioritization skills Proficient with business software,...Full timeWork experience placement
- The Controller is the chief financial officer and auditor for the City and County of San Francisco (City). The Office of the Controller’s mission is to ensure the City’s financial integrity and promote efficient, effective and accountable government. Its vision is to be...Full timeFor contractorsWork experience placementWork at officeLocal areaImmediate startShift work
- ThirdChannel is seeking a freelance Brand Representative to conduct in-store audits, merchandising, and quality control visits for a leading wireless brand. You will act as liaison between the brand and retail stores, performing recurring visits to ensure product quality...Contract workFreelanceImmediate startFlexible hours
- BDO is seeking an Assurance Senior focused on Third Party Attestation to lead SOC and related attestation engagements. Responsibilities include planning examinations, documenting control environments, and supervising staff while applying professional standards across diverse...
- Location San Francisco, CA Remote Available Posted Aug 19, 2026 Pharmatech Associates is seeking an experienced GLP Auditor, Contract/Project Consultant to support upcoming audits for our clients conducting regulated nonclinical research and animal studies Position...Contract workLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Rigor Auditor for Experimental Tasks. Be the first to apply!
Related searches
- information system auditor San Francisco, CA
- coding auditor San Francisco, CA
- security auditor San Francisco, CA
- energy auditor San Francisco, CA
- medical records auditor San Francisco, CA
- inventory auditor San Francisco, CA
- remote auditor San Francisco, CA
- data auditor San Francisco, CA
- sales auditor San Francisco, CA
- auditor San Francisco, CA