Finance Domain Researcher — AI Model Evaluation [Remote]
AuraOne Human Data
- Remote job
Finance Domain Researcher — AI Model Evaluation is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so the modeling team can train on it.
Why this role matters
Finance and risk workflows leave no room for fuzzy reasoning. AuraOne uses experienced finance-and-risk professionals to grade AI outputs the way an audit reviewer would — with citations, severity tags, and the corrected calculation alongside the original.
Responsibilities
- Review AI outputs against current finance and risk standards, regulations, and firm policy for Finance Domain Researcher — AI Model Evaluation assignments.
- Re-perform calculations and flag rounding, classification, or treatment errors.
- Tag compliance, reconciliation, and disclosure issues with structured severity scores.
- Capture the corrected workpaper or narrative so the modeling team can train on it.
- Adjudicate disputed treatments against published standards or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Direct working experience with finance and risk on real engagements, transactions, or audits for Finance Domain Researcher — AI Model Evaluation work.
- A CPA, CFA, or ACA. A comparable credential or equivalent applied experience also works.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites standards, regulations, or firm policy.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Re-perform a finance and risk calculation produced by a model and flag any rounding or classification errors.
- Grade a model's narrative reasoning on a complex transaction and rate the citation quality.
- Adjudicate a disputed treatment between two reviewers using current standards.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Big Four, bulge-bracket, or in-house controller / risk experience.
- Familiarity with AI-assisted close, audit, or risk tooling and its failure modes.
- Bilingual experience for cross-jurisdiction reviews.
Skills
- Financial analysis
- Audit-grade review
- Regulatory standards
- Risk assessment
- Finance and risk
- Finance
- AI model evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$50 per hour
...Category: Legal & Policy AI Evaluation · Pay: $50 / hr · Location: Remote — US-eligible · Contractor Legal Domain Researcher — AI Model Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory...SuggestedHourly payContract workFor contractorsRemote work10 hours per week$100 per hour
...Role Overview Apply your finance expertise to help improve AI models across complex financial problem... ..., portfolio management, research, trading, quantitative finance... ...Key Responsibilities Evaluate language models in finance domains where performance needs improvement...SuggestedHourly payContract workRemote work10 hours per weekFlexible hours- ...Apply your investment expertise to improve AI systems’ financial reasoning across... ...generated outputs on valuation, financial modeling, markets, and investment analysis. Create... ...assumptions in model responses. Provide domain feedback that directly shapes model...SuggestedHourly payFor contractorsRemote work
$100 per hour
...Role Overview Apply your finance expertise to improve AI-driven financial applications... ..., real-world analysis, evaluation, and feedback. This remote... ...financial data, reports, and model outputs using detailed... ...due-diligence reports, and research summaries. Evaluate outputs...SuggestedHourly payContract workPart timeFor contractorsRemote work$100 per hour
...Apply deep financial domain expertise to improve AI-driven financial... ...annotating, and refining model outputs and prompts.... ...emphasis is on your finance subject matter... ...Develop, refine, and evaluate prompts related to financial... ...reports, and research summaries. Evaluate...SuggestedHourly payPart timeFor contractorsRemote work$50 per hour
...the performance of large language models on real-world finance tasks by evaluating model outputs, designing... ...rubrics, and working directly with AI researchers to shape training and evaluation.... ...This role focuses on applying deep domain expertise across capital markets,...Hourly payContract workRemote work10 hours per weekFlexible hours$50 - $60 per hour
...is seeking an Investment Partner to join their remote team in the United States. This role involves training AI models, measuring their progress, and evaluating outputs to enhance their quality. Ideal candidates should possess expert-level financial reasoning and proficiency...Hourly payRemote workFlexible hours$70 - $90 per hour
...Role Overview Evaluate vulnerability reproduction and remediation tasks used to train and assess frontier AI models. You will determine whether CVE reproductions faithfully reflect... ...penetration testing, or vulnerability research. ~ Strong knowledge of CVE taxonomy and...Remote jobHourly pay- ...Role Overview Apply research-grade expertise to help evaluate and improve AI reasoning across technical and humanities disciplines, including STEM, English, literature, and journalism. This remote contract role focuses on producing rigorous training data, evaluations...Hourly payContract workFor contractorsRemote work
$40 - $90 per hour
...humanities expertise to help train and evaluate next-generation AI systems through rigorous, real-world... ...materials that shape how AI models interpret, reason, and respond. Prior... ...analytical reasoning in the humanities. Research and verify answers using primary texts...Hourly payContract workRemote work$150 per hour
...Help create expert-authored forecasting and research data that evaluates and improves AI models on real-world financial analysis. This work focuses on predicting when a named sell-side equity analyst will publish a post-catalyst research note and what that publication...Hourly payRemote work$65 - $105 per hour
...Help advance frontier AI models by bringing rigorous life sciences research judgment into task design, evaluation, and model improvement. You will work closely with an AI lab'... ...challenging evaluation sets and help develop domain-specific skills and tools with the...Hourly payFull timeFreelanceLive inRelocationRelocation package- ...seeking an independent contractor for a remote role focused on benchmark dataset projects that evaluate AI models on visual document understanding in the Energy/Utilities domain. The role requires authoring complex tasks and providing objective rubrics to assess...For contractorsRemote workFlexible hours
$90 - $110 per hour
...Apply your Canadian personal finance expertise to real-world financial workflows and evaluation tasks that help improve how AI systems understand, assess... ...work. Contribute domain expertise that helps train... ...rubric-based evaluation, model output review, or AI training...Hourly payContract workRemote work- ...Role Title: Research Engineer - Code Generation & Model Evaluation Role Type: Contractor Location: Remote micro1 is... ...expertise to help train next-generation AI systems. Your work will shape how... ...in AI is required, your domain knowledge is what matters. Scope...Temporary workFor contractorsRemote work
$110 per hour
...talent network supporting AI labs and companies with medical... ...may contribute to AI research projects by bringing real-world clinical expertise to model development and evaluation. Key Responsibilities... ...clinical scenarios. Provide domain-specific feedback that advances...Hourly payContract workRemote work$100 per hour
...Halluminate is an applied AI and data company working with... ..." for AI systems (ex. modeling exercises, powerpoints, etc... ...with frontier engineering/research teams to implement and evaluate AI systems on real world financial... ...ability in core finance workflows across powerpoint...Hourly payPart timeRemote work$60 - $90 per hour
...judgment to improve how advanced AI models reason through real-world... ...work. You will partner with AI research and program management teams... ..., and create rigorous evaluations grounded in industry practice... ...and controls. Help develop domain-specific tools with the research...Hourly payFull timeRemote work- ...creative and technical talent with leading AI research labs. The company is headquartered in... ...work options. The role focuses on evaluating AI-generated responses for safety, accuracy... ...and policy compliance across sensitive domains, and collaborating with researchers to...Remote jobContract workSummer work
$60 - $180 per hour
...Apply your finance expertise to help shape and evaluate advanced AI systems through remote, project-based... ...Train and evaluate AI models in finance. Create tasks... ...financial scenarios. Provide domain-specific feedback that supports AI research. Qualifications...Hourly payContract workRemote work$70 - $110 per hour
...Overview Shape how advanced AI systems reason about real... ...you will partner with an AI research team to evaluate medical knowledge tasks, define... ...that measure meaningful model improvement. Key Responsibilities... ...researchers and adjacent-domain specialists to calibrate...Hourly payFull timeLive inRelocationRelocation package$40 - $125 per hour
...Finance Expert, AI Trainer (Remote)100% Remote | Part-Time or Full-Time... ...know. A leading AI research company that works with large... ...remote AI trainers and evaluate how frontier AI models handle real finance work:... ...2 to 4 hours and tests domain judgment and careful reading...Hourly payFull timeContract workTemporary workPart timeFreelanceRemote work10 hours per weekAfternoon shift- ...reasoning and computational problem solving to improve and evaluate large language models. You will design rigorous math problems, produce clear,... ...How this work supports customers Accelerate frontier AI research by contributing high quality data and evaluation...Contract workFor contractorsFreelanceRemote work
- Epoch AI seeks a Researcher to lead the evaluation of frontier AI models on real-world, open-ended office tasks. You will curate tasks, design rubrics, and run models to assess performance both quantitatively and qualitatively. The role emphasizes practical evaluation...Remote jobWork at officeFlexible hours
$70 - $90 per hour
...Role Overview Help evaluate Neuron Kernel Interface development tasks that support the training and evaluation of advanced AI models. You will assess kernel quality, numerical correctness, CUDA-to-NKI migration fidelity, and whether implementations are well suited to...Hourly payRemote work$45 - $70 per hour
Gridnaut Recruiting is hiring a remote Behavioral Health Expert, AI Safety and Model Evaluation contractor (pay $45-$70/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Behavioral health professionals (therapists, counselors, social workers...Temporary workPart timeFor contractorsRemote work$70 - $90 per hour
...Review GPU and accelerator kernel development tasks that support the training and evaluation of advanced AI models. This role focuses on assessing task quality, numerical correctness, completeness, fair performance benchmarking, appropriate scope, and whether kernels...Hourly payRemote work$60 - $80 per hour
...high-level mathematical expertise to support AI research and product development. Mathematicians in this expert network train and evaluate mathematical models, design realistic problem tasks and deliverables, and give domain-specific feedback that helps advance frontier...Hourly payContract workImmediate startRemote work$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Remote jobHourly payWork from homeFlexible hours- Prolific is seeking Biology Experts and Life Science Professionals to join an expert network that evaluates and trains AI models. This role involves reviewing AI-generated scientific content for accuracy and validation, requiring candidates with a BS, MS, or PhD in relevant...Remote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Finance Domain Researcher — AI Model Evaluation [Remote]. Be the first to apply!





