Finance SME - AI Evaluation Expert
Mercor
Join a leading AI lab\'s cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. 1. Overview Join a leading AI lab\'s cutting-edge GenAI team and help build foundational AI models from the ground up. We\'re seeking talented Finance subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating AI model outputs against rubrics to bring rigor and real-world financial judgment to our AI training data. This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce. 2. Key Responsibilities Guide research and engineering teams to close knowledge gaps in financial reasoning, analysis, and decision-making. Design challenging, domain-relevant finance tasks and write accurate, well-reasoned solutions grounded in real financial practice. Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality. Develop and refine evaluation guidelines and scoring rubrics specific to finance tasks. Collaborate with other subject matter experts to ensure consistency and accuracy in training data. 3. Core Qualifications 8+ years of dedicated professional experience in finance (e.g., investment banking, asset management, corporate finance, financial advisory) at a recognized, top-tier organization (e.g., Goldman Sachs, JPMorgan, Morgan Stanley, BlackRock, Fidelity, Deloitte, PwC, EY, KPMG, or equivalent). Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria — mandatory; please describe this experience in your application. Demonstrable career progression (e.g., Analyst → Associate → VP/Director). Ability to engage reliably for at least 35 hours/week during weekdays. Verbal and written communication skills, problem-solving skills, and interpersonal skills. About Cincinnatus LLC: Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Equal Employment Opportunity: Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. #J-18808-Ljbffr Mercor
$60 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...solutions grounded in real retail practice. Evaluate AI model outputs against structured... ...Collaborate with other subject matter experts to ensure consistency and accuracy in training...SuggestedContract workSummer workRemote workWeekday work- 1. Overview Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models... .... We’re seeking talented Retail subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating AI model outputs against rubrics to bring rigor...SuggestedContract workWeekday work
- Volga Partners is seeking experienced finance, audit, insurance, compliance, and legal professionals to join our on-call AI Evaluation Specialists network. This remote, project-based role involves evaluating AI outputs, applying critical thinking, and providing high-quality...SuggestedRemote jobFlexible hours
- SME Careers is seeking a Tax & Audit Subject Matter Expert to review AI-generated tax and audit responses. You will create expert accounting content, ensuring accuracy... .... This remote position offers flexibility to evaluate AI outputs across time zones. #J-18808-Ljbffr...SuggestedRemote work
$130 - $160 per hour
Mercor connects elite accounting talent with AI research labs. The Accounting Expert contract is remote, offering $130-$160/hour for candidates with deep US GAAP expertise and strong close-process skills. Responsibilities include designing grading criteria for accounting...SuggestedRemote jobContract work- ...A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates...Hourly payTemporary workRemote workFlexible hours
- SME Careers is seeking a General Nurse Subject Matter Expert for a remote contractor role to review and create healthcare content... .... Your expertise will enhance AI models' accuracy in clinical... ...model integrity through rigorous evaluation of responses. #J-18808-Ljbffr SME...Remote jobFor contractors
$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models...Remote jobHourly payFlexible hours$50 per hour
Military Operations & IHL Expert.AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, heal... Show more $50.00 hourly Remote Full-time Military Operations & IHL Expert...Remote jobHourly payFull timeContract workPart timeFor contractorsApprenticeshipLocal areaWork from homeDay shift- A leading research services provider is seeking a Chemistry Expert (PhD) to evaluate complex chemistry problems and review AI-generated outputs for accuracy. This remote, hourly contract role requires deep subject-matter expertise and excellent communication skills. Candidates...Remote jobHourly payContract workFlexible hours
$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote jobHourly payWork from homeFlexible hours$175k - $250k
...2-5% margins. Despite these stakes, the finance teams behind these organizations are buried... ...is changing that. We're building the AI-native financial platform designed exclusively... ...in how health systems and medical groups evaluate risk, price contracts, forecast costs,...Full timeContract workWork at officeShift work- Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating...Remote jobWork from homeFlexible hours
$130 per hour
Mercor is seeking an Investment Banking Expert to evaluate financial models and review investment banking content for AI research. As a key contributor, you will provide structured feedback to enhance training data quality, develop evaluation benchmarks for financial tasks...Remote jobContract workBank staff10 hours per week$175k - $250k
...2-5% margins. Despite these stakes, the finance teams behind these organizations are buried... ...that. We're building the agentic AI platform designed exclusively for healthcare... ...Build proprietary benchmarks and datasets to evaluate models and AI Agents against real-world FP...Full timeWork at office- A tech company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least...Remote jobContract workFlexible hours
- ...Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems,... ...electromagnetism, use adversarial prompting to surface errors, and provide expert critique of AI responses while working with project #J-1880...Remote job
$80 - $150 per hour
Prolific in New York, NY, is seeking Medical Doctors to join our Expert Network for training and evaluating AI models. As a Domain Expert participant, you will review and rate AI-generated clinical responses, providing crucial feedback for AI development. You must hold...Remote jobHourly payWork from homeFlexible hours- ...is seeking experienced commercial finance analysts to help train an AI language model on professional presentation... .... The role focuses on building, evaluating, and refining AI-generated... ...in FP&A or related finance roles, expert-level PowerPoint skills, and strong...Remote jobImmediate startFlexible hours
$30 per hour
About Prolific Prolific is not just another player in the AI space - we are building the biggest pool of quality human... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...Remote jobWork from homeFlexible hours- ...financial services company in the United States is looking for a part-time Personal Finance Advisor / Certified Financial Planner. In this remote role, you will review financial scenarios, evaluate AI-generated advice, and provide actionable guidance on financial planning. The...Remote jobPart time
$100 per hour
Ethos is seeking experienced M&A associates to contribute to AI-driven presentation work. The role is fully remote, flexible 5-20 hours... ...and PowerPoint craftsmanship. The projects involve creating, evaluating, and refining AI-generated decks, with a focus on storyline...Remote jobImmediate startFlexible hours- LILT (Production) is seeking a Subject Matter Expert to contribute to an AI benchmarking project in the healthcare sector. You will design realistic scenarios reflecting patient care and hospital operations, ensuring context and cultural appropriateness. Ideal candidates...For contractorsFlexible hours
- A leading AI Data Services company is seeking a bilingual content evaluator to review AI-generated responses and create training content. The ideal candidate will have... ...offers flexible hours and requires at least 3 years of relevant experience. #J-18808-Ljbffr SME CareersRemote jobFlexible hours
$30 per hour
Prolific is looking for Fluent Urdu Speakers to join our Expert Network to help train AI models using real legal expertise. The role involves completing tasks that require one hour of uninterrupted work, with pay rates of up to $30/hr. Candidates must possess advanced Urdu...Remote jobWork from homeFlexible hours- Mercor, in partnership with Crossing Hurdles, is looking for a Multimedia Expert to work remotely on project-based tasks. The role involves reviewing and editing multimedia outputs, creating assets for AI model training, and providing feedback to ensure quality standards....Remote jobPart time10 hours per week
- Handshake AI is seeking experienced CAD professionals with 2+ years of hands-on experience using SolidWorks and related CAD software, and professional proficiency in Mandarin Chinese, to support AI research through flexible, hourly contract work. This ongoing, project-...Remote jobHourly payContract workFlexible hours
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work- ...Remote Mathematics Expert (AI/LLM) - 34877 Remote Mathematics Expert (AI/LLM) - 34877 1 week ago Be among the first 25 applicants Turing... ...Collaborate with LLM researchers to align problem types with evaluation goals, particularly in areas where models commonly struggle (e...Hourly payContract workPart timeFor contractorsFreelanceInternshipRemote workWork from homeWorldwideAfternoon shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Finance SME - AI Evaluation Expert. Be the first to apply!
- financial advisor training program New York, NY
- finance operations associate New York, NY
- financial planning assistant New York, NY
- entry level financial advisor New York, NY
- estate planning consultant New York, NY
- associate leveraged finance New York, NY
- financial advisor development program New York, NY
- oracle financial functional consultant New York, NY
- patient financial counselor New York, NY
- financial advisor part time New York, NY


