Finance SME - AI Evaluation Expert
Mercor
Join a leading AI lab\'s cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. 1. Overview Join a leading AI lab\'s cutting-edge GenAI team and help build foundational AI models from the ground up. We\'re seeking talented Finance subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating AI model outputs against rubrics to bring rigor and real-world financial judgment to our AI training data. This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce. 2. Key Responsibilities Guide research and engineering teams to close knowledge gaps in financial reasoning, analysis, and decision-making. Design challenging, domain-relevant finance tasks and write accurate, well-reasoned solutions grounded in real financial practice. Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality. Develop and refine evaluation guidelines and scoring rubrics specific to finance tasks. Collaborate with other subject matter experts to ensure consistency and accuracy in training data. 3. Core Qualifications 8+ years of dedicated professional experience in finance (e.g., investment banking, asset management, corporate finance, financial advisory) at a recognized, top-tier organization (e.g., Goldman Sachs, JPMorgan, Morgan Stanley, BlackRock, Fidelity, Deloitte, PwC, EY, KPMG, or equivalent). Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria — mandatory; please describe this experience in your application. Demonstrable career progression (e.g., Analyst → Associate → VP/Director). Ability to engage reliably for at least 35 hours/week during weekdays. Verbal and written communication skills, problem-solving skills, and interpersonal skills. About Cincinnatus LLC: Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Equal Employment Opportunity: Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. #J-18808-Ljbffr Mercor
- Volga Partners is seeking experienced finance, audit, insurance, compliance, and legal professionals to join our on-call AI Evaluation Specialists network. This remote, project-based role involves evaluating AI outputs, applying critical thinking, and providing high-quality...SuggestedRemote jobFlexible hours
- 1. Overview Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models... .... We’re seeking talented Retail subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating AI model outputs against rubrics to bring rigor...SuggestedContract workWeekday work
- SME Careers is seeking a remote Data Scientist to contribute to AI training content and ensure model integrity. The role involves developing AI prompts, evaluating AI responses, and testing for model reliability. Ideal candidates will have a degree in a quantitative field...SuggestedRemote jobHourly payFor contractors
$80 - $90 per hour
**Pay: $80–$90 per hour** We are seeking experienced **Biology Experts with a PhD** to contribute their subject-matter expertise to projects focused on improving and evaluating advanced AI systems. In this remote contractor role, you will apply your knowledge of biology...SuggestedHourly payFor contractorsRemote work- SME Careers is seeking a General Nurse Subject Matter Expert for a remote contractor role to review and create healthcare content... .... Your expertise will enhance AI models' accuracy in clinical... ...model integrity through rigorous evaluation of responses. #J-18808-Ljbffr SME...SuggestedRemote jobFor contractors
- ESR Healthcare is seeking a PhD & Academic Expert for a remote contractor role to evaluate AI model responses in your field, assess depth and reasoning, and craft expert-level prompts and reference answers. You will provide detailed critiques to support system improvement...Remote jobFor contractors
$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote jobHourly payWork from homeFlexible hours- Mercor is partnering with a leading AI lab to design and evaluate disability adjudication processes for frontier AI models. You will craft realistic disability scenarios, generate determinations and evidence summaries, and assess AI-generated responses against established...
- A leading research services provider is seeking a Chemistry Expert (PhD) to evaluate complex chemistry problems and review AI-generated outputs for accuracy. This remote, hourly contract role requires deep subject-matter expertise and excellent communication skills. Candidates...Remote jobHourly payContract workFlexible hours
$73 per hour
A leading AI innovation firm is seeking individuals for a flexible, project-based role focusing on creating complex tasks for evaluating AI performance. Ideal candidates should possess a postgraduate degree and relevant industry experience, especially in economics. This...Remote workFlexible hours- Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating...Remote jobWork from homeFlexible hours
- ...A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates...Hourly payTemporary workRemote workFlexible hours
- Mercor is seeking experienced musicians to evaluate generative music AI models, collaborating with a leading AI lab. You will assess AI-generated music and lyrics in Telugu and English, applying detailed quality standards across genres. Responsibilities include comparing...Part timeImmediate start
- Mercor is seeking experienced Medical and Health Services Managers to evaluate and improve AI-generated healthcare operations content and workflows. You will leverage your expertise in directing clinical services, personnel, budgets, and compliance across healthcare facilities...
- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...Remote jobContract workImmediate startFlexible hours
- Mercor is hiring Legal Experts to evaluate AI-generated responses for employment and labor law scenarios. This fully remote, hourly contract offers flexible 6-15 hours per week. You will assess accuracy, provide feedback to improve model behavior and participate in calibration...Remote jobHourly payContract workFlexible hours
$30 per hour
...About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...Remote workWork from homeFlexible hours- Mercor is seeking experienced musicians to evaluate generative music AI models in collaboration with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Punjabi and English. Requirements include...
$100 per hour
Ethos is seeking experienced M&A associates to contribute to AI-driven presentation work. The role is fully remote, flexible 5-20 hours... ...and PowerPoint craftsmanship. The projects involve creating, evaluating, and refining AI-generated decks, with a focus on storyline...Remote jobImmediate startFlexible hours- YO AI Labs is seeking PhD and academic experts to support AI research projects. You will evaluate AI model responses across technical and humanities disciplines, using rigorous research methods and high standards of academic writing. As a remote contractor, you will create...Remote jobFor contractors
- Stanford Health Care is seeking a Business Applications Platform Expert (Strata) to optimize and manage the Strata decision-support and... ...role emphasizes cross-functional collaboration with finance, IT, and operations, while maintaining governance and data integrity...
- A leading AI Data Services company is seeking a bilingual content evaluator to review AI-generated responses and create training content. The ideal candidate will have... ...offers flexible hours and requires at least 3 years of relevant experience. #J-18808-Ljbffr SME CareersRemote jobFlexible hours
- Mercor, in partnership with Crossing Hurdles, is looking for a Multimedia Expert to work remotely on project-based tasks. The role involves reviewing and editing multimedia outputs, creating assets for AI model training, and providing feedback to ensure quality standards....Remote jobPart time10 hours per week
- ...sponsorship of a visa. Who We Are At the company, we believe that the future will be resh… Engineering Manager, Agentic AI Join us in building the future of finance. Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by...
- ...Job Description Job Description Developer & Infrastructure Expert Role Type: Contractor Location: Remote Job Overview... ...are seeking experienced Developer & Infrastructure Experts to evaluate AI-powered workflows across software development, cloud...Remote jobFor contractors
- Cloudflare is seeking a Senior Revenue Accountant to ensure US GAAP-compliant revenue recognition while leveraging AI automation to enhance efficiency. The role combines advisory and operational duties across multiple teams, handling token-based usage and evolving AI-related...
- ...Exists At Mercor, we believe the safest AI is the one that’s already been attacked —... ...a red team for this project - human data experts who probe AI models with adversarial inputs... ...that strengthen customer AI systems Evaluation coverage expands: more scenarios tested,...Remote work
- Ethos is seeking experienced equity research analysts to help train AI models by producing professional presentations and slide decks.... ...20 hours per week or more) and starts ASAP. 3+ years in equity research and expert PowerPoint skills are required. #J-18808-Ljbffr EthosRemote jobImmediate startFlexible hours
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Cybersecurity Labeling Expert Type: Contract Compensation... ...ransomware , worms , and exploits . Evaluate POC exploit development to determine...Hourly payWeekly payFull timeContract workFor contractorsSummer workRemote work- Ethos is a new expert network built by a McKinsey/SoftBank/DeepMind team and backed by world‑leading investors. We connect experts with investors... .... We are seeking experienced equity research analysts to train AI models on professional presentation and slide deck tasks,...Remote jobImmediate startFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Finance SME - AI Evaluation Expert. Be the first to apply!
- international financial advisor New York, NY
- financial advisor New York, NY
- financial associate New York, NY
- oracle financial functional consultant New York, NY
- estate planning consultant New York, NY
- associate leveraged finance New York, NY
- financial advisor wealth manager New York, NY
- financial advisor associate New York, NY
- financial planning associate New York, NY
- financial planning assistant New York, NY




