Finance AI Evaluation Lead for GenAI Models

Mercor

Cincinnatus LLC, the employer of record, invites applications for a Finance SME to join an extended workforce embedded with a leading AI lab's GenAI team. You will help build foundational AI models and craft rigorous evaluation tasks grounded in real financial practice. We seek 8+ years in finance with hands-on experience evaluating AI outputs against rubrics, and you will collaborate with other experts to ensure high-quality training data. #J-18808-Ljbffr Mercor

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Finance AI Evaluation Lead for GenAI Models in New York, NY vacancy

Senior AI Platform Lead — GenAI for Finance
Citi is building a cutting-edge agentic AI platform to transform the credit risk model lifecycle. You will lead a hands-on, senior tech team collaborating with quantitative analysts and stakeholders to deliver high-impact use cases. The role focuses on platform design,...
Suggested
Full time
Citi
New York, NY
4 days ago
AI Solutions Lead
...emails , and pull in Finance, Legal, Security, and IT... ...to change that. Our AI-native platform connects... ...As Omnea's AI Solutions Lead, you own deployment of... ...specific instructions and evaluate what comes back... ...architecture - how data models, primary keys, and integration...
Suggested
Contract work
Work at office
Shift work
Day shift
Omnea
New York, NY
2 days ago
Lead AI, Operating Model Design
$130k - $160k
...The OpportunityRole Value PropositionAs Lead, Operating Model Design, you will serve as an internal... ...model designer for Global Technology’s AI-First operating model. You author the team... ...teams to incorporate field feedback, evaluate model effectiveness, and align future-state...
Suggested
Full time
Temporary work
Work experience placement
Work at office
Local area
Relocation package
3 days per week
Metropolitan Life Insurance Company
New York, NY
3 days ago
Senior AI Content Evaluator & Quality Lead
Intelliswift - An LTTS Company is seeking a Content Specialist III to evaluate, improve, and shape AI content across diverse topics. The role focuses on high-quality, accurate model responses, requiring exceptional writing and editing skills and the ability to apply structured...
Suggested
Contract work
Remote work
Intelliswift - An LTTS Company
New York, NY
1 day ago
Advanced Analytics and AI Lead
$184.3k - $331.7k
...Talent Advanced Analytics Lead is responsible for... ...advisory, advanced analytics, AI innovation, talent... ...development of advanced analytics models to identify workforce... ...indicators.Continuously evaluate emerging technologies... ...Studio, Azure AI, enterprise GenAI platforms and machine...
Suggested
Summer holiday
Local area
Immediate start
Flexible hours
Weekend work
EY (Ernst & Young)
New York, NY
6 days ago
AI Lead Architect - RAG & Python
$125k - $150k
...Role: AI Lead Architect – RAG & Python Location: NYC, NY/Charlotte, NC We are... ...Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first... ...establish AI governance, security, monitoring, evaluation, and LLMOps practices. Additional...
Full time
Temporary work
Flexible hours
Synechron
New York, NY
4 days ago
Enterprise Architect Leader
$225k - $265k
...Fractal is a strategic AI partner to Fortune 500... ...Insurance practice supports leading insurers, banks, and... ...analytics, and GenAI solutions, and we help... ...governance, and operating model needed to scale AI safely... ...governance tooling, to evaluate options and direct the...
Hourly pay
Full time
Local area
Fractal
New York, NY
4 days ago
Artificial Intelligence Research Lead - Vice President
JPMorganChase AI Research is a global team of research... ...systems, foundation model training, reinforcement... ...President / Research Lead in AI Research, you will... ...and rigorous evaluation to production-scale delivery... ...diverse range of areas from finance and risk to human...
Work at office
Shift work
JP Morgan Chase
New York, NY
4 days ago
BCG Platinion | Lead AI Tech Architect
$190k
...delivers solutions through leading-edge management... ...uniquely collaborative model across the firm and throughout... ....What You'll DoLead AI Tech Architects at BCG... ...implementation projects.Evaluating products, SW packages,... ...Data analytics, AI and GenAI architecture.Application...
Work at office
Local area
The Boston Consulting Group
New York, NY
6 days ago
BCG Platinion | Lead AI Tech Architect - AI Platforms
$190k
...Data & Digital Platforms, AI at Scale, Cybersecurity... ...strategies into leading-edge tech platforms, at... ...integrate large language models (LLMs), data pipelines,... ...operational complexity.Evaluate emerging Ai frameworks... ...(e.g., proven usage of GenAI such as ChatGPT, Claude...
Work at office
Local area
The Boston Consulting Group
New York, NY
4 days ago
Chase Modeling - Applied AI Modeling Lead (VP)
Come join us in reshaping the future!As an Applied AI Modeling Lead, within our Business Modeling organization, you will collaborate with colleagues... ...advanced forecasting, AI, or ML models in consumer finance, financial services, tech, or a major retailer.AWS Certified...
JP Morgan Chase
New York, NY
3 days ago
Principal Research AI Innovation Lead
$145.02k - $175.73k
Principal Research AI Innovation Lead At Bristol Myers Squibb, our employees... ...LLM-enabled solutions, evaluate scientific quality, and create... ...making. Help shape multi-year GenAI strategies, lead workstreams... ...modern AI and large language model methods, including agentic...
Hourly pay
Full time
Summer work
Live in
Local area
Remote work
Flexible hours
Bristol-Myers Squibb Co
New York, NY
3 days ago
Senior Lead Architect, Agentic AI Solutions Architect
...solutions.As a Senior Lead Architect at JPMorganChase... ..., and scale agentic AI solutions across a global... ...Employee Platforms evaluate trade-offs, apply appropriate... ...LLMs, RAG, embeddings, model selection, prompt... ...diverse range of areas from finance and risk to human...
For contractors
JP Morgan Chase
New York, NY
6 days ago
Lead AI Technical Product Manager
$151.6k - $208.4k
...transformation into an AI-first enterprise, we are... ...technically proficient Lead Product Manager to lead... ..., and adapt as the model landscape and the business... ...launch and iteration. Evaluation and quality: Own how quality... ..., with AI/ML or GenAI products shipped to production...
Full time
Temporary work
Work at office
Remote work
Relocation
Shift work
3 days per week
Humana
New York, NY
4 days ago
Lead Data Analyst
...Team Lead, Scientific Discovery Platforms _ Lead a... ...Reaxys, Embase, and future AI-enabled life sciences... ...matter experts (SMEs) evaluating Reaxys and Embase search... ...expert input on data models and pipelines. Oversee... ...contributing to or validating AI/GenAI-based testing...
Casual work
Immediate start
Home office
Flexible hours
Elsevier
New York, NY
4 days ago
AI Program Lead GenAI
$45 - $70 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San... ...program status clearly to stakeholders. Evaluate expert submissions and quality trends.... ...lead on AI training data human data or model evaluation projects. ~3 years of experience...
Full time
Contract work
Summer work
Remote work
Weekday work
Mercor
New York, NY
10 hours ago
Audit Data Analytics Director, BDOADVANTAGE
$180k - $235k
...analytics portfolio. You will lead multi-disciplinary... ..., automation, and AI-enabled solutions that... ...capacity, and staffing models across concurrent workstreams... ...emerging methodsLeads evaluation, governance, and... ...degree in Accounting, Finance, Data Analytics, or Information...
Work at office
Remote work
Flexible hours
BDO International
New York, NY
6 days ago
Team Lead, Strategic Sourcing (IT, SaaS, Hardware)
$116k - $154k
...best fits them.What You'll Do:Lead strategic sourcing for enterprise... ...a documented, collaborative evaluation process, with action plans... ...scalable execution. Create pricing models based on vendor proposals to... ...Specifically around adopting AI to build repeatable workflows...
Work at office
Datadog
New York, NY
4 days ago
AI Productivity Lead, Sales Development
...organization is entering a new operating model in which AI is embedded into how sellers prospect,... ...pipeline. As the AI Productivity Lead, Sales Development, you will lead that... ...LLMs, prompt design, agent architecture, evaluation, guardrails, and human-in-the-loop operating...
Atlassian
New York, NY
7 days ago
Lead, AI Delivery Transformation
$130k - $160k
...The OpportunityRole Value PropositionAs Lead, AI-First Delivery Practice, you will turn AI... ...now, and the AI-First Operating Model is being designed and proven in live delivery... ...into a regulated delivery environment and evaluating AI output quality at scale through test...
Full time
Temporary work
Work experience placement
Work at office
Local area
Worldwide
Relocation package
3 days per week
Metropolitan Life Insurance Company
New York, NY
3 days ago
Sr. Lead, People Operations, AI, & Automation
...Global People Operations Scaling Lead — AI & Automation is a newly... ...every pillar of the HR support model — onboarding, offboarding, payroll... ...as the system of record.Evaluate and recommend AI and automation... ...of their healthcare and finances. We are also the fastest growing...
Blink Health
New York, NY
3 days ago
Team Lead — Enterprise AI
$235k - $350k
Team Lead — Enterprise AI Location New York Business Area Product Ref # 10053172... ...coherent product, owning the commercial model, and expanding the business into new cohorts... ...markets and how regulated institutions evaluate technology.Salary Range = 235,000 - 350...
Temporary work
For contractors
Work experience placement
Bloomberg
New York, NY
4 days ago
AI Enablement Lead (NYC)
$175k - $225k
...OverviewAbout the Team and DepartmentThe AI Adoption & Solutions Team... ...the RoleThe AI Enablement Lead owns the AI-domain content,... ...fluency — hands-on familiarity with GenAI tools, agentic workflows, and... ...and employees, and we evaluate qualified applicants without regard...
Work at office
Local area
Franklin Templeton
New York, NY
6 days ago
Pricing Strategy Lead
...Management;FinTechSelling Points Lead strategic pricing initiatives... ....Shape pricing frameworks and evaluate opportunities to balance... ...the intersection of strategy, finance, analytics, and business development... ...Strategic Finance teams to model revenue opportunities and profitability...
Green Key Resources
New York, NY
4 days ago
Analytics Solutions Lead
Global Real Estate (GRE) Finance Analytics - Vice PresidentJob Description: The GRE Finance... ...analysis, and portfolio scenario modeling - to inform strategic real estate decisions... ...related domainExperience with firm-approved AI/GenAI tools (e.g., LLMs, Microsoft Copilot)...
Work at office
JP Morgan Chase
New York, NY
5 days ago
Remote Lead AI Trainer & Prompt Evaluator
Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The role involves reviewing datasets for accuracy, providing feedback to annotators, and validating AI model outputs to ensure high production quality. Candidates...
Remote job
Full time
Feitong Buke
New York, NY
5 days ago
GenAI Solutions Lead: Enterprise LLM Architect & MLOps
Citi in New York seeks a Lead Generative AI Developer to architect and implement GenAI and LLM solutions at scale. You will collaborate with operations, data engineers, product managers, and architects to deliver enterprise-grade AI capabilities across COO Technology. The...
Citigroup Inc
New York, NY
3 days ago
Full Stack Lead
$112k - $190k
...Mizuho as a Full Stack Lead! In this role you will... ...optimization Architect AI integration features... ...full application stack Evaluate and adopt modern... ...and Waterfall delivery models. Proficient in using JIRA... ...trading, derivatives, and financing teams. We are looking for...
Work at office
Local area
Remote work
Worldwide
Mizuho Financial Group Inc
New York, NY
1 day ago
Lead Business Process Consultant, Life Sciences
$130k - $165k
...supplemented with Data & AI, Cybersecurity,... ...We are seeking a Lead Business Process... ...as SAP using data models and SQL or equivalent... ...intelligent automation, AI/GenAI, and enterprise... ...the ability to evaluate business processes,... ...Manufacturing, Procurement, Finance, Quality, or...
Full time
Temporary work
Remote work
Worldwide
BIP US
New York, NY
27 minutes ago
AI Enablement Lead
$200k - $220k
...The Opportunity Individual AI gains don't compound on their... .... The AI Enablement Lead owns Ascent's roadmap end to end... ...and the Enterprise Track are evaluated against the same six capabilities... ...instrumentation, reporting, and a working model of what "this skill or agent...
Full time
Work at office
Flexible hours
Upside Services
New York, NY
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Finance AI Evaluation Lead for GenAI Models. Be the first to apply!