Compliance AI Evaluator - Finance
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Compliance / regulatory response with financial-services AI Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Compliance / regulatory response with financial-services AI.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Master's or higher from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years...SuggestedRemote jobHourly payWork at office
- About the role We are hiring expert Evaluators in Compliance / regulatory response with financial-services AI to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject‑...SuggestedHourly payWork at officeRemote work
- Dorado is seeking an experienced Investment Banking SME to support the development, evaluation, and improvement of advanced AI models in finance. You will assess AI-generated analyses for accuracy, reasoned judgments, and data integrity, guiding model refinements and prompts...SuggestedRemote job
$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered... ...Role Responsibilities Evaluate AI-generated financial plans... ...financial soundness, regulatory compliance, and analytical rigor. Review... ...as a Financial Manager, Finance Director, Branch Manager, Financial...SuggestedHourly payContract workSummer workWork at officeImmediate startRemote work- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...SuggestedContract workTemporary workImmediate startRemote work
- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
- ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...Remote work
- ...A leading AI company is seeking detail-oriented linguists with native Turkish fluency for a remote freelance opportunity. This role will focus on AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal candidates will have a strong...FreelanceRemote work
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hours- A virtual AI evaluation firm is seeking individuals to review and evaluate AI-generated responses in therapeutic conversations. The ideal candidate will possess strong written communication and analytical skills, as well as a keen attention to detail for assessing tone...Remote jobImmediate start
$100 - $125 per hour
...hour fast-track onboarding required Key Responsibilities Translate real-world insurance workflows into structured tasks for AI systems Evaluate AI-generated outputs for accuracy, logical reasoning, and business relevance Work on use cases including underwriting,...Remote jobHourly payFor contractorsFreelanceWork at officeImmediate startFlexible hours- Productive Playhouse is building a pool of Urdu-speaking evaluators for testing and judging AI chatbots. This independent contractor role lets you choose tasks, set your own hours, and work with other clients while contributing to model evaluation. You will engage in structured...For contractorsFreelanceFlexible hours
$8 per hour
Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in Thai or Chinese Simplified. This freelance, part-time role is remote from Thailand, offering 10+ hours weekly with an immediate start and a rate of 8 USD/hour. You will engage in...Remote jobPart timeFreelanceImmediate start- Mercor is seeking experienced musicians to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Mandarin Chinese and English. Responsibilities...
- Productive Playhouse is seeking a Kinyarwanda AI Product Evaluator. This freelancer role involves direct interaction with AI chatbots to test quality, safety, and helpfulness, with iterative task batches and flexible hours. You’ll work remotely from anywhere, choose tasks...Remote jobFreelanceFlexible hours
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Malayalam and English. Key responsibilities...
$15 per hour
Productive Playhouse is building a pool of Spanish (Spain) speakers for evaluating leading AI chatbots. You will work as an independent contractor, choosing tasks, setting your own hours, and collaborating with clients globally. Pay is $15.00 USD per hour, with flexible...Remote jobHourly payFor contractorsFreelanceFlexible hours- Obsidian is seeking expert Evaluators in Legal / compliance to review AI-generated work products for accuracy and quality. This remote, hourly engagement requires 5+ years in Legal/compliance, native or professional English, and strong Microsoft Office and Google Slides...Remote jobHourly payWork at office
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate; Duration: up to...Immediate startFlexible hours
- Mercor is hiring experienced musicians to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Turkish and English. Key responsibilities include...
- AIUC is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models on policy-sensitive topics. You will assess AI-generated responses and provide structured feedback to improve model behavior. Join a collaborative team of...
- Mercor seeks experienced brand designers to define grading criteria for real-world brand deliverables and to score AI-generated versus human work with detailed written justifications. You will apply evidence-based judgment, ensure reproducibility, and iteratively incorporate...
- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks....Remote jobHourly payWork at office
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong...Remote jobHourly pay$80 - $120 per hour
Mercor in New York, NY, is looking for a Legal contracts / diligence / redlines Evaluator to assess AI-generated artifacts. This role requires 5+ years of relevant experience and native or professional fluency in English. The ideal candidate will evaluate quality rubrics...Remote job$18 per hour
Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in German. This freelance, part-time role offers a flexible remote schedule with work-from-home options in Germany. Start immediately with 10+ hours per week and a rate of 18 USD per...Remote jobHourly payPart timeFreelanceImmediate startWork from home10 hours per weekFlexible hours- Mercor is seeking a General business strategy / management Evaluator for a remote position. You will evaluate AI-generated documents and provide structured feedback to enhance quality. The ideal candidate has 5+ years experience in a relevant field and professional fluency...Remote jobWork at office
- A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years...Remote jobFull timeFor contractors
- Productive Playhouse is building a talent pool of Armenian speakers to test and evaluate leading AI chatbots. This freelance, project-based opportunity lets you choose tasks, set your own hours, and work with other clients as needed. Open to freelancers outside the U.S....Remote jobFreelanceFlexible hours
- Welo Data is seeking a detail-oriented Data Labeling Associate to evaluate AI outputs and improve system behaviors in real-world scenarios. The ideal candidate will have native French proficiency and a university degree. This full-time role, based in New York City, involves...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Compliance AI Evaluator - Finance. Be the first to apply!
- work from home social media evaluator New York, NY
- work from home web search evaluator New York, NY
- social media evaluator New York, NY
- evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- clinical evaluator New York, NY
- ai evaluator New York, NY
- program evaluator New York, NY
- medicaid compliance New York, NY


