Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Compliance AI Evaluator - Finance

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Compliance / regulatory response with financial-services AI Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines and improve AI model performance .

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Compliance / regulatory response with financial-services AI.
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Master's or higher from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the Compliance AI Evaluator - Finance in New York, NY vacancy
  • Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years... 
    Suggested
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    3 days ago
  • About the role We are hiring expert Evaluators in Compliance / regulatory response with financial-services AI to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject‑... 
    Suggested
    Hourly pay
    Work at office
    Remote work

    Obsidian

    New York, NY
    1 day ago
  • Dorado is seeking an experienced Investment Banking SME to support the development, evaluation, and improvement of advanced AI models in finance. You will assess AI-generated analyses for accuracy, reasoned judgments, and data integrity, guiding model refinements and prompts... 
    Suggested
    Remote job

    Dorado

    New York, NY
    5 days ago
  • $70 - $110 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Role Responsibilities Evaluate AI-generated financial plans...  ...financial soundness, regulatory compliance, and analytical rigor. Review...  ...as a Financial Manager, Finance Director, Branch Manager, Financial... 
    Suggested
    Hourly pay
    Contract work
    Summer work
    Work at office
    Immediate start
    Remote work

    Mercor

    New York, NY
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Suggested
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    4 days ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Work at office
    Remote work

    Obsidian

    New York, NY
    2 days ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    2 days ago
  •  ...A leading AI company is seeking detail-oriented linguists with native Turkish fluency for a remote freelance opportunity. This role will focus on AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal candidates will have a strong... 
    Freelance
    Remote work

    Lilt

    New York, NY
    1 day ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    New York, NY
    3 days ago
  • A virtual AI evaluation firm is seeking individuals to review and evaluate AI-generated responses in therapeutic conversations. The ideal candidate will possess strong written communication and analytical skills, as well as a keen attention to detail for assessing tone... 
    Remote job
    Immediate start

    Crossing Hurdles

    New York, NY
    1 day ago
  • $100 - $125 per hour

     ...hour fast-track onboarding required Key Responsibilities Translate real-world insurance workflows into structured tasks for AI systems Evaluate AI-generated outputs for accuracy, logical reasoning, and business relevance Work on use cases including underwriting,... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Work at office
    Immediate start
    Flexible hours

    Crossing Hurdles

    New York, NY
    1 day ago
  • Productive Playhouse is building a pool of Urdu-speaking evaluators for testing and judging AI chatbots. This independent contractor role lets you choose tasks, set your own hours, and work with other clients while contributing to model evaluation. You will engage in structured... 
    For contractors
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    1 day ago
  • $8 per hour

    Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in Thai or Chinese Simplified. This freelance, part-time role is remote from Thailand, offering 10+ hours weekly with an immediate start and a rate of 8 USD/hour. You will engage in... 
    Remote job
    Part time
    Freelance
    Immediate start

    Dorado

    New York, NY
    5 days ago
  • Mercor is seeking experienced musicians to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Mandarin Chinese and English. Responsibilities... 

    Mercor

    New York, NY
    3 days ago
  • Productive Playhouse is seeking a Kinyarwanda AI Product Evaluator. This freelancer role involves direct interaction with AI chatbots to test quality, safety, and helpfulness, with iterative task batches and flexible hours. You’ll work remotely from anywhere, choose tasks... 
    Remote job
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    1 day ago
  • Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Malayalam and English. Key responsibilities... 

    Mercor

    New York, NY
    2 days ago
  • $15 per hour

    Productive Playhouse is building a pool of Spanish (Spain) speakers for evaluating leading AI chatbots. You will work as an independent contractor, choosing tasks, setting your own hours, and collaborating with clients globally. Pay is $15.00 USD per hour, with flexible... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    1 day ago
  • Obsidian is seeking expert Evaluators in Legal / compliance to review AI-generated work products for accuracy and quality. This remote, hourly engagement requires 5+ years in Legal/compliance, native or professional English, and strong Microsoft Office and Google Slides... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    3 days ago
  • Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate; Duration: up to... 
    Immediate start
    Flexible hours

    Mercor

    New York, NY
    4 days ago
  • Mercor is hiring experienced musicians to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Turkish and English. Key responsibilities include... 

    Mercor

    New York, NY
    3 days ago
  • AIUC is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models on policy-sensitive topics. You will assess AI-generated responses and provide structured feedback to improve model behavior. Join a collaborative team of... 

    Dorado

    New York, NY
    5 days ago
  • Mercor seeks experienced brand designers to define grading criteria for real-world brand deliverables and to score AI-generated versus human work with detailed written justifications. You will apply evidence-based judgment, ensure reproducibility, and iteratively incorporate... 

    Obsidian

    New York, NY
    2 days ago
  • Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks.... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    3 days ago
  • $20 - $30 per hour

    A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong... 
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    1 day ago
  • $80 - $120 per hour

    Mercor in New York, NY, is looking for a Legal contracts / diligence / redlines Evaluator to assess AI-generated artifacts. This role requires 5+ years of relevant experience and native or professional fluency in English. The ideal candidate will evaluate quality rubrics... 
    Remote job

    Mercor

    New York, NY
    3 days ago
  • $18 per hour

    Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in German. This freelance, part-time role offers a flexible remote schedule with work-from-home options in Germany. Start immediately with 10+ hours per week and a rate of 18 USD per... 
    Remote job
    Hourly pay
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Dorado

    New York, NY
    5 days ago
  • Mercor is seeking a General business strategy / management Evaluator for a remote position. You will evaluate AI-generated documents and provide structured feedback to enhance quality. The ideal candidate has 5+ years experience in a relevant field and professional fluency... 
    Remote job
    Work at office

    Mercor

    New York, NY
    4 days ago
  • A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years... 
    Remote job
    Full time
    For contractors

    Turing

    New York, NY
    1 day ago
  • Productive Playhouse is building a talent pool of Armenian speakers to test and evaluate leading AI chatbots. This freelance, project-based opportunity lets you choose tasks, set your own hours, and work with other clients as needed. Open to freelancers outside the U.S.... 
    Remote job
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    1 day ago
  • Welo Data is seeking a detail-oriented Data Labeling Associate to evaluate AI outputs and improve system behaviors in real-world scenarios. The ideal candidate will have native French proficiency and a university degree. This full-time role, based in New York City, involves... 
    Full time

    University of Delaware

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Compliance AI Evaluator - Finance. Be the first to apply!