Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Analytical Evaluator - AI Feedback - AI Trainer

$70 per hour

Mercor Inc

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning. Provide structured written feedback to improve AI model outputs. Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content. Write clear, precise, and well-evidenced rationales beyond surface-level observations. Work independently and asynchronously to meet deadlines and improve AI model performance. Qualifications Must-Have Bachelor's degree from a top-500 globally ranked university preferred. Strong analytical and written communication skills. Ability to work independently and follow detailed task guidelines. Strong critical reading skills. Native English fluency required. Preferred None specified. #J-18808-Ljbffr Mercor Inc

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback - AI Trainer in San Francisco, CA vacancy
  •  ...Overview In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects. Basic Qualifications Bachelor's degree from a top-500... 
    Suggested

    Obsidian

    San Francisco, CA
    4 days ago
  •  ...seeking candidates in San Francisco, California, to evaluate AI-generated responses and provide structured feedback. Ideal candidates will possess a Bachelor's degree from a top-ranked university and strong analytical and communication skills. As part of a high-impact AI... 
    Suggested

    Obsidian

    San Francisco, CA
    5 days ago
  • $80 - $120 per hour

     ...Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour...  ...: Remote Role Responsibilities Evaluate AI-generated artifacts against domain‑specific...  ...decks. Provide clear, structured written feedback to improve AI model outputs. Apply deep... 
    Suggested
    Contract work
    Work at office
    Remote work

    Mercor Inc

    San Francisco, CA
    2 days ago
  •  ...headquartered in San Francisco, seeks a Generalist Expert to evaluate AI-generated responses and provide structured feedback. Candidates should have a Bachelor's degree from a top-500 university and strong analytical skills. The role is remote, allowing for asynchronous... 
    Suggested
    Remote job

    Mercor

    San Francisco, CA
    5 days ago
  •  ...Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to...  ...About the Role We\'re seeking our first data analytics hire to establish and own the data...  ...navigating ambiguity Ability to accept direct feedback and continuously improve Preferred Qualifications... 
    Suggested
    Full time

    Hyperbolic

    San Francisco, CA
    4 days ago
  • $160k - $180k

     ...through the full lifecycle of data science analytics from ideation and exploratory analysis,...  ...and non-technical audiences, soliciting feedback on where to improve Be a champion of A/B...  ...writing production ETL Experience leveraging AI for data science US base salary range... 
    Full time

    United States Digital Space LLC

    San Francisco, CA
    5 days ago
  •  ...is seeking a Data analysis / quantitative readouts Evaluator to connect elite talent with leading AI research labs. This remote position requires 5+ years...  ...assess AI-generated documents for quality and provide feedback to enhance AI performance. Ideal candidates possess... 
    Remote job
    Work at office

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

    Mercor is seeking a Legal / compliance Evaluator to connect elite talent with AI research. This remote position involves evaluating AI-generated artifacts and providing structured feedback. The ideal candidate will have 5+ years of relevant professional experience in Legal... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

    Mercor is seeking a User/customer research and feedback synthesis Evaluator based in San Francisco, California, to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate will have over 5 years of relevant experience and a high proficiency in... 
    Remote job
    Hourly pay
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  •  ...Intelligence is the open platform for evaluating how AI models perform in the real world. Created...  ...perform — and we use our community’s feedback to build transparent, rigorous, and...  ...this role, you will design and build the analytics‑layer data models, pipelines, and... 
    Permanent employment
    Work at office

    Arena

    San Francisco, CA
    3 days ago
  •  ...Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Join to apply for the Python and Kubernetes Software Engineer - Data...  ...chosen path Confidence to respectfully speak up, exchange feedback, and share ideas without hesitation Track record of going... 
    Full time
    Freelance
    Internship
    Local area
    Remote work
    Work from home
    Worldwide

    Canonical

    San Francisco, CA
    5 days ago
  • $170k - $220k

     ...though there is no formal in-office requirement. ABOUT THE TEAM Analytics Engineers at Rocket Money further our mission by helping our...  ...the organization. You self‑organize a peer group to gain feedback. You’re an exceptional communicator who can explain complex data... 
    Temporary work
    Work at office
    2 days per week
    1 day per week

    Dormont Manufacturing Co

    San Francisco, CA
    5 days ago
  • $185k - $240k

     ...with product managers and engineers to design, implement, and evaluate A/B tests and feature rollouts. Develop frameworks for causal...  ...~3+ years of experience in Data Science, Decision Science, or Analytics within a product-focused organization. ~ A bachelor's degree... 
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    Whatnot

    San Francisco, CA
    2 days ago
  • $197.8k - $267.6k

    # Manager, AI Engineering - AnalyticsHybrid - San FranciscoApply...  ...for the in-product analytics and reporting experience our...  ...best work* Give direct, useful feedback and help engineers grow in their...  ...Ability to articulate how to evaluate an agent before, during, and... 
    Work at office
    Immediate start
    Worldwide
    Monday to Friday
    Flexible hours

    Careers at Drata

    San Francisco, CA
    4 days ago
  •  ...presentation objects, reports, and dashboards for delivery of analytic solutions. - Translate business needs and requirements to system...  ...Maximus is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex... 
    Minimum wage
    Contract work
    Temporary work
    Work experience placement

    MAXIMUS

    San Francisco, CA
    3 days ago
  • $197.8k - $267.6k

    We are looking for a player‑coach AI engineer who will lead a small team and shape the...  ...AI and data direction for our in‑product analytics and reporting experience....  ...Lead a small focused team, run 1:1s, give feedback, and hire as needed. Set goals, run management... 
    Flexible hours

    Drata

    San Francisco, CA
    4 days ago
  • $200k - $240k

     ...decades of deep expertise in massively scalable infrastructure, AI, and blockchain from leadership roles at leading companies and universities...  ...Snowflake expertise Experience designing efficient, scalable analytical data models Proficiency with dbt or comparable transformation... 
    Work at office
    Home office
    Flexible hours

    P2P

    San Francisco, CA
    5 days ago
  • $275k - $370k

     ...About the Role As an Analytics Engineer, you will be an early member of the Data Science & Analytics team building the foundation to scale...  ...the company’s mission of building helpful, honest, and harmless AI. Expertise in building multi‑step ETL jobs, building robust data... 
    Work at office
    Visa sponsorship
    Flexible hours

    United States Digital Space LLC

    San Francisco, CA
    2 days ago
  • $175.5k - $219.6k

     ...0 customers and ARR that has grown over 250 percent year over year, ClickHouse leads the market in real‑time analytics, data warehousing, observability, and AI workloads. The company’s sustained, accelerating momentum was recently validated by a $400M Series D financing... 
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours

    ClickHouse

    San Francisco, CA
    5 days ago
  •  ...Perplexity is AI for people who expect more. This role brings that same standard to how our data team works - with AI at the center...  ...We\'re looking for someone who\'s been a great data scientist, analytics engineer, or data engineer - the kind of person who knows which... 

    Perplexity AI Inc.

    San Francisco, CA
    1 day ago
  •  ...offices in New York, Washington D.C., London and Amsterdam. The Analytics Engineering team owns the full-stack analytics foundation for Plaid...  ...and production‑grade analytics. You’ll also help build the AI‑powered experiences that let Marketing partners self‑serve from... 
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    4 days ago
  •  ...Silicon Valley. You'll be working lots in SQL, DBT and Python + leveraging LLMs for data enrichment & tagging. Requirements 6+ years of analytics engineering, data engineering, data science, or other highly analytical, data-oriented roles. Excellent communication skills and... 

    Varos Research

    San Francisco, CA
    4 days ago
  •  ...a pivotal role in building a data-centric culture, enhancing decision-making processes, and driving strategic initiatives through analytics. This role involves a variety of projects aimed at developing canonical data sources and dashboards that enable the business to derive... 
    Work at office
    Relocation package

    United States Digital Space LLC

    San Francisco, CA
    3 days ago
  •  ...We are an applied AI lab building end-to-end software agents. We’re the makers of Devin, the first AI software engineer, and Windsurf...  ..., apply to join us. About the Role We’re hiring a technical Analytics Engineer to own our full data stack – from database architecture... 

    Dormont Manufacturing Company

    San Francisco, CA
    2 days ago
  • $170k - $190k

     ...everyday Americans build financial resilience. Our Data team sits at the center of every product, pricing, and promotion decision — and Analytics Engineering is the foundation that makes trustworthy, consistent data possible across the company. As our Senior Analytics... 
    Contract work
    Local area
    Flexible hours

    Flourish Ventures

    San Francisco, CA
    5 days ago
  • $132k - $182k

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...foundations that make data trustworthy at scale. Senior Analytics Engineer, Enterprise Opportunity We are seeking a Senior Analytics... 
    Immediate start
    Flexible hours

    Okta, Inc.

    San Francisco, CA
    3 days ago
  •  ...Senior Analytics Developer Montreal, Canada MaintainX is the world's leading mobile-first work execution platform for industrial and...  ...rely on them. This role sits at the intersection of data modeling, AI-native analytics, and cross-functional enablement. The Role... 
    Summer work
    Remote work
    Home office

    MaintainX

    San Francisco, CA
    1 day ago
  • $112k

     ...based in San Francisco to help clients optimize their marketing strategies. You will collaborate with various teams to apply advanced analytics and develop transformative business strategies. Applicants should have experience in predictive modeling, proficiency in data... 

    McKinsey & Company

    San Francisco, CA
    4 days ago
  •  ...Role Overview: As an Adobe Analytics Engineer, you will play a crucial role in optimizing our digital touchpoints and enhancing customer experiences. You will work closely with cross-functional teams to implement, configure, and analyze Adobe Analytics solutions, while... 

    BayOne Solutions

    San Francisco, CA
    2 days ago
  •  ...seeking a Cybersecurity Expert to remotely evaluate AI-generated outputs related to cybersecurity and provide structured feedback on accuracy. The role requires 3+ years of...  ...professional experience in cybersecurity, strong analytical skills, and proficiency in incident... 
    Remote job
    Hourly pay
    Weekly pay

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback - AI Trainer. Be the first to apply!