Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Frontend Code Evaluator - Expert - AI Trainer

$90 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote

Role Responsibilities

  • Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
  • Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
  • Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
  • Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
  • Write structured rationales for every judgment, ranking defects by importance in precise language.
  • Flag ties, ambiguous cases, and broken task items rather than forcing a preference.

Qualifications

Must-Have

  • 3+ years of professional web development experience, primarily in frontend or full-stack work.
  • Fluency in hand-written HTML and CSS .
  • Working command of browser devtools .
  • Enough JavaScript to read scripts and understand DOM manipulation.
  • Comfort in a terminal for local server setup.
  • Strong written English and discipline to justify judgments.

Preferred

  • Prior RLHF , preference labeling, or model evaluation work.
  • Code review or technical assessment background.
  • Pixel-perfect design-to-code experience.
  • Web accessibility expertise ( WCAG , ARIA ).
  • Familiarity with LLMs' typical failures in codegen.
  • Web scraping or DOM parsing experience.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert - AI Trainer in San Francisco, CA vacancy
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: Frontend Engineer Type: Contract...  ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-... 
    Front end
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  •  ...Job Application for Rust Coding Specialist - Freelance AI Trainer Project at Meridial Back...  ...Are you a coding expert fluent in Rust eager to shape...  ..., software architecture, frontend and backend development,...  ...our prompt engineering and evaluation metrics. A bachelor’s,... 
    Front end
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Government / public administration Evaluator Type: Contract Compensation: $...  .... Collaborate with subject matter experts to ensure consistency and quality. Work... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    28 days ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract...  ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Summers , and Jack Dorsey . Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location:... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $80 - $120 per hour

    Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $90 - $140 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...AI problems. Evaluate security and responsible AI...  ...Collaborate with other subject matter experts to ensure consistency and accuracy...  ...security and secure code review penetration testing and... 
    Full time
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    San Francisco, CA
    4 days ago
  •  ...Job Application for PHP Coding Specialist - Freelance AI Trainer Project at Meridial Back to jobs PHP Coding...  ...America a Are you a coding expert fluent in PHP eager to shape the...  ...improvements to our prompt engineering and evaluation metrics. A bachelor’s, master’s,... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $35 per hour

     ...Job Application for Kotlin Coding Specialist - Freelance AI Trainer Project at Meridial Back to jobs Kotlin...  ...Wide - Remote Are you a Kotlin expert eager to shape the future of AI?...  ...plus. On a typical day, you’ll evaluate AI-generated code, correct errors,... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $500 per unit

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Software Developers: Share Your AI Coding Sessions Type: Contract Compensation: $500 per task... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    10 days ago
  • $20 - $45 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...agent sources and vets domain experts for our data platform that...  ...(legal, medical, finance, coding, etc.), where expert-level data... 
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    5 days ago
  •  ...are hiring experienced software engineers to design long-horizon coding tasks: realistic, investigation-heavy engineering problems drawn from substantial codebases, used to evaluate and train advanced AI coding agents. The ideal candidate is comfortable working across... 
    Contract work

    AfterQuery

    San Francisco, CA
    a month ago
  • $120 - $175 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $57 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    17 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    20 days ago
  • $70 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product...  ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    21 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $8 - $65 per hour

     ...Job Application for Arabic (Levantine) Language Expert - Freelance AI Trainer Project at Meridial Back to jobs Arabic (Levantine) Language...  ..., and suggest improvements to our prompt engineering and evaluation metrics. A Master's degree in Linguistics, Middle Eastern... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $15 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation...  ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    6 days ago
  • $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Inorganic Chemistry & Synthesis Expert Type: Contract Compensation: $...  ...0 hours/week Role Responsibilities Evaluate technically complex problems involving inorganic... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $30 per hour

     ...to $30/hour ## About SME Careers As AI systems become more sophisticated, they rely...  ...captures the full picture of how expert work actually gets done, the sequence of...  ...diverse subjects. Optimize AI Performance: Evaluate and rank AI responses to enhance the model... 
    Hourly pay
    Full time
    Contract work
    Freelance
    Local area
    Remote work
    Flexible hours

    SuperAnnotate

    San Francisco, CA
    a month ago
  • $180k - $400k

     ...Join a fast-moving, pre-seed-backed AI startup building the next generation of...  ...AI-driven user experiences. Develop evaluation and safety infrastructure to measure model...  ...APIs and data models, writing frontend and backend code, and operating production systems with... 
    Front end

    Clera

    San Francisco, CA
    16 days ago
  • $60 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...-truth outputs and objective rubrics. Evaluate AI models on visual document understanding...  ...content . Collaborate with subject matter experts to ensure task relevance and accuracy.... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  •  ...Employers Job seekers Career centers AI Skills Studio Handshake AI Research Log in Sign up INTELLIGENCE EXPERT (BACHELOR'S, MASTER'S AND PHDS) - AI TRAINER Sign up now Up to $200/hr Depending...  ...Your role will be to simulate and evaluate how malicious actors might leverage... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Handshake

    San Francisco, CA
    a month ago
  • $2,000 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract Compensation...  ...AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with partial credit... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $60 - $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  •  ...is building the TikTok for mini apps — an AI-driven consumer platform where people...  ...with maximal autonomy Developing robust evaluation and quality loops, including eval harnesses...  ...-facing product from 0 to 1 Built a coding agent, devtool, IDE assistant, or code-generation... 
    Full time
    Remote work

    sekai

    San Francisco, CA
    3 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $...  ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert - AI Trainer. Be the first to apply!