Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Frontend Code Evaluation Specialist - AI Trainer

$90 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Frontend Engineer
Type: Contract
Compensation: $90/hour
Location: Remote

Role Responsibilities

  • Render a reference page and two candidate replications at 1920×1080. Judge which is the closer reproduction, state by state.
  • Diff visual fidelity in detail: box model and spacing, typography (family, size, weight, line-height, letter-spacing), color and border treatment, image and asset handling, z-order, and overflow.
  • Read the source of both attempts and grade construction quality. Distinguish a replication that is genuinely correct from one that merely looks correct at one viewport.
  • Test responsiveness. Identify defects such as a nav bar that looks right at 1920px but collapses at 1400px.
  • Write specific, evidence-cited justifications for every preference. Provide detailed explanations like "B nests the article body in a single absolutely-positioned div, so the text overlaps the footer below 1600px, while A uses normal document flow."
  • Use the "this task is broken" escape hatch with judgment. Distinguish a task that genuinely cannot be completed from one that is merely hard.

Qualifications

Must-Have

  • 3–8 years of professional web development experience in frontend or full-stack work.
  • Fluency across web eras, including legacy layouts like used for layout.
  • Command of hand-written HTML and CSS : semantic markup, flexbox, grid, media queries, and legacy float- and table-based layouts.
  • Browser DevTools as muscle memory.
  • Command-line comfort: unzipping an archive, standing up a static local server, and untangling a broken image reference.
  • Enough JavaScript to read a page's scripts and understand their DOM impact.
  • Professional written English for task justification.

Preferred

  • Prior RLHF , preference-labeling, model-evaluation, or structured code-review work.
  • Pixel-perfect design-to-code experience.
  • Accessibility expertise ( ARIA , semantic landmarks, heading hierarchy).
  • Familiarity with how LLMs fail at code generation.
  • Web scraping, archiving, or DOM-parsing background.
  • More than one completed Mercor project and availability in contiguous multi-hour blocks.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluation Specialist - AI Trainer in San Francisco, CA vacancy
  • $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Frontend Engineer — Web Replication Preference...  ...that merely look correct. Evaluate responsive behavior and...  ...or model evaluation work. Code review or technical assessment... 
    Front end
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $400 per month

     ...About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic infrastructure engineering... 
    Suggested

    Mercor Inc

    San Francisco, CA
    12 hours ago
  •  ...author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple...  ...questions across core history and political science domains, evaluate solution quality, and help establish gold-standard benchmarks used... 
    Suggested
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Government / public administration Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $150k - $250k

    About Distyl AI Distyl is an applied AI technology company partnering with the world’...  ...ForAt Distyl, we build AI systems using Evaluation-Driven Development—an approach where evaluation...  ...on engineers who write production Python code, build evaluation pipelines, and use... 
    Suggested
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    3 days ago
  •  ...organize human intelligence to power the AI economy. We partner with leading AI labs...  ...experience, and context that can't be captured in code alone. Today, more than 30,000 experts in...  ...As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of... 
    Full time
    Work at office
    Relocation package

    Mercor

    San Francisco, CA
    12 hours ago
  • Obsidian is partnering with an AI research initiative to support a Frontier Code Agents project in San Francisco. You will evaluate frontier AI coding models by performing realistic data engineering tasks, reviewing ETL pipelines, data warehouses, and distributed systems... 

    Obsidian

    San Francisco, CA
    12 hours ago
  • Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. You will help evaluate frontier AI coding models through structured technical assessments and focus on realistic data engineering workflows. The role involves reviewing model-... 

    Mercor

    San Francisco, CA
    2 days ago
  • $163k - $246.5k

     ...Semgrep Semgrep, the leader in code security for builders,...  ...gets smarter as you build, with AI that learns your context to cut...  ...powered solutions and rigorously evaluate the efficacy of different prompts...  ..., Typescript and React on the Frontend, Python, Flask and SQLAlchemy... 
    Front end
    Full time
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep, Inc.

    San Francisco, CA
    12 hours ago
  • $281k - $356k

     ...job is to ensure that we can continue to evaluate safety and service quality across new cities...  ...product, engineering, data science, frontend, and backend You have: Strong engineering...  ...experience Navigating and modifying a large code base containing C++, SQL, and Python... 
    Front end
    Full time
    Work experience placement
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  • $150k - $210k

    AI Engineer - Agentic AutomationLocation: RemoteCompensation: $...  ...making and task execution- Own evaluation frameworks — accuracy, latency...  ..., including Claude-based and code-first AI frameworks, to build...  ...automation tooling- Build lightweight frontend interfaces from product... 
    Front end
    Local area
    Immediate start

    Cargomatic

    San Francisco, CA
    2 days ago
  •  ...AI Engineer, Search & Knowledge Systems About Pi Pi is building...  ...is still scattered across code, tickets, documents, incidents...  ...representation, ranking, evaluation, and production systems....  ...Partner with product, backend, frontend, platform, and security teams... 
    Front end
    Full time

    Pi Security

    San Francisco, CA
    12 hours ago
  •  ...leaderboards that appear on Vals AI. You will be responsible for...  ...on tasks in law, tax, coding, finance, and more. You will analyze error modes of models, evaluate their strengths and weaknesses...  ...built on Django, with a React frontend. All of the infra is on AWS using... 
    Front end
    Work experience placement
    Relocation
    Relocation package
    Shift work

    Vals AI

    San Francisco, CA
    2 days ago
  •  ...You Are You are an exceptional AI-native software engineer who...  ...and how you build. You use coding agents and other AI development...  ..., establish tests and evaluations, and review generated output...  ...across the full stack, including frontend and backend systems. Minimum... 
    Front end
    Permanent employment
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    1 day ago
  • $211k - $290.5k

     ...— Faire’s user facing AI bet within the Discovery...  ...quality through data, evaluation, and modeling, while...  ...tool wrappers, and the frontend surfaces where the...  ...— not a single-layer specialist; demonstrates cross-stack...  ...in practice: uses AI coding tools and agent workflows... 
    Front end
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    12 hours ago
  • $238k - $302k

     ...simulation across 15+ U.S. states. The Large Model Evaluation team is at the nexus of Waymo’s AI ambition . With advancements in Large Language Models...  ...or C++ ~ Experience with software design principles, coding best practices, testing methodologies, and version control... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    12 hours ago
  •  ...availability. Design reliable AI-system harnesses, execution flows, guardrails, and evaluations. Build internal AI tooling...  ...backend, agent orchestration, and frontend. Use Baseten training and...  ...familiarity with LangChain, Claude Code, Codex, OpenCode, and MCP. ~... 
    Front end
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...hiring Senior Backend + Applied AI Engineers to build the core...  ...wield tools like Cursor, Claude Code, and Copilot as extensions of...  ...the orchestration patterns and evaluation frameworks the team...  ...infrastructure fluently. Partner with frontend and design to shape how AI capabilities... 
    Front end
    Work at office
    Local area

    Within

    San Francisco, CA
    4 days ago
  • $127.49k - $262.2k

     ...is currently seeking a Lead Specialist to join our Federal Advisory...  ...and execute delivery of data / AI engagements (including definition...  ...design through training, evaluation, validation, implementation,...  ...validation, to deploymentExperience coding artificial intelligence... 
    Local area

    KPMG

    San Francisco, CA
    3 days ago
  • $200k - $260k

     ...infrastructure to herald the AI era for physical systems. In...  ...peers on architecture, design, code reviews, and scaling...  ...data paradigms and eagerness to evaluate and integrate emerging tools and...  ...work with may include: Frontend & Backend : Go, gRPC, PostgreSQL... 
    Front end
    Permanent employment
    Work at office
    Relocation

    Sift

    San Francisco, CA
    3 hours ago
  •  ...NexaFlow is building a next-generation code review tool powered by large language models. We are seeking a Senior Full-Stack Engineer...  ...Proficiency in Python (FastAPI) or Node.js for backend; React or Vue for frontend. - Experience with Docker containerization and self-hosted... 
    Front end
    Full time
    Contract work
    Remote work

    Fuku

    San Francisco, CA
    4 days ago
  •  .... Condor is pharma-native, AI-driven infrastructure built to...  ...interfaces, retrieval systems, evaluation harnesses, and serving...  ...forecasting, and budgeting. Build frontend components and interfaces as needed...  ..., maintainable, well-tested code following internal development... 
    Front end
    Live in
    Immediate start

    Condor Software

    San Francisco, CA
    3 days ago
  • $200k - $230k

     ...technology.Job DescriptionDirector, AI Platform EngineeringLocations:...  ...and Business Casual Dress Code, including jeansYour Future: 4...  ...MCP protocol, AG-UI protocol)Evaluate and integrate emerging AI...  ...to Module Federation / micro-frontend architecturesOpen source contributions... 
    Front end
    Ongoing contract
    Full time
    Casual work
    Work at office
    Flexible hours

    SS&C Technologies

    San Francisco, CA
    1 day ago
  •  ...build the data engine behind Simbe’s AI platform: model assisted labeling...  ...versioning, active learning, and evaluation workflows that improve model...  ...operational teams while still writing code and improving systemsExperience with web frontend or full stack development for... 
    Front end
    Flexible hours

    Simbe

    San Francisco, CA
    4 days ago
  •  ...Engineer in San Francisco to contribute to the development of AI training data for a leading human data platform. This unique...  ...AI models. Your responsibilities will include creating coding tasks, evaluating AI-generated solutions, and ensuring high standards of quality... 
    Remote job

    Kake

    San Francisco, CA
    3 days ago
  •  ...mission is general causal intelligence; AI that is capable of (1) predicting the future...  .... Your mission is to build the central evaluation framework that the entire research organization...  ...building both backend pipelines and the frontend tools people read results in Owns... 
    Front end

    Causal Labs

    San Francisco, CA
    1 day ago
  •  ...Senior AI Application Engineer Working with Us Challenging....  ...service boundaries. Partner with frontend engineers to define clean API...  ...and other natural-language-to-code generating agents, enabling...  ..., Observability, and Evaluation Create and maintain CI/CD... 
    Front end

    Bristol-Myers Squibb

    Brisbane, CA
    2 days ago
  • $151k - $204.3k

     ...grow.Are you passionate about Generative AI, Agentic AI, and Machine Learning? Are you...  ...the core of every Amazon business, from coding assistants that help our developers ship...  ...agent frameworks, prompt engineering, model evaluation, fine-tuning) is required. A strong... 
    Local area
    Worldwide
    Flexible hours
    Day shift

    AmazonWebServices

    San Francisco, CA
    3 days ago
  • Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. You will help evaluate frontier AI coding models by performing infrastructure engineering tasks and reviewing model-generated implementations on cloud platforms, Kubernetes, and... 

    Mercor

    San Francisco, CA
    2 days ago
  • $120k - $155k

    Simbe is building the AI powered operating system for physical...  ...versioning, active learning, and evaluation workflows that improve model...  ...workflows. Experience with web frontend or full stack development for...  ...teams while still writing code and improving systems. Bonus... 
    Front end

    Simbe Robotics, Inc.

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Frontend Code Evaluation Specialist - AI Trainer. Be the first to apply!