Frontend Code Evaluator - Expert - AI Trainer
$90 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote
Role Responsibilities
- Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
- Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
- Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
- Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
- Write structured rationales for every judgment, ranking defects by importance in precise language.
- Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
- 3+ years of professional web development experience, primarily in frontend or full-stack work.
- Fluency in hand-written HTML and CSS .
- Working command of browser devtools .
- Enough JavaScript to read scripts and understand DOM manipulation.
- Comfort in a terminal for local server setup.
- Strong written English and discipline to justify judgments.
Preferred
- Prior RLHF , preference labeling, or model evaluation work.
- Code review or technical assessment background.
- Pixel-perfect design-to-code experience.
- Web accessibility expertise ( WCAG , ARIA ).
- Familiarity with LLMs' typical failures in codegen.
- Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert - AI Trainer in San Francisco, CA vacancy
$90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Frontend Engineer Type: Contract... ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-...Front endContract workSummer workLocal areaRemote work$8 - $65 per hour
...Job Application for Coding Specialist - Freelance AI Trainer (Fluent in Italian) Project at... ...Remote Are you a coding expert fluent in Italian eager... ..., software architecture, frontend and backend development,... ...our prompt engineering and evaluation metrics. A bachelor’s,...Front endHourly payContract workPart timeFor contractorsFreelanceImmediate startRemote workInvisible Technologies
San Francisco, CA22 days ago$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Government / public administration Evaluator Type: Contract Compensation: $... .... Collaborate with subject matter experts to ensure consistency and quality. Work...SuggestedContract workSummer workWork at officeRemote work$192k - $288k
...team behind v0, Next.js, and AI SDK, Vercel helps customers like... ..., product development, and frontend engineering. You’ll work closely... ...strategies for UI generation and code synthesis. Collaborating on... ...internal tools, datasets, and evaluation pipelines. Running A/B...Front endWork at officeRemote workWork from homeMonday to FridayFlexible hoursIdlen Inc.
San Francisco, CA3 days ago$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...SuggestedContract workSummer workWork at officeRemote work$60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Application Users - Windows 11 Professional Expert - Professionals Type: Contract Compensation... ...: Remote Role Responsibilities Evaluate and utilize Windows 11 Professional as...Contract workSummer workRemote workMercor
San Francisco, CA11 days ago- ...work Mercor is assembling a panel of radiological safety experts to red-team frontier AI models. The goal is to test whether a model can correctly... ...across three levels: benign, dual-use, and adversarial. Evaluate the responses that come back against a defined policy standard...
- Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured...
$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Contract workSummer workRemote work- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...Remote jobHourly payWork at office
$120 - $175 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location...Contract workSummer workRemote workMercor
San Francisco, CA8 days ago$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location:...Contract workSummer workImmediate startRemote work- Mercor connects elite creative and technical talent with leading AI research labs. This remote contract role focuses on using Visual Studio Code on macOS to support specialized applications and capture high-resolution screenshots. The job requires independence and strong...Remote jobContract work
$50 - $60 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Expert Interviewer Type: Contract Compensation... ...technical depth, communication, and AI-evaluation fit using a provided rubric. Confirm...Contract workSummer workRemote workWeekday workMercor
San Francisco, CA14 days ago- We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve...Worldwide
- Semgrep is seeking a Senior AI Software Engineer to apply LLM technologies across our... ...and own end-to-end AI-powered solutions, evaluating prompts and models with real-world data.... ...role leverages GPT-4/GPT-5, Codex, Claude; frontend in Typescript/React; backend in Python/...Front end
- ...NexaFlow is building a next-generation code review tool powered by large language models. We are seeking a Senior Full-Stack Engineer... ...Proficiency in Python (FastAPI) or Node.js for backend; React or Vue for frontend. ~ Experience with Docker containerization and self-hosted...Front endFull timeContract workRemote work
Fuku
San Francisco, CA1 day ago - Mercor, a San Francisco-based talent platform, is seeking a Government/public administration Evaluator for a remote contract. You will assess AI-generated artifacts against domain rubrics, identify factual and presentation errors, and provide structured feedback to improve...Remote jobContract workWork at office
- ...San Francisco, CA is seeking a Software Engineering evaluator on a contract basis. You will create cutting-edge... ...and benchmarking large language models, curating code examples, providing precise solutions, and refining AI-generated code. You will work with researchers and...Contract workFor contractors
$500 per unit
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Software Developers: Share Your AI Coding Sessions Type: Contract Compensation: $500 per task...Contract workSummer workImmediate startRemote workFlexible hours- ...Job Application for PHP Coding Specialist - Freelance AI Trainer Project at Meridial Back to jobs PHP Coding... ...America a Are you a coding expert fluent in PHP eager to shape the... ...improvements to our prompt engineering and evaluation metrics. A bachelor’s, master’s,...Hourly payContract workPart timeFor contractorsFreelanceImmediate startRemote work
Invisible Technologies
San Francisco, CA22 days ago $35 per hour
...Job Application for Kotlin Coding Specialist - Freelance AI Trainer Project at Meridial Back to jobs Kotlin... ...Wide - Remote Are you a Kotlin expert eager to shape the future of AI?... ...plus. On a typical day, you’ll evaluate AI-generated code, correct errors,...Hourly payContract workPart timeFor contractorsFreelanceRemote workInvisible Technologies
San Francisco, CA22 days ago$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Contract workSummer workRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Machine Learning Expert Type: Contract Compensation: $... ...out of 8 attempts. Focus on inference, evaluation, and systems work rather than heavy model...Contract workSummer workRemote workMercor
San Francisco, CA3 days ago- © 2026 Smart Ecosystems. All rights reserved.Part time
Outlier AI
San Francisco, CA10 days ago - ...California, United StatesCompany: Kaiser PermanentePosted: 2026-10-06Kaiser Permanente seeks an experienced Inpatient Coder to accurately code and abstract inpatient cases using ICD-CM, ICD-PCS, CPT and HCPCS. The role covers OBS, HAS, ED and CHOY services as needed, with...Remote work
Kaiser Permanente
Oakland, CA5 days ago $170k - $220k
...approach to automation at meter.ai.Why this role mattersMeter has... ...closely with our firmware and frontend teams to ensure our... ...data layer to keep downstream code minimalCollaborate with modelers to co-design training and evaluation pipelines that are reproducible...Front endWork at officeFlexible hoursMeter
San Francisco, CA7 days ago- ...Job Description Job Description Claude Code User Job Type: Contractor Location:... ...to support a project focused on advancing AI coding agents. You will share real-world experience... ...and ambiguous technical problems. Evaluate the strengths and limitations of AI coding...Remote jobFor contractors
- ...are hiring experienced software engineers to design long-horizon coding tasks: realistic, investigation-heavy engineering problems drawn from substantial codebases, used to evaluate and train advanced AI coding agents. The ideal candidate is comfortable working across...Contract work
AfterQuery
San Francisco, CA22 days ago $195k - $255k
...AI & Machine Learning Generative Systems Hybrid · San Francisco, CA Full-Time $195,000 – $255,000 USD · 0.2% – 0.4% Equity Join... ...and implement specialized fine-tuning and inference strategies for code generation. Build context compression and semantic retrieval...Full timeRemote workFlexible hoursThemeframer
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert - AI Trainer. Be the first to apply!
Related searches
- quality evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- education evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA