Frontend Code Evaluator - Expert - AI Trainer
$90 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote
Role Responsibilities
- Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
- Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
- Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
- Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
- Write structured rationales for every judgment, ranking defects by importance in precise language.
- Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
- 3+ years of professional web development experience, primarily in frontend or full-stack work.
- Fluency in hand-written HTML and CSS .
- Working command of browser devtools .
- Enough JavaScript to read scripts and understand DOM manipulation.
- Comfort in a terminal for local server setup.
- Strong written English and discipline to justify judgments.
Preferred
- Prior RLHF , preference labeling, or model evaluation work.
- Code review or technical assessment background.
- Pixel-perfect design-to-code experience.
- Web accessibility expertise ( WCAG , ARIA ).
- Familiarity with LLMs' typical failures in codegen.
- Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert - AI Trainer in San Francisco, CA vacancy
$90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Frontend Engineer Type: Contract... ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-...Front endContract workSummer workLocal areaRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...SuggestedContract workSummer workWork at officeRemote work$400 per month
About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic infrastructure engineering...Suggested- ...Bachelor’s with 4+ years of strong coding experience. Proficiency in... ...and a passion for mentoring AI to produce best-in-class code.... ...and challenging test cases to evaluate model performance. Deliver... ...More: Job Title: Coding Expert Job Type: Contract (Part-time...Contract workPart timeRemote work
SwissDevJobs.ch
San Francisco, CA1 day ago $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location:...Contract workSummer workImmediate startRemote work$130 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...the task's question to challenge frontier coding agents while ensuring it remains well-defined... ...work in the task README and submit for expert review, addressing reviewer feedback on returned...Contract workSummer workRemote work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Contract workSummer workRemote work$65 - $75 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...as benign, dual-use, and adversarial. Evaluate model responses against a defined policy... ...for correct responses. Collaborate with experts to ensure models correctly judge misuse potential...Contract workSummer workRemote work$60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Application Users - Windows 11 Professional Expert - Professionals Type: Contract Compensation... ...: Remote Role Responsibilities Evaluate and utilize Windows 11 Professional as...Contract workSummer workRemote work$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Trainium (NKI) Kernel Expert Type: Contract Compensation: $... ...: Remote Role Responsibilities Evaluate the quality, correctness, and hardware-appropriateness...Contract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$120 - $175 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location...Contract workSummer workRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote work$15 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation... ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Contract workSummer workImmediate startRemote workFlexible hours$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product... ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously...Hourly payContract workSummer workImmediate startRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have...Contract workSummer workRemote work$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Contract workSummer workRemote workFlexible hours$70 per hour
...Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original, executable research problems that today's frontier models cannot solve...Contract workPart timeImmediate start- ...Job Description Job Description Claude Code User Job Type: Contractor Location:... ...to support a project focused on advancing AI coding agents. You will share real-world experience... ...and ambiguous technical problems. Evaluate the strengths and limitations of AI coding...Remote jobFor contractors
- ...California, United StatesCompany: Kaiser PermanentePosted: 2026-09-25Kaiser Permanente seeks an experienced Inpatient Coder to accurately code and abstract inpatient cases using ICD-CM, ICD-PCS, CPT and HCPCS. The role covers OBS, HAS, ED and CHOY services as needed, with...Remote work
Kaiser Permanente
Oakland, CA2 days ago $148k - $185k
...innovations and resolving pain points with AI automation solutionsDeliver scalable,... ...high quality and well-tested solutions and code.Collaborate closely with Lyft internal teams... ...effectively with various stakeholders e.g. Backend, Frontend, Data Engineering, Data Science, Claim...Front endHourly payWork experience placementWork at officeLocal area3 days per weekLyft
San Francisco, CA1 day ago$60 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...-truth outputs and objective rubrics. Evaluate AI models on visual document understanding... ...content . Collaborate with subject matter experts to ensure task relevance and accuracy....Contract workSummer workRemote work$50 - $60 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Expert Interviewer Type: Contract Compensation... ...technical depth, communication, and AI-evaluation fit using a provided rubric. Confirm...Contract workSummer workRemote workWeekday work$180k - $400k
...Join a fast-moving, pre-seed-backed AI startup building the next generation of... ...AI-driven user experiences. Develop evaluation and safety infrastructure to measure model... ...APIs and data models, writing frontend and backend code, and operating production systems with...Front endClera
San Francisco, CAa month ago$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work- ...Software Engineers to support an AI training project by creating... ...learning environments that evaluate AI models on complex software... ...Ensure tasks accurately measure coding ability, problem-solving, and... ...apply. Availability Selected experts should be prepared to begin...Remote jobFor contractors
- ...About StackAIStackAI (by Asana) is a no-code AI workflow platform that empowers companies to build, deploy, and scale AI-powered workflows... ...across the Python backend and React/Next.js TypeScript frontend.Forecast and close high-value opportunities.Write proposals, pitch...Front end
Stack AI
San Francisco, CA5 days ago - ...Description Job Description Full-Stack AI Engineer Location: Remote / Flexible... ...influence, and is already using AI coding tools as part of their daily engineering... ...production Design intelligent solutions across frontend, backend, data, and AI agent systems...Front endFull timeContract workRemote workFlexible hours
NxT Level
San Francisco, CAa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert - AI Trainer. Be the first to apply!
Related searches
- ai evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- education evaluator San Francisco, CA
- evaluator San Francisco, CA
- guest service support expert San Francisco, CA
- fulfillment expert San Francisco, CA
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- ai trainer San Francisco, CA