Frontend Code Evaluator - Expert - AI Trainer
$90 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote
Role Responsibilities
- Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
- Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
- Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
- Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
- Write structured rationales for every judgment, ranking defects by importance in precise language.
- Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
- 3+ years of professional web development experience, primarily in frontend or full-stack work.
- Fluency in hand-written HTML and CSS .
- Working command of browser devtools .
- Enough JavaScript to read scripts and understand DOM manipulation.
- Comfort in a terminal for local server setup.
- Strong written English and discipline to justify judgments.
Preferred
- Prior RLHF , preference labeling, or model evaluation work.
- Code review or technical assessment background.
- Pixel-perfect design-to-code experience.
- Web accessibility expertise ( WCAG , ARIA ).
- Familiarity with LLMs' typical failures in codegen.
- Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert - AI Trainer in San Francisco, CA vacancy
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote work- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...SuggestedRemote jobHourly payWork at office
- About the roleWe're building a high-quality evaluation dataset for CNC manufacturing and are looking for experienced CNC machinists to help author and validate grading rubrics for CNC machining work. You'll bring real production-floor judgment to determine whether a machining...Suggested
$120 - $175 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location...SuggestedContract workSummer workRemote workMercor
San Francisco, CA5 days ago- 1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define...
- Perspectum Diagnostics Ltd. is seeking a Field Reimbursement Specialist to guide physicians and staff on reimbursement, coding, and coverage for Perspectum products. You will work with operations and customer success to overcome payer barriers and support patient access...Work at officeWork from home
$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks...Contract workSummer workRemote work- ...experienced engineer to deploy enterprise-grade AI solutions, focusing on Retrieval-Augmented... ...backend and React/Next.js TypeScript frontend. Forecast and close high-value... .... About StackAI Stack AI is a no-code drag-and-drop tool to quickly design, test...Front endFull time
StackAI
San Francisco, CA1 day ago $163k - $246.5k
...Semgrep Semgrep, the leader in code security for builders,... ...gets smarter as you build, with AI that learns your context to cut... ...powered solutions and rigorously evaluate the efficacy of different prompts... ..., Typescript and React on the Frontend, Python, Flask and SQLAlchemy...Front endFull timeCurrently hiringLocal areaRemote workWeekend work3 days per weekSemgrep, Inc.
San Francisco, CA1 day ago- ...role: We’re looking for a Foundational AI Engineer who thrives in ambiguity, enjoys... ...systems using tools like n8n, Claude Code-style agents, or similar orchestration approaches... ...(AWS preferred). ~ Experience with frontend development, especially TypeScript and its...Front endFull timeWork at office
Numeral
San Francisco, CA1 day ago $50 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location:...Contract workSummer workRemote work$150k - $210k
AI Engineer - Agentic AutomationLocation: RemoteCompensation: $... ...making and task execution- Own evaluation frameworks — accuracy, latency... ..., including Claude-based and code-first AI frameworks, to build... ...automation tooling- Build lightweight frontend interfaces from product...Front endLocal areaImmediate start$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $... ...performance . Collaborate with subject matter experts to ensure consistency and domain...Contract workSummer workWork at officeRemote work$15 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation... ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Contract workSummer workImmediate startRemote workFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Program management / implementation planning Evaluator Type: Contract Compensation: $... ...outputs . Collaborate with subject matter experts to ensure consistency and quality....Contract workSummer workWork at officeRemote work- ...AI Engineer, Search & Knowledge Systems About Pi Pi is building... ...is still scattered across code, tickets, documents, incidents... ...representation, ranking, evaluation, and production systems.... ...Partner with product, backend, frontend, platform, and security teams...Front endFull time
Pi Security
San Francisco, CA1 day ago $128k - $173k
...modifies, configures, debugs and evaluates application programs for... ...logical database design, performs coding and tests/debugs programs.... ...opportunities to enhance UX using: AI-driven UX personalization... ...Understanding of micro frontends and modern web architectures...Front endWork at officeRemote work2 days per week1 day per weekPacific Gas And Electric Company
Oakland, CA2 days ago$165k - $190k
...Lawyer is seeking an experienced, passionate AI/ML software engineer for Rocket Copilot,... ...services to allow Rocket Lawyer product frontends to interact with ML models Work closely... ...capabilities, while writing clean, understandable code What you’ll need ~5+ years of...Front endFull timeWork experience placementWorldwideRocket Lawyer
San Francisco, CA1 day ago$148k - $185k
...innovations and resolving pain points with AI automation solutionsDeliver scalable,... ...high quality and well-tested solutions and code.Collaborate closely with Lyft internal teams... ...effectively with various stakeholders e.g. Backend, Frontend, Data Engineering, Data Science, Claim...Front endHourly payWork experience placementWork at officeLocal area3 days per week- ...You are an exceptional AI-native software engineer... ...how you build. You use coding agents and other AI... ...constraints, establish tests and evaluations, and review generated... ...full stack, including frontend and backend systems.... ...customers, and domain experts. The ability to communicate...Front endPermanent employmentFull timeWork experience placementLive inWork at officeLocal area
$140k - $200k
...distributed setting - Speechify has no office. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft,... ...Proficiency in Docker and Infrastructure-as-Code concepts and professional experience with at least one major...Front endRemote jobFull timeWork at officeShift workSpeechify
San Francisco, CA1 day ago$180k - $400k
...team building the next generation of AI-driven products that automate complex,... ...models and APIs to agent orchestration and evaluation infrastructure — and you'll see your... ...APIs and data models, implement frontend and backend code, and operate production systems with CI...Front endFull timeWork at officeClera
San Francisco, CA2 days ago$211k - $290.5k
...Compass — Faire’s user facing AI bet within the Discovery Pillar... ...agent quality through data, evaluation, and modeling, while shipping... ...plumbing, tool wrappers, and the frontend surfaces where the assistant... ...AI-native in practice: uses AI coding tools and agent workflows as a...Front endWork experience placementWork at officeLocal areaImmediate startRemote workMonday to FridayFlexible hours3 days per week$125k - $250k
...startup in San Francisco is seeking a talented Design Engineer to create exceptional brand identities and intuitive UI/UX for their no-code AI platform. The ideal candidate has a proven background in UI/UX design and front-end development, particularly in Next.js and...Front end- ...connectors, transformations, visualizations, AI-powered analytics, and even inbound Zero-... ...designs into responsive, high-quality code.Move quickly and confidently, making smart... ...Django, or related technologies.Familiarity in frontend development with React or typescript....Front endWork at office3 days per week
$180k - $280k
...We build reliable and general AI systems to power economically... ...and performance Develop and own evaluation frameworks to measure quality,... ...Next.js, and Tailwind CSS for frontend, with Kubernetes for... ...their job done, including Claude Code and Cursor. Who we're looking...Front endWork at officeVisa sponsorshipShift work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands...Contract workSummer workRemote work$148k - $185k
...Responsibility Write clean, maintainable, and well‑documented API and code while adhering to industry best practices, including code... ...Identify and resolve performance bottlenecks, ensuring that both frontend and backend components are optimized for speed and reliability....Front endFlexible hours- ...human intelligence to power the AI economy. We're a leading AI data... ...frontier models. Millions of domain experts on the platform are paid over $4... ...work on Mercor's platform is code —the tasks, problems, and solutions that train and evaluate the world's frontier coding...Full timeWork at officeRelocation package
Mercor
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert - AI Trainer. Be the first to apply!
Related searches
- work from home web search evaluator San Francisco, CA
- evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- education evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- subject matter expert San Francisco, CA
- guest service support expert San Francisco, CA
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA