Frontend Code Evaluator - Expert - AI Trainer

$90 per hour

Mercor

Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote
Role Responsibilities
Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
Write structured rationales for every judgment, ranking defects by importance in precise language.
Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
3+ years of professional web development experience, primarily in frontend or full-stack work.
Fluency in hand-written HTML and CSS .
Working command of browser devtools .
Enough JavaScript to read scripts and understand DOM manipulation.
Comfort in a terminal for local server setup.
Strong written English and discipline to justify judgments.
Preferred
Prior RLHF , preference labeling, or model evaluation work.
Code review or technical assessment background.
Pixel-perfect design-to-code experience.
Web accessibility expertise ( WCAG , ARIA ).
Familiarity with LLMs' typical failures in codegen.
Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert - AI Trainer in San Francisco, CA vacancy

BI Dashboard Evaluator - Expert - AI Trainer
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...
Suggested
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
9 days ago
User Research Expert - Evaluator - AI Trainer
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...
Suggested
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
3 days ago
Coding Expert
...Bachelor’s with 4+ years of strong coding experience. Proficiency in... ...and a passion for mentoring AI to produce best-in-class code.... ...and challenging test cases to evaluate model performance. Deliver... ...More: Job Title: Coding Expert Job Type: Contract (Part-time...
Suggested
Contract work
Temporary work
Part time
Remote work
micro1
San Francisco, CA
more than 2 months ago
Pricing Economics Expert Evaluator
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $... ...performance . Collaborate with subject matter experts to ensure consistency and domain...
Suggested
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
8 days ago
Spanish Audio Evaluator - Expert
$50 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location:...
Suggested
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
a month ago
CNC Machining Expert - Evaluator
$120 - $175 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location...
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
6 days ago
Senior Full-Stack Engineer - LLM-Powered Code Review PoC
...NexaFlow is building a next-generation code review tool powered by large language models. We are seeking a Senior Full-Stack Engineer... ...Proficiency in Python (FastAPI) or Node.js for backend; React or Vue for frontend. - Experience with Docker containerization and self-hosted...
Front end
Full time
Contract work
Remote work
Fuku
San Francisco, CA
7 hours ago
Forward Deployed AI Engineer
...experienced engineer to deploy enterprise-grade AI solutions, focusing on Retrieval-Augmented... ...backend and React/Next.js TypeScript frontend. Forecast and close high-value... .... About StackAI Stack AI is a no-code drag-and-drop tool to quickly design, test...
Front end
Full time
StackAI
San Francisco, CA
20 hours ago
Foundational AI Engineer
...role: We’re looking for a Foundational AI Engineer who thrives in ambiguity, enjoys... ...systems using tools like n8n, Claude Code-style agents, or similar orchestration approaches... ...(AWS preferred). ~ Experience with frontend development, especially TypeScript and its...
Front end
Full time
Work at office
Numeral
San Francisco, CA
20 hours ago
Senior AI Software Engineer
$163k - $246.5k
...Semgrep Semgrep, the leader in code security for builders,... ...gets smarter as you build, with AI that learns your context to cut... ...powered solutions and rigorously evaluate the efficacy of different prompts... ..., Typescript and React on the Frontend, Python, Flask and SQLAlchemy...
Front end
Full time
Currently hiring
Local area
Remote work
Weekend work
3 days per week
Semgrep, Inc.
San Francisco, CA
20 hours ago
AI Engineer
$150k - $210k
AI Engineer - Agentic AutomationLocation: RemoteCompensation: $... ...making and task execution- Own evaluation frameworks — accuracy, latency... ..., including Claude-based and code-first AI frameworks, to build... ...automation tooling- Build lightweight frontend interfaces from product...
Front end
Local area
Immediate start
Cargomatic
San Francisco, CA
3 days ago
AI Engineer, Search & Knowledge Systems
...AI Engineer, Search & Knowledge Systems About Pi Pi is building... ...is still scattered across code, tickets, documents, incidents... ...representation, ranking, evaluation, and production systems.... ...Partner with product, backend, frontend, platform, and security teams...
Front end
Full time
Pi Security
San Francisco, CA
20 hours ago
Malayalam Music Expert - Evaluator
$15 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation... ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...
Contract work
Summer work
Immediate start
Remote work
Flexible hours
Mercor
San Francisco, CA
6 days ago
Program Management Evaluator - Expert
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Program management / implementation planning Evaluator Type: Contract Compensation: $... ...outputs . Collaborate with subject matter experts to ensure consistency and quality....
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
3 days ago
SAP UI/UX Programmer Expert
$128k - $173k
...modifies, configures, debugs and evaluates application programs for... ...logical database design, performs coding and tests/debugs programs.... ...opportunities to enhance UX using: AI-driven UX personalization... ...Understanding of micro frontends and modern web architectures...
Front end
Work at office
Remote work
2 days per week
1 day per week
Pacific Gas And Electric Company
Oakland, CA
3 days ago
AI/ML Software Engineer
$165k - $190k
...Lawyer is seeking an experienced, passionate AI/ML software engineer for Rocket Copilot,... ...services to allow Rocket Lawyer product frontends to interact with ML models Work closely... ...capabilities, while writing clean, understandable code What you’ll need ~5+ years of...
Front end
Full time
Work experience placement
Worldwide
Rocket Lawyer
San Francisco, CA
20 hours ago
Senior AI Software Engineer, Risk - Insurance Claims Management
$148k - $185k
...innovations and resolving pain points with AI automation solutionsDeliver scalable,... ...high quality and well-tested solutions and code.Collaborate closely with Lyft internal teams... ...effectively with various stakeholders e.g. Backend, Frontend, Data Engineering, Data Science, Claim...
Front end
Hourly pay
Work experience placement
Work at office
Local area
3 days per week
Lyft
San Francisco, CA
4 days ago
AI Native Software Engineer - Products
...You are an exceptional AI-native software engineer... ...how you build. You use coding agents and other AI... ...constraints, establish tests and evaluations, and review generated... ...full stack, including frontend and backend systems.... ...customers, and domain experts. The ability to communicate...
Front end
Permanent employment
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
San Francisco, CA
2 days ago
Software Engineer, Data Infrastructure & Acquisition - San Francisco, CA, USA
$140k - $200k
...distributed setting - Speechify has no office. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft,... ...Proficiency in Docker and Infrastructure-as-Code concepts and professional experience with at least one major...
Front end
Remote job
Full time
Work at office
Shift work
Speechify
San Francisco, CA
20 hours ago
Data Engineer III
$148k - $185k
...Responsibility Write clean, maintainable, and well-documented API and code while adhering to industry best practices, including code... ...and resolve performance bottlenecks, ensuring that both frontend and backend components are optimized for speed and reliability....
Front end
Flexible hours
Crunchyroll
San Francisco, CA
2 days ago
AI Engineer (Mid-Level)
$180k - $400k
...team building the next generation of AI-driven products that automate complex,... ...models and APIs to agent orchestration and evaluation infrastructure — and you'll see your... ...APIs and data models, implement frontend and backend code, and operate production systems with CI...
Front end
Work at office
Clera
San Francisco, CA
3 days ago
AI Support Engineer
$65k - $95k
...Join to apply for the AI Support Engineer role at Blink.new We’re seeking an AI... ...prompts easily. Understanding of basic frontend, backend, database, authentication, and... ...the top 0.1% in prompt engineering, vibe coding, system architecture, and AI skills. Enjoy...
Front end
Full time
Flexible hours
Blink.new
San Francisco, CA
1 day ago
Senior Applied AI/ML Scientist - Compass
$211k - $290.5k
...Compass — Faire’s user facing AI bet within the Discovery Pillar... ...agent quality through data, evaluation, and modeling, while shipping... ...plumbing, tool wrappers, and the frontend surfaces where the assistant... ...AI-native in practice: uses AI coding tools and agent workflows as a...
Front end
Work experience placement
Work at office
Local area
Immediate start
Remote work
Monday to Friday
Flexible hours
3 days per week
Faire
San Francisco, CA
1 day ago
Design Engineer: UI/UX for AI No‑Code Platform
$125k - $250k
...startup in San Francisco is seeking a talented Design Engineer to create exceptional brand identities and intuitive UI/UX for their no-code AI platform. The ideal candidate has a proven background in UI/UX design and front-end development, particularly in Next.js and...
Front end
StackAI
San Francisco, CA
4 days ago
Software Engineer, Search Systems - Code Data
...human intelligence to power the AI economy. We're a leading AI data... ...frontier models. Millions of domain experts on the platform are paid over $4... ...work on Mercor's platform is code —the tasks, problems, and solutions that train and evaluate the world's frontier coding...
Full time
Work at office
Relocation package
Mercor
San Francisco, CA
4 days ago
Senior Software Engineer, Backend Full Stack - Data Cloud
...connectors, transformations, visualizations, AI-powered analytics, and even inbound Zero-... ...designs into responsive, high-quality code.Move quickly and confidently, making smart... ...Django, or related technologies.Familiarity in frontend development with React or typescript....
Front end
Work at office
3 days per week
Rippling
San Francisco, CA
4 days ago
Sales Engineering Expert - Evaluator
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands...
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
8 days ago
Applied AI Engineer, Fullstack
$10k
...Intelligence team, part of Ramp's Applied AI org, powers the agentic analysis, FP&A,... ...build artifacts on top of. This is a frontend-leaning role for an engineer who obsesses... ...not the other way around Use the latest coding models and agentic workflows as a core part...
Front end
Full time
Work at office
Home office
Relocation package
Flexible hours
Paribus (Ramp)
San Francisco, CA
2 days ago
Staff AI Frontend Engineer
$250k - $315k
...equity About the Company Our client builds AI for AI transformation, tackling the... ...Tools (post-Series B) The Role A Staff AI Frontend Engineer sitting at the intersection of... ...the founding team on how the company scales code review and SDLC with agents Strong comp...
Front end
Full time
Relocation package
David Joseph & Company
San Francisco, CA
23 days ago
Software Engineer, Data Products & Platform
...Design and build complex full-stack features across backend and frontend systems. Improve product performance and reliability and increase... ...of abstraction. Ability to write bug-free, understandable code and raise the engineering bar. Familiarity with Clay’s...
Front end
Full time
Work at office
Remote work
Clay Labs
San Francisco, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert - AI Trainer. Be the first to apply!