Frontend Code Evaluator - Expert
$90 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote
Role Responsibilities
- Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
- Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
- Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
- Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
- Write structured rationales for every judgment, ranking defects by importance in precise language.
- Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
- 3+ years of professional web development experience, primarily in frontend or full-stack work.
- Fluency in hand-written HTML and CSS .
- Working command of browser devtools .
- Enough JavaScript to read scripts and understand DOM manipulation.
- Comfort in a terminal for local server setup.
- Strong written English and discipline to justify judgments.
Preferred
- Prior RLHF , preference labeling, or model evaluation work.
- Code review or technical assessment background.
- Pixel-perfect design-to-code experience.
- Web accessibility expertise ( WCAG , ARIA ).
- Familiarity with LLMs' typical failures in codegen.
- Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert in New York, NY vacancy
$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality...SuggestedContract workSummer workRemote workFlexible hoursMercor
New York, NY27 days ago- ...Health in Westchester, NY is seeking a Certified Professional Coder (CPC) to review clinical documentation and assign CPT and ICD-10 codes for anesthesia services. This hybrid position combines 3 days onsite and 2 days remote, with standard daytime hours and a 1-hour...SuggestedRemote work
Northwell
New York, NY2 days ago - ...is seeking a JavaScript Specialist to join our Expert Network, evaluating AI-generated JavaScript/TypeScript code for accuracy and reliability. You will complete... ...model performance, and offer structured feedback on frontend/backend reasoning. Remote work with flexible...Front endRemote workFlexible hours
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY12 days ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY12 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote workMercor
New York, NY12 days ago- About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade...Hourly payWork at officeRemote work
- A health care organization is seeking a Coding Specialist to ensure accurate coding for patient records. The role requires experience in CPT and ICD-10-CM coding along with AAPC CPC certification. Responsibilities include conducting coding reviews, resolving denials, and...Remote jobFull time
- ...ensuring all HIM functions are effectively integrated. The ideal candidate will have over 3 years of Epic HIM experience, particularly in Coding. This is a full-time position offering a competitive salary and the potential for occasional onsite visits. #J-18808-Ljbffr HCTecRemote jobFull time
- Mercor is seeking an Application Users contractor to work remotely, focusing on Visual Studio Code on macOS for specialized tasks. The role emphasizes independent work with the VS Code environment and the ability to produce high-resolution screenshots beyond 2.5 MP using...Remote jobFor contractorsFlexible hours
- AI Trainer Jobs is seeking a Frontend Developer (Creative + Full-Stack) for a remote engineering review track. You will reproduce... ...so the modeling team can target gaps. The work focuses on evaluating production code, debugging traces, and developer-facing AI outputs for...Front endRemote jobFor contractors
$85 per hour
...Larry Summers , and Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type: Contract Compensation: $85/... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex machine learning and AI engineering tasks....Contract workSummer workRemote workMercor
New York, NY12 days ago$30 per hour
...experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout,...Remote jobWork from homeFlexible hours- Trend Health Partners is seeking a Nurse Coding Auditor to review medical records and itemized bills for accurate CPT/HCPCS/revenue code usage on hospital claims. The role emphasizes CMS guideline adherence, documentation review, and audit accuracy in a dynamic, tech-enabled...
- Nextbyte, a remote-friendly software firm, seeks a Full Stack Frontend Developer to design and deliver scalable web interfaces. You will collaborate with backend engineers and product teams in a fast-paced environment, using React, Next.js, Vue.js, or Angular to build...Front endRemote job
- ROLE SUMMARY True Footage is seeking an Appraiser in New York, NY who is ready to redefine the profession through cutting-edge technology and extensive data-supported analysis. This role is ideal for a Certified residential appraiser with an understanding of valuation...Front endFull timeTraineeshipRemote workLong distance
True Footage
New York, NY4 days ago $80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/hour Location... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Contract workSummer workImmediate startRemote work$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...judgment. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote work$125k - $200k
...that person for a different kind of seat: the in-house compliance expert on a product team building affordable housing certification... ...USDA RD requirements into guidance engineers can build from — no coding, just clarity Review system-generated tenant income certifications...Full timeInterim roleWork at officeRelocationRelocation packageFlexible hoursDay shiftPercy
New York, NY15 hours ago- A management consultancy firm based in New York is looking for an experienced Senior .Net Developer with expertise in C# and VSTO, and a strong knowledge of the Investran application. The ideal candidate will have 6-8 years of hands-on development experience and will be...Front end
Glan Management Consultancy
New York, NY1 day ago $70 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Chemistry PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Contract workSummer workImmediate startRemote work- A leading consulting firm is seeking a versatile Web Developer for future remote opportunities. Candidates should have strong expertise in front-end technologies and eLearning development. This role offers a chance to lead projects and collaborate with creative teams. Proficiency...Front endRemote job
$25 - $100 per hour
...Chemistry Expert (Contract) Remote (UnitedStates preferred) Shape the data that powers frontier AI Labelbox Quick facts Engagement... ...let teams iterate on data as nimbly as they iterate on code, enabling safer, smarter models in production. We’re backed by SoftBank...Hourly payContract workFor contractorsRemote workWorldwideFlexible hoursAlignerr Corp.
New York, NY4 days ago$150 per hour
...Role Overview Join Turing as a Physics Expert (PhD, Remote) and help shape how the... ...frontier model capabilities in reasoning, coding, agentic behavior, multimodality, multilinguality... ..., you’ll design challenging problems, evaluate model outputs, and provide expert...Hourly payContract workFreelanceRemote work10 hours per weekFlexible hoursTuring
New York, NY3 days ago$50 per hour
...by-step solutions with rigorous logic. Evaluate AI outputs for accuracy and quality of... ...expertise). Assessment: Shortlisted experts complete an evaluation before selection.... ...plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality...Contract workRemote workFlexible hoursTuring Inc
New York, NY1 day ago$75 per hour
...0/hr - $75.00/hr Position: Chemistry Expert (Master’s / PhD) Type: Hourly contract... ...Solve and review problems used to train and evaluate frontier AI models. Collaborate... ...or Computational Chemistry. Experience coding in Python and/or R for research or applied...Hourly payContract workPart timeRemote workCrossing Hurdles
New York, NY3 days ago- Title: .NET Architect with P&C Insurance/ Reinsurance experience Locations - Warren, NJ - Hybrid Technical Qualifications: Architecture experience & P&C Insurance/ Reinsurance exp Must Minimum of 15 of experience in .Net application development. Experience with both...Front end
$85k - $110k
...National Skincare & Service Expert, New York From 1946, people of the House of Parfums Christian Dior in France and around the world... ...creator, the couturier-perfumer Christian Dior. Revolutionizing the codes of French elegance and luxury with its perfumes, combining...Work at officeChristian Dior Perfumes
New York, NY1 day ago$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $100–$150/hour Location... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert. Be the first to apply!
Related searches
- ai evaluator New York, NY
- education evaluator New York, NY
- work from home web search evaluator New York, NY
- evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- social media evaluator New York, NY
- quality evaluator New York, NY
- sql expert New York, NY
- guest service support expert New York, NY