Frontend Code Evaluator - Expert
$90 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote
Role Responsibilities
- Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
- Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
- Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
- Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
- Write structured rationales for every judgment, ranking defects by importance in precise language.
- Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
- 3+ years of professional web development experience, primarily in frontend or full-stack work.
- Fluency in hand-written HTML and CSS .
- Working command of browser devtools .
- Enough JavaScript to read scripts and understand DOM manipulation.
- Comfort in a terminal for local server setup.
- Strong written English and discipline to justify judgments.
Preferred
- Prior RLHF , preference labeling, or model evaluation work.
- Code review or technical assessment background.
- Pixel-perfect design-to-code experience.
- Web accessibility expertise ( WCAG , ARIA ).
- Familiarity with LLMs' typical failures in codegen.
- Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert in New York, NY vacancy
$50 per hour
...Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:... ...workflows in Hindi. Familiarity with Hindi-English code-switching and regional language variation. Interest in AI,...SuggestedContract workSummer work10 hours per weekMercor
New York, NY8 days ago$85 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Frontend Engineer (Coding Agent Experience) Type: Contract Compensation: $... ...Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated frontend...Front endContract workSummer workRemote work$150 per hour
...Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each disposition is correct and adequately supported by the record. Confirm work is completed and...SuggestedContract workSummer workRemote workMercor
New York, NY8 days ago- ...Job Description Job Description Claude Code User Job Type: Contractor Location: Remote Job Overview We are seeking experienced... ...to-end feature development and ambiguous technical problems. Evaluate the strengths and limitations of AI coding agents using...SuggestedFor contractorsRemote work
YO AI Labs
New York, NY2 days ago $80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY6 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote workMercor
New York, NY7 days ago$150 per hour
...Summers , and Jack Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $150–$220/hour... ...consistent. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote workMercor
New York, NY5 days ago$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote workMercor
New York, NY2 days ago- ...NeoGenomics seeks a Certified Coding Specialist for a remote role, dedicated to analyzing medical records and coding clinical data. You will engage with physicians when documentation is unclear, ensuring comprehensive coding practices. The candidate must have an AAPC...Remote work
NeoGenomics
New York, NY1 day ago - Handshake AI is seeking experienced CAD professionals with 2+ years of hands-on experience using SolidWorks and related CAD software, and professional proficiency in Mandarin Chinese, to support AI research through flexible, hourly contract work. This ongoing, project-based...Remote jobHourly payContract workFlexible hours
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Remote jobContract workFlexible hours
- ...Special Inspections. You will conduct field inspections for masonry, concrete, rebar, and bolting, ensuring compliance with NYC Building Code and project specifications. You will document results, manage non-conformities, and coordinate with contractors, PMs, and design...For contractors
- ...ensuring all HIM functions are effectively integrated. The ideal candidate will have over 3 years of Epic HIM experience, particularly in Coding. This is a full-time position offering a competitive salary and the potential for occasional onsite visits. #J-18808-Ljbffr HCTecRemote jobFull time
- A health care organization is seeking a Coding Specialist to ensure accurate coding for patient records. The role requires experience in CPT and ICD-10-CM coding along with AAPC CPC certification. Responsibilities include conducting coding reviews, resolving denials, and...Remote jobFull time
- ...charge capture. The role requires analyzing revenue data, resolving discrepancies, and auditing the CDM for process improvements. Strong CPT/HCPCS knowledge, EPIC and Craneware experience, and coding certifications are required. #J-18808-Ljbffr J. Morrissey & CompanyRemote job
- Shakepay is seeking a Staff Product Designer Who Codes to bridge design, product, and engineering. You will write frontend code to prototype and ship features, applying a design-led approach to product development. We value a builder who ships real products, uses AI to...Front endRemote job
- United States Digital Space LLC seeks a Software Engineering evaluator to create cutting-edge datasets for training AI models, focusing... ...pipelines, and ML infrastructure. You will evaluate AI-generated code, ensuring efficiency, scalability, and reliability,...
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote workMercor
New York, NY8 days ago- ...The candidate should have over 5 years of experience, with the ability to interpret engineering drawings and execute complex welds to code-quality standards. The role involves coordinating with inspectors and providing mentorship to junior welders, ensuring adherence to...
- Gainwell is seeking a Medical Claims Auditor to review and analyze medical claims for accuracy, compliance, and proper coding. The role emphasizes auditing provider submissions, validating ICD-10/CPT/HCPCS coding, and identifying discrepancies to improve billing integrity...Remote job
$100k - $150k
...for an RCM Solutions Lead to serve as our in-house revenue cycle expert, partnering closely with Product, Sales, and GTM to ensure our... ...understanding of end-to-end RCM workflows including eligibility, coding, billing, AR, denials, and collections Ability to explain operational...Front end$30 per hour
...experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout,...Remote jobWork from homeFlexible hours$55 - $65 per hour
...Location: Remote Role Responsibilities Review and evaluate AI-generated clinical outputs based on nursing flowsheet documentation... ...assessment data for AI training datasets . Provide expert feedback on nursing assessments and documentation practices....Contract workSummer workRemote workMercor
New York, NY7 days ago- Rockstar is searching for a Design Engineer to join their Product Design Team in New York City. In this full-time role, you will collaborate with engineers and designers to enhance digital product features and experiences. You will leverage your 5+ years of experience and...Front endFull time
- Datavant is seeking a ProFee Auditing Specialist to perform coding audits and provide coder education. This role is fully remote and allows for a flexible schedule while contributing to healthcare data collaboration. Ideal candidates will have over 5 years of coding experience...Remote jobFlexible hours
- Trend Health Partners is seeking a Nurse Coding Auditor to review medical records and itemized bills for accurate CPT/HCPCS/revenue code usage on hospital claims. The role emphasizes CMS guideline adherence, documentation review, and audit accuracy in a dynamic, tech-enabled...
- ...hiring experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical and healthcare settings. This role... ...nursing assessment data for AI training datasets Provide expert feedback on nursing assessments and documentation practices Identify...
- ...fire protection systems across Commercial, Industrial, Residential and Hospitality properties. Travel to sites is required to verify code compliance and communicate with owners and managers. The role involves interpreting building codes, reading technical documents, and...
- ...seeks a Lead Electrician to manage various electrical projects, including installations and compliance with NYC Electrical Building codes. Candidates should have at least 5 years of experience and a current OSHA-40 card, while possessing tools and a valid driver’s license...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert. Be the first to apply!
Related searches
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- subject matter expert New York, NY