Frontend Code Evaluator - Expert
$90 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Frontend Engineer — Web Replication Preference Rater
Type: Contract
Compensation: $90/hour
Location: Remote
Role Responsibilities
- Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
- Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
- Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
- Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid .
- Write structured rationales for every judgment, ranking defects by importance in precise language.
- Flag ties, ambiguous cases, and broken task items rather than forcing a preference.
Qualifications
Must-Have
- 3+ years of professional web development experience, primarily in frontend or full-stack work.
- Fluency in hand-written HTML and CSS .
- Working command of browser devtools .
- Enough JavaScript to read scripts and understand DOM manipulation.
- Comfort in a terminal for local server setup.
- Strong written English and discipline to justify judgments.
Preferred
- Prior RLHF , preference labeling, or model evaluation work.
- Code review or technical assessment background.
- Pixel-perfect design-to-code experience.
- Web accessibility expertise ( WCAG , ARIA ).
- Familiarity with LLMs' typical failures in codegen.
- Web scraping or DOM parsing experience.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Frontend Code Evaluator - Expert in New York, NY vacancy
$85 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Frontend Engineer (Coding Agent Experience) Type: Contract Compensation: $... ...Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated frontend...Front endContract workSummer workRemote work- ...NeoGenomics seeks a Certified Coding Specialist for a remote role, dedicated to analyzing medical records and coding clinical data. You will engage with physicians when documentation is unclear, ensuring comprehensive coding practices. The candidate must have an AAPC...SuggestedRemote work
NeoGenomics
New York, NY16 hours ago - Logan Health is seeking a Senior Certified Professional Coder to remotely assign ICD-10-CM and CPT-4 codes to outpatient and inpatient records. The role also manages billing and collections while ensuring coding compliance across client databases. Qualifications include...SuggestedRemote jobWork at office
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...SuggestedTemporary work10 hours per week
$100 - $150 per hour
...structured sales methodologies. Exceptionally strong written communication skills. Detail-oriented and comfortable with peer-reviewed judgment. Preferred Prior experience with AI training, evaluation, or human-data projects. #J-18808-Ljbffr United States Digital Space LLCSuggestedSummer workRemote work- Mercor is hiring experienced Musicians to evaluate generative musical AI models in partnership with a leading AI lab. You will assess model outputs across in different categories of music in your bilingual language. Key Responsibilities Evaluate AI model output lyrics,...Part timeImmediate start10 hours per week
- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Remote jobContract workFlexible hours
- Handshake AI is seeking experienced CAD professionals with 2+ years of hands-on experience using SolidWorks and related CAD software, and professional proficiency in Mandarin Chinese, to support AI research through flexible, hourly contract work. This ongoing, project-based...Remote jobHourly payContract workFlexible hours
- NewYork-Presbyterian Hospital is seeking a Medical Analyst - (Professional Coding) to join our Central Billing Office. You will perform diagnostic and procedural coding, optimize DRG assignment, and support APC coding to ensure accurate and timely hospital revenue cycle...Work at office
- A health care organization is seeking a Coding Specialist to ensure accurate coding for patient records. The role requires experience in CPT and ICD-10-CM coding along with AAPC CPC certification. Responsibilities include conducting coding reviews, resolving denials, and...Remote jobFull time
- ...ensuring all HIM functions are effectively integrated. The ideal candidate will have over 3 years of Epic HIM experience, particularly in Coding. This is a full-time position offering a competitive salary and the potential for occasional onsite visits. #J-18808-Ljbffr HCTecRemote jobFull time
- ...Special Inspections. You will conduct field inspections for masonry, concrete, rebar, and bolting, ensuring compliance with NYC Building Code and project specifications. You will document results, manage non-conformities, and coordinate with contractors, PMs, and design...For contractors
- ...charge capture. The role requires analyzing revenue data, resolving discrepancies, and auditing the CDM for process improvements. Strong CPT/HCPCS knowledge, EPIC and Craneware experience, and coding certifications are required. #J-18808-Ljbffr J. Morrissey & CompanyRemote job
$50 per hour
...Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:... ...workflows in Hindi. Familiarity with Hindi-English code-switching and regional language variation. Interest in AI,...Contract workSummer work10 hours per week- Shakepay is seeking a Staff Product Designer Who Codes to bridge design, product, and engineering. You will write frontend code to prototype and ship features, applying a design-led approach to product development. We value a builder who ships real products, uses AI to...Front endRemote job
$60 - $70 per hour
...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Contract workSummer workRemote workMercor
New York, NY7 days ago- Gainwell is seeking a Medical Claims Auditor to review and analyze medical claims for accuracy, compliance, and proper coding. The role emphasizes auditing provider submissions, validating ICD-10/CPT/HCPCS coding, and identifying discrepancies to improve billing integrity...Remote job
- ...The candidate should have over 5 years of experience, with the ability to interpret engineering drawings and execute complex welds to code-quality standards. The role involves coordinating with inspectors and providing mentorship to junior welders, ensuring adherence to...
$100k - $150k
...for an RCM Solutions Lead to serve as our in-house revenue cycle expert, partnering closely with Product, Sales, and GTM to ensure our... ...understanding of end-to-end RCM workflows including eligibility, coding, billing, AR, denials, and collections Ability to explain operational...Front end- United States Digital Space LLC seeks a Software Engineering evaluator to create cutting-edge datasets for training AI models, focusing... ...pipelines, and ML infrastructure. You will evaluate AI-generated code, ensuring efficiency, scalability, and reliability,...
- Ensemble Health Partners seeks a remote medical coder with at least 1 year of coding experience. You will review records, assign ICD-9-CM, ICD-10, CPT IV, and HCPCS codes using 3M tools for outpatient work types, and ensure accurate, compliant coding. Responsibilities...Remote job
$30 per hour
...experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout,...Remote jobWork from homeFlexible hours- Rockstar is searching for a Design Engineer to join their Product Design Team in New York City. In this full-time role, you will collaborate with engineers and designers to enhance digital product features and experiences. You will leverage your 5+ years of experience and...Front endFull time
- ...LLC is seeking a Junior Web Designer & Developer for a full-time, fully remote role. You’ll blend design with practical front-end coding, working across Wix, HTML/CSS/JS, and no-code tools like AppSheet. Expect to craft forms, manage assets, and collaborate with a fast...Front endRemote jobFull time
- Job Overview As an AI Model Training Specialist with a focus on Bash coding, you will play a crucial role in enhancing the performance of AI models through precise data annotation and validation. You will be responsible for training AI systems by providing domain expertise...Hourly payFlexible hours
- Datavant is seeking a ProFee Auditing Specialist to perform coding audits and provide coder education. This role is fully remote and allows for a flexible schedule while contributing to healthcare data collaboration. Ideal candidates will have over 5 years of coding experience...Remote jobFlexible hours
- Trend Health Partners is seeking a Nurse Coding Auditor to review medical records and itemized bills for accurate CPT/HCPCS/revenue code usage on hospital claims. The role emphasizes CMS guideline adherence, documentation review, and audit accuracy in a dynamic, tech-enabled...
- Tekton Labs busca un Senior Frontend Developer altamente calificado para unirse a su equipo. La persona seleccionada será responsable del desarrollo de una interfaz web que soporte flujos críticos de autenticación. Se requiere experiencia en frameworks como Nuxt.js y Vue...Front end
- ...hiring experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical and healthcare settings. This role... ...nursing assessment data for AI training datasets Provide expert feedback on nursing assessments and documentation practices Identify...
- ...fire protection systems across Commercial, Industrial, Residential and Hospitality properties. Travel to sites is required to verify code compliance and communicate with owners and managers. The role involves interpreting building codes, reading technical documents, and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontend Code Evaluator - Expert. Be the first to apply!
Related searches
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- subject matter expert New York, NY