Data Engineer - AI Model Evaluator
$400 per monthMercor
About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first serve basis. What You'll Do Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems. Identify bugs, edge cases, scalability issues, and failure modes. Compare outputs from multiple frontier models and assess their strengths and weaknesses. Apply professional engineering judgment to realistic data engineering scenarios. Time Commitment Sprint based project that runs in 12-24 hour stretches based on client requirement. Compensation $400 per accepted task. Typical tasks take approximately 2-3 hours after ramp-up. Compensation is tied to accepted work. Who Should Apply 2+ years of professional data engineering experience. Experience building ETL pipelines, data warehouses, analytics platforms, or distributed data systems. Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools. Ability to evaluate model-generated data infrastructure and pipeline implementations. Experience operating large-scale data platforms is preferred. #J-18808-Ljbffr Mercor
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - AI Model Evaluator in New York, NY vacancy
- ...experienced Investment Banking SME to support the development, evaluation, and improvement of advanced AI models in finance. You will assess AI-generated analyses for accuracy, reasoned judgments, and data integrity, guiding model refinements and prompts for high-quality...SuggestedRemote job
- Obsidian is seeking Insurance domain SMEs to join a cutting-edge AI training program. You will evaluate AI model outputs against real underwriting practice and rubrics, guiding research and engineering teams to close knowledge gaps in underwriting, claims, and risk assessment...Suggested
$20 per hour
Feedinkoo is looking for a Web Developer/Designer to enhance AI models by evaluating design work, including interfaces and user experiences. This role involves reviewing AI‑generated visuals and providing feedback to improve users' experience with AI tools. Working remotely...SuggestedRemote job- Data Scientist and Model Developer, Vice President (Contract) A temporary role... ...in AML model development, AI/ML and GenAI. Location Kuala... ...development, ongoing performance evaluation and annual model reviews.... ...in developing analytic engines with detailed technical documentation...SuggestedContract workTemporary work
- ...independent assurance and evaluating the company's risk management... ....We are looking for data scientists and AI developers who will power our... ...You will be deploying your engineering, data analytics and data science... ...in frameworks for auditing models, including criteria like...Suggested
$175k - $215k
...states. The mission of the Waymo AI Foundations team is to develop... ...from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation. In this hybrid role, you... ...- Drive model development via data, eval, and systems - Implement...Full timeRemote workWaymo
New York, NY1 day ago$228.7k - $343.1k
...enormous scale, and one bad model can mean millions in... ...to models applies to AI. We build the tooling that... ..., so you critically evaluate what it produces and own... ...write, learning the data, configs, and conventions... ...Solid software and data engineering: production-quality...Remote jobFull timeLocal areaShift workBlock
New York, NY1 day ago- Req ID:376263NTT DATA strives to hire exceptional, innovative and passionate individuals... ...now.We are currently seeking a Senior Data Engineer - Snowflake to join our team in Remote, New... .... We are one of the world's leading AI and digital infrastructure providers, with...Full timeWork at officeRemote workFlexible hours
- ...advanced hardware, software, and AI technology to make it possible... ...of sleep into a personalized, data-driven recovery experience. We... ...we need a world-class Data Engineer to power our next phase of hypergrowth... ...expertise in data modeling and warehousing—you think in terms...Full timeWork at officeImmediate startWorldwideSleeping nightsNight shift
$190k - $220k
...more about ourTotal Rewards philosophy.AI is a fundamental part of how work gets done... ...during the interview process.The Data Engineering team builds tools and systems that make... ...event streams.Strong foundation in data modeling, schema design, and data quality best practices...Full timeWork at officeLocal area2 days per week3 days per week- ...Degree in Computer Science, Business Analytics, Engineering, Mathematics, or related field2+ years of professional experience in data engineering, software engineering, or... ...platforms such as (Databricks, SageMaker, Vertex AI), MLOps best practices, and GenAI toolkits (LangChain...ApprenticeshipEasy work
- ...leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are... ...Cohere is a team of researchers, engineers, designers, and more, who are all... .... As a member of our Analytics & Data Insights team, you'll tackle the...Work at officeLocal areaRemote workHome office
$148.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...search, enterprise data discovery, and... ...Knowledge Graph and AI Engineering team.The SMTS will serve... ...Engineering: Develop graph data models, write complex graph... ...standards.)Evaluate & Innovate (LMTS): Conduct...Full timeContract work$72k - $96.9k
...Overview We are seeking a skilled AWS Data Engineer to design, build, and optimize scalable... .... Solid understanding of data modeling, warehousing, and big data concepts.... ...fueled by its market leading capabilities in AI, generative AI, cloud and data, combined...Full timeLocal area- ...Financial ServicesSelling Points Lead impactful data engineering projects in a fast-paced financial... ...quality standards.Contribute to AI agent operations, supporting deployment... ...governance principles are upheld in all data modeling and transformation tasks.Document data processes...
$180k
Title: Data EngineerLocation: New York, NY - Hybrid 3x per weekClient: Leading US financial... ...company is looking for a hands-on Data Engineer to join their IT Infrastructure team. This... ...data lakehouse migrationsFamiliarity with AI coding tools (Cursor, Claude Code, etc.)Compensation...$170k - $230k
...If you're energized by shaping data infrastructure from zero to one... ...-Funnel Agentic Intelligence & Models) — the team building the next generation of agentic AI advertising products- Pipelines... ...reporting that scales spanning Engineering, Science, PM-T, and Design across...Flexible hours$137.4k - $161.7k
...impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will... ...Develop robust ELT/ETL processes, data models, orchestration workflows, and data... ...clients, exercising sound judgment in evaluating outputs.Apply AI technologies (e.g.,...Local areaImmediate startFlexible hours$128k - $252.5k
...services covering valuation modeling, cost optimization,... ...We are hiring a Senior Data Scientist to... ...of tools, products, and AI services. You will work... ...interdisciplinary data scientists, engineers, architects, and... ...helping them understand and evaluate new and essential areas...Local area$123k - $215.25k
...annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full... ...experience engineering (Mobile and Web), AI/ML, marketing technology, enterprise communications... ..., and automation, grounded in our data technology model that prioritizes data governance. It...WorldwideVisa sponsorship$90k - $135.29k
...Program for Surgical Intelligence is seeking a Data Engineer to support the development and deployment... ...execution of research and clinical AI projects across the Department of SurgeryTrack... ....Familiarity with healthcare data models and standards (such as Epic Clarity, Caboodle...TraineeshipLocal areaImmediate startFlexible hours$97.17k - $126.32k
...that mindset.About the Role:The Data Engineer designs, develops, and... ...implement logical and physical data models that promote consistency,... ...and development standards.• Evaluate emerging technologies and recommend... ...Intelligence, analytics, and AI initiatives through modern...Full timeLocal areaVisa sponsorship$110k - $190k
Senior Data Management Professional - Data Engineering - Commodities Data Location New York Business Area... ...we’re responsible for onboarding, modelling and maintaining data that are fit... ...leverages modern technologies including AI and machine learning to enhance...Temporary workFor contractorsWork experience placement$320k - $405k
...interpretable, and steerable AI systems. We want AI to... ...committed researchers, engineers, policy experts, and... ...the role As a Data Engineer on the Safeguards... ...team works to monitor models, prevent misuse, and ensure... ...ML model monitoring or evaluation ~ Familiarity with...Full timeWork at officeImmediate startVisa sponsorshipFlexible hours$106k
...join our team as we help shape a brighter way forward. DATA CENTER OPERATING ENGINEER (Union) Local 30 Shift: 11-7 Sunday-Monday-Tuesday /Wednesday... ...At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between...Daily paidFull timeWork at officeLocal areaFlexible hoursShift workNight shiftAfternoon shift- ...curiosity.Our Technology Infrastructure team engineers and operates the foundational technology... ...oriented and dedicated Low-Latency Market Data Engineer with at least 10 years of... ...Prometheus / Grafana)Develop and expand upon AI based tools that link to key data sources...
$180k - $220k
...reimagining healthcare in the U.S. — and using AI to scale that impact further and faster... ...We are seeking an exceptional Senior Data Engineer with a high sense of ownership who is... ...data pipelines, query optimization, data modeling, and defining reusable datasets ~...Full timeWork at officeFlexible hours3 days per week$125k - $145k
...re building Our team runs a range of data and AI projects across the GPS business. A... ...product, servicing, and client questions. •Models that optimize pricing and foreign-... ...This is a hybrid role that spans data engineering, AI product enablement, and platform architecture...Full timeWork at officeFlexible hoursShift workDay shift$140k - $348k
...translating designs into code, or iterating with AI. From idea to product, Figma empowers... ...us!We are looking for an experienced Data Engineer to partner with our Data Science and Data... ...deep understanding of Figma’s core data models and optimize data pipelines for scale.Partner...Minimum wageFull timeLocal areaRemote workFlexible hours- ...25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date:... ...micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault,... ...AWS Bedrock APIs Knowledge of Generative AI concepts (such as RAG, Vector embeddings,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - AI Model Evaluator. Be the first to apply!
Related searches
- junior data engineer remote New York, NY
- director data engineering New York, NY
- hadoop big data developer New York, NY
- data engineer intern New York, NY
- senior data quality engineer New York, NY
- senior cloud data engineer New York, NY
- data engineer contract New York, NY
- data infrastructure engineer New York, NY
- junior data developer New York, NY
- associate data engineer New York, NY