Data Engineer - AI Model Evaluator - AI Trainer
$80 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Engineer (Coding Agent Experience)
Type: Contract
Compensation: $80/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
- Review model-generated implementations involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems .
- Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic data engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional data engineering experience.
- Experience building ETL pipelines , data warehouses , analytics platforms , or distributed data systems .
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated data infrastructure and pipeline implementations.
Preferred
- Experience operating large-scale data platforms .
Compensation & Legal
- $400 per accepted task .
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - AI Model Evaluator - AI Trainer in Philadelphia, PA vacancy
- ...is partnering with a leading AI research organization to engage... ...for a project focused on evaluating how well AI systems perform real... ...content, and design-to-engineering/production handoff) Score AI... ...training, evaluation, or human-data projects is a strong plus #J...Suggested
$70 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...reasoning and rigor in model outputs . Provide structured... ...feedback to improve training data quality and downstream performance...SuggestedContract workSummer workRemote work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...independently and asynchronously to evaluate and improve AI model performance . Qualifications... ...AI training , evaluation, or human-data projects. Application Process (Takes...SuggestedContract workSummer workRemote work- ...DescriptionCapTech Machine Learning Engineers are responsible for... ...and implementing data-driven solutions for... ...data-driven processes/models and analytical measures... ...MCP and RAG, and agentic AI architectures Strong... ...conversational UX and prompt evaluation metrics Experience with...SuggestedWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...machine learning, large-scale data processing, and cloud technologies... ...Senior Data Science Software Engineer to join our team. In this role... ..., and big data, building AI and ML systems that directly impact... ...data structures, statistical modeling, optimization algorithms, big...SuggestedFull timeTemporary workPart timeWork experience placementLocal areaFlexible hours
$100.79k - $160.26k
...what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and... ....Collaboration & Delivery (Agile Pod Model)Work cross-functionally with engineers, analysts... ...new data and more consistent analytics/AI consumption and creating reduced manual...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$128k - $252.5k
...services covering valuation modeling, cost optimization,... ...We are hiring a Senior Data Scientist to... ...of tools, products, and AI services. You will work... ...interdisciplinary data scientists, engineers, architects, and... ...helping them understand and evaluate new and essential areas...Local area- ...Make history with us.Operational Support Data Engineer (Co-op)We are seeking a motivated and... ...power enterprise analytics, reporting, and AI/ML solutions.You will work with tools... ...transformations using Python, PySpark, and SQL.Data Modeling & STTM: Support STTM, semantic layers,...Full time
- ...DescriptionIntegriChain is the data and application backbone for market... ....Hands-on Snowflake engineering: Design, build, optimize, and operate Snowflake data models, pipelines, stored procedures,... ...downstream Snowflake, analytics, AI, and operational use cases.Partner...Visa sponsorshipFlexible hours
- ...WithAt Slalom, we co-create custom software, data, and cloud products with clients who are... ...true change.Our Data Architecture & Engineering team sees data as the foundation for decision... ..., and transformation. We embrace AI to scale with quality, innovate without fear...Temporary workLocal area
- ...innovate and inspire. Make history with us.Operational Support Data Engineer - Agentic AI & ML Ops (Co-op)We are seeking a motivated and curious Data... ...Analytics & AI/ML: Prepare datasets for reporting, ML models, forecasting, and advanced analytics.Monitor & Support Operations...Full time
- DescriptionWe are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry... ...parallel processing environment, applying dimensional modeling concepts such as facts and dimensions.• Ingest and transform...
- ...through cutting-edge technology, quantitative research, and deep trading expertise. We are looking for an experienced Quantitative Data Engineer to join our Prediction Markets team.We specialize in geopolitical and sports analytics across the globe. This is an opportunity...
$127.34k - $160k
...OVERVIEWNBME is looking for a Data Engineer to join a highly skilled and growing... ...that support analytics, AI/ML, and business decision-making... ...unstructured data for AI/ML model training, fine-tuning, and feature extraction. Lead evaluation, research, and experimentation...InternshipWork at officeLocal areaRemote work- ...partner helping organizations modernize data ecosystems, build real-time... ...capabilities, and responsibly scale AI. As part of Accenture Cloud First... ...Looker, Vertex AI, Gemini Foundation Models, and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in...Full timeWork experience placementLive inWork at officeLocal area
$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI, and cloud products with clients who are ready to accelerate their digital transformation... ...on injecting intelligence into products, engineering systems that support learning and insight...Temporary workWork at officeLocal areaFlexible hours- OverviewWe are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams... ...data processing workflowsCollaborate with application teams to model, transform, and deliver data solutions that meet business...
- ...opportunities to grow, innovate and inspire. Make history with us.Data Engineer / AI Engineer (Co-op)We are seeking a motivated and curious Data... ...to improve the accuracy and reliability of outputs.Monitor Model Performance: Identify "hallucinations" or inconsistencies in...Full timeInternship
$131k - $218.3k
...Summary Our Deloitte AI & Engineering team works to transform technology... ...Work you'll do As an AI and Data Science Engineer III on the... ...maintain data pipelines, model training workflows, and... ...validation/optimization, and evaluation at scale1+ years of technology...Local area- Company DescriptionIntegriChain is the data and application backbone for market access... ...the Data Science team as an AI Data Engineer responsible for building the data foundations... ...curated gold-layer datasets, create semantic models that LLM tools can use reliably, and partner...Work at officeVisa sponsorshipFlexible hours
- ...for supporting complex or leading singular projects related to data engineering requirements and initiatives across Jazz Research and... ...solutions using Amazon Redshift.Build and maintain standard data models.Develop data quality frameworks, validation processes and KPIs...Full timeWork at officeRemote workWorldwideFlexible hours
$152.9k - $221.1k
By joining Chubb as Lead Data Engineer for our North America Finance & Actuarial... ...squads deliver by embedding AI-assisted development, modern... ..., and replatforming efforts.Evaluate and recommend modern tooling,... ...into the team's delivery model. Chubb is a world leader in...Permanent employmentWork experience placementWork at officeLocal area- ...for our employees!Job OverviewWe're looking for a Principal Data Engineer who brings strong technical judgment, a product-oriented mindset... ...to own data solutions end-to-end—from architecture and modeling to implementation and delivery—in a dynamic AdTech environment...Full timeTemporary workPart timeWork experience placementLocal areaFlexible hours
$41 per hour
...Analytics Developer will create reports, data visualizations and analytical solutions... ...practices in data visualization.Experience modeling, wrangling and interpreting large data... ..., In a STEM field (Science, Technology, Engineering, Mathematics or Business Analytics) with...Full timePart time- ...Seeking a Senior Specialist with 7 to 11 years of experience in data analysis proficient in PowerBI and Tableau to deliver advanced... ...tool issues to ensure reliable reporting Collaborate with data engineers and business analysts to integrate data from multiple sources for...
- OverviewLutron is seeking a Lead Data Engineer in Coopersburg, PA or Philadelphia, PA to help... ...and scale a modern, cloud-native data and AI platform powering analytics, real-time... ...streaming pipelines, cloud platforms, and data modeling to deliver high-impact systems powering...Worldwide
- ...is currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.Responsibilities... ..., alternatives, and impact on modeling approach to business stakeholders across... ...with emerging technologies group within AI service providers (e.g., AWS, GCP,...H1bLocal area
$52 per hour
...leaders to understand drivers of success and leverage available data sources to design, develop and deploy analytical solutions with... ...and/or PhD required in Computer Science, Business Analytics, Engineering or closely related quantitative field or equivalent experienceSpecial...Full timePart time$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Media / journalism / communications Evaluator Type: Contract Compensation: $... ...to meet deadlines while improving AI model performance . Collaborate with subject...Contract workSummer workWork at officeRemote work- ...Data Engineer/Data ScientistProven experience (6+ years) as a data engineer and data scientist, preferably in a fast-paced technology or analytics-driven environment.Telecom domain must.Big Data / ETL development background needed.Cloud technologies - AWS S3, AWS Athena...
United IT
Philadelphia, PA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches
- data center engineer Philadelphia, PA
- senior cloud data engineer Philadelphia, PA
- sr information security engineer Philadelphia, PA
- remote data engineer Philadelphia, PA
- etl data engineer Philadelphia, PA
- data engineer analytics Philadelphia, PA
- sr data engineer Philadelphia, PA
- junior big data engineer Philadelphia, PA
- data engineer machine learning Philadelphia, PA
- entry level big data engineer Philadelphia, PA