AI Software Engineer - Task Curator

$60 - $90 per hour

Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software Engineering Expert

Type: Contract

Compensation: $60–$90/hour

Location: Remote

Commitment: 35 hours/week

Role Responsibilities

Design realistic, multi-step software engineering challenges to push the limits of today's best AI coding agents.
Build reference solutions in Python with setup and checks for clear, verifiable answers.
Utilize AI coding assistants in your workflow to identify their strengths and limitations.
Review tasks created by peers and provide feedback on clarity, correctness, and difficulty.
Analyze AI agents' task attempts to help the research team understand failure points.

Qualifications

Must-Have

MSc or PhD in computer science or a related STEM field, or equivalent practical experience.
1+ years in a research, research-engineering, or software engineering role.
Strong Python scripting and debugging skills with clean-code habits.
Proficiency with Git , IDEs, and standard software development workflows.
Ability to engage reliably for approximately 35 hours/week .

Preferred

Experience with AI coding assistants , prompt engineering, or agent workflows.
Past experience in AI training , model evaluation, or benchmark/task authoring.

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on jobs.jobcopilot.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 9 hours ago

Similar jobs that could be interesting for youBased on the AI Software Engineer - Task Curator in New York, NY vacancy

Agentic AI Engineer
...We build AI agents that actually work in enterprise environments... ..., not demos. We need engineer's who can own the entire agent... ...benchmark models for specific agent tasks. Agentic architecture You... ...engagements. ~4+ years of software engineering experience with at...
Software
Full time
Temporary work
Trilagen
New York, NY
9 hours ago
Applied AI Engineer
...has built the first-to-market AI native coaching platform for enterprise... ...As a founding Applied AI Engineer at Valence, you'll spearhead... ...that understand complex tasks, provide accurate and relevant... ...Support other science and software development where required....
Software
Full time
Work at office
Remote work
Work from home
Valence
New York, NY
9 hours ago
Senior AI Engineer
$150k - $160k
...and the productionization of AI capabilities across the publishing... ...THE ROLE As a Senior AI Engineer (Full-Stack / Applications),... ...at the intersection of strong software engineering and deep AI expertise... ...requirements & actionable tasks. Experience leveraging and...
Software
Remote job
Full time
Contract work
Temporary work
Work at office
Local area
Macmillan
New York, NY
9 hours ago
Forward Deployed AI Engineer (GenAI, AWS)
...Partner at the forefront of applied AI, helping enterprises turn... ...posture. We embed engineers and leaders inside client operations... ...project alongside it. Real tasks, not scope. You are not fenced... ...do: ~8+ years building software , a substantial share of it writing...
Software
Full time
Work at office
Remote work
Worldwide
Provectus, Inc.
New York, NY
9 hours ago
Senior Full-Stack AI Engineer (Web + iOS)
...media, and sports—by leveraging data and AI as core assets. Our AI-first, cloud-... ...businesses. The Role We're hiring a Senior Software Engineer to build agentic AI products across web,... ...based software that executes multi-step tasks with tools, memory, and stateful...
Software
Full time
Relocation package
Twg Global Ai
New York, NY
9 hours ago
AI/LLM Engineer
...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent... ...of reasoning, planning, and executing tasks autonomously. The ideal candidate will... ...scalability, reliability, and cost. Software Engineering Develop high-quality, scalable...
Software
Temporary work
2T Consulting
New York, NY
a month ago
Senior AI Engineer
$131k - $170k
Description Senior AI Engineer Location : Hybrid, United States Employment Type... ...overseeing the entire lifecycle of AI and software subsystems-from defining requirements... ...teach new technologies. Ability to multi-task and prioritize ongoing activities based...
Software
Full time
Temporary work
Work experience placement
Work at office
Remote work
OneStream Software
New York, NY
5 days ago
Senior AI Agent Engineer | Moveworks - Federal
$143.2k - $243.4k
...Description It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She... ...work. Today, ServiceNow is the AI control tower for business reinvention... ..., Consulting Engineer, or Software Engineer. Experience designing,...
Software
Permanent employment
Work at office
Immediate start
Remote work
Flexible hours
ServiceNow
New York, NY
1 day ago
DSCA AI/ML Engineer (Engineer Machine Learning) Senior
DSCA AI/ML Engineer (Engineer Machine Learning) Senior Join the growing Warfare Systems Business... ...and unstructured. Develops and sources software programs, algorithms, dashboards, information... ...office equipment to perform analytical tasks. Must be able to effectively communicate...
Software
Work at office
Work from home
Home office
HII Mission Technologies division
New York, NY
4 days ago
Applied AI Engineer
$150k - $300k
...transforms civil, structural, and MEP engineering firms with applied AI. We’re an AI laboratory dedicated to... ..., or doc parsing Is not above any task: Up to write the web scraper, help users... ...the plugin for Windows native AEC software Compensation Competitive cash...
Software
Full time
Work at office
Eagle
New York, NY
9 hours ago
Senior Agentic AI Software Engineer
$124k - $186k
...Paramount Tech is seeking a Senior Agentic AI Software Engineer to architect and build the next... ...executable specifications, intent-based tasks, and acceptance criteria while automatically... ..., and compliance front and center. Curate codebase context, including indexing,...
Software
Local area
Remote work
Worldwide
Shift work
New York, NY
a month ago
AI Engineer
...StatusNeo is a global AI-native transformation firm helping enterprises design, engineer, and govern AI-led systems with trust at the core. We work with global... ...and platform-driven industries to transform how software is built, operated, and scaled in an AI-first...
Software
Full time
Statusneo
New York, NY
9 hours ago
Applied AI Engineer, Life Sciences (Beneficial Deployments)
$280k - $320k
...interpretable, and steerable AI systems. We want AI to be safe... ...group of committed researchers, engineers, policy experts, and business... ...benchmarks grounded in real scientific tasks, and reusable agent skills... ...Have: ~4+ years as a Software Engineer, Forward Deployed...
Software
Full time
Work at office
Visa sponsorship
Flexible hours
Shift work
Anthropic
New York, NY
9 hours ago
AI Pilot Vibe Coding Task Associate
$32 per hour
...data scraping workflows within our hybrid AI + human system. In this role, as an... ...Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain... ...in data analysis, AI automation, data engineering, or software development is desirable. Bachelor's...
Software
Part time
Freelance
Remote work
Mind Rift
New York, NY
5 days ago
AI Support Engineer
We are an applied AI lab building end-to-end software agents. We're the makers of Devin, the first AI software engineer, and Windsurf, the AI-native IDE. Together, they represent our... ...build AI that can reason on real-world tasks, apply to join us. About The Role Cognition...
Software
Cognition
New York, NY
2 days ago
Lead AI/ML Engineer - Eden Prairie, MN or Schaumburg, | Prairie, Minnesota
$145.5k - $249.5k
Lead AI/ML Engineer Optum Tech is a global leader in health care innovation. Our teams develop... ...team Collaborate with data scientists, software engineers, and product stakeholders to operationalize... ...multi-step reasoning workflows, task orchestration, or tool-calling agents...
Software
Minimum wage
Full time
Work experience placement
Work at office
Local area
Remote work
UMR
New York, NY
2 days ago
Sr AI Engineer
$150k - $215k
...future of our communities. This is a Lead Software Engineering position at the Vice President level,... ...Advanced Analytics, Machine learning and Gen AI Platform team(s), across multiple... ...reason, use tools, and complete multi-step tasks using LLMs/Reasoning models, build calibration...
Software
Temporary work
Morgan Stanley
New York, NY
28 days ago
Lead Applied AI Engineer
...Junior AI/ML Engineer Junior is building the AI operating system for investment research. Our software helps private equity firms, consultants and financial institutions complete... ...LLM output on investment research specific tasks Build an agentic entity deduping...
Software
Work at office
Junior Company
New York, NY
4 days ago
Applied AI Engineer
Applied AI Engineer Duration: 6-12 months contract to hire Location: NYC... .... They build and deploy software and biological AI systems to... ...biological frontier models—for tasks in biological security and the... ...biological data, and to create and curate datasets Collaborate closely...
Software
Contract work
CoSourcing Partners - Enterprise-AI and IT Services Company
New York, NY
6 days ago
AI & ML Engineer
...teams to move at the speed of AI, deliver better outcomes, and... ...obsessive attention to detail. Our engineering team is elite, our lawyers... ...long-running, multi-step legal tasks Create evals, datasets,... ...workflow orchestration ~ Strong software engineering fundamentals and...
Software
Full time
Contract work
Work at office
Flexible hours
Day shift
Sandstone
New York, NY
9 hours ago
Gen AI Engineer Lead
GenAI Product Engineering Lead Summary We are seeking an... ...of an enterprise-grade AI platform on Microsoft Azure... ...create tenant-aware or task-specific models that... ...to automate dataset curation and model retraining schedules... ...Strong fundamentals in software engineering, system...
Software
Apex Systems
New York, NY
1 day ago
Forward Deployed AI Engineer
...StackAI (by Asana) is a no-code AI workflow platform that... ...We're seeking an experienced engineer to deploy enterprise-grade AI... ...of experience in data science, software development, or generative AI.... ...answer questions, and complete tasks, using your internal data and...
Software
StackAI
New York, NY
1 day ago
Sr. AI/ML Engineer - Java Background - | Prairie, |
$120.1k - $214.5k
...Guides), event-driven architectures, and AI-powered capabilities. You will work on... ...tools to streamline workflows, automate tasks, and drive continuous improvement Evaluate... ...in. Required Qualifications 5+ years of software engineering experience designing and deploying...
Software
Minimum wage
Full time
Work experience placement
Local area
Remote work
Genoa Telepsychiatry
New York, NY
4 days ago
AI Software Engineer
$180k - $200k
...all backgrounds with the knowledge, skills, and self-belief to succeed in college and in life. We now need a results-driven AI Software Engineer/ Integration Specialist to join our AI Enablement team. Department The Technology Division at Success Academy is the...
Software
Full time
Visa sponsorship
Success Academy Charter Schools
New York, NY
9 hours ago
Senior AI Engineer
$250k - $300k
...Senior AI Engineer Estate settlement, from verified discovery to distribution We're looking... ...'re the foundation of a new category of software for the largest wealth transfer in... ..., and managing hundreds of disconnected tasks while grieving. Which is why we started...
Software
Work at office
Local area
Elayne
New York, NY
4 days ago
Current Master's, AI Engineering Internship Program - Summer 2027
$147k
...Overview Current Master's, AI Engineering Internship Program - Summer 2027 Key Role Details... ...and Experiences (IFX) team, which is tasked with advancing the state-of-the-art in... ..., and your expertise in hardware, software, and AI enable you to see and exploit optimization...
Software
Full time
Part time
Summer work
Internship
Local area
Capital One
New York, NY
13 days ago
Senior AI Application Engineer
$178k - $215k
...Job Description As a Mid-Level AI / Agent Application Engineer, you will be the core builder of the... ...RESPONSIBILITIES: Our employees are tasked with delivering excellent business results... ..., Physics, Artificial Intelligence, Software Engineering, or a closely related...
Software
Local area
Monday to Friday
EVERSANA
New York, NY
12 days ago
Senior Solutions Developer, Prototyping AI Customer Engineering (PACE)
$176.6k - $239k
...trusted customer advocates, the Prototyping AI Customer Engineering (PACE) team helps customers in... ...and enable them to take on more complex tasks in the future.Key job responsibilitiesEngage... ...technology domain areas (e.g. software development, cloud computing, systems...
Software
Local area
Flexible hours
AmazonWebServices
New York, NY
7 days ago
Forward Deployed Senior AI Engineer
$131k - $271.6k
...development, and operation of AI-native enterprise applications... ...delivery teams. You bring solid engineering fundamentals and a growing... ...of hands-on experience in software and application engineering for... ...and take ownership of assigned tasks with a strong sense of...
Software
Permanent employment
Full time
Work at office
Worldwide
Flexible hours
SAP
New York, NY
a month ago
AI/ML Software Engineer
$120k - $149k
Position Overview: We are seeking an experienced AI/ML Software Engineer to design and build production-grade tools for the Maryland Judiciary.... ...successful candidate will integrate AI/ML techniques to automate tasks, assist internal staff, and enhance the digital experience...
Software
Local area
Remote work
Macpower Digital Assets Edge
New York, NY
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Software Engineer - Task Curator. Be the first to apply!