Senior Software Engineer — AI Task Designer & Evaluator
Mindrift
Mindrift is building a dataset to evaluate AI coding agents and how well models handle real-world developer tasks. You will craft tasks, define success criteria, and write tests for diverse valid solutions within realistic simulated environments. You will manage tasks from intermediate environments, ensuring tests accept valid approaches and reject incorrect ones, while iterating based on QA feedback to keep evaluations fair and robust. #J-18808-Ljbffr Mindrift
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer — AI Task Designer & Evaluator in New York, NY vacancy
- ...We Are Social is looking for a Freelance Senior Designer to join our growing team! This role is... ...feedback into actionable, high-priority tasks for the broader creative team Manage multiple... ...brand activations using generative AI, transforming emerging tech capabilities...SeniorFreelanceShift work
We Are Social
New York, NY4 days ago - ...Clad Clad is project management software purpose-built for... ...infrastructure, accelerated by demand from AI and the shift to renewables.... ...internet companies, and contractors tasked with this work are struggling... ...A product-minded, full stack engineer. You'll be responsible for...SeniorFor contractorsShift work
Clad
New York, NY14 hours ago - ...hundreds of web scrapers. Optimizing and evaluating our core utils, which do things like extracting... .... Benchmarking and evaluation of core tasks (human and synthetic). We believe in... ...devops. Interest/experience with stats/ML/AI is a bonus, but not critical. You should...SeniorWork at officeRelocationVisa sponsorship
Midpage
New York, NY4 days ago $50 - $150 per hour
...s fastest-growing AI companies, pushing... ...boundaries of AI-assisted software development. Our... ...of software engineering, open-source ecosystems... ...high-quality evaluation and training datasets... ...engineering tasks. You will have the... ...copilots, or creative design assistants •...SeniorFull timeFor contractorsFlexible hoursTuring Inc
New York, NY4 days ago$159k - $278.25k
...language models to build software which helps our... ...the role of a backend engineer working across the stack... ...contribute to more ML specific tasks. Successful individuals... .... What you will do Design, develop, code and test... ...with other teams to build AI & data-driven GTM...SeniorRippling
New York, NY4 days ago- ...About ExaCare AI ExaCare AI is a leading health tech company... ...are seeking a high‑ownership senior software engineer to own a full‑cycle software development process from design to implementation and maintenance... ...and turning a high‑level task into a game plan Demonstrated...SeniorFlexible hours
ExaCare AI
New York, NY13 hours ago $180k - $225k
...of their teams. Our 4 person engineering team will double in size in 20... ...assistance from cutting edge AI and the latest tools. They identify... ...complete and deliver tasks and tickets with a high standard... ...effectively Create best‑in‑class software development processes so that...SeniorFor contractorsWork at officeImmediate startVisa sponsorshipWork visaFlexible hours1 day per weekRebuild Inc
New York, NY14 hours ago$201.88k - $237.5k
...through world-class software, purpose-built for... ..., with tools designed to enhance the strategic... ...You’ll enter our engineering interview process... ...You’ll Solve As a Senior Software Engineer... ...Tooling: Use the best AI‑assisted... ...stories into actionable tasks and execute them with...SeniorFull timeWork at officecartage.co
New York, NY14 hours ago- ...accelerator for frontier AI labs and a... ...specialize in software engineering, logical reasoning... ...Typical Day Look Like? Evaluate and refine AI-... ..., architecture design, API design, production... ...engineering task. Required Skills... ...from your network. Seniority level Entry level...SeniorFull timeContract workFor contractorsRemote workFlexible hours
Turing Inc
New York, NY5 days ago $165k - $242k
...that enable every engineer at CoreWeave to build and ship software faster, more safely... ...platforms, and the agentic AI tooling that is... ...initiatives from design through production.... ...development tasks and accelerate in an... ...infrastructure profiles. Mentor senior and mid‑level...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursCoreWeave
New York, NY13 hours ago$200.7k - $250.9k
...Senior Software Engineer - Mercury Command San Francisco, CA, New York, NY, Portland... ...was given a mundane task with a tricky problem to it... ...new capabilities users love: Design and ship new Command skills,... ...opinions about what makes an AI product trustworthy, not just...SeniorRemote workShift workMercury
New York, NY14 hours ago$147k - $202k
...Every Identity, from AI to Human Identity... ...an Observability Engineer to help ensure... ...continuing to rapidly ship software that our customers... ...these areas. As a Senior Engineer on this... ...to the process of designing services for high... ...operational tasks and improve scripts...SeniorLocal areaFlexible hoursOkta, Inc.
New York, NY14 hours ago$190k - $200k
...it. That's why we design, build, and operate... ..., every time. Our engineers work on problems... ...confidence. As a Senior Software Engineer on the Business... ...AWS. Embrace and evaluate new tools as the... .... Leverage AI tools to make your... ...and can prioritize tasks effectively, with...SeniorWork at officeLocal areaFlexible hoursWeekend workThe Farmer's Dog
New York, NY5 days ago$245k - $360k
...matters most. Rokt’s AI Brain and ecommerce Network... ...innovation. The Rokt engineering team builds best-in-... .... We are looking for Senior Software Engineers Target total... ...projects into executable tasks, provide accurate... ...reason well about system design, data structures,...SeniorLive inWork at officeRokt group
New York, NY2 days ago$130k - $165k
...Overview: HealthEdge is seeking a Senior Software Engineer (Java) with a strong... ...team, you will lead solution design, develop high-quality code,... ...workflows, and implementing AI-driven solutions where appropriate... ..., and transformation tasks, ensuring data consistency and...SeniorPermanent employmentFull timeWork at officeRemote workHealthEdge
New York, NY4 days ago$190k - $230k
...Join to apply for the Senior Software Engineer role at Miter This range is provided... ...Miter comes in. We’re using AI and embedded payments to... ...success. What You'll Do Lead the design and implementation of... ...and reliability when owning tasks and deliverables. Strong communication...SeniorFull timeFor contractorsWork at officeRemote work3 days per weekMiter
New York, NY14 hours ago$128k - $143k
...advanced microscopes and AI-based image analysis... ...into development and engineering challenges. Here, you... ...everything possible. The Senior Software Engineer is part of a... ...automate repetitive tasks. Preferred... ...environments; User Interface design; Database engines – SQLite...SeniorRemote workWork from homeFlexible hoursDanaher Corporation
New York, NY4 days ago- ...specialize in developing software and services for... ...renters, while evaluating applications with... .... The Role As a Senior Software Engineer, you will play a... ...Product, Data, Design and Engineering.... ...market. You’ll be tasked with partnering... ...verification tools and AI‑based identity...SeniorFull timeWork experience placementWork at officeWork visaFlexible hours
Findigs, Inc.
New York, NY14 hours ago $20 per hour
...A remote AI training company is looking for detail-oriented individuals to train AI chatbots. Responsibilities include creating prompts, writing quality responses, and evaluating AI model outputs. Candidates must be fluent in English and possess excellent writing and research...Hourly payFor contractorsFreelanceRemote workFlexible hoursDataAnnotation
New York, NY2 days ago- ...building a lean, high-output engineering team committed to... .... Who You Are: As a Senior Software Engineer, you excel in... ...web, and mobile — and AI agents make it practical... ...tedious, repetitive tasks so the team can focus... ...services to our users Design and develop new APIs for...Senior
TickPick
New York, NY14 hours ago $2,100 per week
A leading AI lab is seeking experienced Senior or Staff Software Engineers with over 5 years of finance-focused engineering experience. The role involves creating and refining AI-generated systems for financial tasks and requires strong performance in high-reliability...SeniorRemote jobPart timeFlexible hours$60 per hour
...A leading AI development company is looking for experienced quantitative professionals to evaluate AI-generated analyses and provide critical feedback. This remote position allows for flexible scheduling, paying up to $60 per hour. Ideal candidates will have a background...Hourly payRemote workFlexible hoursDataAnnotation
New York, NY5 days ago- ...partner with Savvy tap into AI-powered software, automated sales and... ...us scale! The Role: As a Senior Product Designer focused on client experience... ...collaborating closely with product, engineering, operations, and advisors.... ..., and can prioritize tasks effectively with strong...SeniorWork at office
Savvy Wealth, Inc.
New York, NY4 days ago - Nory is hiring a Senior Product Designer for its Inventory Management squad. You... ...restaurants, automate admin tasks, and work with cross-functional... ...impact. The role emphasizes AI-assisted UX, end-to-end... ...ll collaborate with product, engineering and customer success to ship...Senior
$202k - $230k
...We're looking for a Senior Software Engineer to integrate and improve our AI developer experience so that... .... What you’ll achieve Design and build AI-augmented... ...complete software development tasks faster and with more... .... Experience building evaluation and quality frameworks...SeniorWork at officeLocal areaWork from homeWorldwideAsana
New York, NY14 hours ago$250k - $330k
A leading conversational AI platform in New York is seeking a Senior Software Engineer to design and build critical execution systems for AI agents. The role offers significant... ...debugging skills. You will be part of a team tasked with enhancing agent performance and...Senior$173k - $193k
...investment professionals. As a Senior Engineer, you will build and harden... ...an active role in developing, evaluating, and improving AI‑powered features. Responsibilities Design, develop, and maintain secure... ...systems, caching, and asynchronous task queues (Celery or equivalent)...SeniorWork at office3 days per week$220k - $300k
...combining frontier agentic AI, an enterprise-grade... ...management, and evaluation infrastructure—setting... ...Representative Projects Context Engineering & Agent Infrastructure... ...right one for every task. Evaluation Infrastructure... .... What You’ll Do Design and build abstractions...SeniorHarvey
New York, NY14 hours ago- ## Senior Software Engineer (Hybrid - Edgewood, NY)Applylocations:... ...business partners to design, develop, and implement... ...Capable of managing tasks and priorities with minimal... ...various factors when evaluating a candidate's final... ...perspective.**Use of AI in Hiring**As part of...SeniorLocal area
- About Artian Artian AI is building... ...of AI, enterprise software, workflow automation... ...is looking for a Senior Software Engineer - AI/ML to lead... ...platform. You will help design, build, and scale... ...engineering, evaluation, and system... ...measuring agent quality, task completion,...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer — AI Task Designer & Evaluator. Be the first to apply!
Related searches
- ngo software engineer New York, NY
- software developer New York, NY
- software developer internship no experience New York, NY
- software developer apprenticeship New York, NY
- junior software developer New York, NY
- part time software developer remote New York, NY
- financial software developer New York, NY
- senior software engineer ruby on rails New York, NY
- software engineer amazon New York, NY
- senior software design engineer New York, NY