Senior Python Engineer — AI Task Designer & Evaluator
Dorado
Mindrift is offering a project-based opportunity to craft and evaluate AI coding tasks. You will build a realistic developer environment—a virtual company with a codebase, infrastructure, tickets, docs, and conversations—to test AI agents. You design tasks from intermediate states, define what constitutes a solution, and write tests that accept all valid approaches while rejecting incorrect ones. English proficiency required; 8+ years of software development preferred. #J-18808-Ljbffr Dorado
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Python Engineer — AI Task Designer & Evaluator in New York, NY vacancy
- Mindrift is assembling a dataset to evaluate AI coding agents by creating challenging tasks and evaluation criteria within realistic simulated environments. You... ...realism. Join a project-based effort where you design prompts, define what constitutes a solved state, and...SeniorContract work
- United States Digital Space LLC seeks a Software Engineering evaluator to create cutting-edge datasets for training AI models, focusing on Python across backend services, data pipelines, and ML infrastructure. You will evaluate AI-generated code, ensuring efficiency, scalability...Senior
- ...Strategy, Experience & Design, Engineering and Managed Services.... ...organization is becoming AI-native and agentic-... ...patients. We are seeking a Senior Manager, AI-First... ...approvals, and multi-step task orchestration).... ...Experience with AI experience evaluation approaches (...Senior
$30 per hour
...not just another player in the AI space - we are building the biggest... ...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving... ...and now tackle complex design tasks such as layout, typography, and...SuggestedRemote jobWork from homeFlexible hours- Nory is hiring a Senior Product Designer for its Inventory Management squad. You... ...restaurants, automate admin tasks, and work with cross-functional... ...impact. The role emphasizes AI-assisted UX, end-to-end... ...ll collaborate with product, engineering and customer success to ship...Senior
$159k - $231k
...with product managers, engineers, and cross-functional stakeholders... ...various stages of the design process with wireframes... ....Experience with AI concepts (e.g.,... ...Designers transform complex tasks into intuitive, easy-to... ...products.As a Senior User Experience (UX) Designer...Senior$159k - $231k
...agentic lead-generation flows.Design and create high-quality proposals... ...surfaces.Work closely with Engineering and PM partners to ensure design... ...in leveraging nascent AI technology to vibe code, rapidly... ...Interaction Designers transform complex tasks into intuitive, easy-to-use...Senior- ...Associate Consultant – Senior User Experience Designer ZS is a place... ...designing and delivering AI-powered digital... ...workflows, such as agentic task flows, adaptive... ...generative and evaluative research, synthesizing... ...experience in design engineering (design-to-code, AI...SeniorLocal areaWork from homeWorldwideFlexible hours
ZS Associates
New York, NY4 days ago - Ethos seeks a senior FP&A manager to lead budgeting, forecasting, and executive reporting for AI-driven presentation tasks. The role focuses on crafting high-quality financial slides and narratives for internal reviews and investor-facing materials. You will create and...SeniorRemote job
$150k - $200k
...based public safety platform and design powerful, scalable, and... ...collaborating closely with product and engineering to deliver best-in-class... ...prioritizing and completing design tasks, e.g., in Figma, and... ...libraries. You will drive AI/ML across the product portfolio...SeniorRemote workWork visaShift workMark43
New York, NYmore than 2 months ago$142.32k - $213.48k
...to be successful to designing our digital architecture... ...seeking a versatile Senior GenAI Platform Engineer to spearhead the... ...cutting-edge Generative AI platforms. This role... ...primarily using Python, while also leveraging... ...through in-depth evaluation of complex business...SeniorFull time- ...Onsite Senior Python Full Stack Engineer with Agentic AI Location: DE and NYC 12 Months + Only locals Skills required - AWS preferred... ...) that can perform code reviews and participate in design discussions, not people managers. Software...SeniorLocal area
Amtex Systems Inc
New York, NY1 day ago $125k - $200k
...follow @newmark. Job Description As our Senior UX Designer, you'll be at the forefront of our... ...feedback and refine designs. Experience with AI assisted prototyping tools such as... ...projects simultaneously and prioritize tasks effectively. Passion for staying updated...SeniorTemporary workLocal area- A leading AI solutions firm is seeking a Python Developer to work on a Reinforcement Learning Gym project. You will design and optimize FastAPI services, collaborate with researchers, and... ..., and familiarity with software engineering best practices. This role offers fully...SeniorRemote workFlexible hours
- EvolutionIQ is hiring a Senior Software Engineer to own the backend of our AI insurance SaaS platform. You will build a complex, multi-tenant... ...secure deployments. The role requires strong Python development and systems design, plus experience with AI tools to streamline...Senior
$166k - $214k
...benefits. We believe that great design is at the heart of this... ...curious, empathetic, and passionate Senior Content Designer with a focus... ...searchability, consistency, and AI readiness through better... ...contentCollaborate with designers, engineers, product managers, researchers...SeniorCasual workWork at officeLocal area- Vercel is seeking a Growth Designer to define and own the self-serve journey—from signup and... ...with Product Design, Growth Product, Engineering, and Data to move from observed problems... ...will design interactive prototypes using AI tools, test experiments, and ensure trust...Senior
- SharkNinja is seeking a Senior Designer to scale digital creative for its DTC channels across UK, US, Canada and Mexico. You’ll be deeply embedded... ...design with a strong portfolio and expertise in Figma and AI-generated creative. Hybrid/fast-paced, tied to two global...Senior
$160k - $190k
...winning point-of-sale to AI-powered profit tools,... ...workflows that were designed for humans — and many... ...money. We're hiring a Senior AI Engineer to fix that. Your... ...Strong proficiency in Python and TypeScript/JavaScript... ...agentic workflows — task decomposition, agent...SeniorHourly paySummer workImmediate startShift workSpotOn
New York, NYa month ago- A fintech startup in New York City is looking for a Brand Designer to establish and evolve its brand identity across all platforms. The role involves collaborating with marketing and design teams to create cohesive and sophisticated brand assets. Ideal candidates should...Senior
- PRM FASHION SEARCH is seeking a Senior Designer, Intimates in New York, NY to shape intimates and sleepwear collections. You will drive creative... ...of garment construction, and experience with PLM systems and AI-assisted design tools. #J-18808-Ljbffr PRM FASHION SEARCHSenior
- United States Digital Space LLC is seeking a graphic designer with 3-5 years of experience, especially in social media advertising. The role... ...Figma and Adobe Creative Suite, and should be familiar with AI tools to enhance their creative processes. #J-18808-Ljbffr United...SeniorRemote job
$91k - $120k
...people who are curious about AI, willing to experiment with it... ...full creative output; packaging design, advertising, photography and... ...staying receptive to direction from senior designers while helping... ...Brand Creative, UX, Product, Engineering, and Brand Marketing to ensure...SeniorWork at officeLocal areaVisa sponsorshipFlexible hours- ...About Bold Business Bold Business is an AI-first U.S.-based company building... ...experiments. The Role We’re hiring a Senior Python Engineer who can own both backend systems and... ...backend and data — you will build APIs, design pipelines, and ensure the data powering...SeniorFull timeRemote work
BOLD Business
New York, NY8 days ago - A leading fintech company in New York is seeking a Senior Product Designer to reimagine the infrastructure connecting advisors and clients. This high-impact role involves integrating AI into design workflows and optimizing complex systems. Ideal candidates will have 5-...SeniorWork at office
$175k - $210k
Cohere is seeking a Senior Product Designer in New York to shape the future of enterprise AI. In this role, you'll design intuitive experiences for complex AI-driven... ...collaborating closely with product managers and engineers. With 4+ years of experience and a commitment...SeniorRemote job- Clutch is expanding its design team and seeking a Product Designer to craft end-to-end, human-centered experiences for... ...than surface work. You’ll collaborate with PMs and engineering, move quickly, and leverage AI tools to prototype and ship features, extending design...Senior
- Feedinkoo in the United States is seeking an exceptional Product Designer to help automate security review processes. You will lead design initiatives from brainstorming to delivery, deeply understanding user needs and contributing to product strategies. The role requires...Senior
$175k - $200k
Verana Health is looking for an experienced Product Designer to shape the future of AI interactions in healthcare. In this hybrid role, you'll design impactful experiences, working closely with engineers and product managers to revolutionize healthcare applications. The...Senior$67 - $72 per hour
...Philadelphia Pay Range: $67-$72 per hour Summary We are seeking a Senior AI Designer to join a team of 50+ UX designers and UX researchers, with... ...for Generative AI experiences Some experience with prompt engineering and context engineering Knowledge of the fundamentals of...SeniorHourly payContract workCasual workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Python Engineer — AI Task Designer & Evaluator. Be the first to apply!
Related searches
- python developer data analytics New York, NY
- python developer internship New York, NY
- python engineer New York, NY
- backend python developer New York, NY
- senior python developer New York, NY
- python developer remote New York, NY
- python developer part time New York, NY
- python developer New York, NY
- full stack / python developer (remote) New York, NY
- python programmer New York, NY