Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Founding AI Engineer: Agent Evaluation & Alignment

Zingage

Zingage (Kuzushi Inc.) is building the intelligence layer for home-based care in New York City. We seek a founding AI engineer to own evaluation, simulation, retrieval, and alignment infrastructure for autonomous agents in a high-impact healthcare setting. You will ship production ML/LLM improvements, measure outcomes, and drive the harness while collaborating with founders. This is the most senior AI hire at the company and offers meaningful equity and rapid impact. #J-18808-Ljbffr

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Founding AI Engineer: Agent Evaluation & Alignment in New York, NY vacancy
  •  ...Founding AI Engineer, Agents & Evaluation New York City Full time On-site Engineering We're building the intelligence layer for all home-based...  ...learns. You own the evaluation, simulation, retrieval, and alignment infrastructure that lets us ship agent improvements... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Remote work
    Night shift

    Zingage

    New York, NY
    4 hours ago
  • $115k - $260k

     ...making a real impact on local communities nationwide. Founded in 1936, GEICO is a member of the Berkshire Hathaway...  ..., Great Rewards, and Great Careers. Sr. Staff AI Engineer, AI Agent Platform (Agent & Evaluation Harness) Why Join GEICO? GEICO is transforming how... 
    Suggested
    Hourly pay
    Work experience placement
    Local area

    Government Employees Insurance Company

    New York, NY
    3 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) At Capital One, we are creating responsible and reliable AI systems, changing...  ..., observability, and ethical alignment Define and maintain service-level objectives... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • Kya is hiring a founding software engineer to build the AI agent platform that powers customer success across real accounts. You’ll own systems end to end—from the agent runtime to memory, retrieval, and evaluation harnesses—and ship production services used by customers... 
    Suggested

    Kyahq

    New York, NY
    3 days ago
  •  ...People in AI is hiring an Applied AI Engineer for Agents & Evaluation in New York City, onsite. You will design, build, and iterate on production AI agents, with emphasis on context management, orchestration, prompts, and guardrails to ensure reliability. You’ll own the... 
    Suggested

    People In AI

    New York, NY
    5 days ago
  •  ...Founding AI Lead, Forward Deployed Engineering About the Opportunity A leading global alternative asset management...  ...identified, prioritized, scoped, evaluated, shipped, adopted, handed off,...  ...when to use agentic workflows, multi-agent architectures, retrieval systems,... 
    Full time

    Long Ridge Partners

    New York, NY
    4 hours ago
  •  ...Incedo Inc. Website: Position: AI / Agent Engineer - LaunchDarkly Location: New York,...  ...controlled feature releases, and A/B testing to evaluate AI agent performance, user experience,...  ...teams, and product stakeholders to align implementation with enterprise... 
    Full time

    Incedo Inc.

    New York, NY
    2 days ago
  •  .... PREDICTION is building advanced AI systems for national security. We are looking for an exceptional Founding AI Research Engineer to join our core technical team and help...  ...• Agentic AI systems • Model evaluation, calibration, robustness, and uncertainty... 
    Full time
    Flexible hours

    PREDICTION

    New York, NY
    1 day ago
  •  ...understand which backgrounds may be a fit. THE ROLE As a Founding AI Infrastructure Engineer, you may work on projects that require strong execution,...  ...resume/profile context that helps recruiting teams evaluate fit. WHO THIS IS FOR This is a strong fit for... 

    Career Launch

    New York, NY
    4 hours ago
  • $210k - $250k

     ...Founding AI Engineer New York City, NY | In-Person | $210,000–$250,000 Base + Equity About...  ...ideally with experience implementing evaluations. Key Responsibilities...  ...infrastructure: Build the underlying agent infrastructure, including evaluations... 

    Shields Group Search

    New York, NY
    4 days ago
  •  ...Oracle Business Group AI Center of Excellence is...  ...fast.This is a founding team, these first hires...  ...how you work around AI agents — not just adopted them...  ...conversation.You might come from engineering, consulting, product,...  ...pipelines and evaluation frameworksAccelerate AI... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    4 days ago
  • $140k - $160k

     ...can't. We're hiring the engineer who will lead how she...  ...the frontier of voice AI well enough to tell us...  ...Curo Curo builds voice agents for healthcare practices...  ...now. We’re a small founding team building production...  ...like in production. Evaluation as a reflex. You’ve... 
    Remote work

    Jobrapido

    New York, NY
    1 day ago
  • $200k - $250k

     ...the Role Join an early-stage SaaS team as its Founding AI Engineer and lead development of a real-time AI voice agent for sales conversations. You will own the...  ...meeting low-latency requirements. Develop evaluation pipelines and use sales-call data to drive measurable... 
    Full time
    Visa sponsorship

    True Talent Solutions Partners

    New York, NY
    1 day ago
  • $285k

     ...We're an early-stage AI technology company building...  ...works closely with the founding team. High technical ownership: Own core agent-runtime infrastructure...  ...routing, tool use, evaluation, and security-not simply...  ...influence architecture, engineering standards, and product... 
    Full time
    Work at office
    Local area

    Jobot

    New York, NY
    1 day ago
  • $125k - $190k

     ...Founding AI Engineer / Member of Technical Staff Location: New York, NY, United States Department: Information Technology Type:...  ...and the ability to design sophisticated data pipelines and evaluation frameworks. You will collaborate closely with forward‑deployed... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Relocation package

    Advatix

    New York, NY
    5 days ago
  •  ...Inventure is seeking a Founding Forward Deployed Engineer in New York City (onsite) to bridge...  ...data with production-ready agent workflows and drive real...  ...two to three accounts, aligning business concepts with verified...  ...investors and work on AI-native platform deployments... 

    Inventure

    New York, NY
    1 day ago
  •  ...PREDICTION is seeking a Founding AI Research Engineer to help define the AI research direction and build systems for national security. This hands...  ...will work on multimodal reasoning, transformers, model evaluation, and production-ready systems in secure environments. A PhD... 

    Prediction Defunct

    New York, NY
    4 days ago
  •  ...Morgan Pinnacle Group is hiring a Founding Engineer to build and own the core AI agent harness, with a focus on tool calling, memory, prompts, retrieval, and evaluations. You will own features across the consumer chat app and backend, shaping architecture, and enabling... 

    Morgan Pinnacle Group

    New York, NY
    3 days ago
  • $200k - $300k

     ...backed seed-stage startup (founded 2024) using generative AI to automate debt...  ...a $35B US market. Its AI agents already outperform human collectors...  ...house and needs an AI Agent Engineer to own it end-to-end. You'...  ...and maintain testing/evaluation frameworks (A/B testing, regression... 
    Full time
    Relocation
    Visa sponsorship

    Thomas Talent Network

    New York, NY
    more than 2 months ago
  •  ...Inc. seeks an experienced engineer to establish its AI-native product engineering...  ...own the harness that makes agent output trustworthy. You will...  ...infrastructure engineers to align product scope with the data...  ...contracts. This is a high-impact, founding-role within the team. #J-1... 

    Ellis

    New York, NY
    5 days ago
  • $160k - $200k

     ...AI Engineer [Senior Associate / AVP] Founded in 1992, Cerberus is a global leader in alternative...  .... Implement AI agents in code: Build and integrate...  ..., structured outputs, evaluation and monitoring considerations...  ...workstreams. Aligning engineering decisions with... 

    Cerberus Capital Management

    New York, NY
    3 days ago
  • $200k - $400k

     ...Founding Engineer (AI) Union Square NYC FTE Comp range of $200K – $400K plus up to 2% equity Why candidates should join Bootstrapped and highly profitable - went from $0 to $80M in six months with a tiny cost basis. No VC dependency or dilution risk. You... 
    Full time
    Work experience placement

    Hillview Consulting Solutions

    New York, NY
    4 hours ago
  • $143k - $210k

     ...Essential Cloud for AI. Built for...  ...into capability. Founded in 2017, CoreWeave...  ...You'll Do:The Field Engineering organization at CoreWeave...  ..., you'll own the agent logic, the...  ...stop.- Build and evaluate retrieval over a large...  ...strive for both market alignment and internal... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $148.5k - $223.9k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success...  ...working alongside the founding team and engineers in an organization...  ...wide autonomy, build alignment across engineering and...  ...planning, orchestration, and evaluation systems that enable... 
    Full time
    Remote work

    Salesforce

    New York, NY
    2 days ago
  • $109k - $203k

    Software Engineer - AI - CoCounsel Forward Deployed EngineeringAre you...  ...prototyping, integrations, and evaluation of AI outputs for legal use...  ..., accurate, secure, and aligned with the high standards required...  ...Thomson Reuters can be found on thomsonreuters.comSummaryLocation... 
    Full time
    Contract work
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    4 days ago
  •  ...seeking a Senior Engineer to join our Audit...  ...of our generative AI solutions, focusing...  ...scalable features aligned with an understanding...  ...design of AI agents and orchestration...  ...utilizing our enhanced evaluation framework. Drive...  ...our benefits can be found towards the bottom... 
    Local area

    KPMG

    New York, NY
    4 days ago
  •  ...back the broader engineering community through...  .... At Client, AI is reshaping the future...  ..., including: o Agent frameworks and...  ...model gateways o Evaluation, observability,...  ...technical direction and align teams without...  ...• Experience as a founding engineer or early... 
    Full time

    Open Systems Technologies

    New York, NY
    2 days ago
  • $229.9k - $262.4k

     ...AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good....  ...foundation model training, large language model inference, agents and multi-agent workflows, similarity search,... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • Pockyt, building the AI-native infrastructure for global money movement, seeks a founding engineer for the NYC Applied AI team. You will own critical systems end-to-end,...  ...foundation, deploy high-leverage AI solutions, and align engineering practices with business outcomes... 

    Pockyt

    New York, NY
    5 days ago
  • $144.25k - $256.25k

     ...benefitsJob Function: Engineering &...  ...American Express, AI is reshaping the future...  ...capabilities, including:Agent frameworks and orchestration...  ...to production.Evaluate emerging models,...  ...direction and align teams without formal...  ...industries.Experience as a founding engineer or early... 
    Visa sponsorship

    American Express

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Founding AI Engineer: Agent Evaluation & Alignment. Be the first to apply!