Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer (LLM & Agent Systems) — Platform

$200k - $400k
Full-time

Calliere

Role Summary

This role focuses on designing and scaling reusable AI-driven workflows, particularly those powered by large language models and autonomous agents. You will build foundational components and abstractions that enable multiple internal teams to rapidly develop and deploy intelligent systems. The position emphasizes system reliability, evaluation rigor, and thoughtful tradeoffs in model and tooling selection.

Core Ownership Areas

  • Develop reusable agent-based workflows to accelerate delivery across multiple projects.

  • Define and maintain evaluation standards to ensure consistent model performance over time.

  • Improve system reliability across key dimensions such as accuracy, latency, and robustness.

  • Build shared APIs and platform components used broadly across engineering teams.

Key Responsibilities

  • Design and implement orchestration patterns for LLM-powered agents.

  • Evaluate and select models, tools, and providers based on performance, cost, and reliability.

  • Build testing frameworks, evaluation pipelines, and monitoring systems for AI outputs.

  • Implement safeguards, fallback mechanisms, and cost optimization strategies.

  • Collaborate with platform and backend engineers to integrate AI capabilities into scalable services.

  • Identify repeatable patterns across projects and convert them into reusable platform features.

Requirements

Required Experience

  • Strong background in building production-grade distributed systems or platform infrastructure.

  • Practical experience developing and deploying LLM-based or agent-driven systems.

  • Demonstrated ability to design for reliability, observability, and cost efficiency.

  • High standards for code quality and system design.

Nice-to-Have Experience

  • Familiarity with retrieval systems, embeddings, or context management pipelines.

  • Experience working within regulated or security-conscious environments.

Approach to Work

  • Prioritizes measurable quality through structured evaluation and testing.

  • Designs systems for reuse, scalability, and clean abstraction layers.

  • Focuses on building solutions that generalize beyond a single use case or team.

Benefits

- Hybrid onsite.

- Incredible perks and comp package. 

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer (LLM & Agent Systems) — Platform in New York, NY vacancy
  •  ...Senior AI Engineer — Inference & Agent Systems United States Title: Applied AI Engineer — Inference & Agent Systems...  ...validation, retry loops on malformed LLM output, graceful degradation Tool call...  ...inference systems at An agent platform (any domain) Or you've built eval/harness... 
    Platform
    Senior

    Arcana Analytics Inc.

    New York, NY
    5 days ago
  •  ...A leading iGaming platform provider is seeking a Senior AI / Generative AI Engineer to develop LLM-based systems for their growing AI team. The ideal candidate will take technical ownership from design to production support, ensuring the reliability and maintainability... 
    Platform
    Senior

    GR8 Tech

    New York, NY
    1 day ago
  •  ...leading financial institution in New York seeks an AI Agents Applied Research/Engineering Senior Associate. In this role, you will lead the lifecycle of LLM-based agents, implementing research and best practices for AI systems. You will ensure the delivery of efficient,... 
    Senior

    JPMorgan Chase & Co.

    New York, NY
    4 days ago
  •  ...Dsilo Ai Technologies is seeking a Senior AI Engineer with over 5 years of experience to design and develop AI solutions...  ...ensure robust performance across systems. Strong proficiency in Python and...  ...with AI deployment on cloud platforms like AWS are essential. This role... 
    Platform
    Senior
    Remote work

    Dsilo Ai Technologies

    New York, NY
    21 hours ago
  •  ...Consultants is seeking an experienced Artificial Intelligence Engineer to design and deploy AI/ML and Generative AI solutions addressing real-world...  ...deliver AI-driven applications using production-grade LLM-powered systems. The ideal candidate has 5+ years in AI/ML with solid... 
    Senior

    Bluetick Consultants

    New York, NY
    2 days ago
  • $120 - $175 per hour

    Stott and May is seeking a Senior AI Engineer for a fully remote role focused on...  ...deploying production-grade AI systems. The successful candidate will work on LLM applications, implement RAG pipelines...  ..., and familiarity with cloud platforms. The contract offers a... 
    Platform
    Senior
    Remote job
    Contract work

    Stott and May

    New York, NY
    2 days ago
  •  ...marketing agency is seeking an Associate Director, AI Engineer in New York to develop innovative AI products. The...  ...demands strong Python skills and experience with LLM frameworks, focusing on designing multi-agent systems and collaborating with teams to deliver high-quality... 
    Senior

    Dentsu Aegis Network Ltd.

    New York, NY
    4 days ago
  • $178k - $267k

    AlphaSense is looking for a passionate software engineer to join their AI & Search mission in New York. In this role, you'll architect and implement...  ...and Django, and familiarity with Kubernetes and cloud platforms. The compensation range is $178,000 - $267,000 USD, plus... 
    Platform
    Senior

    BetterCloud

    New York, NY
    2 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an...  ...of customers. Our AI models and platforms empower teams across Capital... 
    Platform
    Senior
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $160k - $220k

     ...Remote Department Engineering Compensation $160K – $220K Job Title: Senior AI Engineer (Natural Language Systems) Prompt is a mission...  ...ourselves as the go-to platform in the space and...  ...pipelines for LLM-powered workflows with...  ...classification, extraction, agent workflows)... 
    Platform
    Senior
    Full time
    Remote work
    Flexible hours

    Launch TN

    New York, NY
    1 day ago
  • $120k - $135k

     ...A leading senior care platform in the United States is seeking a Senior Machine Learning Engineer to design and scale machine learning applications...  ..., particularly with LLM-powered solutions. Responsibilities...  ...include developing ML systems, maintaining model quality,... 
    Platform
    Senior
    Remote work

    A Place for Mom

    New York, NY
    6 days ago
  • $160k - $174k

     ...re looking for a hands-on Senior AI Engineer to lead the design, build,...  ...of production agentic AI systems—including multi-agent research assistants that deliver...  ....Partner effectively with platform, security, and governance...  ...designing and building LLM-powered applications in... 
    Platform
    Senior
    Part time
    Work experience placement
    Local area
    Flexible hours

    Voya Financial, Inc.

    New York, NY
    2 days ago
  •  ...Senior Manager, Applied AI Health System Engineering At PwC, our people in data and analytics engineering focus on...  ...healthcare data sources for use in AI and LLM-powered solutions Manage daily...  ...and/or Google Cloud (Vertex AI) platforms, with an understanding of PHI-... 
    Platform
    Senior

    PwC (US)

    New York, NY
    3 days ago
  •  ...optimization technology firm in the United States is seeking a Senior AI Engineer to design and implement AI agents for optimization applications. The ideal candidate...  ...teams to ensure best practices are met in AI systems and contribute significantly to the Gurobi... 
    Platform
    Senior

    Gurobi Optimization

    New York, NY
    1 day ago
  • $313.06k

     ...exchange in the United States is seeking a Principal Engineer to design and develop autonomous AI agents for their platform. This role involves collaboration across...  ...Learning. The candidate will focus on developing systems that enhance trading and security operations.... 
    Platform
    Senior

    Framework Ventures

    New York, NY
    1 day ago
  • A leading conversational AI platform in New York, NY is seeking an experienced engineer to join their Agent Engineering team. This role offers complete ownership in designing...  ...and Typescript, and a strong background in system challenges. The company provides competitive... 
    Platform
    Senior

    Decagon

    New York, NY
    4 days ago
  •  ...Granum is seeking an experienced AI Engineer to help reshape the future of their products through AI-driven capabilities. This role involves designing autonomous AI agents and architecting systems that enable seamless AI integration throughout the organization. Ideal candidates... 
    Platform
    Senior

    Granum

    New York, NY
    1 day ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview: At Capital...  ...responsible and reliable AI systems, changing banking for good. For years...  ...of customers. Our AI models and platforms empower teams across Capital One... 
    Platform
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    1 day ago
  •  ...ALLIANZ SERVICES PRIVATE LIMITED is hiring a Senior Agentic AI Developer. This role focuses on architecting multi-agent systems and designing advanced workflows. Candidates...  ...currently remote, requiring skills in cloud platforms like AWS or Azure, along with Docker and... 
    Platform
    Senior
    Remote work

    ALLIANZ SERVICES PRIVATE LIMITED

    New York, NY
    4 days ago
  • Pinecone in New York is seeking experienced engineers to enhance AI agent interactions through seamless API and SDK development. The role invites you to innovate workflows and build robust systems that facilitate significant growth. You will partner closely with product... 
    Platform
    Senior

    Pinecone

    New York, NY
    4 days ago
  •  ...Framework Ventures is looking for a Senior AI Engineer to join their team. This role focuses on LLM-based code generation and involves...  ...large language models for their platform, Caffeine. Responsibilities include developing multi-agent architectures, optimizing post-training... 
    Platform
    Senior

    Framework Ventures

    New York, NY
    1 day ago
  • A leading AI research platform in New York is seeking a Sr. Software Engineer to architect and build intelligent backend infrastructure for autonomous AI research agents. You'll design coordination systems and multi-agent frameworks that enhance financial decision-making... 
    Platform
    Senior

    Kepler AI (formerly Keru.ai)

    New York, NY
    4 days ago
  •  ...A global technology firm seeks a Senior AI Engineer for remote work. This position requires 4-...  ...Responsibilities include designing and deploying AI systems, leading model monitoring, and...  ..., and SQL, with experience in cloud platforms and ML frameworks. The company values... 
    Platform
    Senior
    Remote work

    Traackr

    New York, NY
    1 day ago
  • $30 - $50 per hour

     ...A leading tech company is seeking an AI Engineer for a remote role. You will build, evaluate, and deploy production AI systems, focusing on NLP, LLMs, and computer vision. The ideal candidate will have mid-senior experience in delivering ML systems, strong Python skills... 
    Senior
    Hourly pay
    Remote work

    Rex USA

    New York, NY
    4 hours ago
  •  ...A leading technology firm is seeking a Senior AI Data Engineer to design and build agentic systems for their financial intelligence platform. The successful candidate will work at the...  ...data, focusing on creating intelligent agents for complex workflows. Applicants should... 
    Platform
    Senior

    MLabs

    New York, NY
    1 day ago
  • $215k - $230k

     ...Framework Ventures is seeking an AI Engineer for the Model Engineering Team. This role involves designing production-grade evaluation systems, optimizing machine learning models, and collaborating with a cross-functional team. Candidates should have advanced skills in... 
    Senior

    Framework Ventures

    New York, NY
    1 day ago
  •  ...their hybrid cloud and AI journeys. With support...  ...seeking a skilled AI Engineer to join an active enterprise...  ...capacity. This is a senior individual contributor...  ...workflows and multi-agent systems using Azure OpenAI and...  ...databases, workflow platforms, and operational systems... 
    Platform
    Senior
    Worldwide

    IBM

    New York, NY
    4 days ago
  • $138.95k - $169.1k

    60 Insperity Services, L.P. is looking for an Artificial Intelligence Engineer III who will design and deliver complex AI systems to solve impactful business problems. This role requires expertise in software, data science, and machine learning. Applicants should have a... 
    Senior

    60 Insperity Services, L.P.

    New York, NY
    3 hours ago
  • $50 - $60 per hour

     ...United States (US). Job Duties Build agentic AI systems: Design and implement tool-calling agents that combine retrieval, structured reasoning, and...  ..., policy enforcement) following MCP protocol. Engineer robust guardrails for safety, compliance, and least-... 
    Senior
    Hourly pay
    Remote work

    The Nippon Telegraph and Telephone Corporation (NTT)

    New York, NY
    4 days ago
  • $124k - $280k

     ...Senior Manager, Data and Analytics Engineering At PwC, our people in data and analytics engineering...  ...implementing advanced AI and ML solutions to drive...  ...algorithms, models, and systems to enable intelligent...  ...Experience with MLOps platforms and model governance practices... 
    Platform
    Senior

    PwC (US)

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer (LLM & Agent Systems) — Platform. Be the first to apply!