Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AI Engineer - LLM Inference & Production AI

Capital One National Association

Capital One National Association is looking for a Lead AI Engineer in New York, NY, to drive the development of responsible AI systems and solutions. This role involves collaborating with cross-functional teams, designing, and deploying AI products using cutting-edge technologies. The ideal candidate will possess a Bachelor's or Master's degree, strong programming skills in Python and experience in deploying AI solutions on cloud platforms. Competitive salary and performance incentives offered. #J-18808-Ljbffr

Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Lead AI Engineer - LLM Inference & Production AI in New York, NY vacancy
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For...  ...our industry‑leading capabilities with breakthrough product experiences and scalable, high‑performance AI infrastructure... 
    Suggested
    Local area

    Capital One National Association

    New York, NY
    22 hours ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for...  ...deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Financial Corp

    New York, NY
    3 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For...  ...our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Financial Corp

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital One...  ...leading capabilities with breakthrough product experiences and scalable, high-performance...  ...Invent and introduce state-of-the-art LLM optimization techniques to improve the... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Financial Corp

    New York, NY
    3 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview At Capital One, we are...  ...leading capabilities with breakthrough product experiences and scalable, high-...  ...model training, large language model inference, similarity search, guardrails,... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating responsible...  ...capabilities with breakthrough product experiences and scalable, high‑performance...  ...training, large language model inference, similarity search, guardrails,... 
    Full time
    Local area

    Capital One National Association

    New York, NY
    22 hours ago
  •  ...Inference Engine Engineer We build and run the inference engine behind every Perplexity query...  ...users do. Respond to and learn from production incidents. Who We're Looking For...  ...is a plus. You understand modern LLM architectures and are able to bring them... 

    Perplexity AI

    New York, NY
    8 days ago
  •  ...apply novel techniques in production.* You adapt quickly...  ...strong foundation in engineering and mathematics, and your...  ..., software, and AI enable you to see and...  ...Demonstrated ability to lead and mentor an engineering...  ...or technologies (e.g. LLM Inference, Similarity Search and... 
    Full time
    Part time

    Capital One

    New York, NY
    22 hours ago
  •  ...Consultants is seeking an experienced Artificial Intelligence Engineer to design and deploy AI/ML and Generative AI solutions addressing real-world...  ...teams to deliver AI-driven applications using production-grade LLM-powered systems. The ideal candidate has 5+ years in AI... 

    Bluetick Consultants

    New York, NY
    5 days ago
  •  ...Portless Inc is looking for a full-time AI Engineer who will work remotely to own the design, development...  ...TypeScript/JavaScript, and hands-on experience with LLM APIs and prompt engineering. You will collaborate with product, operations, and engineering teams to identify... 
    Full time
    Remote work

    Portless Inc

    New York, NY
    4 days ago
  • $156k - $204k

     ...Fireblocks is seeking a Data Analytics AI Engineer in New York City to design LLM-powered systems and analyze datasets for data-driven decisions. The...  ...candidate will also evaluate AI initiatives and ensure production-grade analytics through reliable CI/CD pipelines. The... 

    Fireblocks

    New York, NY
    22 hours ago
  • $187k - $240k

     ...Datadog is seeking a product-minded backend engineer to help develop AI-assisted tools aimed at enhancing the productivity of software developers. With a focus on LLM-based solutions, you'll collaborate closely with cross-functional teams to define, prototype, and launch... 

    I did my part and supported the Regular Toilet

    New York, NY
    22 hours ago
  •  ...A leading iGaming platform provider is seeking a Senior AI / Generative AI Engineer to develop LLM-based systems for their growing AI team. The ideal candidate will take technical ownership from design to production support, ensuring the reliability and maintainability... 

    GR8 Tech

    New York, NY
    4 days ago
  • $130k - $170k

     ...PerfectServe is seeking a Full Stack AI Engineer to join their R&D organization and play a...  ...central role in bringing AI capabilities to production. This high-impact role involves defining AI architecture standards, integrating LLM APIs, and optimizing system performance.... 
    Remote work

    PerfectServe

    New York, NY
    1 day ago
  • A leading financial institution in New York seeks an AI Agents Applied Research/Engineering Senior Associate. In this role, you will lead the lifecycle of LLM-based agents, implementing research and best practices for AI systems. You will ensure the delivery of efficient... 

    JPMorgan Chase & Co.

    New York, NY
    2 days ago
  • $156k - $204k

     ...Unchain Data seeks an AI Engineer to join our NYC team. You will design LLM-powered systems that enhance data-driven decisions across Product and Engineering. Ideal candidates have 5+ years in AI/ML engineering, strong SQL and Python skills, and hands-on LLM experience... 

    Unchain Data

    New York, NY
    1 day ago
  •  ...A leading AI consulting firm is seeking a Software Engineer to build, deploy, and operate production LLM-powered applications. This role requires strong software engineering skills with a focus on AI-driven features. Ideal candidates should have 3+ years of experience... 
    Full time
    Remote work

    Click2.ai

    New York, NY
    4 days ago
  • A tech solutions company in New York seeks an Associate Data & AI Engineer to build and scale data and AI infrastructure. This role focuses on deploying LLM-powered agents to automate workflows. The ideal candidate has a Bachelor's degree and 0-2 years of experience in... 

    Career Techniques

    New York, NY
    4 days ago
  • Alexander Chapman is seeking skilled individuals to help build an LLM-powered platform for life sciences. The role involves creating advanced AI/ML systems, developing agent-based workflows, and implementing MLOps practices. Candidates should have hands-on experience with... 

    Alexander Chapman

    New York, NY
    4 days ago
  • $165k - $290k

     ...Overview AI Lead Engineer responsible for shaping and executing the AI vision...  ...implementation of AI-based product solutions, collaborating...  ...LLMs, prompt orchestration, LLM telemetry, and inspection. Upskill...  ...model orchestration tools, inference frameworks, cloud‑native ML... 
    Local area
    Remote work

    Commerce.com US, Inc.

    New York, NY
    3 days ago
  •  ...A tech-driven company is seeking an AI Engineer to design, build, and operate machine learning systems in a remote role based in the...  ...ML pipelines, implementing evaluation metrics, and optimizing production services. Strong Python engineering skills and experience with... 
    Remote work

    Rex USA

    New York, NY
    4 days ago
  •  ...JobID: 53328 AI Engineer Pay - $80-85 hr/w-2 Location 100...  ...solutions leveraging the latest LLM and GenAI technologies....  ...capabilities into scalable, production-ready enterprise applications...  ...and automation Optimize inference pipelines for scalability, latency... 
    Remote work

    Prestige Staffing Healthcare Jobs - Clinical & Allied Health

    New York, NY
    4 days ago
  •  ...dexter health, we build AI-powered software for...  ...looking for a high-agency AI Engineer to help us build new AI...  ...will turn ambiguous product ideas into working,...  ...value Design and implement LLM-based workflows,...  ...hosted LLMs, model serving, inference optimization, or similar... 
    Remote work

    dexter health

    New York, NY
    4 days ago
  • $40 per hour

     ...Senior AI Engineer Doctronic | New York City ONSITE...  ...guidelines built for LLM consumption Fine tuning...  ...Real-time inference systems handling millions...  ...from minimal specs to production AI coding tools encouraged...  ...autonomy Access to leading AI technologies and medical... 

    Doctronic Inc

    New York, NY
    4 days ago
  • $200k - $300k

     ...Senior / Principal AI Engineer (Generative AI, Multi-Agent Systems)...  ...for engineers who want to ship production AI that directly affects patient...  ..., and high-throughput inference-alongside infrastructure for...  ...clinical guidelines structured for LLM consumption Fine-tuning... 

    NxT Level

    New York, NY
    3 days ago
  • $30 - $50 per hour

     ...A leading tech company is seeking an AI Engineer for a remote role. You will build, evaluate, and deploy production AI systems, focusing on NLP, LLMs, and computer vision. The ideal candidate will have mid-senior experience in delivering ML systems, strong Python skills... 
    Hourly pay
    Remote work

    Rex USA

    New York, NY
    3 days ago
  •  ...Founding AI Engineer (AI + Production) New York City (5 days on-site) · Top of market...  ...eval failures, and scaling inference—then immediately applying...  ...ML ops stack Mentor and lead: as the team scales, you'll...  ...building production ML/LLM systems—RAG, fine-tuning, evals... 
    Immediate start
    Weekend work

    Everstar

    New York, NY
    23 hours ago
  •  ...Datacor is seeking a Summer 2026 AI Engineer Intern for a remote position. The intern will collaborate on innovative AI solutions, focusing on creating intelligent applications, leading MVP development, and delivering scalable features. Candidates should be enrolled in... 
    Internship
    Summer internship
    Remote work

    Carlsbad Tech

    New York, NY
    3 days ago
  • $160k - $300k

     ...A dynamic health technology startup in New York seeks an ML operations engineer to manage the lifecycle of AI systems, from experimentation to production. The role involves optimizing AI performance on biopharma data, implementing ML Ops best practices, and cross-functional... 

    Solstice Health

    New York, NY
    1 day ago
  • $193.4k - $220.7k

     ...Lead AI Engineer At Capital One, we are creating responsible and reliable...  ...capabilities with breakthrough product experiences and scalable,...  ...training, large language model inference, similarity search,...  ...introduce state-of-the-art LLM optimization techniques to improve... 
    Full time
    Part time
    Local area

    Capital One Financial Corp

    New York, NY
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AI Engineer - LLM Inference & Production AI. Be the first to apply!