Lead AI Engineer - LLM Inference & Production AI
Capital One National Association
Capital One National Association is looking for a Lead AI Engineer in New York, NY, to drive the development of responsible AI systems and solutions. This role involves collaborating with cross-functional teams, designing, and deploying AI products using cutting-edge technologies. The ideal candidate will possess a Bachelor's or Master's degree, strong programming skills in Python and experience in deploying AI solutions on cloud platforms. Competitive salary and performance incentives offered. #J-18808-Ljbffr
$197.3k - $225.1k
...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For... ...our industry‑leading capabilities with breakthrough product experiences and scalable, high‑performance AI infrastructure...SuggestedLocal area$197.3k - $225.1k
...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for... ...deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI...SuggestedFull timePart timeLocal area$197.3k - $225.1k
...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For... ...our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure...SuggestedFull timePart timeLocal area$229.9k - $262.4k
...Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital One... ...leading capabilities with breakthrough product experiences and scalable, high-performance... ...Invent and introduce state-of-the-art LLM optimization techniques to improve the...SuggestedFull timePart timeLocal area$197.3k - $225.1k
...Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview At Capital One, we are... ...leading capabilities with breakthrough product experiences and scalable, high-... ...model training, large language model inference, similarity search, guardrails,...SuggestedFull timePart timeLocal area$197.3k - $225.1k
...Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating responsible... ...capabilities with breakthrough product experiences and scalable, high‑performance... ...training, large language model inference, similarity search, guardrails,...Full timeLocal area- ...Inference Engine Engineer We build and run the inference engine behind every Perplexity query... ...users do. Respond to and learn from production incidents. Who We're Looking For... ...is a plus. You understand modern LLM architectures and are able to bring them...
- ...apply novel techniques in production.* You adapt quickly... ...strong foundation in engineering and mathematics, and your... ..., software, and AI enable you to see and... ...Demonstrated ability to lead and mentor an engineering... ...or technologies (e.g. LLM Inference, Similarity Search and...Full timePart time
- ...Consultants is seeking an experienced Artificial Intelligence Engineer to design and deploy AI/ML and Generative AI solutions addressing real-world... ...teams to deliver AI-driven applications using production-grade LLM-powered systems. The ideal candidate has 5+ years in AI...
- ...Portless Inc is looking for a full-time AI Engineer who will work remotely to own the design, development... ...TypeScript/JavaScript, and hands-on experience with LLM APIs and prompt engineering. You will collaborate with product, operations, and engineering teams to identify...Full timeRemote work
$156k - $204k
...Fireblocks is seeking a Data Analytics AI Engineer in New York City to design LLM-powered systems and analyze datasets for data-driven decisions. The... ...candidate will also evaluate AI initiatives and ensure production-grade analytics through reliable CI/CD pipelines. The...$187k - $240k
...Datadog is seeking a product-minded backend engineer to help develop AI-assisted tools aimed at enhancing the productivity of software developers. With a focus on LLM-based solutions, you'll collaborate closely with cross-functional teams to define, prototype, and launch...- ...A leading iGaming platform provider is seeking a Senior AI / Generative AI Engineer to develop LLM-based systems for their growing AI team. The ideal candidate will take technical ownership from design to production support, ensuring the reliability and maintainability...
$130k - $170k
...PerfectServe is seeking a Full Stack AI Engineer to join their R&D organization and play a... ...central role in bringing AI capabilities to production. This high-impact role involves defining AI architecture standards, integrating LLM APIs, and optimizing system performance....Remote work- A leading financial institution in New York seeks an AI Agents Applied Research/Engineering Senior Associate. In this role, you will lead the lifecycle of LLM-based agents, implementing research and best practices for AI systems. You will ensure the delivery of efficient...
$156k - $204k
...Unchain Data seeks an AI Engineer to join our NYC team. You will design LLM-powered systems that enhance data-driven decisions across Product and Engineering. Ideal candidates have 5+ years in AI/ML engineering, strong SQL and Python skills, and hands-on LLM experience...- ...A leading AI consulting firm is seeking a Software Engineer to build, deploy, and operate production LLM-powered applications. This role requires strong software engineering skills with a focus on AI-driven features. Ideal candidates should have 3+ years of experience...Full timeRemote work
- A tech solutions company in New York seeks an Associate Data & AI Engineer to build and scale data and AI infrastructure. This role focuses on deploying LLM-powered agents to automate workflows. The ideal candidate has a Bachelor's degree and 0-2 years of experience in...
- Alexander Chapman is seeking skilled individuals to help build an LLM-powered platform for life sciences. The role involves creating advanced AI/ML systems, developing agent-based workflows, and implementing MLOps practices. Candidates should have hands-on experience with...
$165k - $290k
...Overview AI Lead Engineer responsible for shaping and executing the AI vision... ...implementation of AI-based product solutions, collaborating... ...LLMs, prompt orchestration, LLM telemetry, and inspection. Upskill... ...model orchestration tools, inference frameworks, cloud‑native ML...Local areaRemote work- ...A tech-driven company is seeking an AI Engineer to design, build, and operate machine learning systems in a remote role based in the... ...ML pipelines, implementing evaluation metrics, and optimizing production services. Strong Python engineering skills and experience with...Remote work
- ...JobID: 53328 AI Engineer Pay - $80-85 hr/w-2 Location 100... ...solutions leveraging the latest LLM and GenAI technologies.... ...capabilities into scalable, production-ready enterprise applications... ...and automation Optimize inference pipelines for scalability, latency...Remote work
- ...dexter health, we build AI-powered software for... ...looking for a high-agency AI Engineer to help us build new AI... ...will turn ambiguous product ideas into working,... ...value Design and implement LLM-based workflows,... ...hosted LLMs, model serving, inference optimization, or similar...Remote work
$40 per hour
...Senior AI Engineer Doctronic | New York City ONSITE... ...guidelines built for LLM consumption Fine tuning... ...Real-time inference systems handling millions... ...from minimal specs to production AI coding tools encouraged... ...autonomy Access to leading AI technologies and medical...$200k - $300k
...Senior / Principal AI Engineer (Generative AI, Multi-Agent Systems)... ...for engineers who want to ship production AI that directly affects patient... ..., and high-throughput inference-alongside infrastructure for... ...clinical guidelines structured for LLM consumption Fine-tuning...$30 - $50 per hour
...A leading tech company is seeking an AI Engineer for a remote role. You will build, evaluate, and deploy production AI systems, focusing on NLP, LLMs, and computer vision. The ideal candidate will have mid-senior experience in delivering ML systems, strong Python skills...Hourly payRemote work- ...Founding AI Engineer (AI + Production) New York City (5 days on-site) · Top of market... ...eval failures, and scaling inference—then immediately applying... ...ML ops stack Mentor and lead: as the team scales, you'll... ...building production ML/LLM systems—RAG, fine-tuning, evals...Immediate startWeekend work
- ...Datacor is seeking a Summer 2026 AI Engineer Intern for a remote position. The intern will collaborate on innovative AI solutions, focusing on creating intelligent applications, leading MVP development, and delivering scalable features. Candidates should be enrolled in...InternshipSummer internshipRemote work
$160k - $300k
...A dynamic health technology startup in New York seeks an ML operations engineer to manage the lifecycle of AI systems, from experimentation to production. The role involves optimizing AI performance on biopharma data, implementing ML Ops best practices, and cross-functional...$193.4k - $220.7k
...Lead AI Engineer At Capital One, we are creating responsible and reliable... ...capabilities with breakthrough product experiences and scalable,... ...training, large language model inference, similarity search,... ...introduce state-of-the-art LLM optimization techniques to improve...Full timePart timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI Engineer - LLM Inference & Production AI. Be the first to apply!
- lead maintenance engineer New York, NY
- lead automation engineer New York, NY
- lead engineer New York, NY
- lead security engineer New York, NY
- lead ios developer New York, NY
- lead product engineer New York, NY
- lead software test engineer New York, NY
- lead algorithm engineer New York, NY
- lead network engineer New York, NY
- lead mobile developer New York, NY

