Senior AI Systems Engineer: LLM Inference & Production AI
Capital One
Capital One is seeking a Sr. Lead AI Engineer (FM Hosting, LLM Inference) to advance responsible AI across banking. You will partner with engineers, researchers, and product teams to design and scale AI-powered experiences and infrastructure. The role focuses on foundation models, inference, guardrails, and observability, using PyTorch, Hugging Face, and vector databases to deliver production-ready AI at scale. #J-18808-Ljbffr Capital One
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Systems Engineer: LLM Inference & Production AI in New York, NY vacancy
$229.9k - $262.4k
...responsible and reliable AI systems, changing banking for... ...applied science and engineering teams to deliver our industry... ...with breakthrough product experiences and... ...large language model inference, similarity search, guardrails... ...state-of-the-art LLM optimization techniques...SeniorFull timePart timeLocal areaCapital One
New York, NY1 day ago- ...Overview Sr. Lead AI Engineer (FM Hosting, LLM Inference). At Capital One, we are creating responsible and reliable AI systems that are changing banking for good. We use machine learning... ..., technical program managers, and product managers to deliver AI‑powered products...SeniorLocal area
Capital One
New York, NY1 day ago - WRITER is seeking an AI engineer to shape how enterprises harness superintelligence. You will build and deploy AI solutions powering the... ...AI engineering. You will work across research, data science, and product teams to deliver impactful features. #J-18808-Ljbffr WRITERSenior
- ...Global is seeking a Principal Engineer / Forward Deployed Engineer... ...execution layer powering enterprise AI Agent platforms. You will own LLM runtime services, agent orchestration, distributed systems, model routing, tool execution, and production AI infrastructure. The role...Senior
$229.9k - $262.4k
AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader... ...capabilities with breakthrough product experiences and scalable, high-performance...SuggestedFull timePart timeLocal areaCapital One
New York, NY4 days ago$229.9k - $262.4k
AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader... ...capabilities with breakthrough product experiences and scalable, high-performance...Full timePart timeLocal areaCapital One
New York, NY2 days ago$170k - $230k
...Build production-ready AI and LLM systems that directly support marketplace growth and operational efficiency. In this role, you will take ownership... ...business outcomes What You’ll Work On AI / ML Engineering (approximately 60%) Model selection, prompt engineering...Permanent employmentFull timeWork at officeRelocation package3 days per weekDataJobs
New York, NY1 day ago$150k - $220k
...Description Senior AI Engineer Full-time Remote Exclusive... ...stakeholders to ship production-grade systems and run in EST hours as a... ...working directly on LLMs or LLM-powered agents ~ Deep Python... ...decision making ~ Inference optimization experience (vLLM...SeniorFull timeRemote workNextDeavor
New York, NY20 hours ago- Capital One is seeking a Lead AI Engineer to advance AI foundations and production-ready ML systems. You will partner with engineers, researchers, PMs and product... ...The role focuses on foundation model training, LLM inference, guardrails, evaluation, and observability,...
- Oliver Wyman Quotient is hiring a Senior Lead AI Engineer to manage technical projects and design AI/ML systems and pipelines that are production-ready and extensible. You will work with OW... ...with agent-based platforms and LLM tooling. Hybrid work and collaboration...Senior
- Capital One is seeking an AI Engineer 4 to advance responsible and scalable AI systems in the IFX team. You will partner with engineers, scientists, and product managers to deliver AI-powered banking... ...foundation model training, LLM inference, agents, vector databases, and...Senior
- Top Gen AI Jobs is seeking a senior engineer to scale production AI tooling and agentic workflows for marketing intelligence. You will design retrieval and memory... ...collaboration with data science teams to deploy reliable AI systems at scale. #J-18808-Ljbffr Top Gen AI JobsSenior
$170k - $230k
DataJobs in New York, NY is seeking to build production-ready AI and LLM systems that directly support marketplace growth and operational efficiency. You will take ownership of AI initiatives from early problem framing and architecture through deployment, evaluation, and...RelocationRelocation package$120.1k - $214.5k
...help make the health system work better for... ...data analytics and AI to cybersecurity,... ...scientists and software engineers through data... ...create a scalable production solution that can... ...cutting edge models, LLM, software, and... ...with low-latency inference and high availability...SeniorRemote jobMinimum wageFull timeWork experience placementWork at officeLocal area- ...Discernis builds AI driven document intelligence... ...core product features, not afterthoughts... ...of the AI systems at the core of our... ...the problem, prompt engineering, agentic orchestration... ...model serving and inference optimization... ...building production LLM or ML powered features...Full time
Discernis
New York, NY2 days ago $175k
...SummaryAssured Guaranty is seeking a Senior AI Software Engineer to build production-grade AI applications using our... ...expectation is to deliver working systems quickly, safely, and at enterprise... ...experienceExperience building production LLM-based applications (prompting,...SeniorAssured Guaranty
New York, NY5 days ago$142.32k - $213.48k
...ProfessionalCompany: CitiGenerative AI Engineer At Citi, we are pioneering... ...in building robust, scalable products that deliver tangible impact.... ...world, commercial production systems, not just proofs-of-concept.... ...programming, and advanced LLM/agentic frameworks will be essential...SeniorFull timeWork at officeWork from homeWorldwideFlexible hoursCitigroup
New York, NY1 day ago$204k - $255k
...Collibra’s Unstructured AI TeamWork at the forefront of context engineering - shaping how AI systems retrieve, structure,... ...prototype to stable production across enterprise... ...making progress as a team.Senior AI Engineer at... ...).Hands-on work with LLM-based and AI-driven enrichment...SeniorWork experience placementWork at officeFlexible hours2 days per weekCollibra
New York, NY1 day ago- ...Points Lead impactful AI initiatives in financial... ...a high-performing engineering team.Job DescriptionSenior... ....Design and deliver production AI systems that enhance sourcing,... ...efficiency.Utilize modern LLM frameworks, cloud... ...unlock new use cases.Senior Vice President, AI Engineering...Senior
Green Key Resources
New York, NY3 days ago $180k - $240k
# Senior AI EngineerOverviewApplication## About the roleThis... ...AI from discovery to production systemsthat move the... ...agentic workflows on LLM APIs from Anthropic... ...Integrate agents with the systems a firm already runs by... ...on what to use.* Set engineering standards and mentor...SeniorDealstitch LLC.
New York, NY1 day ago$200k
...with mission-critical systems running royalties, distribution... ...productionization of AI capabilities across... ...shipped AI-powered products at scale and now wants... ...role.THE ROLEAs a Senior AI Engineer (Full-Stack / Applications... ...maintain robust AI inference, evaluation, and monitoring...SeniorFull timeContract workTemporary workWork at officeLocal areaRemote workMacmillan
New York, NY4 days ago$125.8k - $209.7k
....The OpportunityAs a Cyber AI Engineer at the Senior Consultant level in EY's Cyber... ...—from prototype to production—with guidance from technical... ...Computer Science, Information Systems, Engineering, or a related... ...Deploying frontier AI models or LLM applications for...SeniorImmediate startEY (Ernst & Young)
New York, NY2 days ago$160k - $240k
...the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure... ...infrastructure complexity, empowering engineering teams to focus on creating... ...Mentor junior engineers on system design, debugging, and...SeniorTemporary workFor contractorsWork experience placementBloomberg
New York, NY3 days ago- Scale AI is shaping the future of enterprise AI with frontier agents deployed across... ...design, evaluate, and deploy intelligent systems that combine frontier models with structured... ...enterprise customers. You will build production-grade AI systems, ensure reliability, and...Senior
- SIDRAM TECHNOLOGIES is seeking a Senior Application Security Engineer with hands-on Python development... ...and deep expertise in AI/ML, LLMs and secure software design... ...a track record of mitigating AI/LLM risks within production systems. The position is based in a hybrid...SeniorFull time
- Take2 AI in New York City is hiring a Senior Software Engineer, Applied AI to design, build, and scale the AI systems powering Take2's autonomous healthcare recruiting platform. You’ll... ...prototyping and model selection through production reliability—as we scale from...Senior
- ...over 80 million customers. As an AI Agents Applied Research/Engineering Senior Associate in our The Digital Team... ...lead the end-to-end lifecycle of LLM-based agents: defining research... ..., tool use, and safety; building production systems that perform under real-world...Senior
Testing Site - JPMC
New York, NY20 hours ago - Aimlroles is seeking a Senior Agentic AI/Generative AI Engineer to help architect our next-generation AI-driven products — from prototyping through production deployment. This is a customer... ...and client conversations. You will design LLM-powered workflows, build intelligent...SeniorRemote job
- Capital One is seeking an AI Engineer 4 to design, develop, test, and deploy AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation,...Senior
- ...organization. They are expanding their internal AI engineering function and looking for a strong... ...contributor to help build and ship production grade AI systems that modernize core business... ...environments Plusses Experience with LLM frameworks such as LangChain,...Senior
Career Movement
New York, NYa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Systems Engineer: LLM Inference & Production AI. Be the first to apply!
Related searches
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer New York, NY
- data systems engineer New York, NY
- director systems engineering New York, NY