Senior AI Systems Engineer: LLM Inference & Production AI
Capital One
Capital One is seeking a Sr. Lead AI Engineer (FM Hosting, LLM Inference) to advance responsible AI across banking. You will partner with engineers, researchers, and product teams to design and scale AI-powered experiences and infrastructure. The role focuses on foundation models, inference, guardrails, and observability, using PyTorch, Hugging Face, and vector databases to deliver production-ready AI at scale. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Systems Engineer: LLM Inference & Production AI in New York, NY vacancy
$229.9k - $262.4k
...responsible and reliable AI systems, changing banking for... ...applied science and engineering teams to deliver our industry... ...with breakthrough product experiences and... ...large language model inference, similarity search, guardrails... ...state-of-the-art LLM optimization techniques...SeniorFull timePart timeLocal areaCapital One
New York, NY3 days ago- ...WRITER is seeking an AI engineer to shape how enterprises harness superintelligence. You will build and deploy AI solutions powering the... ...of AI engineering. You will work across research, data science, and product teams to deliver impactful features. #J-18808-Ljbffr...Senior
Writer Corporation
New York, NY3 days ago - ...Nexaminds seeks a Senior AI Developer to design, build, and deploy AI/ML solutions that transform... ...business processes. You will work across product, data, and business teams, delivering... ...ML experience, strong knowledge of LLM APIs, and familiarity with RAG, vector search...SeniorRemote work
Nexaminds
New York, NY4 days ago - ...Overview Sr. Lead AI Engineer (FM Hosting, LLM Inference). At Capital One, we are creating responsible and reliable AI systems that are changing banking for good. We use machine learning... ..., technical program managers, and product managers to deliver AI‑powered products...SeniorLocal area
Capital One
New York, NY3 days ago - ...People In AI is hiring a hands-on IC engineer in New York City to build production AI agents and multi-step LLM workflows. You will own ideas through deployment, integrating with existing backend and ML systems, and ensuring reliability in production. You will work closely...Senior
People In AI
New York, NY2 days ago - ...Capital One is seeking an AI Engineer 5 for Gen AI Platform Services: Agentic AI in New York... ...AI software components, including LLM inference, agents and multi-agent workflows. You... ...functional teams to deliver scalable AI systems, optimize performance, and contribute to...Senior
Capital One
New York, NY2 days ago - ...Cooley LLP is seeking a Senior AI Data Engineer to join the Innovation team. You will build production RAG and embedding pipelines, integrate LLM features, and ensure observability for AI-powered legal applications. Work with the Northstar Lakehouse and Databricks stack...Senior
Cooley
New York, NY9 hours ago $229.9k - $262.4k
AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader... ...capabilities with breakthrough product experiences and scalable, high-performance...Full timePart timeLocal areaCapital One
New York, NY2 days ago$229.9k - $262.4k
AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader... ...capabilities with breakthrough product experiences and scalable, high-performance...Full timePart timeLocal areaCapital One
New York, NY5 days ago- ...Capital One is seeking a Lead AI Engineer to advance AI foundations and production-ready ML systems. You will partner with engineers, researchers, PMs and product... ...The role focuses on foundation model training, LLM inference, guardrails, evaluation, and observability,...
Capital One
New York, NY4 days ago $170k - $230k
...Build production-ready AI and LLM systems that directly support marketplace growth and operational efficiency. In this role, you will take ownership... ...business outcomes What You’ll Work On AI / ML Engineering (approximately 60%) Model selection, prompt engineering...Permanent employmentFull timeWork at officeRelocation package3 days per weekDataJobs
New York, NY3 days ago- ...Capital One is seeking an AI Engineer 4 focused on AI Foundations: LLM customization, finetuning, and reinforcement... ...deliver responsible, scalable AI systems that power banking experiences for... ..., optimize model training and inference pipelines on modern accelerators,...Senior
Capital One
New York, NY4 days ago - ...Capital One is seeking an AI Engineer 4 (MLX) to design, develop, and deploy AI-powered systems at scale. You will collaborate... ...engineers, scientists, PMs and product partners to advance AI capabilities... ...foundation model training, LLM inference, agents and multi-agent...Senior
Capital One
New York, NY4 days ago - ...Amazon is seeking a Forward Deployed Engineer to embed with an enterprise customer, designing, building, deploying, and operating AI-powered production systems in collaboration with the customer's engineering team. The role involves delivering production-grade software...Senior
Amazon
New York, NY5 days ago - Testing Site - JPMC in New York is seeking an AI Agents Applied Research/Engineering Senior Associate to lead end-to-end lifecycle of LLM-based agents, shaping research directions and building production systems. You'll collaborate with Product, Engineering, Design, and...Senior
- Oliver Wyman Quotient is hiring a Senior Lead AI Engineer to manage technical projects and design AI/ML systems and pipelines that are production-ready and extensible. You will work with OW... ...with agent-based platforms and LLM tooling. Hybrid work and collaboration...Senior
- Capital One is seeking an AI Engineer 4 to advance responsible and scalable AI systems in the IFX team. You will partner with engineers, scientists, and product managers to deliver AI-powered banking... ...foundation model training, LLM inference, agents, vector databases, and...Senior
$150k - $220k
Description Senior AI Engineer Full-time Remote Exclusive confidential... ...stakeholders to ship production-grade systems and run in EST hours as a... ...working directly on LLMs or LLM-powered agents Deep Python... ...data-driven decision making Inference optimization experience (...SeniorFull timeRemote work- Top Gen AI Jobs is seeking a senior engineer to scale production AI tooling and agentic workflows for marketing intelligence. You will design retrieval and memory... ...collaboration with data science teams to deploy reliable AI systems at scale. #J-18808-Ljbffr Top Gen AI JobsSenior
$170k - $230k
DataJobs in New York, NY is seeking to build production-ready AI and LLM systems that directly support marketplace growth and operational efficiency. You will take ownership of AI initiatives from early problem framing and architecture through deployment, evaluation, and...RelocationRelocation package- ...Discernis builds AI driven document intelligence... ...core product features, not afterthoughts... ...of the AI systems at the core of our... ...the problem, prompt engineering, agentic orchestration... ...model serving and inference optimization... ...building production LLM or ML powered features...Full time
Discernis
New York, NY5 days ago $120.1k - $214.5k
...help make the health system work better for... ...data analytics and AI to cybersecurity,... ...scientists and software engineers through data... ...create a scalable production solution that can... ...cutting edge models, LLM, software, and... ...with low-latency inference and high availability...SeniorRemote jobMinimum wageFull timeWork experience placementWork at officeLocal area$175k
...SummaryAssured Guaranty is seeking a Senior AI Software Engineer to build production-grade AI applications using our... ...expectation is to deliver working systems quickly, safely, and at enterprise... ...experienceExperience building production LLM-based applications (prompting,...SeniorAssured Guaranty
New York, NY8 days ago$142.32k - $213.48k
...ProfessionalCompany: CitiGenerative AI Engineer At Citi, we are pioneering... ...in building robust, scalable products that deliver tangible impact.... ...world, commercial production systems, not just proofs-of-concept.... ...programming, and advanced LLM/agentic frameworks will be essential...SeniorFull timeWork at officeWork from homeWorldwideFlexible hoursCitigroup
New York, NY4 days ago$204k - $255k
...Collibra’s Unstructured AI TeamWork at the forefront of context engineering - shaping how AI systems retrieve, structure,... ...prototype to stable production across enterprise... ...making progress as a team.Senior AI Engineer at... ...).Hands-on work with LLM-based and AI-driven enrichment...SeniorWork experience placementWork at officeFlexible hours2 days per weekCollibra
New York, NY4 days ago$180k - $240k
# Senior AI EngineerOverviewApplication## About the roleThis... ...AI from discovery to production systemsthat move the... ...agentic workflows on LLM APIs from Anthropic... ...Integrate agents with the systems a firm already runs by... ...on what to use.* Set engineering standards and mentor...SeniorDealstitch LLC.
New York, NY3 days ago$200k
...with mission-critical systems running royalties, distribution... ...productionization of AI capabilities across... ...shipped AI-powered products at scale and now wants... ...role.THE ROLEAs a Senior AI Engineer (Full-Stack / Applications... ...maintain robust AI inference, evaluation, and monitoring...SeniorFull timeContract workTemporary workWork at officeLocal areaRemote workMacmillan
New York, NY7 days ago- ...Points Lead impactful AI initiatives in financial... ...a high-performing engineering team.Job DescriptionSenior... ....Design and deliver production AI systems that enhance sourcing,... ...efficiency.Utilize modern LLM frameworks, cloud... ...unlock new use cases.Senior Vice President, AI Engineering...Senior
Green Key Resources
New York, NY6 days ago - ...Ripple is seeking a Senior Staff Security Engineer focused on AI Security in New York, NY. You will be the deepest technical expert at the intersection... ...powered tooling, and collaborate with Engineering and Product to embed robust guardrails, risk assessments, and governance...Senior
Ripple
New York, NY4 days ago - ...Scale AI is shaping the future of enterprise AI with frontier agents deployed across... ...design, evaluate, and deploy intelligent systems that combine frontier models with structured... ...enterprise customers. You will build production-grade AI systems, ensure reliability, and...Senior
Frontdoor Defense
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Systems Engineer: LLM Inference & Production AI. Be the first to apply!
Related searches
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer New York, NY
- data systems engineer New York, NY
- director systems engineering New York, NY