Senior AI Engineer: LLM Inference & Foundation Models
Capital One Group
Capital One is seeking an AI Engineer 5 to build and scale responsible AI systems that reshape banking experiences. The role focuses on training and deploying foundation models, multi-model workflows, and governance across production AI systems. You will collaborate with engineers, researchers, and product managers to deliver AI-powered features. The ideal candidate has 6+ years in AI/ML, strong Python/Java/CUDA skills, and experience with cloud platforms (AWS/GCP/Azure). #J-18808-Ljbffr Capital One Group
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer: LLM Inference & Foundation Models in Brooklyn, NY vacancy
$286.2k - $326.7k
Senior Staff AI Engineer - Agentic AI Platform (Remote Eligible) At... ...Description: The Intelligent Foundations and Experiences (IFX)... ...of customers. Our AI models and platforms empower... ...large language model inference, agents and multi-... ...technologies (e.g. LLM Inference, Similarity...SeniorFoundationRemote jobFull timePart timeLocal area- ...offers a flexible/hybrid model of 3 days onsite and 2... ...next-generation AI capabilities that transform... ...a highly skilled Senior AI Engineer with hands-on experience... ...orchestrating existing foundation models and AI services... ...that effectively combine LLM intelligence with...SeniorFoundationRemote workFlexible hours
DTCC- The Depository Trust & Clearing Corporation
Jersey City, NJ1 day ago - Capital One is seeking an AI Engineer 4 to help design, develop and deploy AI-powered products across the enterprise. You will work with cross-functional teams to advance foundation model training, inference, and governance. The role emphasizes building scalable AI infrastructure...SeniorFoundation
$100k - $130k
Senior Data ScientistHybrid, NYC$100-130k plus bonusFor more information on... ...Scientist with strong expertise in causal inference, experimentation, predictive modeling, and advanced analytics. The role... ...candidate will have a strong foundation in statistical modeling and...SeniorFoundationEXL Service
Jersey City, NJ1 day ago- ...AI Engineer Location: Remote, Nationwide Our client... ...rapidly advancing model capabilities into reliable... ...to build practical LLM and agent-based systems... ...Set Strong foundation in machine learning, neural... ..., memory, agents, inference, and evaluation. Ability...FoundationRemote work
Blue Signal Search
Jersey City, NJ1 day ago $149 per hour
...provide more details.Vice President - Technical AI Foundation Model EngineerRole SummaryThe VP, Technical AI Foundation Model Engineer is responsible for designing, building,... ...technical recommendations and tradeoffs to senior leadership.Support executive decision-making...FoundationFull timeWork at officeLocal areaRemote work1 day per weekMUFG
Jersey City, NJ3 days ago- ...Distinguished AI Engineer This role requires... ...capabilities: AI gateways, model access and serving... ...coverage, and inference cost. Build or... ...ownership. Mentor senior engineers and drive... ...of the following: LLM platforms, model... ...Strong engineering foundation in distributed systems...Foundation
Kasmo Global
Jersey City, NJ2 days ago - ...LLM / Agentic AI / Full-Stack AI Engineering Level Senior Individual Contributor Target / alternate... ...CI/CD, MLOps, LLMOps, model serving Recruiter red... ...AI systems powered by foundation models, LLMs, retrieval... ...appropriate. Optimize inference workloads for latency,...Foundation
Echo IT Solutions
Jersey City, NJ2 days ago $113.1k - $232.3k
...Lead Applied AI Engineer II - ServiceNow Role... ...candidate will be a role-model leader and mentor,... ..., and owning the inference, token, and cloud... ...experience across LLM integration (... ...CIS-HRSD, CIS-Data Foundations, CIS-ITSM, CIS-IRM... ...level employees to senior leaders, we believe...FoundationWork at officeLocal areaVisa sponsorshipFlexible hours3 days per weekDeloitte
Jersey City, NJ2 days ago$120k - $200k
...harness cutting-edge AI and breakthrough technologies... ...We are seeking a senior‑level engineer to design, build, and... ...focuses on industrializing LLM‑based systems with... ...for prompts, models, and datasets, including... ...including token usage, inference latency, throughput, and...SeniorTemporary workWorldwideFlexible hoursThe Bank of New York Mellon
Jersey City, NJ3 days ago$61k - $101k
...certification in software engineering concepts, with at... ...least 8 years of AI/ML engineering... ...and deploying LLM and GNN solutions... ...experience developing LLM inference engines with... ...ability to advise senior leaders on safe adoption... ...systems for large models, including system...SeniorFull timeJ.P. Morgan
Jersey City, NJ3 days ago$130k - $180k
...delivering cloud, AI, data, and enterprise... ...Job Title NLP AI Engineer Location: 100%... ...scale Large Language Models (LLMs) . The ideal... ...GPU training, inference performance, experiment... ...practices for LLM development, and mentor... ...NLP research, foundation models, and AI frameworks...FoundationFull timeH1bLocal areaRemote workVisa sponsorship- ...deliver healthcare. Our AI sensing platform enables... ...for an Applied AI Engineer to take our growing collection of foundation models and ML components from manually... ...Deploy across our inference surfaces: third-party APIs... ...pipelines (STT, TTS, streaming LLM) Production RAG...FoundationFull time
Norbert Health
Brooklyn, NYmore than 2 months ago $265k
...our purpose-built AI platform, we’re... ...the time. Senior Staff Software Engineer Location: Americas... ..., operating model, and execution roadmap... ...the systems foundation that makes this scalable... ...workloads, from inference pipelines to... ...infrastructure for AI/LLM workloads:...SeniorFoundationFull timeWork at officeLocal areaRemote workWork from homeFlexible hoursGrabJobs
Jersey City, NJ3 days ago$61k - $101k
...years working on AI solutions. We need... ..., or similar models to solve business... ...communication skills with senior technical and... ...Familiarity with LLM fine-tuning and small... ...language model inference is a plus. We prefer... ...Management AI Engineering team, where we are...SeniorFull timeJ.P. Morgan
Jersey City, NJ8 days ago$61k - $101k
...certification in software engineering concepts and at... ...experience with AI/ML platforms, model serving or... ...coaching senior engineers or leads... ...model hosting, inference, training, or batch... ...Experience with LLM and model-serving... ...and optimize AI Foundation Services...SeniorFoundationFull timeJ.P. Morgan
Jersey City, NJ3 days ago$175k - $215k
...a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the... ...role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows... ...orchestration systemsExperience fine-tuning models or working with open-source LLMs for...SeniorFull timeLocal areaBrown Brothers Harriman
Jersey City, NJ3 days ago$142.32k - $213.48k
...organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑... ...agentic AI systems leveraging multiple model providers and platforms (e.g., OpenAI, Anthropic... ...full‑stack applications integrating LLM‑driven workflows and AI coding tools (e....SeniorFull timeCitigroup
Jersey City, NJ2 days ago$142.32k - $213.48k
...solutions are the foundations of everything we do... ...the Citi's Head of AI Organization. Our mandate... ...:As an AI Engineer on the Startups & Partnerships... ...of the newest models and platforms from... ...narratives for senior business and technology... ...with applied AI/LLM experience - this is...FoundationFull timeCitigroup
Jersey City, NJ4 days ago$244.7k - $279.2k
...responsible and reliable AI systems, changing... ...science and engineering teams to deliver our... ...The Intelligent Foundations and Experiences (IFX... ...and home grown AI models, to transform how... ...language model inference, agents and multi-... ...technologies (e.g. LLM Inference, Similarity...FoundationRemote jobFull timePart timeLocal area$61k - $101k
...certification in software engineering, with at least five... ...experience deploying models and inference workloads with AWS SageMaker... ...enterprise-authorized AI-assisted software... ...; experience coaching senior engineers or leads on... ...evaluating, and optimizing LLM performance...SeniorFull timeFor contractorsJ.P. Morgan
Jersey City, NJ3 days ago$141 - $180 per hour
...President, Global Red Team & AI Security Operations... ...with defensive, engineering, and governance teams.Key... ...Team strategy, execution model, and operating standards... ...adversarial testing of AI and LLM systems (e.g., prompt... ...in developing senior and junior red team operators...SeniorFull timeWork at officeLocal areaRemote work1 day per weekMUFG
Jersey City, NJ2 days ago- ...GenAI technologies (e.g., LLMs, Foundation Models) - Deep familiarity with... ..., transformer models, prompt engineering, model fine-tuning) - Experience... ...of: - vLLM - OpenShift AI - Prometheus - Grafana... ...Retrieval frameworks for LLM inferencing - Working knowledge...Foundation
3B Staffing LLC
Jersey City, NJ2 days ago - ...Turn complex AI workload signals into faster, more efficient... ...at data center scale. As a Senior AI Performance Engineer, you will analyze and optimize AI training and inference workloads across large-scale... ...profiling, benchmarking and modeling results into improvements engineers...SeniorContract workTemporary workWork at officeFlexible hours
Graphcore
Brooklyn, NY3 days ago - Senior Principal Software EngineerWe're looking... ...Principal Software Engineer at JPMorganChase... ...and development of model serving solutions for... ...for agentic AI-enabled engineering... ...optimization using model inference servers such as Triton... ...and deploying LLM & GNN solutions on...Senior
- Principal Software Engineer At JPMorgan Chase, we are building... ...of enterprise AI — and we need the best minds in LLM inference to help us do it. This is... ...will work directly with senior engineering leadership to... ...evolves, ensuring every model we serve is fast, cost-efficient...
$61k - $101k
...certification in software engineering concepts, with at... ...experience with production LLM inference systems such as vLLM,... ...trade-offs clearly to senior engineering and... ...the adoption of agentic AI-enabled development practices... ...strategy across our model portfolio, evaluating...Full timeJ.P. Morgan
Jersey City, NJ5 days ago- ...focused on marketing measurement, MMM, and geo-based causal inference. You will design and validate models, build data pipelines, and translate results into... ...methods, and a track record delivering insights to senior stakeholders are essential. The role is US-remote eligible...SeniorContract workRemote work
- Staff Software Engineer, Ai Product EngineeringThomson Reuters is looking... ...incorporating large language models, AI agents, orchestration,... ...OpenAI, Anthropic, and other foundation-model platforms.Design scalable... ...preferred.Experience with LLM-powered agents, agent orchestration...FoundationWork at officeLocal areaFlexible hours
$195k - $250k
...Amentum is hiring an AI Engineer in Hanover, MD responsible for designing... ...open-weight language models, and serving those models securely... ...embeddings, context windows, inference parameters, and common failure... ...and guardrails for LLM output, including accuracy testing...Hourly payContract workWork at officeLocal areaAmentum
Brooklyn, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Engineer: LLM Inference & Foundation Models. Be the first to apply!
Related searches
- ai developer Brooklyn, NY
- ai engineer remote Brooklyn, NY
- ai engineer Brooklyn, NY
- senior living Brooklyn, NY
- senior associate vice president Brooklyn, NY
- senior app developer Brooklyn, NY
- senior application support engineer Brooklyn, NY
- senior manager data analytics Brooklyn, NY
- senior revenue accountant Brooklyn, NY
- senior devops Brooklyn, NY