Senior AI Inference Engineer — Open-Source & GPU
NVIDIA
NVIDIA seeks a Senior Software Engineer – AI Inference to advance open‑source LLM serving on GPUs and to improve the stack for high‑throughput, low‑latency inference at scale. You will contribute upstream to vLLM and SGLang, optimize runtime capabilities such as batching, scheduling, and KV‑cache, and collaborate with model, platform, and SRE teams to deliver production‑ready improvements. #J-18808-Ljbffr NVIDIA
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineer — Open-Source & GPU in New York, NY vacancy
$229.9k - $262.4k
...Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for... ...and observability, etc. Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters,...SeniorFull timePart timeLocal areaCapital One
New York, NY4 days ago$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push... ...agentic kernel optimization: applying AI-driven analysis to diagnose... ...optimization context.Active contributions to open-source LLM inference or GPU kernel libraries...SeniorFull time$144k - $236k
...Responsibilities: AI is at the core of how... ...trust platforms. As a Senior AI Software Engineer you will own end-to-... ...efficacy, and managing the GPU fleets that run them... ...improvement (i.e. inference/training efficiency,... ...by the latest open source generative models and...SeniorFull timeFor contractorsWork at officeImmediate startFlexible hoursLinkedin
New York, NY10 hours ago$144k - $236k
...team.Responsibilities: AI is at the core of how... ...platforms. As a Senior AI Software Engineer you will own end-to-end... ...efficacy, and managing the GPU fleets that run them... ...improvement (i.e. inference/training efficiency,... ...powered by the latest open source generative models and...SeniorFor contractorsWork at officeImmediate startFlexible hours- ...infrastructure foundation for AI teams. With instant GPU access, sub-second... ...jobs, and serve low-latency inference. We have thousands of customers... ...creators of popular open-source projects (e.g. Seaborn, Luigi... ...medalists, and experienced engineering and product leaders with...Senior
$160k - $240k
Senior Software Engineer - AI Inference Location New York Business Area Engineering and CTO Ref... ...governance. Our platform is built on the open-source KServe project, and the CNCS AI... .... Familiarity with PyTorch and GPU software stacks such as CUDA and NCCL...SeniorTemporary workFor contractorsWork experience placement- FMX is seeking a Senior AI Research Engineer to help design, build, and... ...and future work with open-weight models that... ...governed deployment, and inference optimization.Bachelor... ..., or deploying open-source or open-weight... ..., batching, caching, GPU utilization, and latency...Senior
- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp... ...large-scale model training and inference. This role sits at the intersection... ...techniques Contributions to open-source ML systems or GPU libraries...Full timeNew York, NYmore than 2 months ago
$198k - $247.5k
...relentless innovation of the open source community, Cloudera advances... ...enterprises.About Forward Deployed Engineering (FDE) at ClouderaCloudera’s... ...sits within the Applied AI organization, and is a specialized... ...including NVIDIA GPUs, inference optimization, model serving,...SeniorFull timeWork from homeRelocation$161.8k - $184.6k
Senior AI Engineer Overview: At Capital One, we are creating responsible... ...model training, large language model inference, similarity search, guardrails, model... ..., etc. Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters...SeniorFull timePart timeLocal areaCapital One Financial Corporation
New York, NY10 hours ago$250k - $300k
Hudson River Trading (HRT) is seeking an AI Research Engineer (Inference) to join the HAIL team. HAIL (HRT AI... ..., including but not limited to GPU kernel development, novel inference devices... ..., to recruiting and beyond. We value openness and transparency, and celebrate great...Work experience placementWork at officeLocal areaImmediate start$128k - $252.5k
...and data scientists to AI strategists, machine learning... ...specialists, and data engineers. SFL Scientific, a... ...Business, is looking to add a Senior AI Engineer to their... ...cloud/enterprise/open-source solutions, and constructing... ...of experience with GPU computing (CUDA, OpenCL...SeniorLocal areaVisa sponsorship$150k - $160k
...and the productionization of AI capabilities across the... ...for this role.THE ROLEAs a Senior AI Engineer (Full-Stack / Applications),... ...Actions, commercial AI services, Open Source AI Models, Langfuse, Snowflake... ...and maintain robust AI inference, evaluation, and monitoring...SeniorFull timeContract workTemporary workWork at officeLocal areaRemote work$74.1k - $147.8k
...innovative ideas, such as AI-enabled insights and... ...Job Description: Senior AI Engineer 1 About Crowe... ...model telemetry, and inference performance to drive optimization... ...-on background with GPU/accelerator workflows;... ..., recruiting service, sourcing entity or any other...SeniorLocal areaRemote workWorldwideFlexible hoursCrowe
New York, NY3 days ago$229.9k - $262.4k
...Senior Lead AI Engineer (LLM Customization and Finetuning) Overview: At Capital One, we are creating... ...model training, large language model inference, similarity search, guardrails, model... ..., etc. Leverage a broad stack of Open Source and SaaS AI technologies such as AWS...SeniorFull timePart timeLocal areaCapital One
New York, NY4 days ago- ...Founding AI Engineer (AI + Production) New York City (5 days on-site)... ...debugging eval failures, and scaling inference—then immediately applying... ...-informed models, running GPU-accelerated simulations, or collaborating... ...in ML/AI, contributions to open-source ML frameworks ~ Deep...Full timeImmediate startWeekend work
Everstar
New York, NY10 hours ago $229.9k - $262.4k
...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At... ...model training, large language model inference, similarity search, guardrails, model... ...observability, etc. Leverage a broad stack of Open Source and SaaS AI technologies such as AWS...SeniorFull timePart timeLocal areaCapital One
New York, NYmore than 2 months ago- Crusoe Cloud is seeking a Solutions Engineer (early-to-mid career through senior level) to help enterprise customers deploy AI/ML workloads on Crusoe's high-performance GPU infrastructure. Based in our New York City office, you'll work alongside Account Executives and...SeniorWork at office
- Reflection seeks a skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with...Senior
$165k - $180k
...seeking a highly skilled and motivated Sr. AI Data Engineer with a proven track record in building... ...seamlessly integrating a variety of open-source tools to enhance data quality,... ...quality datasets for model training and inference. Required Qualifications: BA or BS degree...SeniorWork experience placementH1bWork at officeLocal area- Kestra is seeking a technically curious Senior Business Development Representative to build the first outbound motion. From open source signals, you will engage developers and engineers to explore Kestra Enterprise and Kestra Cloud. You will articulate value with credibility...Senior
$180k - $250k
...We are seeking a Senior Sourcing Lead – Cloud & AI Inference to join our Global Procurement team. This role will serve as a strategic leader in driving... ...senior stakeholders, technology leaders, platform engineering, and finance teams to ensure we are extracting maximum...SeniorWork at office$182.3k - $220k
...clinical operations, and internal tooling. We're hiring a Senior AI Engineer to join a new team we're building from the ground up... ...(or equivalent depth through substantial side projects or open-source work). ~ Strong Python engineer with experience building...SeniorFull timeLocal areaWeight Loss, Better Sex, Fuller Hair, Improved Skin And More...
New York, NY10 hours ago$152k - $241.5k
We are seeking a Senior AI/ML Performance and Efficiency Engineer, GPU Clusters at NVIDIA to join our AI Efficiency efforts. As an Engineer, you will have a... ...Experience investigating, and resolving, training & inference performance end to endDebugging and optimization...SeniorFull timeRemote work$172k - $349k
AI Solution EngineerThis role has been designated... ...will embrace you. Open up opportunities... ....As an AI Solution Engineer your role will be... ...3rd Party and Open Source components.Assist... ...model training or inference, and how model attributes... ...premise hardware / GPU clusters.Strong...Full timeWork experience placementRemote workWork from home$150k - $170k
...Role As an AI Engineer focused on CreditAI, our... ...incorporating tools, external data sources, memory, and state... ...tune, optimize, and deploy open-source deep learning models... ...use cases, leveraging GPU infrastructure for training and inference Apply systems...Octus Inc
New York, NY10 hours ago$175k - $215k
...right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI... ...orchestration systemsExperience fine-tuning models or working with open-source LLMs for domain-specific tasksOpen-source AI contributions or...SeniorFull timeLocal area$123k - $215.25k
...bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full... ...worldwide.At American Express, AI is reshaping the future of... ...American Express scale.THE ROLEAs a Senior AI Engineer - Agentic AI,... ...AI AND ML:• Commercial and open-source LLMs integrated into production...SeniorWorldwideVisa sponsorship- ...About Merciv Merciv is an AI and data analytics... ...Connects disparate data sources into a single, coherent... ...our team around a strong engineering culture, and are... ...interactive. We want users to open Merciv and immediately... ...The Role As a Senior Backend Engineer, you’ll...SeniorFull timeImmediate startHome officeFlexible hours
Merciv
New York, NY10 hours ago $152k - $241.5k
We are looking for a software engineer with a strong background in parallel processing and GPU architecture to push the limits of... ...performance at the intersection of AI, high-performance computing, and... ...from the crowd: Experience with inference optimization techniques and...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineer — Open-Source & GPU. Be the first to apply!
Related searches
- ai engineer New York, NY
- ai research engineer New York, NY
- machine learning ai engineer New York, NY
- senior ai engineer New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- ai engineer remote New York, NY
- ai developer New York, NY
- senior maintenance supervisor New York, NY
- senior operations associate New York, NY