Senior AI Infrastructure Engineer (GPU and Model Serving)
BragDev
Opportunities in the BragDev network for U.S.-based technical professionals. Senior AI Infrastructure Engineer (GPU and Model Serving) Senior Full-time Remote, U.S. Python AWS PyTorch MLOps Distributed Systems You run the infrastructure behind AI workloads: GPU clusters, model serving with low latency and controlled cost, autoscaling for inference, and the reliability practices around them. This is a standing opportunity in the BragDev network, not one company's opening. We are growing our network of vetted engineers for searches U.S. companies bring us: when a confirmed role matches your profile, we contact you before presenting you to anyone. Engagements are always direct with the company. Every professional completes BragDev's vetting: a live technical interview with BragDev's founder, plus identity, work-history and reference checks. Open roles are opportunities in the BragDev network. Saying you are interested, or applying from a role, does not guarantee an interview: every professional completes BragDev's vetting before we present them for any role. #J-18808-Ljbffr BragDev
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Infrastructure Engineer (GPU and Model Serving) in New York, NY vacancy
$123k - $215.25k
...benefitsJob Function: Engineering &... ...architecture, and infrastructure, providing 24x7 support... ...design, and enterprise AI platforms on behalf... ...operational readiness of GPU- and TPU-enabled... ...capabilities for model training, fine-... ...Experience operating model-serving or inference...SeniorAmerican Express
New York, NY4 days ago$144.25k - $256.25k
...benefitsJob Function: Engineering &... ...architecture, and infrastructure, providing 24x7... ...and enterprise AI platforms on behalf... ...platforms, mentors senior technical... ...retrieval/grounding, model integration,... ..., including GPU platforms, accelerated... ..., model serving, and inference...SeniorVisa sponsorshipAmerican Express
New York, NY3 days ago- ...Senior Vice President, Lead AI/MLOps Infrastructure Engineer About the Company Fast-growing fintech firm building AI and machine learning infrastructure... ...including orchestration, compute, storage, and model serving. This role demands a deep understanding of MLOps...Senior
$105.4k - $207.8k
...Summary Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design, build, and... ...-augmented generation (RAG), model-serving, and AI-enabled enterprise applications... ...workloads, Kubernetes, and infrastructure-as-code controlsBuilding AI-assisted...SeniorWork experience placementLocal areaVisa sponsorshipDeloitte
New York, NY1 day ago$123k - $215.25k
...the company’s technology engineering, architecture, and infrastructure, providing 24x7 support to... ...design, and enterprise AI platforms on behalf of the... ...requirements into reliable model-serving capabilities, build... ...inference optimization, GPU fundamentals, Kubernetes,...SeniorFull timeWork experience placementWork at officeLocal areaFlexible hours$197.3k - $225.1k
AI Engineer 4 (Vision model (VLM) customization experience) At Capital... ...investments in technology infrastructure and world-class... ...to reimagine how we serve our customers and businesses... ...to optimize GPU/TPU utilization and accelerate... ...Mentor Principal and Senior Associates on...Full timePart timeLocal areaCapital One
New York, NY2 days ago- We Are:The Global AI Infrastructure team is at the center of enabling... ...powers AI platforms, GPU-accelerated workloads, large-scale models, simulations, and... ...AIaaS, Token-aaS, model serving, and agentic AI frameworksIntegrate... ...with LLM inference engines (TensorRT-LLM),...Full timeWork experience placementLive inWork at officeLocal area
Accenture
New York, NY5 days ago $160k - $200k
...TL;DR Kharon is seeking a full-time Senior AI Engineer based in New York City. This role requires... ...ideas, gather feedback, and refine models and interfaces. Build and integrate... ...and excessively costly to any business. Serving many of today’s leading global financial...SeniorFull timeWork at officeImmediate startFlexible hours3 days per weekKharon
New York, NY9 days ago$130k - $147k
...every decision. Our AI-first platform transforms... ...We are seeking a Senior ML/AI Platform Engineer to help build and... ...and implementing the infrastructure, tooling, automation... ...production machine learning models, LLM applications,... ...with model serving architectures, APIs,...SeniorPart timeWork at officeRemote workWork from homeFlexible hoursCurinos Inc
New York, NY15 days ago- FMX is seeking a Senior AI Research Engineer to help design, build, and scale Skynapse... ...work with open-weight models that may require evaluation... ...adaptation.Experience with model serving and inference optimization... ..., ONNX, batching, caching, GPU utilization, and latency/...Senior
Cantor Fitzgerald
New York, NY4 days ago $200k - $230k
SVP, Lead AI/MLOps Infrastructure Engineer - Full Time - HybridWe’re partnering with... ...growing fintech firm, on a senior-level hire to lead and own... ...inference infrastructure to model serving, reliability, and cost,... ...orchestration, compute (including GPU), storage, and model...Full timeRemote workBenchmark IT
New York, NY1 day ago- ...in the United States is seeking a Senior AI Engineer to own and scale OCR-driven document... ...pipelines and self-hosted LLM infrastructure. You will build production-grade systems... .../Hugging Face TGI, layout-aware models, GPU-backed serving, and robust validation layers. #J...SeniorRemote job
$229.9k - $262.4k
AI Engineer 5 (GenAI Platform, Agentic Infrastructure) At Capital One, we are creating responsible and... ...capabilities to reimagine how we serve our customers and... ...of customers. Our AI models and platforms empower teams... ...AI systems, tracking GPU utilization, model throughput...Full timePart timeLocal areaCapital One
New York, NY2 days ago$212k - $407k
...grade enterprise AI through its AI Center... ...direction for AI infrastructure. If you thrive in... ...and inferencing, model serving, agentic AI, and... ...and deliver engineering patterns that support... ...of HPC, GPU, accelerated compute... ...including engaging senior stakeholders and...SeniorInternshipFlexible hours$229.9k - $262.4k
Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails... ...investments in technology infrastructure and world-class talent —... ...capabilities to reimagine how we serve our customers and businesses... ...of customers. Our AI models and platforms empower teams...SeniorFull timePart timeLocal areaCapital One
New York, NY2 days ago- Boundless is coordinating GPU compute at scale as it becomes a leader in AI. As a Senior Infrastructure Engineer (GPU Compute), you'll build and operate the compute fabric powering our AI inference workloads across a large, heterogeneous GPU fleet including consumer RTX...SeniorRemote job
$164.6k - $282.2k
...data analytics and AI to cybersecurity,... ...Principal AI/ML Platform Engineer on the... ...enterprise team, you will serve as the AI... ...optimize high-throughput model training and... ...OpenShift, OpenShift AI, GPU operators, drivers... ...of experience in infrastructure, DevOps, SRE, or...Remote jobMinimum wageFull timeWork experience placementWork at officeLocal area$197.3k - $245.6k
...Computer Science, AI, Electrical Engineering, Computer Engineering... ...systems for model training, evaluation... .... We work with infrastructure engineering to improve GPU and TPU utilization... ...mentor Principal and Senior Associates on... ...proprietary solutions that serve millions of...Full timeCapital One
New York, NY23 days ago- Atlassian is seeking a Senior ML System Engineer to design and optimize large-scale model serving systems across distributed infrastructure. You will own everything from global KV caches and... ...expertise in C/C++ or Rust, experience with GPU inference engines, and a track record...SeniorRemote job
- ...Senior Platform Engineer Nomic is the domain-specific AI platform for the Architecture, Engineering... ...combining embedding models, document parsing,... ...Engineer to own our infrastructure stack — multi-account... ...at scale — serving infrastructure, GPU workloads, and the performance...SeniorRemote workFlexible hours
Nomic
New York, NY3 days ago $110 - $130 per hour
...we place. Our client, an investment firm, is seeking a Senior AI Platform Engineer to join their team in New York, NY! AIVA is the firm's... ...interact with tools and enterprise systems, use the right model for the workload, recover from failures, and operate with the...SeniorEleven Recruiting
New York, NY7 hours ago- Lightning AI is seeking a Senior Backend Engineer for the Managed Services team to design, build, and operate backend services that power our GPU infrastructure platform. You will develop control planes and automation to provision and scale Kubernetes and Slurm clusters...SeniorWork at office2 days per week
$115k - $130k
...& DevOps, Data, and Software Engineering, servicing an array of noteworthy... ...Blockchain to Data Science models, Digital Underwriting, mobile... ...We are seeking a hands-on Senior AI Engineer to design, build, and... .... Develop reliable model-serving and inference systems with a...SeniorFull timeTemporary workFlexible hoursSynechron
New York, NY2 days ago$190k - $235k
...SENIOR AI FULL-STACK ENGINEER Thresh Consulting — Strategy in Action for the AI Era Salary: $190,000... ...ll guide a team of 2-4 engineers, and serve as a primary partner to client engineering... ..., carts, and checkout steps that the model calls as tools and the frontend draws...SeniorFull timeShift workThresh Consulting
New York, NY2 days ago$131k - $271.6k
...development, and operation of AI-native enterprise... ...teams.You bring solid engineering fundamentals and a growing... ...under the guidance of senior engineers and technical... ...such as large language models, RAG pipelines, and... ...and industry expert team serving customers across the Americas...SeniorPermanent employmentFull timeWork at officeWorldwideFlexible hoursSAP
New York, NY3 days ago$185k - $200k
...everything possible. The Senior Legal Engineer is responsible for... ...building, and deploying AI-powered solutions that... ...in large language models (LLMs), agentic AI, and modern AI infrastructure to solve high-impact legal... ...no-code AI solutions. Serve as the technical...SeniorFull timeContract workRemote workWork from homeFlexible hoursDanaher Corporation
New York, NY5 days ago$119k - $218.3k
Position Summary Senior Consultant - Digital Assets Enterprise Strategy, Risk and Operating Model Design Enterprise Operations & Risk... ...our team and use advanced data, AI, and emerging technologies... ...various digital asset ecosystems.Serve as a subject matter resource for...SeniorContract workWork at officeLocal areaDeloitte
New York, NY3 days ago$148.75k - $201.25k
...We are seeking a Senior Platform Engineer to join a team developing AI applications that... ...Deployed Engineering model, our team works... ...feedback. You will serve as the team’s primary... ..., cloud infrastructure, application deployments... ...troubleshooting of AI and GPU‑enabled workloads....SeniorRemote jobFull timeFor contractorsLocal areaHome officeFlexible hours$148.5k - $174.7k
...customers and businesses we serve to make better and smarter financial... ...contributor to support our Model Development & Decision... ...documentation under guidance of senior model developers.· Data preparation... ..., mathematics, statistics, engineering, computer science) or...SeniorFull timeLocal area3 days per weekUS Bank
New York, NY1 day ago$125.8k - $209.7k
...The OpportunityAs a Cyber AI Engineer at the Senior Consultant level in EY's Cyber... ...apply frontier AI cyber models to real security... ...automationDevSecOps, CI/CD, containers, and infrastructure-as-code for AI... ...agent orchestration, model serving, LLM observability, and CI...SeniorImmediate startEY (Ernst & Young)
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infrastructure Engineer (GPU and Model Serving). Be the first to apply!
Related searches
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer New York, NY
- lead infrastructure engineer New York, NY
- infrastructure developer New York, NY