Remote-First Lead ML Inference Systems Engineer
Runpod
Runpod is hiring an ML Systems Engineer, Inference to own end-to-end LLM serving performance, optimizing latency and cost across models and hardware generations. This hands-on role requires identifying bottlenecks, implementing fixes, and delivering reliable production configurations.
You will profile serving stacks, define metrics, and collaborate with product and infra teams to shape Runpod's inference offerings. Remote-first team with competitive compensation and equity.
#J-18808-LjbffrVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote-First Lead ML Inference Systems Engineer in Laurel, MD vacancy
$150k - $220k
...processed more than 20 billion inference requests. We closed a $100M... ...on. We're a small, remote‑first team. We take ownership seriously... ...: We're looking for a ML Systems Engineer, Inference. We want Runpod... ...cost-efficient. You'll lead that effort. You'll own LLM...Remote workHome officeVisa sponsorshipWork visaFlexible hoursRunpod
Laurel, MD3 days ago- ...Red Hat, LLC in Boston seeks a senior engineer to lead the design and implementation of high-performance Python, C++, CUDA, and Triton code for vLLM-based inference systems in production-scale environments. You will drive performance profiling and optimization on NVIDIA...Remote work
Red Hat
Boston, MA3 days ago $85k - $110k
...Startup Employer and by BuiltIn Seattle as a Best Place to Work. First Voice Lead (Onboarding & Activation) - Hybrid in Seattle, WA Our First... ...weekly team lunches, game nights, and events. In-person and remote. Recognition. Recognize a peer with Sprees (redeemable for...Remote workWork at officeFlexible hoursNight shift2 days per weekRentSpree LLC
Seattle, WA17 hours ago- ...ąc onboarding, enablement oraz wzrost przychodów. Arbe zespół ds. sprzedaży, inżynierii i produktu w zespole międzynarodowym, dzięki doświadczeniu w AI/ML. Praca zdalna - możliwość pracy z Hiszpanii lub Włoch, z biurem w Madrycie jako opcja. #J-18808-Ljbffr ElevenLabsRemote job
$142k - $195k
...Liftoff is a leading AI-powered performance... ...(e.g., ML model changes,... ...functionally with Engineering, Product, Data... ...in statistical inference, A/B test design... ...for full-time remote work in one of... ...We are a remote-first company with US... ...Applicant Tracking System by approved...Remote workFull time$144k - $192k
...Machine Learning Systems EngineerBoston, MA September... ...Learning Systems Engineer to join our ML Acceleration team. In... ...during training and inference, alongside a strong understanding... ...role can be fully remote.The salary range for... ...is always people first.We aren't just...Remote workWork at officeVenturefizz Product Management Community
Boston, MA2 days ago- ...Systems Engineer LeadThis opportunity resides with Global Security... ...Specialist - Technical Lead (Tech Lead). The... ...Environment (NCTE) local and remote operators and engineers... ..., machine learning (AI/ML) experts; engineers;... ...safety and well-being first. Regardless of your role...Remote workFor contractorsWork at officeLocal area
HII Mission Technologies division
Norfolk, VA3 days ago - ...spans cloud, data, AI/ML, embedded software... ...with client engineering teams to transform... ...an AI Enablement Lead, you will design practical... ...Owner write their first AI-ready... ...training, Fine‑tuning, Inference optimisation, MLOps... ...working format - remote, office-based or flexible...Remote workPermanent employmentFreelanceWork at officeImmediate startFlexible hours
- ...Lead Data Platform and ML Engineer Company: LHL Strategies, Inc. Location: Remote (United States), with periodic travel... ...We are a remote-first company, and this role... ...always done it” · Systems thinking: automate... ...batch and real-time inference through Databricks...Remote workFull timeFlexible hours
Lighthouse Life Solutions
United States2 days ago $161k - $253.6k
...opportunities to work on revolutionary systems that impact people's lives... ...nation's history - from the first flight across the Atlantic... ...for a Staff Systems Engineer (Lead) (26-499) to join our team of... ...requires on-site work with no remote options.Position Overview:The...Remote workContract workFor contractorsWork experience placementRelocationFlexible hoursShift workNorthrop Grumman
Huntsville, AL1 day ago$220.92k - $361.48k
...authoritative systems architect owning... ...Architecture: Perform first-principles... ...nodes and remote sensor pods.Key... ...Functional Authority: Lead multi-... ...trades across ML research, controls... ...Mentor senior engineers in system-level... ...in transformer inference constraints (quantization...Remote workFull timeLocal areaImmediate startShift workIntel
Phoenix, AZ4 days ago- ...Staff Systems Engineer (Lead)At Northrop Grumman, our employees have incredible opportunities to work... ...advancements in our nation's history - from the first flight across the Atlantic Ocean, to... ...and requires on-site work with no remote options.Position Overview: The Command...Remote workContract workFor contractorsWork experience placementRelocation packageFlexible hours
ClearanceJobs
Huntsville, AL2 days ago $177k - $265.6k
...Staff Systems Engineer / Execution LeadAt Northrop Grumman, our employees... ...nation's history - from the first flight across the Atlantic Ocean... ...Systems Engineer / Execution Lead to join our team of qualified... ...at our facility. There is no remote / hybrid / telework available...Remote workFull timeShift workNorthrop Grumman
Palmdale, CA4 days ago$99k - $225k
Systems Engineer, LeadThe Opportunity: Are you looking for an opportunity to combine your technical... ...provided. Work ModelOur people-first culture prioritizes the benefits of collaboration... ...have their cameras on during meetings.Remote: If this position is listed as remote, there...Remote workFull timeContract workPart timeLocal areaBooz Allen Hamilton
El Segundo, CA3 days ago$106.9k - $176.5k
...opportunity We are seeking AI Systems Engineers to own the security and... ...roots of trust, and remote attestation. A security-first mindset: thinking in... ...gateways. Exposure to AI/ML workloads and the... ...challenges of confidential AI inference (models/secrets inside...Remote workWork experience placementSummer holidayFlexible hoursEY
Westlake Village, CA3 days ago- ...Premera Blue Cross is seeking an AI Engineer IV for a remote/telecommuter role. You will contribute leadership in a team developing AI/ML solutions for complex business problems from conception to production. Your responsibilities include guiding solutioning, prototyping...Remote workWork from home
Premera Blue Cross
Idaho Falls, ID3 days ago $235k - $350k
...scale distributed systems, processing... .... We use an AI-first mindset as a force... ...Distinguished Engineer who has built... ...environments, on-sensor inference, and cloud-... ...and spend. Lead through... ...production AI or ML systems for security... ...stopped. #LI-Remote #LI-CS1...Remote workFull timeWork experience placementWork at officeLocal area$160k - $230k
...About the Role As a Systems Research Engineer specialized in GPU... ...kernels and algorithms for ML/AI applications.... ...get high-performance inference that scales reliably,... ...around a marketplace of leading open models that... ...flexibility in terms of remote work. The US base...Remote workFull time- ...stakeholders. The role emphasizes storytelling, cross-functional collaboration, and scalable analytics. You will own KPI definitions, build analytical frameworks, and guide a cross-functional team from strategy to implementation in a remote-first environment. #J-18808-Ljbffr...Remote work
Affirm
New York, NY2 days ago - ...Flodesk is a remote-first company building AI systems to help small business owners launch campaigns across email, workflows, forms and analytics.... ...instructions and the quality framework, working across engineering, product and language models. This hands-on role requires...Remote work
Flodesk
Phoenix, AZ5 days ago - ...ensure launches, and drive retention for high-value customers. You’ll lead multi-team initiatives, define strategy, and build roadmaps that combine product fixes with CX improvements. This role is remote-first, with emphasis on impactful, measurable outcomes in a fintech...Remote work
Coinbase
Columbus, OH2 days ago - ...About Nebius: Nebius is leading a new era in cloud... ...building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large... ...GPU orchestration to inference optimization, we own the... ...company. Flexible, remote-first culture. Hiring Process...Remote workFull timeFlexible hours
Nebius
Remote25 days ago - ...Coinbase is a remote-first company that values intense in-person sessions called 'surges' a few times a year. We seek a Senior Sales Associate for our Infrastructure team to drive new partnerships with PSPs, fintechs, and banks and manage complex deals from strategy through...Remote work
Coinbase
United States2 days ago - ...senior ASIC verification expert to lead verification phases of next-... ...aimed at generative AI inference acceleration. You will work closely with design engineers, ensuring pre-silicon correctness... ...developing testing strategies using System Verilog and UVM. This dynamic startup...Remote work
Tensordyne
Sunnyvale, CA17 hours ago $148k - $270k
...complexities of AI systems, we’re empowering... ...About the role: ML developers today... ...State-of-the-art inference is a fast moving target... ...Los Altos, CA or remotely from home.... ...would include: Leading cross-team architecture... ...way why defensive engineering is worth the extra...Remote workWork experience placementWork at officeLocal areaVisa sponsorshipFlexible hoursModular Services
Los Altos, CA2 days ago- ...You will collaborate with our Sales, Product, Marketing, and Engineering teams to enable partners and unlock joint growth across platforms... ...quota-carrying, hybrid role anchored in San Francisco, with remote-first culture and strong emphasis on recruiting, onboarding, and...Remote work
Speedrun Talent Network
San Francisco, CA3 days ago - ...HONK is reshaping the towing and roadside industry with a remote-first, inclusive culture. This senior support role is part of the Secondary Logistics team, handling escalations and driving timely resolutions while supporting pilots and new initiatives. You will own...Remote work
Honk
United States3 days ago - ...Premera Blue Cross is seeking an AI Engineer IV for a remote, telecommuter role. You will lead a team developing AI/ML solutions from conception to production and guide the solutioning of complex challenges with prototyping of new AI products. Strong software engineering...Remote work
Premera Blue Cross
Madison, WI3 days ago $206.1k - $269.08k
...Engineering | Remote, Americas | Remote, Remote | San Francisco, United... ...of being a distributed-first company. As a Senior ML System Engineer in the Rovo... ...have the opportunity to lead other engineers to drive... ...deep learning training/inference platfrom. Experience...Remote workFull timeWork at officeAtlassian
Eastern, KY3 days ago- ...with the COO and leadership to evaluate product, market opportunities, and cross-functional initiatives in a fast-paced, remote-first environment. Lead corporate and product strategy, build investment cases with robust financial analyses, and cascade strategy into...Remote work
MGID
United States1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote-First Lead ML Inference Systems Engineer. Be the first to apply!
Related searches
- lead operating engineer Laurel, MD
- lead engineer Laurel, MD
- machine learning software engineer Laurel, MD
- machine learning engineer Laurel, MD
- unix linux systems engineer Laurel, MD
- healthcare systems engineer Laurel, MD
- senior staff systems engineer Laurel, MD
- senior linux systems engineer Laurel, MD
- space systems engineer Laurel, MD
- system performance engineer Laurel, MD