Senior AI Inference DevOps Engineer
Lila Sciences
Lila Sciences is seeking a Staff/Principal DevOps Engineer for AI Inference in Cambridge, MA. You will design and optimize GPU-accelerated infrastructure for scalable ML model serving, spanning Kubernetes clusters, Terraform/Helm deployments, and multi-region pipelines. You will collaborate with ML researchers, software engineers, and data scientists to build reliable inference platforms with maximum GPU utilization and minimal latency. #J-18808-Ljbffr Lila Sciences
$165k - $190k
Maven AGI is an enterprise AI platform founded in July 2023 by executives from HubSpot... ...and Stripe.The RoleWe’re looking for a Senior DevOps Engineer to own and evolve the infrastructure... ...GPU resource orchestration, model inference performance tuning, and high-concurrency...Senior$192k - $272k
Staff/Principal DevOps Engineer, AI Inference Cambridge, MA USA The Staff/Principal DevOps Engineer - AI Inference will drive the design, implementation, and optimization of infrastructure purpose-built for serving machine learning models at scale. This role bridges platform...SuggestedFull timeWork at officeLocal areaFlexible hours$119k - $221k
...and the customers they serve. We build AI-powered software that keeps everyone in... ...love to meet you. We are looking for a Sr. DevOps Engineer IIto help us build and scale the... ...operating AI/ML infrastructure (model serving, inference, LLM orchestration, or agentic systems)...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week$105.4k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation,... ...fuel growth through innovation.Work you'll doAs a Senior Engineering Management Specialist - DevOps Engineer on the Industry Solutions team, you will...SeniorLocal area- ...Senior DevOps EngineerFoley is seeking a Senior DevOps Engineer to help modernize and scale the infrastructure that powers both our core compliance SaaS platform and our next generation of AI-enabled products. This role sits within the Infrastructure Platform team and...SeniorContract workRemote work
$95.2k - $142.8k
...DescriptionVertex is seeking a highly skilled Senior Azure DevSecOps Engineer to design, implement, secure, and... ...power enterprise software, data, and AI-driven solutions. This role will be a... ....Strong experience with Azure DevOps, GitHub Actions, CI/CD automation, and...SeniorFull timeSummer workRemote workFlexible hours2 days per week$119k - $221k
...Marley’s SaaS platform and agentic AI services. Build and monitor... ...initiatives and mentor engineers on infrastructure and operational... ...Requirements ~6+ years of DevOps, SRE, or platform engineering... ...infrastructure involving model serving, inference, LLM orchestration, or agentic...SeniorFull timeWork at officeLocal areaFlexible hours3 days per week- ...Senior Azure DevOps / Cloud Platform Engineer Location: Boston, MA Area (Onsite 5 days per week) Duration: 6+ months Interview Process... ...supporting Microsoft Purview, Microsoft Fabric, Azure AI Foundry, Azure OpenAI, or other AI/data platforms will...Senior
- ...Meghana GorusuCompany: SRI Tech SolutionsSr. DevOps EngineerBoston, MA (4 days a week onsite)... ...: ContractDescription: The Data Platform Engineering team supports CI/CD and infrastructure... ...with use of advanced features of AI tools: ChatGPT, custom GPTs, and/or other...SeniorHourly pay
$175k - $195k
OpenGov is the leader in AI and ERP solutions for local and state governments in the U.S. More than 2,000 cities, counties, state... ...has to be fast, resilient, and built for scale. As a Sr. DevOps Engineer, you'll own the design and delivery of the cloud systems, CI/CD...SeniorContract workWork experience placementWork at officeLocal area$150k - $210k
...higher level and live longer by using AI to transform continuous physiological data... ...act on every day. WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence layer... ...evaluation sets to production deployments with inference optimization, observability, and...SeniorFull timeWork at officeRelocation$200k - $325k
Job DescriptionWe are building an AI Engineering function to enable productivity and agentic... ...users, developers, and business teams.As a Senior AI Platform Engineer, you will design... ...that powers AI systems firm-wide: inference services, agentic platforms, developer...SeniorFull timeWork at officeLocal area$155k - $175k
...aerospace, semiconductors, and luxury goods. They are looking for a Senior DevOps Engineer to own their cloud infrastructure, CI/CD pipelines, and... ...knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr OscarSeniorFull timeWork at office2 days per week- ...: Senior DevOps Engineer I (REMOTE) Are you a skilled DevOps / Site Reliability Engineer with a strong background in building and maintaining... ...This role will be a key contributor enabling technologies like AI derived insights and serverless on demand infra to our...SeniorFull timeRemote workWorldwide
$286.2k - $326.7k
...Senior Director, AI Engineering -Agentic AI PlatformAt Capital One, we are creating responsible and reliable AI systems, changing banking for good... ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation,...SeniorFull timePart timeRemote work$253.9k - $298.7k
...more about working at Coinbase. As a Senior Staff Software Engineer on the Data Platform team within... ...distributed systems, data engineering, and AI-readiness, reporting to the Senior... ...training, feature stores, real-time inference, and multi-agent AI architectures at...SeniorLocal area$229.9k - $262.4k
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems,... ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation...SeniorFull timePart timeLocal area$229.9k - $262.4k
Senior Lead AI Engineer (GenAI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking... ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation,...SeniorFull timePart timeLocal area$118k - $190k
...that make us who we are and the work we do possible. Principal DevOps Engineer Boston, MA | Hybrid | Onshape Onshape, a PTC SaaS business,... ...For more information about PTC’s comprehensive benefits and our AI usage, please visit our Careers Page ( Applications will be...Full timeWork at officeLocal areaImmediate startVisa sponsorshipFlexible hours- ...and reliably is core to this mission.The AI Devex team exists to accelerate... ...underpinning business acceleration.As a Senior Platform Engineer on the AI Devex team, you will play a key... ...QUALIFICATIONS5+ years of experience in DevOps, Platform, Site Reliability, CloudEngineering...SeniorWork at officeRelocation
- Boston, MAHybridFull Time$120k - $150kWe are seeking a full-time DevOps Engineer to join their team in Chelmsford, MA. This is an opportunity... ...SOC 2 or other compliance framework exposure Experience with AI-assisted development tools (GitHub Copilot, Claude, etc.) Experience...Full time
- ...MAEmployment Type: Full-TimeJoin a growing engineering team that's modernizing its... ...cloud-native technologies, automation, and DevOps best practices. This full-time opportunity... ...tools SOC 2 or similar compliance experience AI-assisted development tools (GitHub Copilot...Full time
$150k - $215k
...software platform provide personalized insights that help individuals optimize their health, fitness, and recovery. As a Senior Software Engineer on the AI team, you will play a key role in building and scaling the systems that power WHOOP AI’s internal and member-facing...SeniorFull timeWork at officeRelocation- ...A leading data technology firm is seeking a Data Platform Engineer to design and implement CI/CD workflows for their Data Fabric platform... ...computer science or engineering, with a minimum of 10 years in DevOps and extensive experience in GitHub Actions, Terraform, and AWS...Senior
- ...YO AI Labs seeks an experienced Developer & Infrastructure Expert to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and workflows against real...For contractorsRemote work
- ...HTS Assist, Hopper’s flagship agentic AI platform, used internally and offered as... ...worldwide. About the job As a Software Engineer on the CX Platform team, you will design,... ...experiences. You’ll report to a Senior Engineering Manager and work alongside engineers...SeniorFull timeRemote workWorldwide
- ...expertise that help nearly 16 million people save for a better today and tomorrow.Section 1: Position SummaryWe are seeking a Senior DevOps Engineer with 10+ years of hands‑on experience designing, building, and operating enterprise‑grade CI/CD platforms across hybrid...SeniorFull time
$135k - $325k
...Technology department is an internal software engineering organization whose mission is to provide... ...compute platform, workflow, messaging, AI and observability systems. Arrowstreet,... ...knowledge of Git, and familiarity with a DevOps platform like GitLab1+ years of experience...SeniorFull timeLocal area- ...customer relationship.The RoleWe're hiring an engineer to own our infrastructure — the AWS... ...including the infrastructure behind our AI agents. And like everyone on this team, you... ...production many times a day with confidenceAttack DevOps problems with AI: use coding agents and...Work at officeLocal areaRemote workWork from home
- ...high-value customers and large orders. ezCater is hiring senior software engineers to build shared platform capabilities across administration,... ...systems. We are looking for engineers who are fluent in an AI-native SDLC. That means more than familiarity with tools...SeniorRemote jobPermanent employmentFull timeWork at officeVisa sponsorshipWork visaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference DevOps Engineer. Be the first to apply!
- senior ai engineer Cambridge, MA
- ai developer Cambridge, MA
- ai engineer Cambridge, MA
- senior devops cloud engineer Cambridge, MA
- devops aws developer (remote) Cambridge, MA
- senior devops engineer remote Cambridge, MA
- senior network engineer remote Cambridge, MA
- senior manager legal Cambridge, MA
- sr project manager Cambridge, MA
- senior account executive Cambridge, MA



