Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference DevOps Engineer

Lila Sciences

Lila Sciences is seeking a Staff/Principal DevOps Engineer for AI Inference in Cambridge, MA. You will design and optimize GPU-accelerated infrastructure for scalable ML model serving, spanning Kubernetes clusters, Terraform/Helm deployments, and multi-region pipelines. You will collaborate with ML researchers, software engineers, and data scientists to build reliable inference platforms with maximum GPU utilization and minimal latency. #J-18808-Ljbffr Lila Sciences

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference DevOps Engineer in Cambridge, MA vacancy
  • $165k - $190k

    Maven AGI is an enterprise AI platform founded in July 2023 by executives from HubSpot...  ...and Stripe.The RoleWe’re looking for a Senior DevOps Engineer to own and evolve the infrastructure...  ...GPU resource orchestration, model inference performance tuning, and high-concurrency... 
    Senior

    Maven AGI

    Boston, MA
    4 days ago
  • $192k - $272k

    Staff/Principal DevOps Engineer, AI Inference Cambridge, MA USA The Staff/Principal DevOps Engineer - AI Inference will drive the design, implementation, and optimization of infrastructure purpose-built for serving machine learning models at scale. This role bridges platform... 
    Suggested
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    4 days ago
  • $119k - $221k

     ...and the customers they serve. We build AI-powered software that keeps everyone in...  ...love to meet you. We are looking for a Sr. DevOps Engineer IIto help us build and scale the...  ...operating AI/ML infrastructure (model serving, inference, LLM orchestration, or agentic systems)... 
    Senior
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Hi Marley

    Boston, MA
    3 days ago
  • $105.4k - $207.8k

    Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation,...  ...fuel growth through innovation.Work you'll doAs a Senior Engineering Management Specialist - DevOps Engineer on the Industry Solutions team, you will... 
    Senior
    Local area

    Deloitte

    Boston, MA
    3 days ago
  •  ...Senior DevOps EngineerFoley is seeking a Senior DevOps Engineer to help modernize and scale the infrastructure that powers both our core compliance SaaS platform and our next generation of AI-enabled products. This role sits within the Infrastructure Platform team and... 
    Senior
    Contract work
    Remote work

    Foley

    Boston, MA
    2 days ago
  • $95.2k - $142.8k

     ...DescriptionVertex is seeking a highly skilled Senior Azure DevSecOps Engineer to design, implement, secure, and...  ...power enterprise software, data, and AI-driven solutions. This role will be a...  ....Strong experience with Azure DevOps, GitHub Actions, CI/CD automation, and... 
    Senior
    Full time
    Summer work
    Remote work
    Flexible hours
    2 days per week

    Vertex Pharmaceuticals

    Boston, MA
    6 days ago
  • $119k - $221k

     ...Marley’s SaaS platform and agentic AI services. Build and monitor...  ...initiatives and mentor engineers on infrastructure and operational...  ...Requirements ~6+ years of DevOps, SRE, or platform engineering...  ...infrastructure involving model serving, inference, LLM orchestration, or agentic... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours
    3 days per week

    Hi Marley

    Boston, MA
    10 days ago
  •  ...Senior Azure DevOps / Cloud Platform Engineer Location: Boston, MA Area (Onsite 5 days per week) Duration: 6+ months Interview Process...  ...supporting Microsoft Purview, Microsoft Fabric, Azure AI Foundry, Azure OpenAI, or other AI/data platforms will... 
    Senior

    Akaasa Technologies

    Boston, MA
    1 day ago
  •  ...Meghana GorusuCompany: SRI Tech SolutionsSr. DevOps EngineerBoston, MA (4 days a week onsite)...  ...: ContractDescription: The Data Platform Engineering team supports CI/CD and infrastructure...  ...with use of advanced features of AI tools: ChatGPT, custom GPTs, and/or other... 
    Senior
    Hourly pay

    SRI Tech

    Boston, MA
    2 days ago
  • $175k - $195k

    OpenGov is the leader in AI and ERP solutions for local and state governments in the U.S. More than 2,000 cities, counties, state...  ...has to be fast, resilient, and built for scale. As a Sr. DevOps Engineer, you'll own the design and delivery of the cloud systems, CI/CD... 
    Senior
    Contract work
    Work experience placement
    Work at office
    Local area

    OpenGov

    Boston, MA
    3 days ago
  • $150k - $210k

     ...higher level and live longer by using AI to transform continuous physiological data...  ...act on every day. WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence layer...  ...evaluation sets to production deployments with inference optimization, observability, and... 
    Senior
    Full time
    Work at office
    Relocation

    Whoop

    Boston, MA
    11 hours ago
  • $200k - $325k

    Job DescriptionWe are building an AI Engineering function to enable productivity and agentic...  ...users, developers, and business teams.As a Senior AI Platform Engineer, you will design...  ...that powers AI systems firm-wide: inference services, agentic platforms, developer... 
    Senior
    Full time
    Work at office
    Local area

    Arrowstreet Capital

    Boston, MA
    6 days ago
  • $155k - $175k

     ...aerospace, semiconductors, and luxury goods. They are looking for a Senior DevOps Engineer to own their cloud infrastructure, CI/CD pipelines, and...  ...knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr Oscar
    Senior
    Full time
    Work at office
    2 days per week

    Oscar

    Newton, MA
    2 days ago
  •  ...: Senior DevOps Engineer I (REMOTE) Are you a skilled DevOps / Site Reliability Engineer with a strong background in building and maintaining...  ...This role will be a key contributor enabling technologies like AI derived insights and serverless on demand infra to our... 
    Senior
    Full time
    Remote work
    Worldwide

    The RepTrak Company

    Boston, MA
    2 days ago
  • $286.2k - $326.7k

     ...Senior Director, AI Engineering -Agentic AI PlatformAt Capital One, we are creating responsible and reliable AI systems, changing banking for good...  ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation,... 
    Senior
    Full time
    Part time
    Remote work

    Capital One

    Cambridge, MA
    5 days ago
  • $253.9k - $298.7k

     ...more about working at Coinbase. As a Senior Staff Software Engineer on the Data Platform team within...  ...distributed systems, data engineering, and AI-readiness, reporting to the Senior...  ...training, feature stores, real-time inference, and multi-agent AI architectures at... 
    Senior
    Local area

    Coinbase

    Boston, MA
    2 days ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems,...  ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    5 days ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (GenAI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation,... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    4 days ago
  • $118k - $190k

     ...that make us who we are and the work we do possible. Principal DevOps Engineer  Boston, MA | Hybrid | Onshape  Onshape, a PTC SaaS business,...  ...For more information about PTC’s comprehensive benefits and our AI usage, please visit our Careers Page ( Applications will be... 
    Full time
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Flexible hours

    PTC

    Boston, MA
    4 days ago
  •  ...and reliably is core to this mission.The AI Devex team exists to accelerate...  ...underpinning business acceleration.As a Senior Platform Engineer on the AI Devex team, you will play a key...  ...QUALIFICATIONS5+ years of experience in DevOps, Platform, Site Reliability, CloudEngineering... 
    Senior
    Work at office
    Relocation

    WHOOP

    Boston, MA
    5 days ago
  • Boston, MAHybridFull Time$120k - $150kWe are seeking a full-time DevOps Engineer to join their team in Chelmsford, MA. This is an opportunity...  ...SOC 2 or other compliance framework exposure Experience with AI-assisted development tools (GitHub Copilot, Claude, etc.) Experience... 
    Full time

    Motion Recruitment

    Boston, MA
    3 days ago
  •  ...MAEmployment Type: Full-TimeJoin a growing engineering team that's modernizing its...  ...cloud-native technologies, automation, and DevOps best practices. This full-time opportunity...  ...tools SOC 2 or similar compliance experience AI-assisted development tools (GitHub Copilot... 
    Full time

    Motion Recruitment

    Boston, MA
    6 days ago
  • $150k - $215k

     ...software platform provide personalized insights that help individuals optimize their health, fitness, and recovery. As a Senior Software Engineer on the AI team, you will play a key role in building and scaling the systems that power WHOOP AI’s internal and member-facing... 
    Senior
    Full time
    Work at office
    Relocation

    Whoop

    Boston, MA
    3 hours ago
  •  ...A leading data technology firm is seeking a Data Platform Engineer to design and implement CI/CD workflows for their Data Fabric platform...  ...computer science or engineering, with a minimum of 10 years in DevOps and extensive experience in GitHub Actions, Terraform, and AWS... 
    Senior

    TalentOla

    Boston, MA
    2 days ago
  •  ...YO AI Labs seeks an experienced Developer & Infrastructure Expert to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and workflows against real... 
    For contractors
    Remote work

    YO AI Labs

    Boston, MA
    2 days ago
  •  ...HTS Assist, Hopper’s flagship agentic AI platform, used internally and offered as...  ...worldwide. About the job As a Software Engineer on the CX Platform team, you will design,...  ...experiences. You’ll report to a Senior Engineering Manager and work alongside engineers... 
    Senior
    Full time
    Remote work
    Worldwide

    The Hopper Company

    Boston, MA
    11 hours ago
  •  ...expertise that help nearly 16 million people save for a better today and tomorrow.Section 1: Position SummaryWe are seeking a Senior DevOps Engineer with 10+ years of hands‑on experience designing, building, and operating enterprise‑grade CI/CD platforms across hybrid... 
    Senior
    Full time

    Ascensus

    Boston, MA
    5 days ago
  • $135k - $325k

     ...Technology department is an internal software engineering organization whose mission is to provide...  ...compute platform, workflow, messaging, AI and observability systems. Arrowstreet,...  ...knowledge of Git, and familiarity with a DevOps platform like GitLab1+ years of experience... 
    Senior
    Full time
    Local area

    Arrowstreet Capital

    Boston, MA
    2 days ago
  •  ...customer relationship.The RoleWe're hiring an engineer to own our infrastructure — the AWS...  ...including the infrastructure behind our AI agents. And like everyone on this team, you...  ...production many times a day with confidenceAttack DevOps problems with AI: use coding agents and... 
    Work at office
    Local area
    Remote work
    Work from home

    OnRamp

    Boston, MA
    2 days ago
  •  ...high-value customers and large orders. ezCater is hiring senior software engineers to build shared platform capabilities across administration,...  ...systems. We are looking for engineers who are fluent in an AI-native SDLC. That means more than familiarity with tools... 
    Senior
    Remote job
    Permanent employment
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours

    Ezcater

    Boston, MA
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference DevOps Engineer. Be the first to apply!