Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Senior AI Inference Systems Engineer

DigitalOcean

Austin, TX
  • Remote job

DigitalOcean is expanding its AI infrastructure and seeking a Senior Engineer 2 for the AI Inference Data Plane team. You will lead the design, development, and delivery of high-scale data plane services that power our Inference as a Service offering. The role combines distributed systems work with AI hardware optimization and requires hands-on software development. You will drive system design for multi-tenant inference, implement performance optimizations, and collaborate across product, #J-18808-Ljbffr DigitalOcean

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote Senior AI Inference Systems Engineer in Austin, TX vacancy
  •  ...operational support of AI platforms, tools, and services...  ...with existing systems and enterprise processes...  ...server, cloud, and platform engineering teams.Operationalize...  ...with model serving, inference optimization, or AI platform...  ...may be performed fully remote, hybrid, or onsite at... 
    Remote work
    Senior
    Full time
    Work at office

    Applied Research Associates

    Raleigh, NC
    4 days ago
  • Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize... 
    Senior

    Causal Labs

    San Francisco, CA
    2 days ago
  •  ...infrastructure for the global AI economy. We are building a full...  ...infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard...  ...our top priorities—we engineer systems to remain reliable and... 
    Remote work
    Senior
    Full time

    Nebius

    Remote
    4 days ago
  • A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving...  ...candidates should have strong software engineering skills and experience with ML inference... 
    Senior

    Gimlet Labs

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...About Wizard AI At Wizard AI, we’re building...  ..., and trust. Our ML systems sit at the core of that...  ...we’re looking for a Senior MLOps Engineer to help us run them reliably...  ...across a custom-built inference platform powering a...  ...holidays ~ Fully remote work within the United... 
    Remote work
    Senior
    Full time
    Flexible hours

    Wizard

    United States
    17 hours ago
  • AMD in Santa Clara is seeking a Senior Product Manager to drive strategy and execution for ROCm, AMD’s open-source GPU software stack. This role involves managing the product roadmap for inference capabilities and engaging with the open-source community to enhance AMD'... 
    Remote job
    Senior

    AMD

    Santa Clara, CA
    2 days ago
  • NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • A leading AI research company in San Francisco seeks Senior/Staff Engineers skilled in distributed systems and large-scale ML training. Responsibilities include designing systems...  ...heavy compensation, a competitive salary, remote-first work culture, and a world-class team... 
    Remote work
    Senior

    Pluralis Research

    San Francisco, CA
    1 day ago
  •  ...Job Description Job Description Senior Systems Engineer SAP Security & GRC, immediate start. I...  ...continuous improvement initiatives ▪️ Explore AI/ML solutions for predictive access...  ..., and stakeholder collaboration skills This position is temporarily remote.... 
    Remote work
    Senior
    Immediate start

    CLOUDSCOUTS SOFTWARE SOLUTIONS LLC

    Frisco, TX
    a month ago
  • NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build new abstractions for LLM serving engines, and contribute to accelerators and runtimes that power large language models... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

    NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will...  ...today’s most sophisticated AI applications. Our team is responsible...  ...by law.SummaryLocation: US, CA, Remote; US, TX, Remote; US, NY, Remote;... 
    Remote work
    Senior
    Full time

    Nvidia

    Texas
    3 days ago
  •  ...d-Matrix, headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize the AI compute engine's SW stack, developing deployment software and collaborating with ML, compiler, and hardware... 
    Senior

    Jobleads-US

    Santa Clara, CA
    4 days ago
  • NVIDIA seeks outstanding AI systems engineers to advance the inference software stack for high-impact workloads. You will develop libraries, code generators, and GPU kernel tech for NVIDIA hardware, building abstractions for LLM serving and just-in-time compilers across... 
    Senior

    NVIDIA

    Westford, MA
    2 days ago
  • WOOD Federal Solutions, Inc. is seeking a Systems Engineer Level 3 to support AI capabilities within a complex government environment. The role requires a TS/SCI with Polygraph, U.S. Citizenship, and at least six years of SE experience. The successful candidate will partner... 
    Remote job
    Senior

    WOOD Federal Solutions

    Frederick, MD
    1 day ago
  • Principal Senior Systems Engineer - HPE Networking (Mid-Telco Accounts)This role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We Are:Hewlett...  ...IP, transport, data center, and AI-ready networking environments.The ideal candidate... 
    Remote work
    Senior
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    Work from home

    Hewlett Packard Enterprise

    Denver, CO
    2 days ago
  •  ...security-first enterprise AI company. We build...  ...enterprises who are building AI systems. We believe that our...  ...a team of researchers, engineers, designers, and more,...  ...us!We’re looking for a senior engineer to help build,...  ...offices if you are remote, plus an annual company... 
    Remote work
    Senior
    Full time
    Work at office
    Local area
    Home office

    Cohere

    New York, NY
    2 days ago
  •  ...Moveworks is the Agentic AI Assistant platform that...  ...all of their business systems through natural...  ...with Moveworks’ Reasoning Engine and natural language capabilities...  ...training and inference pipeline for large language...  ...Work personas (flexible, remote, or required in office)... 
    Remote work
    Senior
    Full time
    Work at office
    Flexible hours

    Servicenow

    Remote
    17 hours ago
  • NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources. You will collaborate with...  ..., while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs.... 
    Senior
    Local area

    NVIDIA

    Santa Clara, CA
    3 days ago
  • OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long... 
    Senior

    Slope

    San Francisco, CA
    1 day ago
  •  ...experiences—from AI and data centers,...  ...gaming and embedded systems. Grounded in a culture...  ...:AMD is seeking a Senior Product Manager to...  ...large-scale model inference on AMD Instinct™...  ...will influence engineering roadmaps, represent...  ...Bay Area · Austin · Remote This role is not... 
    Remote work
    Senior

    AMD

    Santa Clara, CA
    17 hours ago
  • Cloudflare is seeking a high‑agency systems engineer to design and build the AI inference platform that powers real‑time workloads across Cloudflare’s global network. You will tackle sub‑second model cold starts, multi‑accelerator scheduling, and efficient KV cache management... 
    Senior

    Cloudflare

    Austin, TX
    17 hours ago
  •  ...Hewlett Packard Enterprise Development LP seeks an AT&T SE Systems Engineering Director to lead a distributed team, shaping technical strategy...  ...relationships with AT&T. The role focuses on networking, security, AI-driven infrastructure, and cloud solutions, aligning with... 
    Remote job
    Senior

    Jobleads-US

    Dallas, GA
    3 days ago
  • $152k - $241.5k

     ...learning ignited modern AI — the next era of...  ...Deep Learning Compiler Engineer. NVIDIA is hiring software...  ...generative AI, recommendation systems, image classification,...  ...backbone of NVIDIA’s inference engine, spanning across...  ..., TX, Austin; US, TX, Remote; US, WA, Remote; US, CA... 
    Remote work
    Senior
    Full time

    Nvidia

    Austin, TX
    2 days ago
  • $174.9k - $261.3k

     ...understand the world!The Data Labeling Engineering team designs, builds, and...  ..., data engineering, and AI/ML, defining the strategies, tooling...  ..., and direct impact on systems that unblock the next generation...  ...California, United States of America; Remote - United StatesType: Full time
    Remote work
    Senior
    Full time
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, TX
    2 days ago
  • $139.2k - $174k

     ...DigitalOcean is expanding its AI Infrastructure layer to...  .... We are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In this role...  ...generative AI models. ~System Design: Architect and refine...  ...- $174,000 ~This is a remote role. ~JR: 2026-7624... 
    Remote work
    Senior
    Full time

    DigitalOcean

    Remote
    1 day ago
  • Role Description We are looking for an Sr Systems engineer with strong hands-on experience in...  ...will support and scale infrastructure for AI/ML workloads across hybrid environments...  ...~Comfortable working independently in a remote environment Company Description At... 
    Remote work
    Senior
    Full time
    Local area

    ePlus

    Remote
    17 hours ago
  • $131k - $175k

     ...prestigious awards, such as Best Engineering Team, Best Company for...  ...You’ll Work With As a Senior Rack Solution Engineer...  ...the world’s largest AI and cloud deployments....  ...layouts and cabling systems, including fiber/copper...  ...to manage and work with remote vendors and integration... 
    Remote work
    Senior
    Flexible hours

    Arista Networks

    Santa Clara, CA
    4 days ago
  • $102k - $182.71k

     ...98620Position OverviewWe’re seeking a Senior Search Systems Engineer to build the intelligence and automation...  ...that sits on top of our marketing and AI visibility data. This role focuses on...  ...Francisco, CA, USA; Colorado, USA - Remote; California, USA - Remote; Hawaii, USA... 
    Remote work
    Senior
    Full time
    For contractors
    Shift work

    Autodesk

    San Francisco, CA
    1 day ago
  •  ...more secure. TestPros is seeking a  Senior Software/System Test Engineer with an analytical, customer-focused...  ...: ISO/IEC 25010:2023 Location: Remote, with occasional travel to customer sites...  ...software/systems, including AI systems ~ Strong understanding of ISO... 
    Remote work
    Senior
    Contract work
    Part time
    For contractors
    Work experience placement
    Local area
    Immediate start

    TestPros

    Sterling, VA
    5 days ago
  •  ...technical staff member focused on multimodal AI. You will design and develop systems integrating text, speech, and vision, and...  ...learning. The role emphasizes hands‑on engineering, scalable systems, and potential publications; remote‑friendly environment with offices in... 
    Remote work
    Senior
    Worldwide

    Cohere

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Senior AI Inference Systems Engineer. Be the first to apply!