Remote Senior AI Inference Systems Engineer
DigitalOcean
DigitalOcean is expanding its AI infrastructure and seeking a Senior Engineer 2 for the AI Inference Data Plane team. You will lead the design, development, and delivery of high-scale data plane services that power our Inference as a Service offering.
The role combines distributed systems work with AI hardware optimization and requires hands-on software development. You will drive system design for multi-tenant inference, implement performance optimizations, and collaborate across product,
#J-18808-LjbffrVacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Remote Senior AI Inference Systems Engineer in Austin, TX vacancy
- ...operational support of AI platforms, tools, and services... ...with existing systems and enterprise processes... ...server, cloud, and platform engineering teams.Operationalize... ...with model serving, inference optimization, or AI platform... ...may be performed fully remote, hybrid, or onsite at...Remote workSeniorFull timeWork at office
- Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize...Senior
- ...Adobe Firefly's Generative AI Services team is seeking Senior Machine Learning Engineers to help build scalable GenAI systems powering features across Adobe products like Firefly... ...Stock, and Premiere. You will design inference pipelines, optimize models for latency,...Senior
Adobe Inc.
San Jose, CA10 hours ago - A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving... ...candidates should have strong software engineering skills and experience with ML inference...Senior
$174.2k - $183.73k
...Responsibilities for this Position Senior Principal Systems Lead Engineer ID: 2026-73509 US-IN-Ft.... ...integration. Familiarity with AI/ML inference on embedded edge platforms (NVIDIA... ...This position is fully onsite, remote or Hybrid/Flex based on candidate...Remote workSeniorFull timeFor subcontractorFlexible hoursGD Mission Systems
Wayne, INa month ago- NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team...Senior
$200k - $250k
...About Wizard AI At Wizard AI, we’re building... ..., and trust. Our ML systems sit at the core of that... ...we’re looking for a Senior MLOps Engineer to help us run them reliably... ...across a custom-built inference platform powering a... ...holidays ~ Fully remote work within the United...Remote workSeniorFull timeFlexible hoursWizard
United States1 day ago- ...infrastructure for the global AI economy. We are building a full... ...infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard... ...our top priorities—we engineer systems to remain reliable and...Remote workSeniorFull time
Nebius
Remote9 days ago - ...NVIDIA is seeking outstanding AI systems engineers to advance the inference systems software stack. You will develop libraries, code generators, and GPU kernel technologies for NVIDIA's hardware architecture, building abstractions and runtimes to accelerate LLMs and AI...Senior
NVIDIA AI
California, MO10 hours ago - AMD in Santa Clara is seeking a Senior Product Manager to drive strategy and execution for ROCm, AMD’s open-source GPU software stack. This role involves managing the product roadmap for inference capabilities and engaging with the open-source community to enhance AMD'...Remote jobSenior
- ...NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build new abstractions for LLM serving engines, and contribute to accelerators and runtimes that power large language models...Senior
NVIDIA
Santa Clara, CA10 hours ago - ...NVIDIA in Seattle, WA seeks outstanding AI systems engineers to advance the inference software stack for AI workloads. You will develop libraries, code generators, and GPU kernel technologies for NVIDIA hardware, including new abstractions and runtimes for large language...Senior
NVIDIA
Seattle, WA10 hours ago - ...company in Bristol seeks Rust engineers to join a new team focused on creating an AI inference stack. The role includes writing... ...Candidates should be strong in systems languages, preferably with Rust... ...flexibility between office and remote work, fostering a collaborative...Remote workSeniorWork at office
Fractile
Bristol, Washington County, VA17 hours ago - ...NVIDIA seeks outstanding AI systems engineers to advance the inference software stack for high-impact workloads. You will develop libraries, code generators, and GPU kernel tech for NVIDIA hardware, building abstractions for LLM serving and just-in-time compilers across...Senior
NVIDIA
Westford, MA10 hours ago - Bright Vision Technologies is seeking an ML Systems Engineer to design, build, and operate high-performance inference platforms for production ML models. This role emphasizes scalable systems engineering, request routing, batching, caching, autoscaling, and observability...Remote job
- ...Crusoe Cloud is hiring a Senior Cloud Support Engineer to empower customers using Crusoe's sustainable GPU... ...technical contact, resolving issues across AI/ML workloads, physics simulations, and... ...on-site Tue-Sat, with some Saturday remote duties, and a focus on triage,...Remote workSenior
Crusoe
Dallas, TX11 hours ago - Cloudflare is seeking a high-agency, systems engineer to design and build AI inference infrastructure across its global network. You will tackle sub-second model cold starts, multi-accelerator workload scheduling, and efficient cache management alongside AI/ML engineers...Senior
- ...NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources. You will collaborate with... ..., while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs....SeniorLocal area
NVIDIA
Santa Clara, CA10 hours ago - ...d-Matrix, headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize the AI compute engine's SW stack, developing deployment software and collaborating with ML, compiler, and hardware...Senior
$152k - $241.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will... ...today’s most sophisticated AI applications. Our team is responsible... ...by law.SummaryLocation: US, CA, Remote; US, TX, Remote; US, NY, Remote;...Remote workSeniorFull time- ...security-first enterprise AI company. We build... ...enterprises who are building AI systems. We believe that our... ...a team of researchers, engineers, designers, and more,... ...us!We’re looking for a senior engineer to help build,... ...offices if you are remote, plus an annual company...Remote workSeniorFull timeWork at officeLocal areaHome office
- Principal Senior Systems Engineer - HPE Networking (Mid-Telco Accounts)This role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We Are:Hewlett... ...IP, transport, data center, and AI-ready networking environments.The ideal candidate...Remote workSeniorFull timeWork experience placementWork at officeLocal areaImmediate startWork from home
- OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long...Senior
- ...Moveworks is the Agentic AI Assistant platform that... ...all of their business systems through natural... ...with Moveworks’ Reasoning Engine and natural language capabilities... ...training and inference pipeline for large language... ...Work personas (flexible, remote, or required in office)...Remote workSeniorFull timeWork at officeFlexible hours
Servicenow
Remote1 day ago - Cloudflare is seeking a high‑agency systems engineer to design and build the AI inference platform that powers real‑time workloads across Cloudflare’s global network. You will tackle sub‑second model cold starts, multi‑accelerator scheduling, and efficient KV cache management...Senior
- ...experiences—from AI and data centers,... ...gaming and embedded systems. Grounded in a culture... ...:AMD is seeking a Senior Product Manager to... ...large-scale model inference on AMD Instinct™... ...will influence engineering roadmaps, represent... ...Bay Area · Austin · Remote This role is not...Remote workSenior
- ...Hewlett Packard Enterprise Development LP seeks an AT&T SE Systems Engineering Director to lead a distributed team, shaping technical strategy... ...relationships with AT&T. The role focuses on networking, security, AI-driven infrastructure, and cloud solutions, aligning with...Remote jobSenior
- ...Job Description Job Description Senior Systems Engineer SAP Security & GRC, immediate start. I... ...continuous improvement initiatives ▪️ Explore AI/ML solutions for predictive access... ..., and stakeholder collaboration skills This position is temporarily remote....Remote workSeniorImmediate start
CLOUDSCOUTS SOFTWARE SOLUTIONS LLC
Frisco, TXa month ago $174.9k - $261.3k
...understand the world!The Data Labeling Engineering team designs, builds, and... ..., data engineering, and AI/ML, defining the strategies, tooling... ..., and direct impact on systems that unblock the next generation... ...California, United States of America; Remote - United StatesType: Full timeRemote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hours$175k - $190k
...Platform unites agentic AI solutions with the... ...across code, cloud, and AI systems. Through solutions like... ...respect, and accountability.Senior GTM Systems & Process... ...the revenue engine, building an AI-native... ...philosophy, this is a remote role targeted for candidates...Remote workSeniorContract workApprenticeshipLocal areaFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior AI Inference Systems Engineer. Be the first to apply!
Related searches
- ai ml engineer Austin, TX
- machine learning ai engineer Austin, TX
- ai developer Austin, TX
- ai engineer Austin, TX
- ai prompt engineer Austin, TX
- senior ai engineer Austin, TX
- ai engineer remote Austin, TX
- senior windows systems engineer Austin, TX
- software system engineer Austin, TX
- system test engineer Austin, TX