Remote Senior AI Inference Systems Engineer
DigitalOcean
- Remote job
DigitalOcean is expanding its AI infrastructure and seeking a Senior Engineer 2 for the AI Inference Data Plane team. You will lead the design, development, and delivery of high-scale data plane services that power our Inference as a Service offering. The role combines distributed systems work with AI hardware optimization and requires hands-on software development. You will drive system design for multi-tenant inference, implement performance optimizations, and collaborate across product, #J-18808-Ljbffr DigitalOcean
- ...operational support of AI platforms, tools, and services... ...with existing systems and enterprise processes... ...server, cloud, and platform engineering teams.Operationalize... ...with model serving, inference optimization, or AI platform... ...may be performed fully remote, hybrid, or onsite at...Remote workSeniorFull timeWork at office
- Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize...Senior
- ...infrastructure for the global AI economy. We are building a full... ...infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard... ...our top priorities—we engineer systems to remain reliable and...Remote workSeniorFull time
- A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving... ...candidates should have strong software engineering skills and experience with ML inference...Senior
$200k - $250k
...About Wizard AI At Wizard AI, we’re building... ..., and trust. Our ML systems sit at the core of that... ...we’re looking for a Senior MLOps Engineer to help us run them reliably... ...across a custom-built inference platform powering a... ...holidays ~ Fully remote work within the United...Remote workSeniorFull timeFlexible hours- AMD in Santa Clara is seeking a Senior Product Manager to drive strategy and execution for ROCm, AMD’s open-source GPU software stack. This role involves managing the product roadmap for inference capabilities and engaging with the open-source community to enhance AMD'...Remote jobSenior
- NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team...Senior
- A leading AI research company in San Francisco seeks Senior/Staff Engineers skilled in distributed systems and large-scale ML training. Responsibilities include designing systems... ...heavy compensation, a competitive salary, remote-first work culture, and a world-class team...Remote workSenior
- ...Job Description Job Description Senior Systems Engineer SAP Security & GRC, immediate start. I... ...continuous improvement initiatives ▪️ Explore AI/ML solutions for predictive access... ..., and stakeholder collaboration skills This position is temporarily remote....Remote workSeniorImmediate start
- NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build new abstractions for LLM serving engines, and contribute to accelerators and runtimes that power large language models...Senior
$152k - $241.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will... ...today’s most sophisticated AI applications. Our team is responsible... ...by law.SummaryLocation: US, CA, Remote; US, TX, Remote; US, NY, Remote;...Remote workSeniorFull time- ...d-Matrix, headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize the AI compute engine's SW stack, developing deployment software and collaborating with ML, compiler, and hardware...Senior
- NVIDIA seeks outstanding AI systems engineers to advance the inference software stack for high-impact workloads. You will develop libraries, code generators, and GPU kernel tech for NVIDIA hardware, building abstractions for LLM serving and just-in-time compilers across...Senior
- WOOD Federal Solutions, Inc. is seeking a Systems Engineer Level 3 to support AI capabilities within a complex government environment. The role requires a TS/SCI with Polygraph, U.S. Citizenship, and at least six years of SE experience. The successful candidate will partner...Remote jobSenior
- Principal Senior Systems Engineer - HPE Networking (Mid-Telco Accounts)This role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We Are:Hewlett... ...IP, transport, data center, and AI-ready networking environments.The ideal candidate...Remote workSeniorFull timeWork experience placementWork at officeLocal areaImmediate startWork from home
- ...security-first enterprise AI company. We build... ...enterprises who are building AI systems. We believe that our... ...a team of researchers, engineers, designers, and more,... ...us!We’re looking for a senior engineer to help build,... ...offices if you are remote, plus an annual company...Remote workSeniorFull timeWork at officeLocal areaHome office
- ...Moveworks is the Agentic AI Assistant platform that... ...all of their business systems through natural... ...with Moveworks’ Reasoning Engine and natural language capabilities... ...training and inference pipeline for large language... ...Work personas (flexible, remote, or required in office)...Remote workSeniorFull timeWork at officeFlexible hours
- NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources. You will collaborate with... ..., while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs....SeniorLocal area
- OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long...Senior
- ...experiences—from AI and data centers,... ...gaming and embedded systems. Grounded in a culture... ...:AMD is seeking a Senior Product Manager to... ...large-scale model inference on AMD Instinct™... ...will influence engineering roadmaps, represent... ...Bay Area · Austin · Remote This role is not...Remote workSenior
- Cloudflare is seeking a high‑agency systems engineer to design and build the AI inference platform that powers real‑time workloads across Cloudflare’s global network. You will tackle sub‑second model cold starts, multi‑accelerator scheduling, and efficient KV cache management...Senior
- ...Hewlett Packard Enterprise Development LP seeks an AT&T SE Systems Engineering Director to lead a distributed team, shaping technical strategy... ...relationships with AT&T. The role focuses on networking, security, AI-driven infrastructure, and cloud solutions, aligning with...Remote jobSenior
$152k - $241.5k
...learning ignited modern AI — the next era of... ...Deep Learning Compiler Engineer. NVIDIA is hiring software... ...generative AI, recommendation systems, image classification,... ...backbone of NVIDIA’s inference engine, spanning across... ..., TX, Austin; US, TX, Remote; US, WA, Remote; US, CA...Remote workSeniorFull time$174.9k - $261.3k
...understand the world!The Data Labeling Engineering team designs, builds, and... ..., data engineering, and AI/ML, defining the strategies, tooling... ..., and direct impact on systems that unblock the next generation... ...California, United States of America; Remote - United StatesType: Full timeRemote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hours$139.2k - $174k
...DigitalOcean is expanding its AI Infrastructure layer to... .... We are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In this role... ...generative AI models. ~System Design: Architect and refine... ...- $174,000 ~This is a remote role. ~JR: 2026-7624...Remote workSeniorFull time- Role Description We are looking for an Sr Systems engineer with strong hands-on experience in... ...will support and scale infrastructure for AI/ML workloads across hybrid environments... ...~Comfortable working independently in a remote environment Company Description At...Remote workSeniorFull timeLocal area
$131k - $175k
...prestigious awards, such as Best Engineering Team, Best Company for... ...You’ll Work With As a Senior Rack Solution Engineer... ...the world’s largest AI and cloud deployments.... ...layouts and cabling systems, including fiber/copper... ...to manage and work with remote vendors and integration...Remote workSeniorFlexible hours$102k - $182.71k
...98620Position OverviewWe’re seeking a Senior Search Systems Engineer to build the intelligence and automation... ...that sits on top of our marketing and AI visibility data. This role focuses on... ...Francisco, CA, USA; Colorado, USA - Remote; California, USA - Remote; Hawaii, USA...Remote workSeniorFull timeFor contractorsShift work- ...more secure. TestPros is seeking a Senior Software/System Test Engineer with an analytical, customer-focused... ...: ISO/IEC 25010:2023 Location: Remote, with occasional travel to customer sites... ...software/systems, including AI systems ~ Strong understanding of ISO...Remote workSeniorContract workPart timeFor contractorsWork experience placementLocal areaImmediate start
- ...technical staff member focused on multimodal AI. You will design and develop systems integrating text, speech, and vision, and... ...learning. The role emphasizes hands‑on engineering, scalable systems, and potential publications; remote‑friendly environment with offices in...Remote workSeniorWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior AI Inference Systems Engineer. Be the first to apply!
- ai engineer Austin, TX
- machine learning ai engineer Austin, TX
- senior ai engineer Austin, TX
- ai ml engineer Austin, TX
- ai prompt engineer Austin, TX
- ai engineer remote Austin, TX
- ai developer Austin, TX
- lead system engineer Austin, TX
- distributed systems engineer Austin, TX
- operations support system engineer Austin, TX




