[Agentic AI] AI Runtime / ML Model Systems Engineer
$130.7k - $205.2kJuniper Networks
[Agentic AI] AI Runtime / ML Model Systems EngineerDescription -This role is responsible for developing runtime abstraction layers and intelligent model placement systems across heterogeneous compute resources.. In this role, you will ensure the technical design, development, installation, and maintenance of state-of-the-art software applications and services for the company. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools.*Houston in-office requirement: 4 daysResponsibilities• Build runtime abstraction frameworks.• Implement model placement policies.• Develop xPU routing logic.• Optimize inference execution.• Leads the building of various software development projects and platforms while aligning them with business and security strategies and requirements.• Builds standards, designs, and automates the deployment of software.• Designs and develops solutions that protect and manage software products and data.• Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.• Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians.Education & Experience Recommended• Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.• Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.• Strong AI runtime expertise.• Optimize inference execution.Required Qualifications• ONNX, TensorRT, OpenVINO.• NPU/GPU scheduling.• Edge AI deployment.Knowledge & Skills• Agile Methodology• Amazon Web Services• Application Programming Interface (API)• Automation• C++ • Computer Science• DevOps• Docker (Software)• Full Stack Development• Java (Programming Language)• JavaScript (Programming Language)• Kubernetes• Microservices• Microsoft Azure• Python (Programming Language)• React.js• Scalability• Software Development• Software Engineering• SQL (Programming Language)The pay range for this role is $130,700 to $205,200 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience.Benefits:HP offers a comprehensive benefits package for this position, including:Health insuranceDental insuranceVision insuranceLong term/short term disability insuranceEmployee assistance programFlexible spending accountLife insuranceGenerous time off policies, including;4-12 weeks fully paid parental leave based on tenure11 paid holidaysAdditional flexible paid vacation and sick leave (US benefits overview)The compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time, with or without notice, subject to applicable law.Job -SoftwareSchedule -Full timeShift -No shift premium (United States of America)Travel -25%Relocation -Equal Opportunity Employer (EEO) - HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal"SummaryLocation: Spring, Texas, United States of America; Austin, Texas, United States of AmericaType: Full time
- Product Manager - AI Inference & Model Serving Full-time Job Summary... ...infrastructure, distributed systems, and performance engineering. You will define how... ...design trade‑offs across runtime integration, GPU scheduling... ...technical role owning AI/ML and inference product(s)...SuggestedFull time
$158.4k - $237.6k
...Technologies, Inc. Job Area Engineering Group, Engineering... ...connectivity, and AI acceleration to... ...-scale foundation models. We are seeking a... ...layout decisions, and runtime integration.... ...core and multi-device systems. Establish reusable... ...computer architecture, ML accelerators, and...SuggestedWork experience placement- ...discovery to powering AI and the technologies... ...highly motivated AI Model Optimization & Software Engineer Interns/Co-op to... ...computing, distributed systems, and AI software... ...communication, framework, and runtime layers. Design,... ..., coding agents, or agentic development...SuggestedFull timeSummer workInternshipSummer internshipWorldwide
- ...Associate Vice President, Model & AI Governance About the Company Influential organization in the health & wellness industry Industry... ...in relevant disciplines, and a strong understanding of AI/ML technologies and their associated risks. Experience in a complex...Suggested
- ...Opportunity Join a team building AI capabilities that power... ...Austin, Texas, the AI Model Developer (JS5/JS6)... ...researchers, software engineers, data scientists, and product... ...in Python and modern ML development workflows... ...CI/CD practices for AI systems What happens once you apply...SuggestedTemporary workWork at officeRelocation3 days per week
$144.7k - $261.3k
...Foundations team, part of Embodied AI's Scaling Foundations,... ...vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid... ...next-generation autonomous systems. About the Role As a Senior...Local areaRemote workWork from homeFlexible hours- ...“normalized” problem and the AI-native curiosity to create a... ...LLMs, and customer-deployed models running on a heterogeneous fleet... .... Working alongside AI/ML engineers, hardware partners, and Cloudflare... ...hard problems in distributed systems and high-performance computing...Local areaWorldwide
$150k - $170k
...development company delivering cloud, AI, data, and enterprise... ...potential. Job Title: Secure AI Systems Engineer Location: 100% Remote (U.S.... ...of security controls, threat models, and incident response... ...including significant work on AI or ML systems. Strong...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship- Compunnel, Inc. is looking for an experienced Systems Engineer to support large-scale technology... ...enterprise systems and involves working with AI-assisted workflows and cloud-native... ...DevOps practices, microservices, and AI/ML implementation. You will design and develop...
- ..., high-performance computing, cloud, and AI. Whether you're designing next-gen processors... ...for a dynamic, energetic Lead Software Systems Engineer to join our growing team. As a key... ...Experience developing and integrating AI/ML solutions, including LLM-based applications...
- ...hiring the world’s best engineers, scientists, designers,... ..., and you decide how AI runs here rather than inheriting... ...-unit chargeback model.Keep the platforms... ...platforms to internal systems, with least-privilege access... ...the data is.Build agentic workflows and automations...
- ...development. As the leader in AI code verification and... ...the leaderboards for agentic software repair.... ...landscape to manage more systems in a predictable way that... ...operations, enterprise platform engineering, and IT service... ...stack - Claude MCP (Model Context Protocol) integrations...Work at officeRelocation
$104k - $164k
...re looking for a Senior Lead Systems Engineer who's passionate about building... ..., software engineering, AI, and intelligent integrations... ..., intelligent workflows, and agentic experiences that enable employees... ...technologies, large language models, MCP integrations, and agent...Work at officeLocal areaFlexible hours- NVIDIA is seeking an outstanding High Performance AI Engineer to build groundbreaking multi-agent systems for the CUDA ecosystem. You will develop agentic runtimes and collaborate with NVIDIA’s software and hardware teams to accelerate AI workloads on GPUs. The role requires...
- Graphcore in Austin, Texas, is seeking a Graduate Systems Engineer to contribute to the design, integration, validation, and performance analysis of advanced AI compute platforms. You will collaborate with hardware, firmware, software, mechanical, thermal, and systems...Flexible hours
- ...A leading technology firm in Austin, Texas is seeking an AI solutions systems Engineer to architect and develop innovative AI fleet management solutions. The role requires strong expertise in software engineering and system design, with a focus on leveraging AI for productivity...
$124k - $242k
...reimagining how work gets done. Engineers define intent, author precise... ..., and orchestrate AI agents that execute at speed and... ...energized by solving complex systems challenges, excited to work alongside... ...reliability engineering, including CFD modeling (Icepak, FloTHERM, Star-CCM+),...Relocation package- NVIDIA is seeking a Senior Performance Engineer to characterize and optimize large-scale AI workloads within the DGX Cloud AI Efficiency Team. You will drive end-to-end performance studies, establish baselines, diagnose bottlenecks, and guide optimization from investigation...
- ...TX is seeking a recent graduate or early-career engineer to join the Hardware Platform Development team as a Graduate Systems Engineer. You will contribute to the design,... ...validation, and performance analysis of advanced AI compute platforms. You will work with hardware,...
$124k - $195.5k
...Deep Learning Systems. As the complexity... ...for emerging AI workloads. You... ...territories in model optimization, custom... ...tools and runtime systems to profile... ..., Computer Engineering, Electrical Engineering... ...compilers and ML systems,... ...and implementing agentic AI systems applied...Full time- Sonar Austin is seeking a senior technologist to own the internal technology platform that powers AI-enabled operations. You’ll design, build, and operate AI-native systems, while administrating Jira Service Management and Atlassian Cloud tools to enable teams at scale....
$174.9k - $261.3k
...world! The Data Labeling Engineering team designs, builds,... ...machine learning models within General Motors'... ...data engineering , and AI/ML , defining the strategies... ...and direct impact on systems that unblock the next... ...leveraging AI tools (agentic coding, search, documentation...Full timeLocal areaRemote workWork from homeRelocation packageFlexible hours- ...instinct to spot a "normalized" problem and the AI-native curiosity to create a solution... ...features and improvements for the Workers Runtime. Improve runtime performance, reliability,... ...debug issues in a large-scale distributed system. Work in a fast-paced, iterative...Local area
- Graphcore in Austin, TX is seeking a Staff Hardware Engineer to provide advanced operational, diagnostic, and engineering support for... ...engineering, platform, and data center teams to ensure reliability and performance of next-generation AI systems. #J-18808-Ljbffr Graphcore
$124k - $280k
...PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...developing and implementing advanced AI and ML solutions to drive innovation and... ...designing and optimising algorithms, models, and systems to enable intelligent decision-making...H1b- ...Dialpad Dialpad is the AI platform for customer experience... .... Unlike legacy systems built to route and answer, or standalone agentic bot vendors built to... ...Applied AI team develops models, agentic capabilities, and... .... As a Sr. Software Engineer, Applied AI Systems, you...Work at office
- ...Mythic is building next‑generation AI hardware platforms that require... ...silicon, packaging, and system design. We are looking for a hands... ...on Senior Staff Systems Design Engineer to own and drive the design... ...Qualifications Experience with AI/ML hardware or high‑performance...
- ...Staff ML Systems Engineer - Explainability at Elloe AI Full-time | Remote | ML Infrastructure | Reports to CTO About Elloe Elloe is the trust layer... ...We sit between the world’s most powerful language models and the institutions that can't afford to get it wrong...Full timeRemote workFlexible hours
- ...Atlassian’s surfaces. Agentic search is pushing... ...with today’s search systems and this role is intended... ...and discovery for AI. You'll lead the search and ML architecture that... ...search serving: ranking models, retrieval... ...and elevate senior engineers across Search Serving...Work at officeLocal area
- ...Graphcore in Austin seeks a Staff Hardware Engineer to provide advanced support for Arm-based hardware platforms across lab and data center environments. You will focus on hardware bring-up, validation, and troubleshooting of server blades, racks, and rack-scale infrastructure...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to [Agentic AI] AI Runtime / ML Model Systems Engineer. Be the first to apply!
- senior ml engineer Austin, TX
- machine learning software engineer Austin, TX
- machine learning engineer Austin, TX
- machine learning ai engineer Austin, TX
- ai ml engineer Austin, TX
- computer vision machine learning engineer Austin, TX
- distributed systems engineer Austin, TX
- unix linux systems engineer Austin, TX
- digital communications systems engineer Austin, TX
- system design engineer Austin, TX





