[Agentic AI] AI Runtime / ML Model Systems Engineer
$130.7k - $205.2kHP
Description -
This role is responsible for developing runtime abstraction layers and intelligent model placement systems across heterogeneous compute resources.. In this role, you will ensure the technical design, development, installation, and maintenance of state-of-the-art software applications and services for the company. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools.
*Houston in-office requirement: 4 days
Responsibilities
• Build runtime abstraction frameworks.
• Implement model placement policies.
• Develop xPU routing logic.
• Optimize inference execution.
• Leads the building of various software development projects and platforms while aligning them with business and security strategies and requirements.
• Builds standards, designs, and automates the deployment of software.
• Designs and develops solutions that protect and manage software products and data.
• Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.
• Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians.
• Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
• Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.
• Strong AI runtime expertise.
• Optimize inference execution.
Required Qualifications
• ONNX, TensorRT, OpenVINO.
• NPU/GPU scheduling.
• Edge AI deployment.
• Agile Methodology
• Amazon Web Services
• Application Programming Interface (API )
• Automation
• C++
• Computer Science
• DevOps
• Docker (Software)
• Full Stack Development
• Java (Programming Language)
• JavaScript (Programming Language)
• Kubernetes
• Microservices
• Microsoft Azure
• Python (Programming Language)
• React.js
• Scalability
• Software Development
• Software Engineering
• SQL (Programming Language)
The pay range for this role is $130,700 to $205,200 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience.
- Health insurance
- Dental insurance
- Vision insurance
- Long term/short term disability insurance
- Employee assistance program
- Flexible spending account
- Life insurance
- Generous time off policies, including;
- 4-12 weeks fully paid parental leave based on tenure
- 11 paid holidays
- Additional flexible paid vacation and sick leave (US benefits overview)
The compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time, with or without notice, subject to applicable law.
Job -
SoftwareSchedule -
Full timeShift -
No shift premium (United States of America)Travel -
25%Relocation -
Equal Opportunity Employer (EEO) -
HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).
Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.
For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal"
- ...discovery to powering AI and the technologies... ...highly motivated AI Model Optimization & Software Engineer Interns/Co-op to... ...computing, distributed systems, and AI software... ...communication, framework, and runtime layers. Design,... ..., coding agents, or agentic development...SuggestedFull timeSummer workInternshipSummer internshipWorldwide
- ...hiring the world’s best engineers, scientists, designers,... ..., and you decide how AI runs here rather than inheriting... ...-unit chargeback model.Keep the platforms... ...platforms to internal systems, with least-privilege access... ...the data is.Build agentic workflows and automations...Suggested
- ...development. As the leader in AI code verification and... ...the leaderboards for agentic software repair.... ...landscape to manage more systems in a predictable way that... ...operations, enterprise platform engineering, and IT service... ...stack - Claude MCP (Model Context Protocol) integrations...SuggestedWork at officeRelocation
- ...Senior Lead Systems Engineer, Ai & Automation At Braze, we have found our people. We're a genuinely... ..., intelligent workflows, and agentic experiences that enable employees to get... ...emerging AI technologies, large language models, MCP integrations, and agent frameworks...Suggested
$150k - $170k
...development company delivering cloud, AI, data, and enterprise... ...potential. Job Title: Secure AI Systems Engineer Location: 100% Remote (U.S.... ...of security controls, threat models, and incident response... ...including significant work on AI or ML systems. Strong...SuggestedFull timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...A leading technology firm in Austin, Texas is seeking an AI solutions systems Engineer to architect and develop innovative AI fleet management solutions. The role requires strong expertise in software engineering and system design, with a focus on leveraging AI for productivity...
- ...Location: Remote Role Overview We are looking for Generalists with strong analytical and critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information across different topics while maintaining...Remote jobFor contractors
$124k - $195.5k
...Deep Learning Systems. As the complexity... ...for emerging AI workloads. You... ...territories in model optimization, custom... ...tools and runtime systems to profile... ..., Computer Engineering, Electrical Engineering... ...compilers and ML systems,... ...and implementing agentic AI systems applied...Full time- ...Dialpad Dialpad is the AI platform for customer experience... .... Unlike legacy systems built to route and answer, or standalone agentic bot vendors built to... ...Applied AI team develops models, agentic capabilities, and... .... As a Sr. Software Engineer, Applied AI Systems, you...Work at office
- ...Atlassian’s surfaces. Agentic search is pushing... ...with today’s search systems and this role is intended... ...and discovery for AI. You'll lead the search and ML architecture that... ...search serving: ranking models, retrieval... ...and elevate senior engineers across Search Serving...Work at officeLocal area
- ...Mythic is building next‑generation AI hardware platforms that require... ...silicon, packaging, and system design. We are looking for a hands... ...on Senior Staff Systems Design Engineer to own and drive the design... ...Qualifications Experience with AI/ML hardware or high‑performance...
$145k - $165k
...software development company delivering cloud, AI, data, and enterprise solutions across... ...career growth potential. Job Title: ML Systems Engineer Location: 100% Remote (U.S.)... ...platforms for serving large machine learning models in production. The role focuses on the...Full timeH1bLocal areaRemote workVisa sponsorship- ...for Bitcoin mining and AI cloud. Bitdeer is... ...every product built on a model is bounded by what it... ...and decision systems that make agentic inference measurable,... ...the MaaS and platform engineering teams on production integration... ...Publications at top-tier ML, NLP, or systems...Full time
- ...Position Purpose: The Sr. Systems Engineer is responsible for... ...infrastructure, network, database, cloud, AI, and security architectures... ...to infrastructure as code models; Drives keeping monitoring/alerting... ...Familiarity with debuggers, runtime analysis, library systems,...Work experience placementRemote work
- ...pivotal role where your engineering expertise will directly... ...leverage cutting‑edge AI‑assisted engineering workflows... ...judgment to ensure system stability. Act as a... ...and quality. Apply agentic and spec‑driven... ...as API contracts, data models, and integration details...
- ...Senior Systems Engineer Hybrid About the Role This is a hands-on... ...and build the Linux-based edge runtime and distributed control plane... ...secure systems, including threat modeling, least privilege, credential... ...~ Practical experience using AI-assisted engineering tools,...Local areaRemote work
- ...world-leading technology company for AI and Bitcoin mining infrastructure. Bitdeer... ...We are seeking a Senior GPU Systems & Fabric Engineer to serve as the critical bridge between... ...level parameters, device drivers, and runtime libraries (CUDA, NCCL) to resolve bottlenecks...Full timeLocal area
$72 - $75 per hour
...experience leveraging AI powered tools and building... ...guidance on data modeling and serialization standards... ...frameworks to automate engineering and operational workflows... ...vision. - Design agentic workflows and multi-agent... ...complex distributed systems, integration, and operational...Hourly payContract workTemporary workWork experience placement$110.3k - $159.95k
C++ Engineer (Computer Vision/Embedded Systems)Description -Job SummaryThe C++ Engineer (Computer Vision/Embedded Systems... ...production C++ features in vision/AI pipelines and supporting services.... ...system integration.Collaborate with ML, QA, and platform teams to deliver...Full timeTemporary workWork experience placementLocal areaRemote workFlexible hoursShift work- ...Our Opportunity: We are looking for a skilled engineer with disciplines that incorporate aspects of software systems engineering and operations. We are combining these... ...managing and operating applications — including AI/ML-driven approaches to observability and...
$125k - $170k
...Infrastructure Reliability Engineer – Remote Bright... ...company delivering cloud, AI, data, and enterprise solutions... ...the large-scale data systems that power modern AI... ...choices propagate into model quality and training efficiency... .... Collaborate with ML researchers and...Full timeLocal areaImmediate startRemote work- ...company for Bitcoin mining and AI cloud. Bitdeer is... ...happens: every product built on a model is bounded by what it costs to... ...Computer Science, Electrical Engineering, or a related field, with hands... ..., model optimization, or ML systems Strong programming ability...Full time
$70.32 - $78.13 per hour
...forefront of integrating cutting-edge technology, including AI/ML, to enhance the reliability and performance of its... ...in the industry. Are you a skilled engineer passionate about combining software systems engineering with robust operations, especially through...Hourly payTemporary work$129.2k - $174.8k
...Amazon's CIA Orchestration and build the AI-powered tools that run Amazon's global network... ...safety services used by network engineers across thousands of Amazon fulfillment centers... ...You will partner with Network Engineers, Systems Engineers, and Product Managers to...Full timeTemporary workSeasonal workWorldwideFlexible hours- ...highly motivated and technically skilled AI Platform Engineer who will be responsible for standing up... ...activities. Define support models, service level objectives, and operational... ...operations, infrastructure provisioning, system integrations, and operational workflows...Contract workRemote work
$168k - $200k
...their medical records to powering the AI revolution in healthcare, Datavanters... ...for a Senior Site Reliability Engineer to join our Data & ML Platform team. You'll be at the forefront... ...cloud environment and can architect systems that balance velocity, safety, and cost...Remote work- ...Experience:Familiarity with cloud-hosted systems such as AWS or GCPHands-on experience deploying... ...)Get notified about new Site Reliability Engineer jobs in Austin, Texas Metropolitan... ...and Kubernetes Software Engineer - Data, AI/ML & AnalyticsAustin, TX $6,400.00-$8,581.00...Remote work
- ...highly skilled and motivated Site Reliability Engineer (SRE) to lead technical excellence across... ...expertise in cloud-native architecture, AI/ML integration, and modern DevOps practices.... ...and documentation. Integrate AI/ML models for analytics, visualization, and...Full timeMonday to Friday
$145k - $165k
...software development company delivering cloud, AI, data, and enterprise solutions across... ...career growth potential. Job Title: ML Systems Engineer Location: 100% Remote (U.S.)... ...platforms for serving large machine learning models in production. The role focuses on the...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...Role: Site Reliability Engineer Location: Southlake / Austin, TX - Onsite 4 days weekly Duration... ...* Monitor and maintain production systems to meet reliability and availability objectives... .... AIOps & Intelligence * Explore AI/ML-driven operational improvements such as anomaly...For contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to [Agentic AI] AI Runtime / ML Model Systems Engineer. Be the first to apply!
- senior ml engineer Austin, TX
- machine learning software engineer Austin, TX
- machine learning engineer Austin, TX
- machine learning ai engineer Austin, TX
- ai ml engineer Austin, TX
- computer vision machine learning engineer Austin, TX
- distributed systems engineer Austin, TX
- unix linux systems engineer Austin, TX
- digital communications systems engineer Austin, TX
- system design engineer Austin, TX




