Software Engineer - Hosted Model Infrastructure
Palantir
A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We are a software engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety of environments: air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements. Our customers rely on us for frontier AI capabilities running on hardware they control, often with constrained GPU resources and limited direct access. Rising to that challenge and meeting those expectations is what Palantir's excels at. We treat models like any other software: continuously tested, continually delivered, packaged for reproducible deployment, and built for long-term maintainability. You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform. The goal is to deliver new models and capabilities quickly and continuously. Join us if you want to solve problems at the intersection of infrastructure and machine learning that directly enable critical customers. #J-18808-Ljbffr Palantir
$176k
What to Expect We are looking for strong software engineers to help scale the next generation of large AI models for Autopilot, Optimus & Digital Optimus. This role... ...will work closely with ML practitioners and infrastructure engineers to improve training efficiency,...SuggestedHourly payFull timeTemporary workFlexible hours$174k - $253k
...5 years of experience with software development in one or more programming... ...with developing large-scale infrastructure, distributed systems or... ...job Google Cloud's software engineers develop the next-generation... ...forward. The GDC Host Network Functions team provides...Suggested$176k - $420k
...real‑world AI through humanoid robots. As a Software Engineer for the Optimus team, you will build the tools and infrastructure to make and measure improvements to neural network... ...applications. What You'll Do Optimize ML models for latency, memory usage, and inference...SuggestedHourly payFull timeTemporary workFlexible hours$190k - $260k
...its commercial self‑driving software to develop, test and deploy... ...it. Every improvement to our models - from GigaFusionNet to large... ...world models - depends on infrastructure that turns thousands of hours... ...throughput. We are looking for engineers who make model training fast...SuggestedWork at officeFlexible hours$160.36k - $240.54k
...connected future. About The Role Our software team is growing, and we are looking for talented engineers to join us and be instrumental... ..., Simulation, and Technical Infrastructure. Data Platform: The Data... ...: generic compute platform to host mission‑critical workflows...Suggested- ...help in executing the roadmap for data infrastructure and systems to power the world’s... ...possess strong foundational knowledge of software engineering, big data and ML platform principles.... ...a wide swath of software platforms (hosted or built in-house). You have experience...
$213k - $263k
...reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust... ...within the Waymo Driver Develop automated, high‑performance infrastructure to ensure the dependable and efficient rollout of data solutions...Full timeTemporary work$180k - $220k
...building the operator intelligence infrastructure that modern hardware... ...proven that a single foundation model works out of the box across... ...AI architecture and systems engineering - not low-level GPU kernel... ...Engineering Expectations Strong software engineering fundamentals...$147k - $211k
...e.g., sequential decision making), ML infrastructure, or specialization in another ML field... ...experience with ML infrastructure (e.g., model deployment, model evaluation,... ...technologies. About the Job Google's software engineers develop the next-generation technologies...Worldwide$184k - $287.5k
Senior Software Engineer focused on container and cloud infrastructure at NVIDIA. Design and implement NVIDIA Inference Microservices container strategy and hosted services. Build enterprise‑grade software and... ...day‑0 availability of new models. Mentor teammates; set high...$174k - $252k
Senior Software Engineer, AI/ML, AI and Infrastructure Mountain View, CA, USA Mid level role focused on driving progress, solving problems, and mentoring junior... ...3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data...Full timeWorldwide$150k - $250k
...leveraging its commercial self-driving software to develop, test and deploy autonomous... ...this role, you will: Collaborate with engineers across multiple domains to build the Kodiak... ...robots. Design and implement our core infrastructure and libraries using modern C++. Build...Temporary workWork at officeVisa sponsorshipFlexible hours$164.2k - $205.2k
At Databricks, the Compute Infrastructure organization builds and operates the foundation that runs all Data, AI, and stateful workloads... ...elasticity, reliability, and cost efficiency. As a Senior Software Engineer on the Compute Infra team, you will design and build the...$204k - $259k
...states. The Simulation ML Infrastructure team builds scalable AI/ML infrastructure... ...we employ large foundation models trained on massive datasets... .... This role reports to an Engineering Manager. You will: Be part... ...: 5+ years of professional software engineering experience, with...Full timeRemote work- Google is seeking a Senior Software Engineer for Display Ads, Audience Infrastructure in Mountain View. The role focuses on building scalable infrastructure and data-driven advertising technologies across Google’s ads products. Responsibilities include designing, reviewing...
$140k - $220k
...LLM choice, and robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI across their entire business... ..., in every company. About the Role: Glean is seeking a Software Engineer, Compute Infrastructure to help design, build, and operate...Work at officeHome officeFlexible hours$147k - $211k
...Ability to start full‑time role in 2026. Excellent engineering skills. About the Job Google's software engineers develop the next‑generation technologies... ...world, across many product areas, including AI & Infrastructure, Cloud, and more! Our Engineering teams include...Full timeTemporary work$160.36k - $240.54k
...deployment experience and a flexible, partner‑led business model, Nuro is working toward a future where millions of... ...investors. About The Role Nuro is seeking a Software Engineer with expertise in large‑scale infrastructure, workload orchestration, and data processing to...Immediate startFlexible hours$180k - $215k
Senior Software Engineer, Planning Infrastructure Mountain View, CA Kodiak Robotics, Inc. was founded in 2018 and has become a leader in autonomous ground transportation committed to a safer and more efficient future for all. The company has developed an artificial intelligence...Visa sponsorship$140k - $300k
...AI hardware initiatives by developing automation, infrastructure, and services. Join a dynamic team of engineers dedicated to accelerating workloads through... ...with evidence of exceptional ability and practical software engineering expertise Strong proficiency in Python...Hourly payTemporary workFlexible hours$140k - $390k
What To Expect As a Software Engineer on Tesla AI’s RL Infrastructure team, you will build the systems that make large-scale reinforcement learning fast, stable, and flexible for ML engineers working on real-world AI problems. Your work on RL training will be critical for...Hourly payTemporary workFlexible hours$140k - $390k
What to Expect Tesla AI's Deployment Infrastructure team is building the systems that enable extremely fast model iteration and dynamic deployment on end-user hardware... ...strong product instincts: you enjoy talking to engineers across teams, can convert a vague ask into a...Hourly payFull timeTemporary workFlexible hours- Software Engineer, AI Compute Infrastructure About HeyGen At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade,... ...compute infrastructure that powers our state-of-the-art AI models—from multimodal training data pipelines to high-...Full time
$132k - $198k
...About The Role We are looking for a skilled engineer to help build and maintain release and (OTA) update infrastructure. Our team, Fleet connectivity, builds the infrastructure... ...for network connectivity, telemetry, and software updates, which is critical to the advancement...$135k - $160k
...with the ultimate goal of enabling human life on Mars. SOFTWARE INFRASTRUCTURE ENGINEER (STARLINK) At SpaceX we’re leveraging our experience in building... ...techniques Understanding of databases and data modeling Experience with automatically managing dozens, hundreds,...Permanent employmentTemporary workWorldwideWeekend work$128.25k - $266.88k
...Platform team builds and operates critical infrastructure that powers Search reliability,... .... We are a small but highly impactful engineering team responsible for foundational systems... ...systems, automation tooling, and modern software development practices. Strong problem‑...$193.93k - $291.15k
...connected future. About The Role Nuro is seeking a Software Engineer with expertise in large‑scale infrastructure, workload orchestration, and data processing to... ...You will build the foundation that powers Nuro’s model development from experimentation to production. Key...$118k - $390k
What To Expect As a Software Engineer within the Autopilot AI Infrastructure team, you will work on reinforcing, optimizing, and scaling our infrastructure components... ...large-scale GPU clusters. Robustly training these models at scale and in the shortest amount of time is...Hourly payTemporary workFlexible hours$160.36k - $240.54k
...partner-led business model, Nuro is working toward... ...About the Role Our software team is growing, and... ...looking for talented engineers to join us and be instrumental... ..., and Technical Infrastructure. Data Platform:... ...generic compute platform to host mission-critical...Immediate startFlexible hours$152k - $228k
...test different aspects of the software and hardware integration... ...autonomy code change, from ML model updates to radius of map around... ...the road. You will own the infrastructure that makes this possible.... ...tools, and much, much more. Engineers across the company rely on this...Temporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - Hosted Model Infrastructure. Be the first to apply!
- ngo software engineer Palo Alto, CA
- software developer Palo Alto, CA
- software developer internship no experience Palo Alto, CA
- part time software developer remote Palo Alto, CA
- financial software developer Palo Alto, CA
- senior software engineer ruby on rails Palo Alto, CA
- software engineer amazon Palo Alto, CA
- senior software design engineer Palo Alto, CA
- software engineer part time Palo Alto, CA
- software engineer remote Palo Alto, CA
