Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - Hosted Model Infrastructure

Palantir

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We are a software engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety of environments: air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements. Our customers rely on us for frontier AI capabilities running on hardware they control, often with constrained GPU resources and limited direct access. Rising to that challenge and meeting those expectations is what Palantir's excels at. We treat models like any other software: continuously tested, continually delivered, packaged for reproducible deployment, and built for long-term maintainability. You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform. The goal is to deliver new models and capabilities quickly and continuously. Join us if you want to solve problems at the intersection of infrastructure and machine learning that directly enable critical customers. #J-18808-Ljbffr Palantir

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - Hosted Model Infrastructure in Palo Alto, CA vacancy
  • $176k

    What to Expect We are looking for strong software engineers to help scale the next generation of large AI models for Autopilot, Optimus & Digital Optimus. This role...  ...will work closely with ML practitioners and infrastructure engineers to improve training efficiency,... 
    Suggested
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla Motors, Inc.

    Palo Alto, CA
    2 days ago
  • $174k - $253k

     ...5 years of experience with software development in one or more programming...  ...with developing large-scale infrastructure, distributed systems or...  ...job Google Cloud's software engineers develop the next-generation...  ...forward. The GDC Host Network Functions team provides... 
    Suggested

    Google

    Sunnyvale, CA
    2 days ago
  • $176k - $420k

     ...real‑world AI through humanoid robots. As a Software Engineer for the Optimus team, you will build the tools and infrastructure to make and measure improvements to neural network...  ...applications. What You'll Do Optimize ML models for latency, memory usage, and inference... 
    Suggested
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla Motors, Inc.

    Palo Alto, CA
    2 days ago
  • $190k - $260k

     ...its commercial self‑driving software to develop, test and deploy...  ...it. Every improvement to our models - from GigaFusionNet to large...  ...world models - depends on infrastructure that turns thousands of hours...  ...throughput. We are looking for engineers who make model training fast... 
    Suggested
    Work at office
    Flexible hours

    Kodiak

    Mountain View, CA
    2 days ago
  • $160.36k - $240.54k

     ...connected future. About The Role Our software team is growing, and we are looking for talented engineers to join us and be instrumental...  ..., Simulation, and Technical Infrastructure. Data Platform: The Data...  ...: generic compute platform to host mission‑critical workflows... 
    Suggested

    Nuro

    Mountain View, CA
    2 days ago
  •  ...help in executing the roadmap for data infrastructure and systems to power the world’s...  ...possess strong foundational knowledge of software engineering, big data and ML platform principles....  ...a wide swath of software platforms (hosted or built in-house). You have experience... 

    Moonhub

    Palo Alto, CA
    2 days ago
  • $213k - $263k

     ...reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust...  ...within the Waymo Driver Develop automated, high‑performance infrastructure to ensure the dependable and efficient rollout of data solutions... 
    Full time
    Temporary work

    Waymo

    Mountain View, CA
    2 days ago
  • $180k - $220k

     ...building the operator intelligence infrastructure that modern hardware...  ...proven that a single foundation model works out of the box across...  ...AI architecture and systems engineering - not low-level GPU kernel...  ...Engineering Expectations Strong software engineering fundamentals... 

    Vinci4D.ai

    Palo Alto, CA
    2 days ago
  • $147k - $211k

     ...e.g., sequential decision making), ML infrastructure, or specialization in another ML field...  ...experience with ML infrastructure (e.g., model deployment, model evaluation,...  ...technologies. About the Job Google's software engineers develop the next-generation technologies... 
    Worldwide

    Google

    Mountain View, CA
    2 days ago
  • $184k - $287.5k

    Senior Software Engineer focused on container and cloud infrastructure at NVIDIA. Design and implement NVIDIA Inference Microservices container strategy and hosted services. Build enterprise‑grade software and...  ...day‑0 availability of new models. Mentor teammates; set high... 

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $174k - $252k

    Senior Software Engineer, AI/ML, AI and Infrastructure Mountain View, CA, USA Mid level role focused on driving progress, solving problems, and mentoring junior...  ...3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data... 
    Full time
    Worldwide

    Google

    Mountain View, CA
    2 days ago
  • $150k - $250k

     ...leveraging its commercial self-driving software to develop, test and deploy autonomous...  ...this role, you will: Collaborate with engineers across multiple domains to build the Kodiak...  ...robots. Design and implement our core infrastructure and libraries using modern C++. Build... 
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    Mountain View, CA
    2 days ago
  • $164.2k - $205.2k

    At Databricks, the Compute Infrastructure organization builds and operates the foundation that runs all Data, AI, and stateful workloads...  ...elasticity, reliability, and cost efficiency. As a Senior Software Engineer on the Compute Infra team, you will design and build the... 

    Databricks

    Mountain View, CA
    2 days ago
  • $204k - $259k

     ...states. The Simulation ML Infrastructure team builds scalable AI/ML infrastructure...  ...we employ large foundation models trained on massive datasets...  .... This role reports to an Engineering Manager. You will: Be part...  ...: 5+ years of professional software engineering experience, with... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  • Google is seeking a Senior Software Engineer for Display Ads, Audience Infrastructure in Mountain View. The role focuses on building scalable infrastructure and data-driven advertising technologies across Google’s ads products. Responsibilities include designing, reviewing... 

    Google

    Mountain View, CA
    2 days ago
  • $140k - $220k

     ...LLM choice, and robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI across their entire business...  ..., in every company. About the Role: Glean is seeking a Software Engineer, Compute Infrastructure to help design, build, and operate... 
    Work at office
    Home office
    Flexible hours

    Glean

    Mountain View, CA
    2 days ago
  • $147k - $211k

     ...Ability to start full‑time role in 2026. Excellent engineering skills. About the Job Google's software engineers develop the next‑generation technologies...  ...world, across many product areas, including AI & Infrastructure, Cloud, and more! Our Engineering teams include... 
    Full time
    Temporary work

    Google

    Mountain View, CA
    2 days ago
  • $160.36k - $240.54k

     ...deployment experience and a flexible, partner‑led business model, Nuro is working toward a future where millions of...  ...investors. About The Role Nuro is seeking a Software Engineer with expertise in large‑scale infrastructure, workload orchestration, and data processing to... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $180k - $215k

    Senior Software Engineer, Planning Infrastructure Mountain View, CA Kodiak Robotics, Inc. was founded in 2018 and has become a leader in autonomous ground transportation committed to a safer and more efficient future for all. The company has developed an artificial intelligence... 
    Visa sponsorship

    Kodiak

    Mountain View, CA
    2 days ago
  • $140k - $300k

     ...AI hardware initiatives by developing automation, infrastructure, and services. Join a dynamic team of engineers dedicated to accelerating workloads through...  ...with evidence of exceptional ability and practical software engineering expertise Strong proficiency in Python... 
    Hourly pay
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    2 days ago
  • $140k - $390k

    What To Expect As a Software Engineer on Tesla AI’s RL Infrastructure team, you will build the systems that make large-scale reinforcement learning fast, stable, and flexible for ML engineers working on real-world AI problems. Your work on RL training will be critical for... 
    Hourly pay
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    2 days ago
  • $140k - $390k

    What to Expect Tesla AI's Deployment Infrastructure team is building the systems that enable extremely fast model iteration and dynamic deployment on end-user hardware...  ...strong product instincts: you enjoy talking to engineers across teams, can convert a vague ask into a... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla Motors, Inc.

    Palo Alto, CA
    2 days ago
  • Software Engineer, AI Compute Infrastructure About HeyGen At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade,...  ...compute infrastructure that powers our state-of-the-art AI models—from multimodal training data pipelines to high-... 
    Full time

    HeyGen

    Palo Alto, CA
    2 days ago
  • $132k - $198k

     ...About The Role We are looking for a skilled engineer to help build and maintain release and (OTA) update infrastructure. Our team, Fleet connectivity, builds the infrastructure...  ...for network connectivity, telemetry, and software updates, which is critical to the advancement... 

    Nuro

    Mountain View, CA
    2 days ago
  • $135k - $160k

     ...with the ultimate goal of enabling human life on Mars. SOFTWARE INFRASTRUCTURE ENGINEER (STARLINK) At SpaceX we’re leveraging our experience in building...  ...techniques Understanding of databases and data modeling Experience with automatically managing dozens, hundreds,... 
    Permanent employment
    Temporary work
    Worldwide
    Weekend work

    SpaceX

    Palo Alto, CA
    2 days ago
  • $128.25k - $266.88k

     ...Platform team builds and operates critical infrastructure that powers Search reliability,...  .... We are a small but highly impactful engineering team responsible for foundational systems...  ...systems, automation tooling, and modern software development practices. Strong problem‑... 

    Yahoo Holdings Inc.

    Mountain View, CA
    2 days ago
  • $193.93k - $291.15k

     ...connected future. About The Role Nuro is seeking a Software Engineer with expertise in large‑scale infrastructure, workload orchestration, and data processing to...  ...You will build the foundation that powers Nuro’s model development from experimentation to production. Key... 

    Nuro

    Mountain View, CA
    2 days ago
  • $118k - $390k

    What To Expect As a Software Engineer within the Autopilot AI Infrastructure team, you will work on reinforcing, optimizing, and scaling our infrastructure components...  ...large-scale GPU clusters. Robustly training these models at scale and in the shortest amount of time is... 
    Hourly pay
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    2 days ago
  • $160.36k - $240.54k

     ...partner-led business model, Nuro is working toward...  ...About the Role Our software team is growing, and...  ...looking for talented engineers to join us and be instrumental...  ..., and Technical Infrastructure. Data Platform:...  ...generic compute platform to host mission-critical... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    26 days ago
  • $152k - $228k

     ...test different aspects of the software and hardware integration...  ...autonomy code change, from ML model updates to radius of map around...  ...the road. You will own the infrastructure that makes this possible....  ...tools, and much, much more. Engineers across the company rely on this... 
    Temporary work

    Nuro

    Mountain View, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - Hosted Model Infrastructure. Be the first to apply!