Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - Hosted Model Infrastructure

Palantir Technologies

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We are a software engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety of environments: air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements. Our customers rely on us for frontier AI capabilities running on hardware they control, often with constrained GPU resources and limited direct access. Rising to that challenge and meeting those expectations is what Palantir's excels at. We treat models like any other software: continuously tested, continually delivered, packaged for reproducible deployment, and built for long-term maintainability. You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform. The goal is to deliver new models and capabilities quickly and continuously. Join us if you want to solve problems at the intersection of infrastructure and machine learning that directly enable critical customers. #J-18808-Ljbffr Palantir Technologies

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - Hosted Model Infrastructure in Palo Alto, CA vacancy
  • $176k

    # Sr. Software Engineer, Model Scaling, AI InfrastructureTesla$176K - $558KPalo Alto, CA, USSeniorAI Software EngineerInterested in this AI...  ...engineering. You will work closely with ML practitioners and infrastructure engineers to improve training efficiency, accelerate... 
    Suggested
    Hourly pay
    Full time
    Temporary work
    Local area
    Flexible hours

    AI Pulse

    Palo Alto, CA
    3 days ago
  • $174k - $253k

     ...5 years of experience with software development in one or more programming...  ...with developing large-scale infrastructure, distributed systems or...  ...job Google Cloud's software engineers develop the next-generation...  ...forward. The GDC Host Network Functions team provides... 
    Suggested

    Google

    Sunnyvale, CA
    3 days ago
  • $190k - $260k

     ...its commercial self‑driving software to develop, test and deploy...  ...it. Every improvement to our models - from GigaFusionNet to large...  ...world models - depends on infrastructure that turns thousands of hours...  ...throughput. We are looking for engineers who make model training fast... 
    Suggested
    Work at office
    Flexible hours

    Kodiak

    Mountain View, CA
    3 days ago
  • $160.36k - $240.54k

     ...connected future. About The Role Our software team is growing, and we are looking for talented engineers to join us and be instrumental...  ..., Simulation, and Technical Infrastructure. Data Platform: The Data...  ...: generic compute platform to host mission‑critical workflows... 
    Suggested

    Nuro

    Mountain View, CA
    3 days ago
  • $213k - $263k

     ...reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust...  ...within the Waymo Driver Develop automated, high‑performance infrastructure to ensure the dependable and efficient rollout of data solutions... 
    Suggested
    Full time
    Temporary work

    Waymo

    Mountain View, CA
    3 days ago
  • $147k - $211k

     ...e.g., sequential decision making), ML infrastructure, or specialization in another ML field...  ...experience with ML infrastructure (e.g., model deployment, model evaluation,...  ...technologies. About the Job Google's software engineers develop the next-generation technologies... 
    Worldwide

    Google

    Mountain View, CA
    3 days ago
  • $180k - $220k

     ...building the operator intelligence infrastructure that modern hardware...  ...proven that a single foundation model works out of the box across...  ...AI architecture and systems engineering - not low-level GPU kernel...  ...Engineering Expectations Strong software engineering fundamentals... 

    Vinci4D.ai

    Palo Alto, CA
    3 days ago
  • $174k - $252k

    Senior Software Engineer, AI/ML, AI and Infrastructure Mountain View, CA, USA Mid level role focused on driving progress, solving problems, and mentoring junior...  ...3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data... 
    Full time
    Worldwide

    Google

    Mountain View, CA
    3 days ago
  • $150k - $250k

     ...leveraging its commercial self-driving software to develop, test and deploy autonomous...  ...this role, you will: Collaborate with engineers across multiple domains to build the Kodiak...  ...robots. Design and implement our core infrastructure and libraries using modern C++. Build... 
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    Mountain View, CA
    3 days ago
  • $180k - $215k

    Senior Software Engineer, Planning Infrastructure Mountain View, CA Kodiak Robotics, Inc. was founded in 2018 and has become a leader in autonomous ground transportation committed to a safer and more efficient future for all. The company has developed an artificial intelligence... 
    Visa sponsorship

    Kodiak

    Mountain View, CA
    3 days ago
  • $160.36k - $240.54k

     ...deployment experience and a flexible, partner‑led business model, Nuro is working toward a future where millions of...  ...investors. About The Role Nuro is seeking a Software Engineer with expertise in large‑scale infrastructure, workload orchestration, and data processing to... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $160.36k - $240.54k

     ...About the Role The Autonomy ML Infrastructure team is responsible for...  ...components in machine learning model life cycle, to push the...  ...pruning. Work with autonomy engineers to optimize, validate, and deploy...  ...Write robust, high‑quality software to increase our confidence... 
    Work experience placement
    Immediate start

    Nuro

    Mountain View, CA
    3 days ago
  • Software Engineer, AI Compute Infrastructure About HeyGen At HeyGen, our mission is to make visual storytelling accessible to all. Over the last decade,...  ...compute infrastructure that powers our state-of-the-art AI models—from multimodal training data pipelines to high-... 
    Full time

    HeyGen

    Palo Alto, CA
    3 days ago
  • $135k - $160k

     ...with the ultimate goal of enabling human life on Mars. SOFTWARE INFRASTRUCTURE ENGINEER (STARLINK) At SpaceX we’re leveraging our experience in building...  ...techniques Understanding of databases and data modeling Experience with automatically managing dozens, hundreds,... 
    Permanent employment
    Temporary work
    Worldwide
    Weekend work

    SpaceX

    Palo Alto, CA
    3 days ago
  • $132k - $198k

     ...About The Role We are looking for a skilled engineer to help build and maintain release and (OTA) update infrastructure. Our team, Fleet connectivity, builds the infrastructure...  ...for network connectivity, telemetry, and software updates, which is critical to the advancement... 

    Nuro

    Mountain View, CA
    3 days ago
  • $164.2k - $205.2k

    At Databricks, the Compute Infrastructure organization builds and operates the foundation that runs all Data, AI, and stateful workloads...  ...elasticity, reliability, and cost efficiency. As a Senior Software Engineer on the Compute Infra team, you will design and build the... 

    Databricks

    Mountain View, CA
    3 days ago
  • Google is seeking a Senior Software Engineer for Display Ads, Audience Infrastructure in Mountain View. The role focuses on building scalable infrastructure and data-driven advertising technologies across Google’s ads products. Responsibilities include designing, reviewing... 

    Google

    Mountain View, CA
    3 days ago
  • $140k - $220k

     ...LLM choice, and robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI across their entire business...  ..., in every company. About the Role: Glean is seeking a Software Engineer, Compute Infrastructure to help design, build, and operate... 
    Work at office
    Home office
    Flexible hours

    Glean

    Mountain View, CA
    3 days ago
  • $204k - $259k

     ...states. The Simulation ML Infrastructure team builds scalable AI/ML infrastructure...  ...we employ large foundation models trained on massive datasets...  .... This role reports to an Engineering Manager. You will: Be part...  ...: 5+ years of professional software engineering experience, with... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    3 days ago
  • $147k - $211k

     ...Ability to start full‑time role in 2026. Excellent engineering skills. About the Job Google's software engineers develop the next‑generation technologies...  ...world, across many product areas, including AI & Infrastructure, Cloud, and more! Our Engineering teams include... 
    Full time
    Temporary work

    Google

    Mountain View, CA
    3 days ago
  • $174k - $253k

    Senior Software Engineer, Display Ads, Audience Infrastructure Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area. Minimum qualifications: Bachelor’s degree or equivalent practical... 

    Google

    Mountain View, CA
    3 days ago
  • $152k - $228k

     ...test different aspects of the software and hardware integration...  ...autonomy code change, from ML model updates to radius of map around...  ...the road. You will own the infrastructure that makes this possible....  ...tools, and much, much more. Engineers across the company rely on this... 
    Temporary work

    Nuro

    Mountain View, CA
    3 days ago
  • $150k - $235k

     ...the communities that need it most. About The Role The Crypto Infrastructure team builds the foundational systems that power Nclusion’s crypto...  ..., indexing, and blockchain integrations. This team enables engineers working on our crypto rails to move fast while maintaining... 
    Temporary work
    Work at office
    Worldwide
    Flexible hours

    Nclusion

    Palo Alto, CA
    3 days ago
  • $174k - $253k

    Senior Software Engineer, Search Ads Infrastructure Google - Mountain View, CA, USA Mid - Experience driving progress, solving problems, and mentoring more...  ...stack and prepare it for next-gen AI/Large Language Model (LLM) capabilities. Google Ads is helping power the... 

    Google

    Mountain View, CA
    3 days ago
  • $145k - $155k

     ...Company Palantir builds the world's leading software for data-driven decisions and...  ...more. The Role Are you passionate about engineering quality, performance, and increasing the...  ...ever imagined, as you build the shared infrastructure that underpins the Palantir Foundry, Palantir... 
    Relocation package
    Flexible hours

    Palantir Technologies

    Palo Alto, CA
    3 days ago
  • $128.25k - $266.88k

     ...Platform team builds and operates critical infrastructure that powers Search reliability,...  .... We are a small but highly impactful engineering team responsible for foundational systems...  ...systems, automation tooling, and modern software development practices. Strong problem‑... 

    Yahoo Holdings Inc.

    Mountain View, CA
    3 days ago
  • $136.5k

    Software engineering opportunities are available across a variety of technology-focused organizations. Software Engineer - Institute of...  ...skilled software engineer to develop and maintain the software infrastructure. Compensation: $136,500.00 yearly Full-time Senior... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Work at office

    Pinnacle Technical Resources

    Mountain View, CA
    2 days ago
  • $193.93k - $291.15k

     ...connected future. About The Role Nuro is seeking a Software Engineer with expertise in large‑scale infrastructure, workload orchestration, and data processing to...  ...You will build the foundation that powers Nuro’s model development from experimentation to production. Key... 

    Nuro

    Mountain View, CA
    3 days ago
  • $160.36k - $240.54k

     ...partner-led business model, Nuro is working toward...  ...About the Role Our software team is growing, and...  ...looking for talented engineers to join us and be instrumental...  ..., and Technical Infrastructure. Data Platform:...  ...generic compute platform to host mission-critical... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    27 days ago
  • Join to apply for the Software Engineer, Infrastructure role at Simular . Get AI-powered advice on this job and more exclusive features. Where multiple...  ...- from microVMs to multi-agent orchestration, fine-tuned model endpoints, or community task galleries. Collaborate with... 
    Full time

    Simular

    Palo Alto, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - Hosted Model Infrastructure. Be the first to apply!