Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infrastructure Engineer

$180k

Xai

ML Infrastructure Engineer

Palo Alto, California, United States

SpaceXAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

About The Role:

As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact.

Responsibilities:
  • Designing, building, and scaling GPU compute infrastructure, training frameworks, and experimentation tools to enable rapid iteration on ML hypotheses
  • Developing data pipelines and integrating large-scale data, training, and inference systems
  • Collaborating with ML teams to productionize models and ensure seamless integration across the stack
  • Ensuring scalability, reliability, and efficiency of large-scale machine learning systems
  • Working across the full stack to solve complex problems independently
  • Mentoring junior engineers and contributing to the growth of the team
Basic Qualifications:
  • Bachelor, Master, Post-graduate or PhD in computer science, machine learning, or other quantitative discipline; or equivalent work experience
  • 2+ years of industry experience working with high traffic or large-scale production environments, distributed systems, GPU infrastructure, and/or deep learning applications
  • 2+ years experience with ML platforms, training infrastructure, or close collaboration with modeling engineers and data scientists
  • Strong proficiency with Python and experience with compiled languages such as C++ or Rust
Preferred Skills And Experience:
  • Deep familiarity with modern ML frameworks such as JAX or PyTorch
  • Low-level understanding of compute systems, including distributed storage, NVIDIA drivers, CUDA toolkits, and networking
  • Comfortable with Linux systems and orchestration tools
  • Experience with job schedulers (e.g., Slurm), configuration management (Puppet/Ansible), or related infrastructure tooling
Compensation And Benefits:

$180,000 - $440,000 USD

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Infrastructure Engineer in Palo Alto, CA vacancy
  • $124k - $250k

     ...their support of others.A Day in the LifeAs a member of our software engineering infra team, you'll solve technical challenges, including upgrading and implementing state-of-the-art software infrastructure. The team builds a high-performance, high availability, globally... 
    Suggested

    AppLovin

    Palo Alto, CA
    4 days ago
  • $250k - $320k

    Staff Infrastructure Engineer We are partnered with a Stealth AI Lab (backed by top-tier investors and advised by pioneering figures in generative...  ...Experience Required 5+ years of experience in Software / ML Infrastructure Engineering. Deep experience with distributed... 
    Suggested
    Full time
    Immediate start

    Strativ Group

    Menlo Park, CA
    4 days ago
  • $153.2k - $234.1k

     ...vehicle behavior across real-world scenarios. As a Senior ML Infra Engineer, you will work on the core systems that enable rapid dataset...  ...working on large-scale distributed systems, applications, or ML infrastructure. Experience designing robust services or frameworks with... 
    Suggested
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $153.2k - $234.1k

     ...team at General Motors, where we build the critical infrastructure that powers every machine learning engineer working on our cutting-edge Autonomous Driving models...  ...'s most advanced driverless vehicles.As a Senior ML Infra Engineer, you will build critical infrastructure... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $155.42k - $205.9k

     ...AV efforts. We’re proud to serve as the infrastructure platform for teams developing autonomous...  ...development by prioritizing high-impact, ML-centric use cases. About the Role: We are seeking a Senior ML Infrastructure engineer to help build and scale robust Compute platforms... 
    Suggested
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • A leading technology firm is seeking GCP Certified Data Engineers or Machine Learning Engineers for a part-time role. Candidates should have...  ...opportunity to build a team of skilled professionals in the Data/AI/ML field, with a flexible workload expectation. #J-18808-Ljbffr
    Part time
    Remote work
    Flexible hours

    Avant Digital Inc

    Mountain View, CA
    1 day ago
  • A leading AI-powered fraud detection platform in Mountain View is seeking experienced platform engineers to design and build advanced machine learning systems. You will engage in improving core detection algorithms, using unsupervised and supervised machine learning, and... 

    DataVisor

    Mountain View, CA
    4 days ago
  • $185k - $335.3k

     ...General Motors is seeking an experienced Staff ML Engineer to lead the design and development of scalable AI/ML infrastructure. The role involves working across teams to define technical direction and ensure the success of ML initiatives. Ideal candidates should have a... 
    Remote work

    General Motors

    Mountain View, CA
    2 days ago
  • NewsBreak in California is hiring a Machine Learning Infrastructure Engineer to build the backbone that trains, serves, and monitors models behind...  ...an idea to a safely launched model. You’ll work across the ML lifecycle: making training faster and more reliable,... 

    Francisco Partners

    Mountain View, CA
    2 days ago
  • $150k - $180k

    Overview Job Title: Machine Learning Infrastructure Engineer - Computer Vision & AI Employer: The Mice Groups, Inc. Location Redwood City, CA (Hybrid...  ..., and computer vision Proven experience with scalable ML infrastructure and distributed systems Proficient in Python... 
    Full time
    Contract work

    The Mice Groups, Inc.

    Redwood City, CA
    4 days ago
  • $193.3k - $261.5k

    We are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective operations - the fundamental...  ...components that are critical building blocks for EC2 infrastructure. Every instance in EC2 is running some type of hardware... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $300k

     ...training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in...  ...pioneers. The Role   We're looking for a distributed ML infrastructure engineer to help extend and scale our training systems. You’... 
    Full time
    Flexible hours

    Institute Of Foundation Models

    Sunnyvale, CA
    17 hours ago
  • $230k - $300k

     ...team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re...  ...are seeking a Staff Machine Learning Engineer to provide technical leadership for our...  ...industry experience building large-scale ML or recommendation systems. - Deep expertise... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    4 days ago
  •  ...workflow automation with Moveworks’ Reasoning Engine and natural language capabilities, we...  ..., and enhance our end-to-end product infrastructure with the utmost engineering quality and...  ...monitoring and analysis.Collaborate closely with ML engineers, application engineers,... 
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    17 hours ago
  •  ...About the Role We’re looking for an Applied ML Engineer to design, evaluate, and scale recommendation and ranking systems that power how content, ads, and interactive experiences are selected and surfaced in real time. This role focuses on decision-making systems, with... 
    Full time

    Darwin

    Palo Alto, CA
    17 hours ago
  • $160k - $200k

    Santa Clara, CAData Engineering - Machine Learning and Data Engineer /Full-time /HybridPlusAI is a Physical AI company pioneering AI...  ...talented individuals to join its fast-growing teams.As a Senior ML Infrastructure Engineer at Plus, you will design scalable architectures... 
    Full time

    Plus.ai

    Santa Clara, CA
    4 days ago
  •  ...Together, we advance your career. THE ROLEWe are hiring AI / ML Platform Engineers to build the platform layer that makes AI-for-engineering...  ..., reliable, and reproducible. This role focuses on the infrastructure and platform systems that support large-scale agent execution... 

    AMD

    Santa Clara, CA
    17 hours ago
  • $250k - $350k

    About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this...  ...toolkitsContributions to open source projects in AI infrastructure or deep learning compilersStartup or rapid prototyping experienceWhat... 
    Work at office
    3 days per week

    Pika

    Palo Alto, CA
    17 hours ago
  • $207k - $301k

     ...embedding) in production and experience building architecture in different modeling domains.5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).5 years of experience testing, and... 

    Google

    Mountain View, CA
    3 days ago
  •  ...deliver a product that will help serve tens of millions of customers per day.Your Role and ResponsibilitiesWe are seeking to hire an ML Engineer to join our growing team! This is a hands-on technical role where you will spend most of your time designing, coding, and... 
    Full time
    Temporary work
    Part time

    IBM

    Mountain View, CA
    17 hours ago
  • $157.3k - $212.8k

     ...high performance and scalability in AI/ML and HPC workloads.Utility Computing (UC)...  ...team of software, hardware, and network engineers, supply chain specialists, security experts...  ...design for large scale applications- AI infrastructure hardware development and debugging... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $105k - $143k

     ...Machine Learning Infrastructure Engineer – Remote Bright Vision Technologies is a technology consulting and software development company delivering...  ...-offs between latency, throughput, cost, and quality in ML serving. Required Qualifications Bachelor’s or Master’... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Milpitas, CA
    20 days ago
  •  ...Scale our Ray + PyTorch infrastructure for the multimodal video, training, and RL pipelines that...  ...teams. 3+ yrs distributed systems / ML infra. About Orbifold AI Orbifold AI...  ...Overview We are hiring a Machine Learning Engineer to scale and optimize the ML... 
    Full time

    Orbifold AI

    Palo Alto, CA
    15 days ago
  • $190k - $234k

     ...enterprise marketing. What You’ll Do As a StaffMachine Learning Engineer/Applied Scientist, you will be responsible for building machine...  ...Science or a related fieldExperience with building and evolving ML Training and Inferencing systems at significant scale with a purpose... 
    Work at office
    Local area
    3 days per week

    Typeface

    Palo Alto, CA
    4 days ago
  • $230k - $260k

     ...You’ll Do As a Principal Machine Learning Engineer, you will operate at the company level—...  ...You will lead the design of large-scale ML systems and shared platforms that power...  ...generation Define and evolve shared ML infrastructure and platforms for training, fine-tuning,... 
    Work at office
    Immediate start
    3 days per week

    Typeface

    Palo Alto, CA
    4 days ago
  • $207k - $300k

     ...Notifications.Develop AI-generated content through advanced context engineering and agentic feedback loops to identify and deliver engaging...  ...need to solve complex engineering challenges and expand our infrastructure, while maintaining a universally accessible and useful... 

    Google

    Mountain View, CA
    3 days ago
  •  ...and hyper-connected world.Role OverviewAs our Staff Software Engineer, ML infra Engineer for Search & Discovery organization, you will...  ..., and ML model training pipelinesDevelop and scale data infrastructure that powers batch and real-time data processing, monitoring,... 
    Temporary work

    Coupang

    Mountain View, CA
    4 days ago
  • $213k - $263k

     ...The Platform team is part of the Marketplace engineering: we provide specialized business platforms supporting Marketplace ML and Optimization products. We own and host...  ...commercial services. Develop high-level infrastructure code for automatically training and deploying... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    4 days ago
  • $152k - $241.5k

    Join our team of innovative engineers who are building an AI Data Center AIOps platform that...  ...and automation for GPU fleets. As an ML Engineer on this team, you'll design and...  ...surfacing insights across massive-scale infrastructure before they impact AI training and inference... 
    Full time

    Nvidia

    Santa Clara, CA
    17 hours ago
  • $161k - $264.5k

     ...City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical...  ...automotive software developers. That's why the Enterprise Technology Engineering Team (EnTec) builds solutions that enhance productivity, so... 
    Temporary work
    For contractors
    Work at office

    Woven

    Palo Alto, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infrastructure Engineer. Be the first to apply!