Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff AI/ML Infrastructure Engineer

$145k - $160k

Vultr

Who We Are

Vultr is on a mission to make high-performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 33 global cloud data center locations, Vultr is trusted by hundreds of thousands of active customers across 185 countries for its flexible, scalable, global Cloud Compute, Cloud GPU, Bare Metal, and Cloud Storage solutions. In December 2024 Vultr announced an equity financing at a $3.5 billion valuation. Founded by David Aninowsky and self-funded for over a decade, Vultr has grown to become the world's largest privately-held cloud infrastructure company.

Vultr Cares
  • 100% company-paid insurance premiums for employee medical, dental and vision plans.
  • 401(k) plan that matches 100% up to 4%, with immediate vesting
  • Professional Development Reimbursement of $2,500 each year
  • 11 Holidays + Paid Time Off Accrual + Rollover Plan
  • Commitment matters to Vultr! Increased PTO at 3 year and 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year
  • $500 stipend for remote office setup in first year + $400 each following year
  • Internet reimbursement up to $75 per month
  • Gym membership reimbursement up to $50 per month
  • Company paid Wellable subscription
Join Vultr

Vultr is seeking a highly skilled and experienced Staff AI/ML Infrastructure Engineer to drive the design, performance, and reliability of our AI infrastructure platform. The ideal candidate is a hands-on infrastructure expert with deep GPU systems knowledge, strong automation experience, and a track record of technical leadership in high-performance environments. This is a highly visible role in a high-growth technology company, requiring ownership of complex hardware and software systems, collaboration across engineering and vendor partners, and a relentless focus on operational excellence. This is your opportunity to build the foundation powering next-generation AI workloads and leave a lasting mark on Vultr and the future of cloud infrastructure.

Key Responsibilities
  • Design and maintain GPU and bare metal infrastructure in containerized and physical environments
  • Build scalable GPU clusters in partnership with networking and provisioning teams
  • Ensure reliable, high-performance provisioning of GPU infrastructure
  • Develop automated testing systems for GPU-based platforms
  • Implement infrastructure solutions for diverse AI/ML workloads
  • Benchmark, test, and troubleshoot GPU performance at scale
  • Collaborate with hardware vendors on drivers, firmware, and support
  • Resolve hardware, software, and performance issues across environments
  • Optimize rail and cluster performance across architectures
  • Lead technical direction and mentor engineers on infrastructure best practices
Qualifications
  • 5+ years experience working with bare metal infrastructure and hardware automation
  • Hands-on experience with modern NVIDIA/AMD GPU platforms and high-performance networking (RoCE, InfiniBand)
  • Deep knowledge of BIOS, BMC, firmware, NICs, Redfish/IPMI, and PCIe systems
  • Strong Linux systems experience including device drivers and package management
  • Experience building infrastructure automation using Python and Bash
  • Familiarity with GPU drivers, firmware ecosystems, and vendor collaboration
  • Experience designing and delivering complex infrastructure products
  • Proven ability to lead projects and mentor engineers
  • Experience optimizing multi-cluster GPU environments
  • Exposure to Machine Learning software stacks and GPU workloads

Compensation

$145,000 - $160,000

This salary can vary based on location, years of experience, background and skill set.

Inclusion & Privacy

We are an equal opportunity employer and are committed to creating an inclusive environment for all employees. We welcome applications from individuals of all backgrounds and experiences, and we prohibit discrimination based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected status under applicable laws. Vultr will consider qualified applicants with arrest or conviction records in accordance with applicable laws and will not conduct a background check until after an offer of employment has been extended and accepted.

We also take your privacy seriously. We handle personal information responsibly and follow applicable laws, including U.S. privacy rules and India's Digital Personal Data Protection Act, 2023. Your data is used only for legitimate business purposes and is protected with proper security measures.

Where allowed by law, applicants may request details about the data we collect, access or delete their information, withdraw consent for its use, and opt out of nonessential communications. For more details, please see our Privacy Policy.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff AI/ML Infrastructure Engineer in United States vacancy
  • $153.2k - $234.1k

     ...autonomous driving? Join the Embodied AI Infra Foundation team at General...  ..., where we build the critical infrastructure that powers every machine learning engineer working on our cutting-edge Autonomous...  ...driverless vehicles.As a Senior ML Infra Engineer, you will build critical... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, TX
    2 days ago
  • $153.2k - $234.1k

     ...autonomous driving? Join the Embodied AI team at General Motors. Our team is developing...  ...real-world scenarios. As a Senior ML Infra Engineer, you will work on the core systems that...  ...systems, applications, or ML infrastructure. Experience designing robust services or... 
    Suggested
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $124k - $250k

     ...in the LifeAs a member of our software engineering infra team, you'll solve technical challenges...  ...implementing state-of-the-art software infrastructure. The team builds a high-performance,...  ...tools, including artificial intelligence (AI), to help identify and evaluate... 
    Suggested

    AppLovin

    Palo Alto, CA
    3 days ago
  • $155.42k - $205.9k

     ...DescriptionAbout the Team: The AI Validation Platform team owns...  .... We’re proud to serve as the infrastructure platform for teams developing...  ...by prioritizing high-impact, ML-centric use cases. About the Role...  ...a Senior ML Infrastructure engineer to help build and scale robust... 
    Suggested
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  •  ...The RoleAt Mach9, ML infrastructure engineers build and maintain the systems that power production AI models for civil engineering and surveying. Our ML pipeline spans 10,000+ miles of labeled survey data, image segmentation networks, and 3D prediction models serving real... 
    Suggested
    Work experience placement

    Mach9

    San Francisco, CA
    4 days ago
  • $200k - $300k

     ...ML Infrastructure EngineerThe company is building one of the leading AI infrastructure platforms powering document intelligence for modern AI applications.As an ML Infrastructure Engineer, you'll own critical training and inference infrastructure powering production machine... 

    Recruiting from Scratch

    San Francisco, CA
    4 days ago
  •  ...Inference And Model-Serving Infrastructure EngineerYou'll own our inference...  ...Sofus and work closely with our ML and infra teams.What You'll...  ...workloadsOptimize and improve the engine builder and model server that...  ...ability to build scalable ML/AI platforms from scratch, end-to... 
    H1b
    Visa sponsorship

    zaimler

    San Mateo, CA
    2 days ago
  • $250k - $320k

     ...Staff Infrastructure Engineer We are partnered with a Stealth AI Lab (backed by top-tier investors and advised by pioneering figures in generative and interactive media...  ...Required 5+ years of experience in Software / ML Infrastructure Engineering. Deep experience with distributed... 
    Full time
    Immediate start

    Strativ Group

    Menlo Park, CA
    4 days ago
  • $180k

     ...SpaceXAI's mission is to create AI systems that can accurately understand the universe...  ..., highly motivated, and focused on engineering excellence. This organization is for...  ...teammates. ABOUT THE ROLE: As an ML Infrastructure Engineer, you will play a pivotal role... 
    Temporary work
    Work experience placement

    SpaceXAI

    Palo Alto, CA
    4 days ago
  •  ...ML Infrastructure Engineer - RemoteBright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Bellevue, WA
    2 days ago
  • $180k - $250k

     ...About Graphon Graphon AI is building the pre-model intelligence...  ...We are developing the context engine layer that solves a...  ...progress will come from better infrastructure around models: Better Memory...  ...ex-Amazon; PhD in Robotics and ML. Clark Zhang, CTO: ex-Meta... 

    GraphOn

    San Francisco, CA
    1 day ago
  •  ...ML Infrastructure EngineerSan FranciscoCompany OverviewEcho Neurotechnologies is an exciting new startup in the Brain-Computer Interface...  ...(BCI) space, driving innovation through advanced hardware engineering and AI solutions. Our mission is to deliver cutting-edge... 
    Flexible hours

    Echo Neurotechnologies

    San Francisco, CA
    4 days ago
  • $216.7k - $303.4k

     ...Senior Machine Learning Systems Engineer Remote - United States...  ...high-impact team that owns the infrastructure that powers recommendations, content...  ...You’ll Do: As a Senior ML Infrastructure Engineer, you...  ...summarized by artificial intelligence (AI). You will have the... 
    For contractors
    Work experience placement
    Remote work

    Reddit

    United States
    2 days ago
  •  ...general-purpose robots and providing physical AI solutions for the most challenging...  ...We are looking to recruit an exceptional Infrastructure Engineer to own and build the backend systems...  ...and commercial discussions with cloud and ML compute providers, including capacity planning... 

    Maven Robotics

    San Francisco, CA
    3 days ago
  • $122.13k - $183.2k

    JOB DESCRIPTIONJob Description: Data Infrastructure & ML Engineer (Hybrid Role)Role SummaryWe are seeking a Senior Data Infrastructure & Machine Learning...  ...deployment workflows.Enable scalable data foundations for AI/ML integration into production systems.Required... 
    Full time
    Local area

    Axcelis

    Beverly, MA
    3 days ago
  • $193.3k - $261.5k

    We are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective...  ...critical building blocks for EC2 infrastructure. Every instance in EC2 is running...  ...other employees, supervisors, and staff; adhere to standards of excellence... 
    Internship
    Local area
    Flexible hours

    Amazon.com Services LLC

    Cupertino, CA
    4 hours ago
  •  ...ML Engineer, Network Intelligence Colt provides network, voice and...  ...goals instead of the underlying infrastructure. Job title: ML Engineer,...  ...Intelligence Reports to: VP of AI Technology and Architecture...  ...Partner with the Staff AI Engineer to connect ML model... 
    Work at office
    2 days per week
    3 days per week

    Hackajob

    Boulder, CO
    2 days ago
  •  ...Senior ML Infrastructure Engineer (PyTorch, Kubernetes, GPU Training) Short Job Description We are seeking a Senior ML Infrastructure Engineer...  ...-Time Nice to Have: ~ Experience with multimodal AI, robotics data pipelines, Triton, TensorRT, custom ML... 
    Full time

    Finoit Inc

    Redwood City, CA
    3 days ago
  • Anthropic is seeking an engineer for its Safeguards team to own the infrastructure behind cutting-edge AI research. You will build the tooling, pipelines, and production workflows that enable researchers to run experiments, train detection methods, and deploy results at... 

    Neura Market

    San Francisco, CA
    3 days ago
  • Snowflake is seeking an Senior Software Engineer for Cortex Training to advance the ML platform that lets customers run demanding ML/AI workloads inside Snowflake. You will design and implement across the full stack, ensuring scalable, fault-tolerant GPU compute for post... 

    Neura Market

    Bellevue, WA
    3 days ago
  • Overview AI Infrastructure Engineer (GPU Systems & Model Deployment) (Principal and Entry level available) We are seeking an AI Infrastructure Engineer...  ...and real-world deployment. You will work closely with ML researchers and software engineers to ensure models are production... 
    Relocation

    Franklin Fitch

    Dallas, TX
    3 days ago
  • Google is seeking a Software Engineering Manager to lead and grow cross‑functional teams focused on large‑scale infrastructure and distributed systems. You will guide project goals, mentor engineers, and collaborate across AI, cloud, and infrastructure groups to deliver... 

    Socket.dev

    Sunnyvale, CA
    5 days ago
  • $300k

     ...research, nurture the next generation of AI builders, and drive transformative...  ...class researchers, data scientists, and engineers, tackling the most fundamental and impactful...  ...We're looking for a distributed ML infrastructure engineer to help extend and scale our training... 
    Full time
    Flexible hours

    Institute Of Foundation Models

    Sunnyvale, CA
    20 hours ago
  • Tilde Research is a moonshot AI lab focused on mechanistic interpretability, new architectures, and pretraining science. As an ML Engineer, you will build and operate the infrastructure enabling cutting-edge research in training and evaluating large models. You will optimize... 

    Tilde Research

    San Francisco, CA
    2 days ago
  • $124k - $210k

     ...software. Our team is at the forefront of AI, cloud, and data platform adoption,...  ...teamwork. ¹As a Senior Machine Learning Engineer - AI/ML, you will architect and scale the ML platform...  ...model monitoring.Design and implement infrastructure for model training, hyperparameter... 
    Full time
    Part time
    Immediate start
    Flexible hours

    Guidewire Software, Inc.

    San Mateo, CA
    4 days ago
  • $145k - $160k

    DescriptionKforce has a client in West Palm Beach, FL that is seeking a Staff AI/ML Infrastructure Engineer.Key Responsibilities:* Design and maintain GPU and bare metal infrastructure in containerized and physical environments* Build scalable GPU clusters in partnership... 

    KForce

    West Palm Beach, FL
    3 days ago
  • $129.1k - $191.03k

     ...are the essential building blocks of the data infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology...  ...strong ASIC CAD Flow & Infrastructure Engineer to drive the development, deployment, and support... 
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Austin, TX
    20 hours ago
  • $160k - $240k

    Senior ML Platform Engineer - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10050078 Description & Requirements Bloomberg’s Engineering AI department has 400+ AI practitioners building highly sought after products... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    3 days ago
  •  ...Analytica is seeking a  Senior AI-ML Engineer (Azure) with deep Microsoft Azure ecosystem experience combining a blend of high-level architectural design skills, deep proficiency in Azure’s specialized AI toolset, and a mastery of the end-to-end Machine Learning Lifecycle... 
    Full time
    For contractors
    Work at office
    Local area

    Analytica

    Bethesda, MD
    20 hours ago
  • $150k - $210k

     ...members to perform at a higher level and live longer by using AI to transform continuous physiological data into clear insights...  ...that members can act on every day. WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence layer behind WHOOP’s AI-powered... 
    Full time
    Work at office
    Relocation

    Whoop

    Boston, MA
    20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff AI/ML Infrastructure Engineer. Be the first to apply!