Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff AI/ML Infrastructure Engineer

$145k - $160k

Vultr

Who We Are Vultr is on a mission to make high-performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 32 global cloud data center locations, Vultr is trusted by hundreds of thousands of active customers across 185 countries for its flexible, scalable, global Cloud Compute, Cloud GPU, Bare Metal, and Cloud Storage solutions. In December 2024 Vultr announced an equity financing at a $3.5 billion valuation. Founded by David Aninowsky and self-funded for over a decade, Vultr has grown to become the world’s largest privately-held cloud infrastructure company. Vultr Cares 100% company-paid insurance premiums for employee medical, dental and vision plans. 401(k) plan that matches 100% up to 4%, with immediate vesting Professional Development Reimbursement of $2,500 each year 11 Holidays + Paid Time Off Accrual + Rollover Plan Commitment matters to Vultr! Increased PTO at 3 year and 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year $500 stipend for remote office setup in first year + $400 each following year Internet reimbursement up to $75 per month Gym membership reimbursement up to $50 per month Company paid Wellable subscription Join Vultr Vultr is seeking a highly skilled and experienced Staff AI/ML Infrastructure Engineer to drive the design, performance, and reliability of our AI infrastructure platform. The ideal candidate is a hands‑on infrastructure expert with deep GPU systems knowledge, strong automation experience, and a track record of technical leadership in high‑performance environments. This is a highly visible role in a high‑growth technology company, requiring ownership of complex hardware and software systems, collaboration across engineering and vendor partners, and a relentless focus on operational excellence. This is your opportunity to build the foundation powering next‑generation AI workloads and leave a lasting mark on Vultr and the future of cloud infrastructure. Key Responsibilities Design and maintain GPU and bare metal infrastructure in containerized and physical environments Build scalable GPU clusters in partnership with networking and provisioning teams Ensure reliable, high‑performance provisioning of GPU infrastructure Develop automated testing systems for GPU-based platforms Implement infrastructure solutions for diverse AI/ML workloads Benchmark, test, and troubleshoot GPU performance at scale Collaborate with hardware vendors on drivers, firmware, and support Resolve hardware, software, and performance issues across environments Optimize rail and cluster performance across architectures Lead technical direction and mentor engineers on infrastructure best practices Qualifications 5+ years experience working with bare metal infrastructure and hardware automation Hands‑on experience with modern NVIDIA/AMD GPU platforms and high‑performance networking (RoCE, InfiniBand) Deep knowledge of BIOS, BMC, firmware, NICs, Redfish/IPMI, and PCIe systems Strong Linux systems experience including device drivers and package management Experience building infrastructure automation using Python and Bash Familiarity with GPU drivers, firmware ecosystems, and vendor collaboration Experience designing and delivering complex infrastructure products Proven ability to lead projects and mentor engineers Experience optimizing multi‑cluster GPU environments Exposure to Machine Learning software stacks and GPU workloads Compensation $145,000 - $160,000 This salary can vary based on location, years of experience, background and skill set. Inclusion & Privacy We are an equal opportunity employer and are committed to creating an inclusive environment for all employees. We welcome applications from individuals of all backgrounds and experiences, and we prohibit discrimination based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected status under applicable laws. Vultr will consider qualified applicants with arrest or conviction records in accordance with applicable laws and will not conduct a background check until after an offer of employment has been extended and accepted. We also take your privacy seriously. We handle personal information responsibly and follow applicable laws, including U.S. privacy rules and India’s Digital Personal Data Protection Act, 2023. Your data is used only for legitimate business purposes and is protected with proper security measures. Where allowed by law, applicants may request details about the data we collect, access or delete their information, withdraw consent for its use, and opt out of nonessential communications. For more details, please see our Privacy Policy. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff AI/ML Infrastructure Engineer in New York, NY vacancy
  • $216.7k - $303.4k

     ...Senior Machine Learning Systems Engineer Remote - United States Reddit...  ...-impact team that owns the infrastructure that powers recommendations, content...  .... What You’ll Do: As a Senior ML Infrastructure Engineer, you...  ...by artificial intelligence (AI). You will have the opportunity... 
    Suggested
    For contractors
    Work experience placement
    Remote work

    Reddit

    New York, NY
    3 days ago
  • TryApplyNow is seeking a mid-level Software Development Engineer, ML Systems for Annapurna Labs in New York, New York. This full-time...  ...problems and contribute to high-impact projects that enhance cloud infrastructure. Candidates should have at least 3 years of software... 
    Suggested
    Full time

    TryApplyNow

    New York, NY
    11 hours ago
  • A leading healthcare AI company is seeking engineers to build foundational ML infrastructure for healthcare applications. The role involves designing scalable ML systems, optimizing performance, and collaborating with product teams. Candidates should have a strong background... 
    Suggested
    Remote job

    Neurex AI Limited

    New York, NY
    3 days ago
  • Job Title: ML Platform Engineer - GPU Infrastructure Support team by designing, implementing, and maintaining the automation and ML workload enablement layer...  ...role focuses on optimizing GPU compute environments for AI/ML training and Isaac Sim simulation workloads,... 
    Suggested

    Optimal

    Brooklyn, NY
    11 hours ago
  • $200.2k - $357.5k

     ...term. About the role Samsara is the industry leader in AI for physical operations. We’re hiring a Staff / Senior Staff Machine Learning Infrastructure Engineer to lead the design and evolution of our end‑to‑end ML platform powering Safety AI and adjacent product areas.... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Samsara

    New York, NY
    3 days ago
  • $148.7k - $199.4k

    Disney Cruise Line - The Walt Disney Company is seeking a Senior Machine Learning Engineer to shape the technical direction of the News ML Platform. You will design and develop infrastructure supporting the ML cycle, mentor engineers, and collaborate across teams to... 

    Disney Cruise Line - The Walt Disney Company

    New York, NY
    1 day ago
  • Dormont Manufacturing Co is seeking a skilled Machine Learning Engineer to join the team in New York. This role focuses on designing and maintaining scalable ML infrastructure, collaborating closely with engineers and scientists to enhance machine learning initiatives.... 

    Dormont Manufacturing Company

    New York, NY
    4 days ago
  • $180k - $230k

     ...eliminating vendors whose business exists mostly to take a cut. AI is the foundation that makes this work. We use it across...  ...healthcare operators. About the Role As a Senior ML Infrastructure Engineer, you will own the data infrastructure that powers our underwriting... 

    Arlo

    New York, NY
    11 days ago
  • $130k - $185k

     ...With deep functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with...  ...Within the EY-Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business Leaders, Data... 
    For contractors
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    New York, NY
    1 day ago
  • $204k - $262k

     ...About the Role Joining Hinge’s AI Platform Core team offers a...  ...and contribute to a growing ML platform with the goal of accelerating...  ...data science and backend engineering. You will meet our internal...  ...and underlying operational infrastructure to enable Product impact. Develop... 
    Work experience placement

    Match Group

    New York, NY
    1 day ago
  • $170k - $220k

     ...Senior Machine Learning Platform Engineer New York, NY Why Charlie Health? Millions...  ...than 100,000 clients nationwide. Our ML and AI capabilities are expanding rapidly—...  ...products, and developer tooling—and the infrastructure underneath needs to scale with them.... 
    Full time
    Work at office
    Local area

    Charlie Health

    New York, NY
    1 day ago
  • $197.3k - $225.1k

     ...Lead Machine Learning Engineer (Enterprise Platforms Technology)...  ...ll be expected to perform many ML engineering activities, including...  ...Science teams. Inform your ML infrastructure decisions using your...  ...in Responsible and Explainable AI. Use programming languages... 
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    New York, NY
    1 day ago
  • Apply is seeking a skilled Software Engineer to join the Fintech Foundation team in New York. In this role, you will design and develop machine...  ...ideal candidate should have extensive experience in production ML, strong proficiency in Python, Scala, and SQL, and excellent... 
    Remote job

    Apply

    New York, NY
    11 hours ago
  •  ...spent five years as a Senior Engineer at Etsy and built the first version...  ...how machine learning and AI shape the future of TRACE. You...  ...systems end-to-end, from data infrastructure to models to production systems...  ...powered listing creation Production ML systems that directly impact... 
    Remote work

    Trace

    New York, NY
    11 hours ago
  • $200k - $240k

     ...Senior Machine Learning Engineer (Computer Vision / Vision-Language...  ...more than $200M and is using AI to transform how care is delivered...  ...~ Proven record of deploying ML systems into production ~ Experience...  ...LLMs, edge systems, and cloud infrastructure Significant ownership and... 
    Remote work

    Harnham

    New York, NY
    3 days ago
  • $160k - $300k

     ...ML Engineer Location: New York City (Flatiron) Company Stage: Series B - AI Infrastructure / Financial Operations Technology Office Type: Onsite Salary: $160K - $300K + Equity Company Description We're partnering with a fast-growing Series B AI... 
    Work at office

    Recruiting from Scratch

    New York, NY
    2 days ago
  •  ...Working remotely in a full-time capacity, the ML Engineer will design, optimize, and deploy advanced AI systems, focusing on production-grade software engineering and natural language processing for diverse industries. Key responsibilities Architect and build AI features... 
    Full time
    Remote work

    NineTwoThree AI Studio (923 Digital, LLC)

    New York, NY
    1 day ago
  •  ...protected veteran.**Job Description:****ML Engineer****3M Health Care is now Solventum****At...  ...and maintaining the pipelines that power AI in our Healthcare Information Systems (...  ...implementing automated workflows, managing cloud infrastructure, and ensuring our AI services are secure... 
    H1b
    Remote work

    Solventum

    New York, NY
    1 day ago
  • $101.49k - $147k

     ...to be a place where our exceptionally talented faculty, staff, and students of all identities can thrive. We embrace inclusion...  ...have an exciting opportunity to join our team as a Sr. Engineer I - AI. As a Senior ML Engineer, you will support the implementation of diverse... 
    Work at office

    NYU Langone Health

    New York, NY
    4 days ago
  • $150k - $200k

     ...A financial services firm in New York is seeking a Machine Learning Engineer to join its High Frequency Trading Technology team. This role involves applying AI technologies to solve real-world challenges, including developing a production support AI agent. The ideal candidate... 

    Point72 Asset Management, L.P

    New York, NY
    11 hours ago
  •  ...Machine Learning Engineer, Applied AI As a machine learning engineer you'll join our product...  ...team and work across the full applied ML stack - deploying models, building the...  ...actually work, and making the data and infrastructure decisions that turn experimental data... 
    Work at office
    Work from home
    Home office

    CreatorIQ

    New York, NY
    3 days ago
  •  ...address business needs. Collaborate with data scientists and software engineers to design and implement scalable and efficient solutions. Clean,...  ...(GCP), including services like BigQuery, Cloud Storage, and AI Platform. GCP Professional Machine Learning Engineer... 

    Resolve Tech Solutions

    New York, NY
    2 days ago
  •  ...which has developed Synapsis AI, an end-to-end system that combines...  ...-driven algorithmic reasoning engine to understand and assess...  ...in that mission. As a senior ML engineer at Dyania, you'll design...  ...scalable and maintainable ML infrastructure and services. Collaborate cross... 
    Internship
    Local area
    Remote work
    Flexible hours
    Shift work

    HealthX Ventures

    Jersey City, NJ
    2 days ago
  • $200k - $240k

     ...Overview ML Engineer — New York City or Remote. Base salary $200,000 to $240,000 plus equity...  ...opportunity to join a very early stage AI startup and take full ownership of building...  ...of machine learning, security, and infrastructure, they are tackling a rapidly growing challenge... 
    Immediate start
    Remote work

    Harnham

    New York, NY
    1 day ago
  • $225k - $280k

     ...An AI technology firm in the United States is seeking a Machine Learning Engineer to design feedback-driven learning systems. This remote role focuses on turning user interactions into learning signals. The ideal candidate has 5-8 years of experience and holds a Bachelor... 
    Remote work

    Wizard

    New York, NY
    3 days ago
  •  ...About Remy Remy is an AI‑powered platform on a mission to modernize...  .... Founded by a former project engineer and backed by top operators,...  ...Do Own and evolve backend and ML‑driven features across our Python‑based services and ML infrastructure. Design, deploy, and fine‑tune... 
    For contractors
    Flexible hours

    Remy

    New York, NY
    4 days ago
  • $170k - $220k

     ...Founding ML Engineer Title of Role: Founding ML Engineer Location: New York, hybrid Company Stage of Funding: Venture-Backed - AI, Media Office Type: Hybrid Salary: $170K-$220K Company Description We're representing a dynamic startup focused... 
    Work at office

    Recruiting from Scratch

    New York, NY
    2 days ago
  • $150k - $300k

     ...transforms civil, structural, and MEP engineering firms with applied AI. We’re an AI laboratory dedicated...  ...need to solve the world’s hardest infrastructure, energy, and climate problems. By arming...  ...purpose‑built tools for their staff, and compounding that proprietary intelligence... 
    Work at office

    Eagle KMC Transportation

    New York, NY
    4 days ago
  •  ...Build and deploy AI agent pipelines that extract structured...  ...architecture changes, prompt engineering, fine‑tuning, or rule‑based post...  ...internal engineering and infrastructure teams to deploy, scale, and monitor...  ...2+ years building ML/AI systems in production Built... 

    triomics inc.

    New York, NY
    1 day ago
  •  ...Senior ML Engineer Highlight is building a shared intelligence layer for the modern workforce...  ...a Senior ML Engineer to help build the AI systems that power Highlight. You will...  ...AI powered features Contribute to ML infrastructure decisions and best practices across the... 
    Work at office
    Relocation
    Relocation package
    Flexible hours

    Highlight AI

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff AI/ML Infrastructure Engineer. Be the first to apply!