Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff AI/ML Infrastructure Engineer

$145k - $160k

Vultr

Who We Are Vultr is on a mission to make high-performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 32 global cloud data center locations, Vultr is trusted by hundreds of thousands of active customers across 185 countries for its flexible, scalable, global Cloud Compute, Cloud GPU, Bare Metal, and Cloud Storage solutions. In December 2024 Vultr announced an equity financing at a $3.5 billion valuation. Founded by David Aninowsky and self-funded for over a decade, Vultr has grown to become the world’s largest privately-held cloud infrastructure company. Vultr Cares 100% company-paid insurance premiums for employee medical, dental and vision plans. 401(k) plan that matches 100% up to 4%, with immediate vesting Professional Development Reimbursement of $2,500 each year 11 Holidays + Paid Time Off Accrual + Rollover Plan Commitment matters to Vultr! Increased PTO at 3 year and 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year $500 stipend for remote office setup in first year + $400 each following year Internet reimbursement up to $75 per month Gym membership reimbursement up to $50 per month Company paid Wellable subscription Join Vultr Vultr is seeking a highly skilled and experienced Staff AI/ML Infrastructure Engineer to drive the design, performance, and reliability of our AI infrastructure platform. The ideal candidate is a hands‑on infrastructure expert with deep GPU systems knowledge, strong automation experience, and a track record of technical leadership in high‑performance environments. This is a highly visible role in a high‑growth technology company, requiring ownership of complex hardware and software systems, collaboration across engineering and vendor partners, and a relentless focus on operational excellence. This is your opportunity to build the foundation powering next‑generation AI workloads and leave a lasting mark on Vultr and the future of cloud infrastructure. Key Responsibilities Design and maintain GPU and bare metal infrastructure in containerized and physical environments Build scalable GPU clusters in partnership with networking and provisioning teams Ensure reliable, high‑performance provisioning of GPU infrastructure Develop automated testing systems for GPU-based platforms Implement infrastructure solutions for diverse AI/ML workloads Benchmark, test, and troubleshoot GPU performance at scale Collaborate with hardware vendors on drivers, firmware, and support Resolve hardware, software, and performance issues across environments Optimize rail and cluster performance across architectures Lead technical direction and mentor engineers on infrastructure best practices Qualifications 5+ years experience working with bare metal infrastructure and hardware automation Hands‑on experience with modern NVIDIA/AMD GPU platforms and high‑performance networking (RoCE, InfiniBand) Deep knowledge of BIOS, BMC, firmware, NICs, Redfish/IPMI, and PCIe systems Strong Linux systems experience including device drivers and package management Experience building infrastructure automation using Python and Bash Familiarity with GPU drivers, firmware ecosystems, and vendor collaboration Experience designing and delivering complex infrastructure products Proven ability to lead projects and mentor engineers Experience optimizing multi‑cluster GPU environments Exposure to Machine Learning software stacks and GPU workloads Compensation $145,000 - $160,000 This salary can vary based on location, years of experience, background and skill set. Inclusion & Privacy We are an equal opportunity employer and are committed to creating an inclusive environment for all employees. We welcome applications from individuals of all backgrounds and experiences, and we prohibit discrimination based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected status under applicable laws. Vultr will consider qualified applicants with arrest or conviction records in accordance with applicable laws and will not conduct a background check until after an offer of employment has been extended and accepted. We also take your privacy seriously. We handle personal information responsibly and follow applicable laws, including U.S. privacy rules and India’s Digital Personal Data Protection Act, 2023. Your data is used only for legitimate business purposes and is protected with proper security measures. Where allowed by law, applicants may request details about the data we collect, access or delete their information, withdraw consent for its use, and opt out of nonessential communications. For more details, please see our Privacy Policy. #J-18808-Ljbffr

Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Staff AI/ML Infrastructure Engineer in New York, NY vacancy
  •  ...leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT),...  ...of requests is one of the hardest problems in AI. As an ML Ops Infrastructure Engineer at Deepgram, you will own the critical bridge between... 
    Suggested
    Home office
    Flexible hours

    Deepgram

    New York, NY
    15 hours ago
  •  ...leading construction tech investors, we're entering our next phase of growth - with AI at the center of everything we build next. We're looking for a Senior ML Infrastructure Engineer to build the platform our ML engineers depend on to rapidly iterate, experiment,... 
    Suggested
    For subcontractor

    Rebar

    New York, NY
    1 day ago
  • $216.7k - $303.4k

     ...Senior Machine Learning Systems Engineer Remote - United States Reddit...  ...-impact team that owns the infrastructure that powers recommendations, content...  .... What You’ll Do: As a Senior ML Infrastructure Engineer, you...  ...by artificial intelligence (AI). You will have the opportunity... 
    Suggested
    For contractors
    Work experience placement
    Remote work

    Reddit

    New York, NY
    15 hours ago
  • $180k - $230k

     ...Senior ML Infrastructure Engineer Most of what makes American healthcare expensive isn't medical care. It's the machinery wrapped around it: middlemen...  ...vendors whose business exists mostly to take a cut. AI is the foundation that makes this work. We use it across... 
    Suggested

    Arlo Inc

    New York, NY
    1 day ago
  • Whatnot, the leading livestream shopping platform, is seeking an AI/ML Platform Engineer in the Seattle area to develop core infrastructure for machine learning applications. This role involves designing scalable systems, productionizing ML architectures, and enhancing... 
    Suggested
    Flexible hours

    Whatnot

    New York, NY
    15 hours ago
  •  ...for a Senior Machine Learning Engineer - Training Platform in Australia...  .... You will join a high-impact AI Platform group focused on...  ...you will design and evolve the infrastructure that enables distributed AI training...  ...support research scientists, ML engineers, and product teams... 
    Remote work
    Flexible hours

    Jobgether

    New York, NY
    15 hours ago
  • $160k - $240k

     ...Senior ML Platform Engineer - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10050078 Description & Requirements Bloomberg’s Engineering AI department has 400+ AI practitioners building highly sought after products... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  •  ...Lightning-Ai is seeking a Platform Support Engineer to support ML engineers running large-scale workloads. This role involves diagnosing complex systems issues and providing guidance to enhance infrastructure reliability. It requires a strong background in Kubernetes... 
    Remote work

    Lightning AI

    New York, NY
    15 hours ago
  • $150k - $200k

     ...looking for a Senior Machine Learning Engineer to help us build a revolutionary new health...  ...avoidable adverse events, our ML/NLP/LLM infrastructure is central to working on our central mission...  ...: build a clinically intuitive, AI-enabled solution that fits within physicians... 
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Clover Health

    New York, NY
    15 hours ago
  • $150k - $215k

    A defense technology company is seeking a Technical Leader for Machine Learning Services in the United States. The role involves designing and deploying scalable machine learning platforms, collaborating with product teams, and ensuring service reliability. Candidates ...
    Remote work

    Vannevar Labs

    New York, NY
    15 hours ago
  •  ...A tech startup specializing in banking AI seeks an experienced ML Data Engineer to design and scale data and model-serving systems. In this role, you'll build APIs and microservices for ML models, implement validation frameworks, and improve pipelines for data workflows... 
    Remote work

    Titan AI

    New York, NY
    15 hours ago
  • Zscaler is seeking motivated individuals to join their team in the United States. The company focuses on making cloud environments safe and efficient for enterprise users. As part of a diverse team, you will manage responsibilities and collaborate on innovative solutions...

    Framework Ventures

    New York, NY
    15 hours ago
  •  ...Xfactor is looking for AI/ML professionals eager to tackle real-world business challenges by designing, building, and deploying models. This role demands strong skills in Python, experience with various ML frameworks, and the ability to work with diverse datasets. Collaborating... 
    Relocation

    X Factor

    New York, NY
    1 day ago
  •  ...leading technology firm in the United States is seeking a Staff Machine Learning Engineer to elevate AI-powered capabilities. In this role, you will design and...  ...The ideal candidate has over 8 years of experience in ML engineering, along with strong programming skills in... 

    Clutch Canada

    New York, NY
    15 hours ago
  •  ...Bechtel Corporation is seeking an Artificial Intelligence Engineer to design, develop, and deploy AI/ML solutions that enhance engineering and construction processes. This role requires proficiency in Python and AI frameworks, along with experience in cloud platforms like... 
    Full time
    Remote work

    Bechtel Corporation

    New York, NY
    3 days ago
  •  ...About Basis Basis is a nonprofit applied AI research organization with two mutually reinforcing...  ...human values first. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast, reliable, and scalable. You will own the... 
    Full time
    Work at office

    Basis Research

    New York, NY
    2 days ago
  •  ...its Machine Learning Platform engineering organization. You will own the technical strategy for the ML Platform, manage a team of...  ...and innovate to stay ahead of AI and ML needs. Ideal candidates...  ...expertise in large-scale ML infrastructure and data. Affirm offers a remote... 
    Remote work

    Affirm

    New York, NY
    15 hours ago
  • A leading healthcare innovation company is seeking a Principal ML Engineer to design and implement robust MLOps pipelines. This role involves leading the technical architecture for integrating AI into healthcare systems, optimizing data engineering, and ensuring compliance... 
    Remote work

    Solventum

    New York, NY
    3 days ago
  • $180k - $220k

     ...A healthcare AI startup is seeking a Machine Learning Engineer to contribute to scalable AI pipelines. This role entails developing infrastructure for model training and optimization, requiring extensive experience with ML frameworks and cloud services. The ideal candidate... 
    Remote work

    Artera Corporation

    New York, NY
    15 hours ago
  •  ...A leading automotive company is seeking a Senior ML Engineer to design and build scalable AI/ML platform infrastructure. In this role, you will collaborate with machine learning engineers and research scientists to create advanced AI solutions for intelligent driving... 

    General Motors

    New York, NY
    15 hours ago
  •  ...Lead AI/ML Engineer – On-Prem & Cloud AI Infrastructure Location: Onsite working in Downtown Brooklyn, NY Longterm contract In addition to playing the role of an AI/ML engineer, work with my network and DevOps teams to build out necessary AI/ML infrastructure on... 
    Contract work

    Suncap Technology

    Brooklyn, NY
    4 days ago
  •  ...Role: AI/ML Azure Engineer Duration : Full Time / Contact W2 Location: NYC, NY Mode: Hybrid JD below: Designing, implementing, and maintaining AI infrastructure supporting generative Ai and machine learning services, including... 
    Full time
    Work experience placement

    ACI Infotech

    New York, NY
    1 day ago
  • $180k - $230k

     ...Harnham is looking for a Senior Machine Learning Engineer to join their AI-driven technology company, focused on building large-scale ML systems. The role emphasizes production ML over research, involving designing, training, and deploying ML models. Responsibilities include... 
    Remote work

    Harnham

    New York, NY
    15 hours ago
  •  ...About the Company At Future Secure AI, we're building something genuinely...  ...a highly skilled and motivated Sr. AI/ML Software Engineer to join our core Platform Team in Austin...  ...to building and scaling the infrastructure that powers FutureSecure.ai's intelligent... 

    Future Secure AI

    New York, NY
    1 day ago
  • A cloud technology company is seeking a skilled developer to join their Artificial Intelligence and Machine Learning team. The role focuses on building and maintaining cloud-based solutions, particularly in machine learning. Candidates should have extensive experience ...
    Remote work

    Civo Ltd

    New York, NY
    15 hours ago
  • $137k - $180k

     ...A leading financial technology company is looking for a Machine Learning Engineer to join their remote team. The role involves designing and maintaining scalable backend services, collaborating with cross-functional partners, and managing AWS services. Candidates should... 
    Remote work

    SmartAsset

    New York, NY
    15 hours ago
  • A leading healthcare AI company is seeking engineers to build foundational ML infrastructure for healthcare applications. The role involves designing scalable ML systems, optimizing performance, and collaborating with product teams. Candidates should have a strong background... 
    Remote job

    Neurex AI Limited

    New York, NY
    15 hours ago
  • $204k - $262k

    A leading dating app company is seeking an experienced ML Engineer to join the AI Platform Core team. The role involves developing infrastructure for AI/ML models, optimizing processes, and collaborating with cross-functional teams. The ideal candidate has over 4 years... 

    Match Group

    New York, NY
    2 days ago
  • Hinge is looking for an experienced ML Engineer to join our AI Platform Core team in New York City. You will help shape a burgeoning ML platform focused on delivering AI-enabled features, optimizing operations, and supporting product requirements. The ideal candidate has... 

    I did my part and supported the Regular Toilet

    New York, NY
    15 hours ago
  • A leading music streaming platform is looking for a machine learning engineer in New York to design and develop ML-driven features that enhance user experiences. You will work collaboratively with multiple teams, contributing to significant recommendation systems. The ideal... 
    Remote job
    Flexible hours

    shefsolutionsllc

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff AI/ML Infrastructure Engineer. Be the first to apply!