Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

vCluster

As vCluster’s AI Infrastructure Engineer, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready deployment. This is not a traditional professional services role; you operate pre-sale as part of a proof of value engagement scoped to reach production. You will be one of the first team members a neocloud or AI Factory engages with at a technical depth, and the playbooks you develop will scale the motion for the next hire and customer. vCluster is gaining rapid traction with GPU AI Clouds and enterprises building AI Factories: organizations that need to offer Kubernetes as a managed service on bare metal GPU infrastructure, and need to do it fast. This role exists to make that happen. As an AI Infrastructure Engineer, your role will include: Lead Technical Deployments: Drive end-to-end technical deployments for GPU neocloud and AI Factory customers, from initial bare metal configuration to a validated vCluster environment. Infrastructure Optimization: Configure and troubleshoot bare metal GPU node infrastructure, including CNI configuration, GPU Operator setup, distributed storage backends, and RDMA/InfiniBand. Validation: Deploy and validate Kubernetes and vCluster to provide GPU-powered managed K8s. Knowledge Transfer: Work alongside customer teams to build self-sufficiency, ensuring they can operate and grow the platform independently. Scaling through Documentation: Document reusable playbooks and deployment architectures so your learnings become the next customer's head start. Feedback Loop: Collaborate with Engineering and Product to surface recurring infrastructure challenges, acting as a direct feedback loop from the field into the roadmap. Strategic Partnering: Join Sales in the pre-sales process where deep infrastructure work is required to achieve a meaningful proof of value. This role could be a fit for you if you bring: Production K8s Mastery: 5+ years of experience deploying and operating Kubernetes in production, ideally on bare metal or in high-complexity environments. GPU Fluency: Practical knowledge of NVIDIA GPU Operators, CUDA tooling, and systems-level configuration for GPU nodes. Networking Fundamentals: Deep understanding of CNI plugins, overlay networks, load balancing, and connectivity diagnosis in layered environments. Storage Expertise: Experience with persistent volume configuration, CSI drivers, and distributed systems like Ceph, Rook, Weka, or Longhorn. Operational Agility: Comfort operating in ambiguous, fast-moving environments where you are often writing the playbook in real time. Modern Tech Mindset: You thrive in environments that reject legacy tech and prefer a modern stack where you can solve a variety of problems from pipelines to internal services. Automation Skills: Experience writing automation scripts with Bash, Python, or Go. Kubernetes Depth: Relevant certifications such as CKA (Certified Kubernetes Administrator) or experience writing Kubernetes Operators. AI/ML Familiarity: Experience with inference serving, GPU scheduling, and the tooling around LLM deployment. Documentation: Experience building AI Automation in documentation to contribute to a shared knowledge base. About VCluster Labs We are a venture-backed tech startup striving to be the leading force in enabling platform engineers. We raised +$30M from top-tier VCs such as Khosla Ventures (first investor in OpenAI, GitLab, Stripe, Doordash) and are in a hyper‑growth phase looking for motivated people to complement our team. Our headquarters are in San Francisco (Salesforce Tower), but our team is distributed around the globe and we have a remote‑first work culture . We're the company behind vCluster, an open‑source technology for virtualizing Kubernetes (+10k GitHub stars). Open source is part of our DNA. The adoption of our commercial product based on vCluster has grown extremely fast (multi‑million dollar revenue) and our customer base includes some of the biggest companies in the world, including 6 Global Fortune 500 companies as well as some of the fastest‑growing tech unicorns. We offer the following benefits: Competitive Salary: We offer a competitive compensation package, including equity. Platinum‑Level Insurance: Health, dental, vision, and life Insurance, including plans for you and eligible dependents (benefits vary depending on country). Flexible Working Schedule: You have a doctor’s appointment or need to head to the supermarket to get groceries at 2pm? We won’t have an issue with that. To us, results matter more than clocking in and out at the same time every day. Workplace Flexibility: We’re very flexible about where you work. We know things can change in life and we’re happy to adjust the work environment for you along the way. Culture & Values At vCluster Labs, we value and stand for: Open Source, Open Mind: We are actively contributing to and maintaining open‑source projects. Internally, we foster meritocracy — the strongest ideas win, no matter who or where they come from. Build Tomorrow’s Standards, Intentionally: We don't just ship software; we define the state‑of‑the‑art of tomorrow. We are fearless in tearing down old approaches to build something better, but we are disciplined in how we do it because we know our users rely on our technology to run mission‑critical infrastructure platforms. Create Wow: We measure success by the experience we generate, both inside and outside the company. For our customers, this means impressive speed and intuitive experiences. For our team, this means going the extra mile to support one another and to continuously drive each other to new heights. Own the Outcome: We understand that our responsibility doesn't end when a task is checked off; it ends when the value is delivered. We connect our daily individual actions to the broader success of the company and our customers. #J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in New York, NY vacancy
  •  ...HTEC Group is hiring for a software development position focused on next-generation AI compute platforms. You will design and implement software components across various stacks while collaborating with compiler developers and ML scientists. Candidates should have at... 
    Suggested

    HTEC Group Inc

    New York, NY
    2 days ago
  •  ...transform critical institutions with applied AI. We care that industries that power the...  ...bring: Forward-deployed expertise in engineering, product, and research Mosaic, our in...  ...About the role We're hiring an AI Infrastructure Engineer to own the infrastructure,... 
    Suggested
    Contract work

    Percepta

    New York, NY
    1 day ago
  • $170k - $210k

     ...Utilidata is a fast‑growing NVIDIA‑backed AI company enabling AI data centers to...  ...more compute capacity from existing energy infrastructure. For over a decade, we have applied AI to...  ...to them. The AI Infrastructure Engineer is responsible for designing, building,... 
    Suggested
    Local area
    Remote work
    Flexible hours

    Utilidata

    New York, NY
    2 days ago
  • $200k - $250k

     ...AI Infrastructure Engineer Chicago, New York Jump Trading Group is committed to world class research. We empower exceptional talent across the mathematical and computational sciences to push past scientific boundaries and apply cutting edge research to global financial... 
    Suggested

    Jump Trading

    New York, NY
    4 days ago
  • $60 per hour

    A technology company seeks proficient programmers to contribute to AI development. This remote role offers flexible scheduling, allowing you to select projects that fit your availability. Applicants should be fluent in English and possess coding skills in languages like... 
    Suggested
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    8 hours ago
  •  ...A leading U.S. technology firm is hiring an AI Infrastructure Engineer for a full-time remote position with H-1B visa sponsorship available. This role involves designing and optimizing AI platforms, deploying Kubernetes and Docker container environments, and enhancing... 
    Full time
    H1b
    Remote work
    Visa sponsorship

    NewsNowGh

    New York, NY
    2 days ago
  •  ...Tribe is seeking an experienced engineer to deploy AI systems in Fortune 500 enterprises. You will work hands-on with cloud platforms such as AWS, GCP, or Azure and have strong Kubernetes experience. This role demands deep production debugging skills and the ability to... 
    Remote work

    Tribe

    New York, NY
    2 days ago
  • $180k - $210k

     ...AI Infrastructure Engineer Location: New York, NY (Hybrid) Pay: $180k - $210k Base + Bonus Overview This role sits within a highly technical investment and technologydriven organisation operating at the intersection of advanced data, engineering and artificial... 

    Harnham

    New York, NY
    4 days ago
  •  ...Founders Fund–backed NVIDIA cloud partner building the infrastructure platform that powers AI at scale. We connect AI Factories—high-performance GPU...  ...onboarding. Your job is to change that. As an AI Infrastructure Engineer, you'll work directly with AI platform customers to get... 
    Remote work

    Slope

    New York, NY
    2 days ago
  •  ...TetraScience is the Scientific Data and AI company. We are catalyzing the Scientific...  ...players in compute, cloud, data, and AI infrastructure have converged on TetraScience as the de...  ...We’re looking for a Senior AI Platform Engineer to help design, build, and scale our AI... 
    Immediate start
    Remote work
    Flexible hours

    TetraScience

    New York, NY
    2 days ago
  • $165k - $200k

     ...AI Infrastructure Engineer New York, New York We see the world differently at Capstone Investment Advisors. You will, too. Capstone Investment Advisors, LLC ("Capstone") is a global asset manager, dedicated to exploring alpha opportunities in derivatives and... 
    Minimum wage

    Capstone Investment Advisors

    New York, NY
    1 day ago
  •  ...we partner with a global logistics company leveraging AI, Machine Learning, and Data Engineering to optimize warehouse operations, predictive...  ...route planning. Role: Build and maintain scalable AI infrastructure, enabling teams to run ML experiments, deploy machine... 
    Long term contract
    Remote work

    Sphere Software

    New York, NY
    2 days ago
  •  ...A cutting-edge tech company is seeking a Customer Engineer to bridge technical expertise and sales acumen. The role involves providing technical guidance, leading demonstrations, and cultivating relationships with clients. Candidates should possess a Bachelor's degree... 
    Remote work

    Armada

    New York, NY
    2 days ago
  •  ...A technology development company in the United States is seeking an experienced AI Engineer. The role involves developing advanced AI and machine learning solutions with technologies such as Python, TensorFlow, and cloud platforms like AWS. Candidates should have 3-5 years... 
    Full time
    Remote work

    Atexo

    New York, NY
    2 days ago
  • $60 - $70 per hour

     ...Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large... 
    Remote work

    The Leadership Agency Inc.

    New York, NY
    2 days ago
  •  ...Lead Software Engineer We have an opportunity to impact your career and provide an adventure...  .... This role requires a strong AI-forward mindset. We are looking for engineers...  ...~ Strong experience with Terraform and infrastructure-as-code principles ~ Solid... 

    Chase

    Jersey City, NJ
    3 days ago
  • A pioneering AI legal tech firm is seeking an Infrastructure Engineer to support its AI-driven platform. You will design and maintain distributed systems, ensuring stability and security while optimizing performance. The ideal candidate has extensive experience in backend... 

    Anytime AI Inc.

    New York, NY
    4 days ago
  •  ...NOVA Corporation seeks an AI Engineer to support the International Trade Administration's AI Center of Excellence. The role involves delivering AI solutions across the system lifecycle, focusing on model development, deployment, and optimization within secure federal IT... 
    Remote work

    Nova Usa

    New York, NY
    2 days ago
  •  ...is seeking a talented developer to join its Corellium team in Washington, DC. The role focuses on developing scalable, cloud-native AI solutions on AWS, including job orchestration and API integrations. Applicants should have proficiency in Python, Typescript, and hands... 

    Cellebrite

    New York, NY
    2 days ago
  •  ...A global technology firm is seeking a Senior AI Software Engineer to enhance cloud networking and AI products. In this role, you will deliver high-quality solutions to complex challenges, manage APIs in cloud-native environments, and mentor team members. The ideal candidate... 

    Solo.io, Inc.

    New York, NY
    2 days ago
  • A leading technology firm is seeking an experienced Infrastructure Engineer to build and maintain the platform layer for large-scale machine learning...  ...reliability and performance of infrastructure supporting AI systems. Candidates should have over 5 years of experience,... 

    Maxana

    New York, NY
    2 days ago
  •  ...Citrin-Cooperman Advisors LLC is seeking a Senior Cloud Engineer to be part of their AI Solutions team. This role focuses on the architecting, deployment, and management of AI infrastructure, requiring strong expertise in cloud engineering, security, and Infrastructure... 

    Citrin-Cooperman-Advisors-LLC

    New York, NY
    2 days ago
  •  ...customers in the initial adoption of the HPE PCAI Private Cloud AI product.* Project manage the customer and use case* Provide...  ...are transitioning to a secure, cloud-enabled, mobile-friendly infrastructure. Many rely on a combination of both. Wherever they are in that... 
    Local area

    Hewlett Packard Enterprise Development LP

    New York, NY
    2 days ago
  • $100k - $200k

     ...Nscale is seeking a Senior Network Engineer for AI Infrastructure to ensure the operational health of their high-speed interconnects. With 5+ years of experience in network engineering, you'll be responsible for maintaining and optimizing large-scale Infiniband and RoCE... 
    Remote work

    Nscale

    New York, NY
    2 days ago
  •  ...United Therapeutics Corporation is looking for a skilled software engineer to design and develop scalable web AI applications utilizing modern frameworks such as C# Blazor and Azure. The role requires collaboration with business stakeholders and expertise in cloud architecture... 

    United Therapeutics

    New York, NY
    2 days ago
  •  ...A global tech company is seeking an experienced professional to assist customers in adopting their Private Cloud AI product. The role involves managing customer projects, providing hands-on support, and conducting product training. Ideal candidates will have strong skills... 

    Hewlett Packard Enterprise Development LP

    New York, NY
    2 days ago
  •  ...We are seeking a highly skilled AI Infrastructure & Cloud Engineering Consultant to lead the adoption of AI-enabled operational practices across enterprise infrastructure environments. This role focuses on leveraging Generative AI and Infrastructure as Code (IaC) to improve... 
    Hourly pay
    Freelance

    Solomon Page

    New York, NY
    1 day ago
  •  ...NOVA Corporation is seeking a Low Code AI Engineer to support the International Trade Administration by developing and maintaining AI solutions. This role requires expertise in machine learning and cloud environments, with a focus on automating and deploying AI models.... 
    Remote work

    Nova Usa

    New York, NY
    2 days ago
  •  ...A technology investment firm is seeking an experienced Zero Knowledge engineer to join their team in the United States. The role entails researching, developing, and implementing cutting-edge zero-knowledge systems and algorithms to bring ZK products to a broad audience... 

    Panga Capital

    New York, NY
    2 days ago
  •  ...Principal Software Engineer If you are looking for a game-changing career, working for one of the world's leading financial institutions...  ..., design, development, and technical troubleshooting for AI-enabled applications. Creates complex and scalable coding frameworks... 
    Work experience placement
    Work at office

    Chase

    Jersey City, NJ
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!