Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

$150k - $200k

vCluster

AI Infrastructure Specialist

As vCluster’s AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production‑ready deployment. This is not a traditional professional services role; you operate pre‑sale as part of a proof‑of‑value engagement scoped to reach production. You will be one of the first team members an AI Factory engages with at a technical depth, and the playbooks you develop will scale the motion for the next hire and customer.

vCluster is gaining rapid traction with GPU AI Clouds and enterprises building AI Factories: organizations that need to offer Kubernetes as a managed service on bare metal GPU infrastructure, and need to do it fast. This role exists to make that happen.

Responsibilities
  • Lead Technical Deployments: Drive end‑to‑end technical deployments for GPU neocloud and AI Factory customers, from initial bare metal configuration to a validated vCluster environment.
  • Infrastructure Optimization: Configure and troubleshoot bare metal GPU node infrastructure, including CNI configuration, GPU Operator setup, distributed storage backends, and RDMA/InfiniBand.
  • Validation: Deploy and validate Kubernetes and vCluster to provide GPU‑powered managed K8s.
  • Knowledge Transfer: Work alongside customer teams to build self‑sufficiency, ensuring they can operate and grow the platform independently.
  • Scaling through Documentation: Document reusable playbooks and deployment architectures so your learnings become the next customer’s head start.
  • Feedback Loop: Collaborate with Engineering and Product to surface recurring infrastructure challenges, acting as a direct feedback loop from the field into the roadmap.
  • Strategic Partnering: Join Sales in the pre‑sales process where deep infrastructure work is required to achieve a meaningful proof of value.
Qualifications
  • Production K8s Mastery: 5+ years of experience deploying and operating Kubernetes in production, ideally on bare metal or in high‑complexity environments.
  • GPU Fluency: Practical knowledge of NVIDIA GPU Operators, CUDA tooling, and systems‑level configuration for GPU nodes.
  • Networking Fundamentals: Deep understanding of CNI plugins, overlay networks, load balancing, and connectivity diagnosis in layered environments.
  • Storage Expertise: Experience with persistent volume configuration, CSI drivers, and distributed systems such as Ceph, Rook, Weka, or Longhorn.
  • Operational Agility: Comfort operating in ambiguous, fast‑moving environments where you are often writing the playbook in real time.
  • Modern Tech Mindset: Thrive in environments that reject legacy tech and prefer a modern stack where you can solve a variety of problems from pipelines to internal services.
Bonus Points
  • Automation Skills: Experience writing automation scripts with Bash, Python, or Go.
  • Kubernetes Depth: Relevant certifications such as CKA or experience writing Kubernetes Operators.
  • AI/ML Familiarity: Experience with inference serving, GPU scheduling, and the tooling around LLM deployment.
  • Documentation: Experience building AI Automation in documentation to contribute to a shared knowledge base.
About vCluster Labs

We are a venture‑backed tech startup striving to be the leading force in enabling platform engineers. We raised +$30M from top‑tier VCs such as Khosla Ventures and are in a hyper‑growth phase looking for motivated people to complement our team. Our headquarters are in San Francisco (Salesforce Tower), but our team is distributed around the globe and we have a remote‑first work culture. We’re the company behind vCluster, an open‑source technology for virtualizing Kubernetes (10k+ GitHub stars). The adoption of our commercial product based on vCluster has grown extremely fast (multi‑million dollar revenue), and our customer base includes some of the biggest companies in the world, including 6 Global Fortune 500 companies as well as some of the fastest‑growing tech unicorns.

Benefits
  • Competitive Salary: We offer a competitive compensation package, including equity.
  • Platinum‑Level Insurance: Health, dental, vision, and life insurance, including plans for you and eligible dependents (benefits vary depending on country).
  • Flexible Working Schedule: You can work around life commitments; results matter more than clocking in on a fixed schedule.
  • Workplace Flexibility: We’re very flexible about where you work. We know things can change in life and we’re happy to adjust the work environment for you along the way.
Culture & Values
  • Open Source, Open Mind: We actively contribute to and maintain open‑source projects, fostering meritocracy internally.
  • Build Tomorrow’s Standards, Intentionally: We define state‑of‑the‑art standards, tearing down old approaches to create better solutions while remaining disciplined.
  • Create Wow: We measure success by the experience we generate for customers and for our team, continuously striving to support one another and push toward new heights.
  • Own the Outcome: Responsibility ends when value is delivered, connecting daily actions to broader company and customer success.

Compensation Range: $150K - $200K

#J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Boston, MA vacancy
  • $60 per hour

    A growing AI development company is seeking proficient programmers to contribute to cutting-edge AI systems. This fully remote role allows flexibility in choosing projects and working hours, with competitive pay up to $60 per hour based on performance. Responsibilities... 
    Suggested
    Hourly pay
    Remote work

    DataAnnotation

    Boston, MA
    4 days ago
  • $314.8k - $359.3k

    Capital One is seeking a Senior Distinguished Engineer, AI Compute to lead the architectural design and implementation of a scalable machine learning platform. The role involves working on distributed systems, developing solutions using Ray and Spark, and collaborating... 
    Suggested
    Remote work

    Capital One

    Cambridge, MA
    9 days ago
  • $75 - $90 per hour

    A global staffing organization is seeking a Senior AI Platform Engineer to enhance development workflows with agentic AI capabilities. This role involves improving unit tests and building MCP servers in support of CI/CD pipelines. Candidates should have expertise in agentic... 
    Suggested
    Hourly pay
    Remote work

    Yoh, A Day & Zimmermann Company

    Boston, MA
    9 days ago
  • $150k - $180k

     ...expertise, scale, and technology. Job Description Senior AI Platform Engineer Locations : San Francisco, CA / Jacksonville, FL /...  ..., ensuring it seamlessly integrates with our big data infrastructure, and enabling scalable, intelligent, and autonomous data-... 
    Suggested
    Ongoing contract
    Casual work
    Flexible hours

    SS&C Technologies

    Boston, MA
    1 day ago
  • $200k - $325k

     ...Job Description We are building an AI Engineering function to enable productivity and agentic capabilities across the firm, for end...  ...Engineering, AI Integration/Application teams, and core infrastructure groups. Responsibilities Platform Infrastructure... 
    Suggested
    Work at office
    Local area

    Arrowstreet Capital

    Boston, MA
    4 days ago
  • $143.19k - $194.47k

     ...their own family and become part of a community that values its people and empowers you to make an impact. Position: GCP AI Engineer - Cambridge, MA Position Summary: Lead the design, development, and deployment of AI solutions on Google Cloud that elevate... 
    Full time
    3 days per week

    Lumeris

    Cambridge, MA
    3 days ago
  • $314.8k - $359.3k

     ...Sr. Distinguished AI Engineer (Agentic AI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems...  ...customer experiences. Our investments in technology infrastructure and world-class talent - along with our deep experience in machine... 
    Full time
    Part time
    Work at office
    Local area

    Capital One

    Cambridge, MA
    3 days ago
  • A leading AI company is seeking a Senior Software Engineer to join their Boston team. In this role, you'll design and develop scalable software applications employing foundational LLMs. Ideal candidates will have over 5 years of Python experience alongside a strong background... 
    Remote work
    Relocation
    Flexible hours

    Liberate

    Boston, MA
    1 day ago
  • A real estate firm in Boston seeks a Solutions Engineer to design and maintain technology systems. You will support business initiatives using Microsoft technologies like Azure and Microsoft 365, ensuring reliability and security. The ideal candidate has over 5 years of... 

    TA Realty LLC

    Boston, MA
    17 hours ago
  • $150k - $210k

     ...empowers members to perform at a higher level and live longer by using AI to transform continuous physiological data into clear insights...  ...members can act on every day. WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence layer behind WHOOP’s AI-powered... 
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    1 day ago
  • $120.12k - $214.5k

     ...leading healthcare technology organization is seeking a lead AI/ML Engineer to enhance patient care through innovative AI systems. This...  ...ideal candidate will have significant experience with cloud infrastructure and AI tools. The salary ranges from $120,118 to $214,496 annually... 
    Remote work

    UnitedHealth Group

    Boston, MA
    2 days ago
  • $188k - $282k

     ...Senior Principal Ai Engineer We are seeking a unique individual with a passion for data and AI technology who can help our team drive forward enterprise-scale AI adoption of our data & AI platform. Vertex Pharmaceuticals is in a transformational period where we are... 
    Summer work

    Ver-Tex

    Boston, MA
    1 day ago
  • $145k - $165k

     ...secures cloud email and cloud platforms using AI. Check Point is seeking a promising and talented Production AI Engineer to join our Production and DevOps group....  .... Continuously improve our cloud infrastructure to ensure fault tolerance, scalability, and... 
    Temporary work

    Checkpoint Software

    Boston, MA
    3 days ago
  • A leading insurance company located in Boston, Massachusetts, is seeking an AI Engineer to design innovative AI systems. The successful candidate will develop applications powered by large language models and work closely with various teams to enhance operational efficiency... 

    Plymouth Rock Assurance

    Boston, MA
    17 hours ago
  • A leading global professional services company is seeking a seasoned expert to lead cloud and AI offerings. This role involves defining strategy, establishing architectural standards, and packaging solutions for sales activation. The ideal candidate should possess over... 

    Accenture

    Boston, MA
    1 day ago
  • $144k - $270k

    Your Impact at LILA We are seeking a Senior Software Engineer to join our Applied AI group and help build the next generation of our AI-driven...  ...-latency AI retrieval and inference workloads. Cloud & Infrastructure: Leverage AWS, Kubernetes, and infrastructure-as-code (... 
    Full time
    Work at office
    Local area
    Flexible hours

    Dormont Manufacturing Co

    Cambridge, MA
    17 hours ago
  • $125k - $180k

     ...Customer Success Manager in Boston, MA to drive customer onboarding and application adoption. This role demands a strong understanding of AI platforms and the ability to connect with both technical and business stakeholders. Candidates should have over 5 years of relevant... 

    DataRobot

    Boston, MA
    4 days ago
  • $135k - $220k

    Plymouth Rock Assurance in Boston, MA is seeking a skilled AI Engineer responsible for designing and building Generative and Agentic AI systems. The ideal candidate will have over 5 years of software engineering experience and strong proficiency in Python. Responsibilities... 

    Plymouth Rock Assurance

    Boston, MA
    3 days ago
  • Red Hat is looking for a Senior Performance Engineer in Boston to join the Performance and Scale Engineering team. This role focuses on enhancing performance and scalability for AI workloads, particularly with Large Language Models (LLMs). Candidates should have over 5... 

    Red Hat

    Boston, MA
    3 days ago
  • Ascensus is looking for associates to join their AI Technology team in Boston, Massachusetts. Multiple positions are available from...  ...improving AI systems performance. The role involves collaboration with engineers, user training, and debugging technical issues. Candidates... 
    Remote job

    Ascensus

    Boston, MA
    1 day ago
  • RapidWorks is looking for a GTM Engineer to build and ship internal AI tools aimed at enhancing efficiency in Sales, CS, and Marketing teams. The ideal candidate will own each tool from conception to production, ensuring robust data pipelines and user adoption. Familiarity... 

    RapidWorks

    Boston, MA
    3 days ago
  • Harley Ellis Devereaux (HED) is seeking an AI Platform Developer in Boston, MA to design and maintain AI systems that integrate with...  .... The ideal candidate will have 5+ years of software and data engineering experience, expertise in Python, and knowledge of AI deployment... 

    Harley Ellis Devereaux (HED)

    Boston, MA
    3 days ago
  • $60 per hour

     ...A leading AI development firm is hiring programmers to advance AI technologies. Candidates can work remotely and choose their projects and schedules. Responsibilities include solving coding problems for AI systems, writing code, and evaluating AI-generated outputs. A... 
    Remote work

    DataAnnotation

    Boston, MA
    3 days ago
  • $60 per hour

    A leading AI development company is seeking proficient programmers to join remote work in developing cutting-edge AI systems. You'll design diverse coding problems for AI training, write clear code, and evaluate AI outputs. The role suits both full-time professionals and... 
    Full time
    Remote work

    DataAnnotation

    Boston, MA
    4 days ago
  • Physical Superintelligence in Boston is seeking engineers to develop platform infrastructure combining AI and computational science. The role focuses on applying machine learning to real-world physics challenges, requiring five or more years of production experience, strong... 

    Physical Superintelligence

    Boston, MA
    4 days ago
  • $230k - $270k

    LangChain is seeking a Principal/Lead Software Engineer based in Boston to drive the technical direction of their core platform. You will lead architectural decisions, mentor engineers, and ensure system reliability across their full stack. With 10+ years of experience... 
    Flexible hours

    LangChain

    Boston, MA
    2 days ago
  • A leading financial institution is seeking a Lead AI Engineer to develop advanced AI solutions that will revolutionize customer interactions and internal processes. You will collaborate with a cross-functional team, leveraging cutting-edge technologies like AI and machine... 

    Capital One National Association

    Cambridge, MA
    4 days ago
  • $166.64k - $250k

    A leading biotechnology company in Boston is seeking a Principal Engineer for AI Authoring. This pivotal role involves designing and optimizing AI-driven content generation systems and ensuring compliance with industry standards. The ideal candidate has over 8 years of... 

    Vertex Pharmaceuticals

    Boston, MA
    17 hours ago
  • CVS Health is seeking a Senior Manager for AI LaunchPad to drive the AI platform's strategy, architecture, and delivery. This hybrid role requires leadership of AI and software engineers and collaboration across product and business teams. Ideal candidates will have over... 

    Stryker Corporation

    Boston, MA
    3 days ago
  • $250k - $330k

    Blitzy is seeking a Director of Engineering in Cambridge, MA, to lead engineering teams driving the development of its AI software platform. This hands-on leadership role involves managing Principal and Senior Engineers while ensuring the delivery of high-quality software... 

    Blitzy

    Cambridge, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!