AI Infrastructure Engineer
$150k - $200kvCluster
AI Infrastructure Specialist
As vCluster’s AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production‑ready deployment. This is not a traditional professional services role; you operate pre‑sale as part of a proof‑of‑value engagement scoped to reach production. You will be one of the first team members an AI Factory engages with at a technical depth, and the playbooks you develop will scale the motion for the next hire and customer.
vCluster is gaining rapid traction with GPU AI Clouds and enterprises building AI Factories: organizations that need to offer Kubernetes as a managed service on bare metal GPU infrastructure, and need to do it fast. This role exists to make that happen.
Responsibilities
- Lead Technical Deployments: Drive end‑to‑end technical deployments for GPU neocloud and AI Factory customers, from initial bare metal configuration to a validated vCluster environment.
- Infrastructure Optimization: Configure and troubleshoot bare metal GPU node infrastructure, including CNI configuration, GPU Operator setup, distributed storage backends, and RDMA/InfiniBand.
- Validation: Deploy and validate Kubernetes and vCluster to provide GPU‑powered managed K8s.
- Knowledge Transfer: Work alongside customer teams to build self‑sufficiency, ensuring they can operate and grow the platform independently.
- Scaling through Documentation: Document reusable playbooks and deployment architectures so your learnings become the next customer’s head start.
- Feedback Loop: Collaborate with Engineering and Product to surface recurring infrastructure challenges, acting as a direct feedback loop from the field into the roadmap.
- Strategic Partnering: Join Sales in the pre‑sales process where deep infrastructure work is required to achieve a meaningful proof of value.
Qualifications
- Production K8s Mastery: 5+ years of experience deploying and operating Kubernetes in production, ideally on bare metal or in high‑complexity environments.
- GPU Fluency: Practical knowledge of NVIDIA GPU Operators, CUDA tooling, and systems‑level configuration for GPU nodes.
- Networking Fundamentals: Deep understanding of CNI plugins, overlay networks, load balancing, and connectivity diagnosis in layered environments.
- Storage Expertise: Experience with persistent volume configuration, CSI drivers, and distributed systems such as Ceph, Rook, Weka, or Longhorn.
- Operational Agility: Comfort operating in ambiguous, fast‑moving environments where you are often writing the playbook in real time.
- Modern Tech Mindset: Thrive in environments that reject legacy tech and prefer a modern stack where you can solve a variety of problems from pipelines to internal services.
Bonus Points
- Automation Skills: Experience writing automation scripts with Bash, Python, or Go.
- Kubernetes Depth: Relevant certifications such as CKA or experience writing Kubernetes Operators.
- AI/ML Familiarity: Experience with inference serving, GPU scheduling, and the tooling around LLM deployment.
- Documentation: Experience building AI Automation in documentation to contribute to a shared knowledge base.
About vCluster Labs
We are a venture‑backed tech startup striving to be the leading force in enabling platform engineers. We raised +$30M from top‑tier VCs such as Khosla Ventures and are in a hyper‑growth phase looking for motivated people to complement our team. Our headquarters are in San Francisco (Salesforce Tower), but our team is distributed around the globe and we have a remote‑first work culture. We’re the company behind vCluster, an open‑source technology for virtualizing Kubernetes (10k+ GitHub stars). The adoption of our commercial product based on vCluster has grown extremely fast (multi‑million dollar revenue), and our customer base includes some of the biggest companies in the world, including 6 Global Fortune 500 companies as well as some of the fastest‑growing tech unicorns.
Benefits
- Competitive Salary: We offer a competitive compensation package, including equity.
- Platinum‑Level Insurance: Health, dental, vision, and life insurance, including plans for you and eligible dependents (benefits vary depending on country).
- Flexible Working Schedule: You can work around life commitments; results matter more than clocking in on a fixed schedule.
- Workplace Flexibility: We’re very flexible about where you work. We know things can change in life and we’re happy to adjust the work environment for you along the way.
Culture & Values
- Open Source, Open Mind: We actively contribute to and maintain open‑source projects, fostering meritocracy internally.
- Build Tomorrow’s Standards, Intentionally: We define state‑of‑the‑art standards, tearing down old approaches to create better solutions while remaining disciplined.
- Create Wow: We measure success by the experience we generate for customers and for our team, continuously striving to support one another and push toward new heights.
- Own the Outcome: Responsibility ends when value is delivered, connecting daily actions to broader company and customer success.
Compensation Range: $150K - $200K
#J-18808-Ljbffr$60 per hour
A growing AI development company is seeking proficient programmers to contribute to cutting-edge AI systems. This fully remote role allows flexibility in choosing projects and working hours, with competitive pay up to $60 per hour based on performance. Responsibilities...SuggestedHourly payRemote work$314.8k - $359.3k
Capital One is seeking a Senior Distinguished Engineer, AI Compute to lead the architectural design and implementation of a scalable machine learning platform. The role involves working on distributed systems, developing solutions using Ray and Spark, and collaborating...SuggestedRemote work$75 - $90 per hour
A global staffing organization is seeking a Senior AI Platform Engineer to enhance development workflows with agentic AI capabilities. This role involves improving unit tests and building MCP servers in support of CI/CD pipelines. Candidates should have expertise in agentic...SuggestedHourly payRemote work$150k - $180k
...expertise, scale, and technology. Job Description Senior AI Platform Engineer Locations : San Francisco, CA / Jacksonville, FL /... ..., ensuring it seamlessly integrates with our big data infrastructure, and enabling scalable, intelligent, and autonomous data-...SuggestedOngoing contractCasual workFlexible hours$200k - $325k
...Job Description We are building an AI Engineering function to enable productivity and agentic capabilities across the firm, for end... ...Engineering, AI Integration/Application teams, and core infrastructure groups. Responsibilities Platform Infrastructure...SuggestedWork at officeLocal area$143.19k - $194.47k
...their own family and become part of a community that values its people and empowers you to make an impact. Position: GCP AI Engineer - Cambridge, MA Position Summary: Lead the design, development, and deployment of AI solutions on Google Cloud that elevate...Full time3 days per week$314.8k - $359.3k
...Sr. Distinguished AI Engineer (Agentic AI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems... ...customer experiences. Our investments in technology infrastructure and world-class talent - along with our deep experience in machine...Full timePart timeWork at officeLocal area- A leading AI company is seeking a Senior Software Engineer to join their Boston team. In this role, you'll design and develop scalable software applications employing foundational LLMs. Ideal candidates will have over 5 years of Python experience alongside a strong background...Remote workRelocationFlexible hours
- A real estate firm in Boston seeks a Solutions Engineer to design and maintain technology systems. You will support business initiatives using Microsoft technologies like Azure and Microsoft 365, ensuring reliability and security. The ideal candidate has over 5 years of...
$150k - $210k
...empowers members to perform at a higher level and live longer by using AI to transform continuous physiological data into clear insights... ...members can act on every day. WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence layer behind WHOOP’s AI-powered...Full timeWork at officeRelocation$120.12k - $214.5k
...leading healthcare technology organization is seeking a lead AI/ML Engineer to enhance patient care through innovative AI systems. This... ...ideal candidate will have significant experience with cloud infrastructure and AI tools. The salary ranges from $120,118 to $214,496 annually...Remote work$188k - $282k
...Senior Principal Ai Engineer We are seeking a unique individual with a passion for data and AI technology who can help our team drive forward enterprise-scale AI adoption of our data & AI platform. Vertex Pharmaceuticals is in a transformational period where we are...Summer work$145k - $165k
...secures cloud email and cloud platforms using AI. Check Point is seeking a promising and talented Production AI Engineer to join our Production and DevOps group.... .... Continuously improve our cloud infrastructure to ensure fault tolerance, scalability, and...Temporary work- A leading insurance company located in Boston, Massachusetts, is seeking an AI Engineer to design innovative AI systems. The successful candidate will develop applications powered by large language models and work closely with various teams to enhance operational efficiency...
- A leading global professional services company is seeking a seasoned expert to lead cloud and AI offerings. This role involves defining strategy, establishing architectural standards, and packaging solutions for sales activation. The ideal candidate should possess over...
$144k - $270k
Your Impact at LILA We are seeking a Senior Software Engineer to join our Applied AI group and help build the next generation of our AI-driven... ...-latency AI retrieval and inference workloads. Cloud & Infrastructure: Leverage AWS, Kubernetes, and infrastructure-as-code (...Full timeWork at officeLocal areaFlexible hours$125k - $180k
...Customer Success Manager in Boston, MA to drive customer onboarding and application adoption. This role demands a strong understanding of AI platforms and the ability to connect with both technical and business stakeholders. Candidates should have over 5 years of relevant...$135k - $220k
Plymouth Rock Assurance in Boston, MA is seeking a skilled AI Engineer responsible for designing and building Generative and Agentic AI systems. The ideal candidate will have over 5 years of software engineering experience and strong proficiency in Python. Responsibilities...- Red Hat is looking for a Senior Performance Engineer in Boston to join the Performance and Scale Engineering team. This role focuses on enhancing performance and scalability for AI workloads, particularly with Large Language Models (LLMs). Candidates should have over 5...
- Ascensus is looking for associates to join their AI Technology team in Boston, Massachusetts. Multiple positions are available from... ...improving AI systems performance. The role involves collaboration with engineers, user training, and debugging technical issues. Candidates...Remote job
- RapidWorks is looking for a GTM Engineer to build and ship internal AI tools aimed at enhancing efficiency in Sales, CS, and Marketing teams. The ideal candidate will own each tool from conception to production, ensuring robust data pipelines and user adoption. Familiarity...
- Harley Ellis Devereaux (HED) is seeking an AI Platform Developer in Boston, MA to design and maintain AI systems that integrate with... .... The ideal candidate will have 5+ years of software and data engineering experience, expertise in Python, and knowledge of AI deployment...
$60 per hour
...A leading AI development firm is hiring programmers to advance AI technologies. Candidates can work remotely and choose their projects and schedules. Responsibilities include solving coding problems for AI systems, writing code, and evaluating AI-generated outputs. A...Remote work$60 per hour
A leading AI development company is seeking proficient programmers to join remote work in developing cutting-edge AI systems. You'll design diverse coding problems for AI training, write clear code, and evaluate AI outputs. The role suits both full-time professionals and...Full timeRemote work- Physical Superintelligence in Boston is seeking engineers to develop platform infrastructure combining AI and computational science. The role focuses on applying machine learning to real-world physics challenges, requiring five or more years of production experience, strong...
$230k - $270k
LangChain is seeking a Principal/Lead Software Engineer based in Boston to drive the technical direction of their core platform. You will lead architectural decisions, mentor engineers, and ensure system reliability across their full stack. With 10+ years of experience...Flexible hours- A leading financial institution is seeking a Lead AI Engineer to develop advanced AI solutions that will revolutionize customer interactions and internal processes. You will collaborate with a cross-functional team, leveraging cutting-edge technologies like AI and machine...
$166.64k - $250k
A leading biotechnology company in Boston is seeking a Principal Engineer for AI Authoring. This pivotal role involves designing and optimizing AI-driven content generation systems and ensuring compliance with industry standards. The ideal candidate has over 8 years of...- CVS Health is seeking a Senior Manager for AI LaunchPad to drive the AI platform's strategy, architecture, and delivery. This hybrid role requires leadership of AI and software engineers and collaboration across product and business teams. Ideal candidates will have over...
$250k - $330k
Blitzy is seeking a Director of Engineering in Cambridge, MA, to lead engineering teams driving the development of its AI software platform. This hands-on leadership role involves managing Principal and Senior Engineers while ensuring the delivery of high-quality software...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!
- machine learning ai engineer Boston, MA
- senior ai engineer Boston, MA
- ai engineer remote Boston, MA
- ai ml engineer Boston, MA
- ai engineer Boston, MA
- ai developer Boston, MA
- ai prompt engineer Boston, MA
- data infrastructure engineer Boston, MA
- infrastructure engineering manager Boston, MA
- remote infrastructure engineer Boston, MA

