Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Solution Architect - AI Infrastructure

$275k
Full-time

Looking for a role with plenty of growth opportunities?

Join an early-stage company building GPU compute infrastructure from the ground up. As one of the first technical hires, you'll help shape the company's core infrastructure while working directly with the founders in a high-ownership, hands-on environment.

This company is seeking a Senior Solutions Architect / Network Infrastructure Engineer to lead the design, deployment, and optimisation of GPU compute clusters across networking, software, and infrastructure. This customer-facing role combines hands-on engineering with technical leadership, including cluster architecture, fabric engineering, deployment, troubleshooting, and customer onboarding, while influencing the future direction of the platform.

Don’t miss out on this exciting opportunity and apply today!

Responsibilities:

  • Design compute, storage, and networking topology for new cluster deployments
  • Specify node configurations, redundancy, and scaling plans
  • Make real-time build decisions on-site during deployment, not just on paper
  • Bridge data center specifications to cluster deployment, including power whips and rack fit-out
  • Design and personally implement GPU interconnect fabric using InfiniBand and/or RoCEv2
  • Plan and validate bandwidth, topology, and east-west throughput at scale
  • Diagnose and fix network bottlenecks under load, hands-on rather than in theory
  • Get workloads running well across both CUDA and ROCm stacks
  • Own driver and firmware compatibility, NCCL/RCCL tuning, and performance benchmarking
  • Troubleshoot low-level issues directly across drivers, firmware, and fabric managers
  • Lead technical onboarding and workload validation for new customers
  • Act as the direct escalation point when a customer's cluster underperforms, diagnosing it yourself
  • Translate customer workload requirements into concrete infrastructure and configuration decisions
  • Document runbooks and SOPs that reflect how the infrastructure actually gets built and fixed

Skills/Must Have:

  • Direct, hands-on experience standing up GPU clusters at production scale, with specific clusters you built rather than systems you oversaw
  • Real InfiniBand or RoCEv2 design and implementation experience
  • Comfortable working across both CUDA and ROCm ecosystems, or clearly demonstrated ability to ramp fast on a new GPU vendor stack
  • Direct customer-facing technical experience, comfortable being the person a customer talks to when something's wrong
  • Genuine preference for staying hands-on over moving into pure management
  • Based in or willing to relocate to San Francisco (onsite)

Benefits:

  • Founding-level ownership and visibility
  • Direct access to and collaboration with the founders
  • Onsite role in San Francisco

Salary:

  • $275,000 Base Salary
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Solution Architect - AI Infrastructure in San Francisco, CA vacancy
  • $220k - $290k

     ...generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move...  ...build on. fal - Features & Labels, Inc. seeks a Senior Solutions Architect (multiple openings) for its San Francisco, CA... 
    Senior
    Full time
    Work at office

    fal

    San Francisco, CA
    1 day ago
  • Airbyte is the data and action layer for AI agents. We give agents fast, accurate...  ...." We're now building that context infrastructure for production-grade agents on the...  ...AI agents. The Role: As an Airbyte Senior Solutions Architect, you will have a unique opportunity to... 
    Senior
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    Airbyte

    San Francisco, CA
    1 day ago
  • Senior Principal Technical Solution Architect – Humanoid RoboticsLocation: California Bay Area PreferredPhysical AI is transforming how humans interact with intelligent machines. At Cerence...  ..., operating systems, SDKs, AI infrastructure, and deployment architectures.... 
    Senior
    Remote work

    Cerence Inc.

    San Francisco, CA
    17 hours ago
  • A pioneering AI technology firm in San Francisco is seeking a Pre-Sales Architect to lead technical discovery and solution design during the sales process. This role collaborates with Sales Directors and engineers to create compelling, feasible solutions for the mortgage... 
    Senior

    SAI Group Inc Defunct

    San Francisco, CA
    53 minutes ago
  • $163k - $220k

    A leading AI software provider is seeking a Senior Solution Consultant for the Finance Domain to support presales technical processes, working closely with finance executives. This role involves influencing finance leaders through advanced AI solutions, driving application... 
    Senior

    Anaplan

    San Francisco, CA
    37 minutes ago
  • $175k - $250k

     ...revolutionizing how developers handle complex data with their AI Powered solutions. With recent partnerships with tech giants, multi‑...  ...in touch today for more details and immediate interview! Seniority level Mid‑Senior level Employment type Full‑time... 
    Senior
    Full time
    Immediate start
    Remote work

    Strativ Group

    San Francisco, CA
    2 days ago
  • $180k - $230k

    About Sift Sift is the data infrastructure platform for hardware engineering teams. Sift turns...  ...building the data infrastructure to herald the AI era for physical systems. In This Role,...  ...scalable, resilient infrastructure solutions to support our growing platform and... 
    Senior
    Full time
    Work at office
    Relocation

    Sift Stack, Inc.

    San Francisco, CA
    10 hours ago
  •  ...A tech company specializing in AI infrastructure is seeking a Software Engineer to build a scalable compute platform for its generative video models. The ideal candidate will have over 5 years of experience in MLOps or AI infrastructure management, along with strong Python... 
    Senior

    HeyGen

    San Francisco, CA
    1 day ago
  • A leading AI research firm in San Francisco seeks a Staff Infrastructure Engineer to identify and resolve infrastructure bottlenecks and design large-scale systems for AI training. The ideal candidate has over 3 years of experience in infrastructure engineering and strong... 
    Senior

    Jobleads-US

    San Francisco, CA
    2 days ago
  • Grow Therapy in San Francisco is seeking a Senior AI Enablement Engineer to define how AI transforms operations across the organization. You will design and build foundational AI infrastructure that enhances efficiency. Responsibilities include implementing AI systems,... 
    Senior
    Flexible hours
    3 days per week

    Grow Therapy

    San Francisco, CA
    2 days ago
  •  ...Who We Are Serval is the AI platform for IT teams — replacing legacy systems like...  ...enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational...  ...performance bottlenecks, and implement effective solutions. Nice to Have Experience with... 
    Senior
    Full time

    Serval

    San Francisco, CA
    17 hours ago
  • $160k - $300k

     ...About Apiphany Apiphany is a pioneering foundational AI company for physical product development. We empower global innovators...  ...-defining company together. About the Role As a Senior / Staff Infrastructure Engineer at Apiphany, you’ll design, build, and operate the... 
    Senior
    Work at office
    Visa sponsorship
    Flexible hours

    Apiphany

    San Francisco, CA
    17 hours ago
  • $320k

     ...’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and...  ...beneficial AI systems. About the Role We're building the infrastructure that enables Claude to act in the world—booking travel, writing... 
    Senior
    Full time
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    17 hours ago
  • About Liquid AI Spun out of MIT CSAIL, we build general-purpose AI systems that run...  ...The Opportunity Liquid AI is building a solutions architecture function from scratch. You...  ..., mobile, embedded systems, and on-prem infrastructure where frontier models simply cannot run.... 

    Liquid AI

    San Francisco, CA
    1 day ago
  •  ...golden paths for developers and AI agents. By combining rich...  ...organizations operate. As a Solutions Architect (SA) at Port, you will serve...  ..., platform leads, and senior technical stakeholders Translate...  ...architecture, cloud‑native infrastructure, and modern DevOps practices... 
    Work at office
    Flexible hours
    3 days per week

    Port

    San Francisco, CA
    4 days ago
  • $176k - $301k

     ...the company: the company is the agentic infrastructure company. We free people and agents to...  .... As the team behind Next.js, v0, and AI SDK, we create products that help...  ...what comes next. About the Role: As a Solution Architect in the Field Engineering team, you will... 
    Work from home
    Worldwide
    Flexible hours

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  • Solutions Architect (9976) – Department of Technology Senior technical leader responsible for guiding the City’s technical...  ...including legacy platforms and City infrastructure (API gateway, cloud, and data...  ...integrations, and intelligent (AI‑enabled) solutions across the... 

    City and County of San Francisco

    San Francisco, CA
    50 minutes ago
  •  ...TL;DR - We’re looking for a Solutions Architect to bridge product depth with business outcomes...  ...and Engineering to drive adoption of AI-native software creation. Please note:...  ..., integrations, data flows, and cloud infrastructure Strong consultative selling skills – able... 
    Shift work

    Lovable

    San Francisco, CA
    2 days ago
  •  ...FuriosaAI is looking for a Solutions Architect to bring the full potential of our powerful RNGD...  ...as the primary technical authority in AI/LLM model deployments. From running POCs...  ...the current status-quo of AI infrastructure in real-world environments, join us in... 

    FuriosaAI, Inc.

    San Francisco, CA
    2 days ago
  •  ...engineering intelligence infrastructure for modern hardware...  ...workflows, and bring AI directly into the development...  ...looking for a Systems Architect to help our customers...  ..., design scalable solutions, and help them...  ...adoption Serve as the senior technical escalation point... 
    Work at office
    Remote work
    Flexible hours

    AllSpice, Inc.

    San Francisco, CA
    5 days ago
  • $70 - $125 per hour

     ...Solutions Architect Experience: Senior Level Salary: $70 - $125 per hour Job Details Seeking a Solutions Architect...  ...GCP environments. Stay current on AI-driven security capabilities and...  ..., segmentation) and cloud infrastructure security. Proven track record of managing... 
    Hourly pay
    Long term contract

    Leoforce

    San Francisco, CA
    2 days ago
  • $165k - $225k

     ...inference for the world's most dynamic AI companies, like Cursor, Notion,...  ...uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable...  ...to to ship AI products. THE ROLE As a Solution Architect at Baseten you will partner closely with... 
    Flexible hours

    Baseten

    San Francisco, CA
    4 days ago
  • $199k - $273.9k

     ...Secure Every Identity, from AI to Human Identity is the...  ...the trusted, neutral infrastructure that enables...  ...compliant, and innovative solutions to life, and we are actively architecting the next generation of AI...  ...automation goals. This is a senior, highly strategic role that... 
    Local area
    Worldwide
    Flexible hours

    Okta, Inc.

    San Francisco, CA
    4 days ago
  •  ...At Composio, we are building infrastructure that allows agents to communicate with the tools you...  ...pressure and defend them in front of senior engineers customer technical ownership -...  ...customer from first call to live deployment ai native you have built with language... 

    Composio

    San Francisco, CA
    2 days ago
  •  ...kind. We're searching for the architects of the audacious & the...  ...‘best practices,’ and build solutions that make the future possible...  ...the primary enabler of our AI ambitions. With a deep-seated...  ...build the foundational data infrastructure that powers the customers entire... 

    Searce

    San Francisco, CA
    1 day ago
  • $147k - $198k

     ...on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers...  ...'s build what's next - together! Anaplan is hiring a Senior Solution Architect - Supply Chain Applications. This is a business-critical... 
    Senior
    Remote work

    Anaplan

    South San Francisco, CA
    55 minutes ago
  • $140k - $225k

     ...Who We Are HP IQ is HP’s new AI innovation lab. Combining startup...  ...developing intuitive, adaptive solutions that spark creativity, boost productivity...  .... About The Role As the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    17 hours ago
  • $150k - $200k

     ...account strategy, VPC design, and workload segmentation as our infrastructure footprint grows Owning our firewalls, and edge security strategy...  ...detection, and SIEM strategy Setting the security bar for our AI products and AI‑adjacent developer tooling, in partnership with... 
    Senior
    Work at office
    Remote work

    Truebill

    San Francisco, CA
    3 days ago
  • About Interface.ai interface.ai is redefining how financial institutions...  ...Own the end‑to‑end solution design for assigned strategic...  ..., or equivalent), telephony infrastructure, and contact center stack — accounting...  ...in a dedicated Solutions Architect, principal engineer, or... 

    Interface

    San Francisco, CA
    17 hours ago
  • $165k - $220k

     ...| Reporting to: Commercial Director, AI&HPC | WorkLocation Type: #On-site IREN...  ...performance compute platform, IREN is hiring a Solutions Architect to partner with customers and support...  ...architecture, systems engineering, infrastructure engineering, or customer‑facing... 
    Daily paid
    Full time
    Temporary work
    Live out
    Relocation package

    Iris Energy

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Solution Architect - AI Infrastructure. Be the first to apply!