Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff AI Product Engineer

$220k - $330k

Nscale

 

About Nscale

Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centers, software, and applications that power today’s AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As a Nscaler, you’ll build trust through openness and transparency, where everyone is inspired to do their best work. Collaboration is key, and we work together swiftly and respectfully, embracing adaptability and resilience in all we do.

 

About the Role

Nscale is looking for a  Staff AI Product Engineer to drive technical direction across the AI product domain. Working across 2–4 teams, you’ll set architectural standards, resolve complex cross-cutting concerns, and create engineering leverage that accelerates the entire product organization.

As a Staff engineer, you define how Nscale’s AI services platform is built — establishing the patterns, APIs, and systems that other engineers rely on to deliver reliably and at speed. Your scope spans the full platform layer: AI service capabilities, API gateway, developer experience, billing, identity, and the extensibility surfaces that enterprise and developer customers build on. Your decisions will have meaningful, lasting impact on platform scalability, developer experience, and product velocity.

 

Responsibilities

  • Set technical direction for the AI product platform domain across multiple teams
  • Drive cross-team architectural decisions: service boundaries, API contracts, data models, and platform standards
  • Identify and lead systemic improvements — performance, reliability, cost, or developer experience — that create leverage across the organization
  • Resolve ambiguous, open-ended technical problems where the solution space is genuinely undefined
  • Coach and grow Senior AI Product Engineers across teams; raise technical capability broadly
  • Partner with product leadership and engineering managers to align technical strategy with business direction
  • Evaluate build-vs-buy decisions for key platform capabilities and drive them to clear conclusions
  • Represent the product engineering domain in cross-functional architecture reviews

 

Requirements

  • 8–12 years of software engineering experience
  • Proven ability to set technical direction for a product domain, including cross-team architectural patterns
  • Deep expertise in API design, platform engineering, and large-scale distributed systems
  • Experience designing cloud services with clear control plane / data plane separation and cell-based architecture for horizontal scalability and blast-radius isolation
  • Experience building and operating developer-facing platforms used by large numbers of engineers or customers
  • Proven ability to define the provisioning contract other teams onboard onto: typed inputs, readiness semantics, published outputs, and declared dependencies between provisioned services
  • Experience with dependency-ordered composition across services owned by different teams — readiness gating, eventual consistency, and deciding what may be provisioned in parallel
  • Track record of setting versioning and compatibility policy for customer-facing configuration surfaces, and of sequencing change across the schema, controller, packaging, and deployment layers that must land in order
  • Sustained hands-on production ownership at scale — has carried on-call for systems they designed and fed that operational experience back into the architecture
  • Track record of raising stability across a domain: SLO and error-budget policy, incident review that produces systemic fixes, and reliability tracked as a measurable trend rather than per-incident firefighting
  • Experience making cost a first-class engineering signal: usage attribution, cost-per-unit visibility, and guardrails that keep spend predictable as the platform scales
  • Strong ability to resolve ambiguous, open-ended technical problems at system scope
  • Demonstrated ability to influence without formal authority — across teams, disciplines, and seniority levels
  • Track record of creating durable technical standards and practices adopted across an organization

 

Preferred

  • Experience designing SDK and Terraform provider strategies that enable customers to extend and automate the platform
  • Track record of building extensible platform layers: plugin systems, API versioning strategies, client library design
  • Experience building AI/ML product platforms: inference APIs, fine-tuning UX, model management, evaluation tooling
  • Experience building self-service, paved-path onboarding so teams can ship new deployable units without platform-team involvement
  • Background in GPU cloud or compute platforms serving ML workloads; experience operating platforms with strict SLAs at scale

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Salary Range

$220,000—$330,000 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice:  Here.

Nscale does not accept unsolicited candidate submissions from recruitment agencies.

Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Staff AI Product Engineer in San Francisco, CA vacancy
  • $250k - $350k

     ...through the cracks. We believe AI should do more. Thorin is...  ...Own features from the initial product decision through...  ...raise the quality of a small engineering pod. Turn product and customer...  ...What We’re Looking For Staff-level engineering judgment, whether... 
    Suggested
    Full time

    thorin

    San Francisco, CA
    3 days ago
  • $150k - $200k

    San Francisco, CaliforniaEngineering - AI Engineering /US Full-time Salaried /On-siteSamba is a media intelligence company. We know what...  ...selectionWHO YOU AREYou’ve built AI agents and shipped them to production—not just prototypesYou’ve deployed agents in cloud... 
    Suggested
    Full time
    Local area

    Samba TV

    San Francisco, CA
    4 days ago
  • $127.2k - $201.3k

     ...as we are, join our team.KPMG is currently seeking a Manager, AI Product Security Leader to join our Enterprise Security Services...  ...secure model- and tool-interaction patternsLead complex security engineering initiatives end-to-end with minimal oversight, from risk and... 
    Suggested
    H1b
    Local area

    KPMG

    San Francisco, CA
    2 days ago
  • $140k - $180k

     ...scientific benchmarks ( benchmarks.bio ) for AI agents across biology. We work with...  ...AI Biologist to join our Protein Design & Engineering team, working at the frontier of what artificial...  ...interview with a Member of Technical Staff (pod lead). # Culture interview with... 
    Suggested
    Full time
    For contractors
    H1b
    Work at office
    Remote work
    Night shift

    LatchBio

    San Francisco, CA
    2 days ago
  •  ...About Brain Co. Brain Co. builds AI-native operating systems for large, regulated...  ...Brain Co. is entering its next phase of production deployments on a national scale with an elite...  ...About the Role As an AI Product Engineer, you will work closely with cross-functional... 
    Suggested
    Remote job
    Full time
    Internship
    Local area

    brainco

    San Francisco, CA
    3 days ago
  • $200k - $250k

     ...About Us At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create...  ...reliable, transparent, and useful. Our team includes engineers, researchers, product builders, and operators who care about solving meaningful... 
    Remote job
    Immediate start
    Work from home
    Flexible hours
    Early shift

    You.com

    San Francisco, CA
    8 hours ago
  •  ...About Town Town is building the AI coworker for every team. Everyone gets their own...  ...previously led EPD at Plaid and applied AI product at Google.   About the Role The core...  ...anyone automate real work, a suggestion engine that discovers what to automate before you... 
    Full time

    town

    San Francisco, CA
    3 days ago
  •  ...is building the TikTok for mini apps — an AI-driven consumer platform where people...  ...shape the next generation of consumer social products. Download our app and give it a try!...  ...We are looking for a product-centric engineer who cares deeply about user experience, moves... 
    Full time
    Remote work

    sekai

    San Francisco, CA
    3 days ago
  • $200k - $320k

     ...Job Description Job Description Senior AI Product Engineer Location: San Francisco Bay Area (Hybrid/Flexible – Occasional Office Visits) Compensation: $200,000–$320,000 Base Salary + Competitive Equity Employment: Full-Time Industry: Artificial Intelligence... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Kastel Staffing

    San Francisco, CA
    4 days ago
  • Samba is a media intelligence company. We know what the world is watching, reading, and thinking about — in real time, at scale, across every screen. Our data exists with the consent of over a billion people, organized into the most complete picture of consumer attention...
    Full time

    sambatv

    San Francisco, CA
    3 days ago
  •  ...Benefits & Perks Comprehensive medical, dental, and vision coverage Career growth at a rapidly scaling AI startup About This Role As an AI Product Engineer, you will design, build, and iterate on our core AI-driven product. Our small engineering team works... 
    Full time
    H1b
    Work at office
    Visa sponsorship

    Cephas Consultancy Services Private Limited

    San Francisco, CA
    5 days ago
  • $180k - $325k

     ...About Brain Co. Brain Co. builds AI-native operating systems for large, regulated...  ...Brain Co. is entering its next phase of production deployments on a national scale with an elite...  ...About The Role As an AI Product Engineer at Brain Co., you will play a pivotal role... 
    Remote job
    Full time
    Local area
    Worldwide

    brainco

    San Francisco, CA
    3 days ago
  • $170k - $220k

     ...About Tavrn: Tavrn is a pioneering legal AI company transforming the plaintiff law sector through automation of medical chronologies...  ...Overview: We're seeking innovative and highly motivated Product Engineers to join our dynamic product team. As a Product Engineer, you'... 
    Remote job
    Full time

    tavrn

    San Francisco, CA
    3 days ago
  • $35 - $58 per hour

     ...team that's shaping an exciting array of product solutions, including Video-Based Safety,...  ...the long term. About Samsara Hardware Engineering: Samsara's hardware systems bridge the...  ...asset trackers, vehicle ADAS systems with AI/ML, telematics systems, and rackmount video... 
    Full time
    Internship
    Work at office
    Remote work
    Relocation package
    Monday to Friday
    Flexible hours

    Samsara

    San Francisco, CA
    6 hours ago
  • $290k

     ...applications that power today's AI stack using sustainable...  ...is looking for a  Principal AI Engineer (Specialised) to lead the inference...  ...AI engineering, research, product, and infrastructure leadership...  ...commercial terms Mentor and develop Staff and Senior AI Engineers, and... 
    Flexible hours

    Nscale

    San Francisco, CA
    8 hours ago
  • $220k - $330k

     ...software, and applications that power today's AI stack using sustainable technology...  ...About the Role Nscale is looking for a  Staff AI Engineer (Specialised)to set technical direction...  ...quality broadly Work with research, product, and infrastructure leadership so the... 
    Flexible hours

    Nscale

    San Francisco, CA
    8 hours ago
  •  ...Monaco is building an AI-native revenue platform that replaces the fragmented GTM stack...  ...already 65 people, and have strong early product-market fit generating millions in ARR...  ...We're looking for an AI Backend Product Engineer to help build and shape Monaco's core AI... 
    Full time
    Work at office

    monaco

    San Francisco, CA
    3 days ago
  • $200k - $260k

     ...to build their own clinical AI agents. Our mission is to make...  ...meets the real world. Our core engineering team builds the platform. We...  ...software that runs in production. As a Senior Applied AI Engineer...  ...AI ladder runs from Senior to Staff or Tech Lead. You move up by... 
    Full time
    Work at office
    Flexible hours

    Concurrence

    San Francisco, CA
    10 days ago
  • Zipporin is seeking an exceptional Senior Full-Stack AI Product Engineer to join our team in San Francisco on a hybrid basis. In this role, you will lead the architecture and deployment of intelligent, user-facing AI applications, transforming cutting-edge generative AI... 
    Contract work

    Zipporin

    San Francisco, CA
    1 day ago
  • Zipporin is seeking an exceptional Senior Full-Stack AI Product Engineer to join our team in San Francisco, CA on a hybrid schedule. In this role, you will bridge the gap between cutting-edge foundational AI models and polished, customer-facing product experiences. You... 
    Contract work

    Zipporin

    San Francisco, CA
    13 days ago
  • $200k - $250k

     ...Job Description Job Description About the Role Join a small team building AI-powered advertising products in the SaaS sector. You will shape production agents that create personalized interactive and video ads, then connect their output to live recommendation systems... 

    Wintermeyer Ventures

    San Francisco, CA
    5 days ago
  •  ...Area, California | Fully On-site We are seeking an Applied AI Engineer to join an early-stage technology company building AI systems...  ...applied AI, computer vision, evaluation systems, and production engineering. Key Responsibilities Build and deploy agentic... 
    Work at office
    Visa sponsorship

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    15 days ago
  • $135k - $175k

     ...era of high-performance, Made in America production. About the team: Formic's Business...  ...data across platforms, and develop AI-powered tools that make information more...  ...career path. You might come from software engineering, applied AI, technical product development... 
    Full time
    Temporary work
    Remote work
    Home office
    Flexible hours
    Shift work

    Formic

    San Francisco, CA
    8 days ago
  •  ...keep reading. About the Role We are looking for an AI Enablement Engineer to accelerate AI adoption across engineering by turning standards...  ...at the intersection of AI tooling enablement, developer productivity, engineering standards, lightweight training, feedback... 
    Work at office
    Immediate start

    Emerald Development Managers

    San Francisco, CA
    3 days ago
  • $200k - $250k

     ...Description About the Role Join an early-stage AI company building software for physical...  ..., from early experiments through production use. What You'll Do Build agent harnesses...  ...For Four to ten years of software engineering experience, including ownership of... 
    Remote work

    Wintermeyer Ventures

    San Francisco, CA
    6 days ago
  • $175k - $275k

     ...company Our client is a seed-stage AI company building the data and infrastructure...  ...and application-layer companies. Its products support post-training, reinforcement learning...  ...verification. The role As AI Engineer, RL & Evals, you will build reinforcement... 
    Full time
    H1b
    Work at office

    Raydar

    San Francisco, CA
    5 days ago
  •  ...Job Description Job Description Founding Senior AI Engineer — Agent Quality & Evaluation On behalf of an early-stage startup...  ...Requirements What we're looking for ~3+ years building production ML or AI systems, with recent hands-on shipping of LLM products... 
    Full time

    Fruition Executive Search

    San Francisco, CA
    28 days ago
  • $120k - $180k

     ...Job Description About the Role This is a founding engineering role at a seed-stage AI startup building the intelligence layer for the construction...  ...vision, LLMs, and multimodal AI to prototype and ship production systems on real-world, noisy construction documents.... 
    Full time
    Work at office
    Relocation

    Clera

    San Francisco, CA
    18 days ago
  • $180k - $200k

     ...system into their real, regulated production — then you watch the business...  ...it. Embedded is not staff-augmented. Autonomous. You own...  ...how leading enterprises adopt AI, from strategy through first...  ...you measured and why. Strong engineering fundamentals — dropped into an... 
    Full time
    Work at office
    Visa sponsorship

    Provectus

    San Francisco, CA
    4 days ago
  • $180k - $275k

     ...Job Description Job Description Senior AI Engineer Company: Confidential — consumer and business banking Location: San Francisco...  ...end to end, from ideation to deployment, and help shape the product and engineering culture. What You Will Do Build and ship... 
    Full time
    Work at office
    Visa sponsorship

    Rumi

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff AI Product Engineer. Be the first to apply!