Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Product Engineer

Fireworks AI

Product-Minded Engineer

We just shipped Fireworks Nexus: a drop-in platform that lets engineering organizations route their AI workloads off expensive proprietary models and onto high-performing open models like Kimi-K3 and GLM-5.2, without changing how a single developer works. The early numbers are the kind that change how an industry buys intelligence: 3–5x lower AI spend, roughly a third off the cost of every merged PR, and a blended token rate about a quarter of the closed labs, all while matching or beating frontier models on real engineering work from real customer repositories.

We're looking for a product-minded engineer to join as a Member of Technical Staff and own the surfaces that make this real: the intelligent router that scores and directs every request, the cost-observability and enterprise-control layers that give an org visibility over its entire AI footprint, the FireConnect integrations that make adoption a single command, and the core platform underneath; inference APIs, the developer console, and fine-tuning workflows.

This is a high-autonomy IC role on a small team building something that ships to production the day you write it, at a scale almost nowhere else can offer. You'll own features end to end — from understanding the problem, to designing the solution, to shipping it, to watching how developers actually use it. If you're the kind of engineer who ships things other people think are impossible, on timelines other people think are impossible, this is a place where that has enormous leverage and nothing standing between you and impact.

What You'll Do
  • Own product features end-to-end across Nexus and the broader Fireworks platform, the intelligent router, FireConnect harness integrations, cost observability, enterprise controls and policy, the developer console, API surfaces, the model playground, fine-tuning workflows, and billing, scoping the problem, building it, shipping it, instrumenting it, and iterating on real usage.
  • Build the routing and migration layer that scores request difficulty in real time and sends routine work to open models while passing hard tasks through to a customer's existing provider, the system that delivers 3–5x cost reductions without sacrificing quality.
  • Make adoption frictionless: extend FireConnect and our Anthropic- and OpenAI-compatible APIs so a team can drop Nexus into their existing tools with just a base URL and a model ID, and improve the caching and infra paths that turn that into material cost savings.
  • Work across the full stack, frontend (React/TypeScript), backend services (Python, Go), APIs, and data layers, to ship polished, production-quality product surfaces for deeply technical users.
  • Build for products evolving week to week: new models, new serving paths, new consumption models, new enterprise controls, and new multi-agent harness tooling.
  • Partner closely with Infrastructure, Applied Research, Growth, Data, and Design to turn raw platform capability into products developers love.
  • Instrument everything you build and let the data tell you where the friction is — then remove it.
Minimum Qualifications
  • 3+ years as a software engineer, with meaningful time spent building and shipping user-facing products.
  • Strong full-stack skills, comfortable across frontend (React/TypeScript), backend (Python, Go, or similar), APIs, and databases.
  • A track record of shipping developer-facing products: APIs, dashboards, consoles, CLIs, or developer tools.
  • Genuine end-to-end ownership, you're as comfortable scoping an ambiguous problem as you are deploying the fix at 2am.
  • Strong product instincts: you optimize for the developer experience, not just the diff.
  • The ability to operate at high velocity with extreme ownership: you ship fast, make pragmatic trade-offs, and don't wait to be told what to build.
Preferred Qualifications
  • Experience building products on top of complex infrastructure, inference platforms, cloud services, data platforms, or ML tooling.
  • Experience building for deeply technical users, where the product surface is an API as much as a UI.
  • Comfort in a fast-moving, founder-led environment where the product changes week to week and you're drawing the map as you walk it.
  • You build with AI tools every day, and you have sharp intuition for what a great AI developer experience feels like from the inside.
Why Fireworks?
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What's Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Product Engineer in San Mateo, CA vacancy
  • $192k - $300k

     ...We believe that developing the end-to-end product will get us to market faster and result...  ...define and enforce the best practices for engineering across the company. Our approach involves...  ...Claude, Gemini, GPT.Build tools that leverage AI and improve engineer productivity by 10x... 
    Suggested
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    5 days ago
  • $110k - $270k

     ...graph code and conventional C++ DSP and control code.RoleThe AI Applications Engineer is the key bridge between development engineering and hands...  .... The AI Application Engineer will [1] integrate Quadric product and software stack into AI/LLM frameworks and ecosystem; [2... 
    Suggested
    Full time
    Work at office
    Local area
    Immediate start
    Worldwide

    Quadric

    Burlingame, CA
    5 days ago
  • $110k - $270k

     ...of a machine learning graph, the Quadric GPNPU executes both NN graph code and conventional C++ DSP and control code.RoleThe AI Inference Engineer in Quadric is the key bridge between the world of AI/LLM models and Quadric unique platforms. The AI Inference Engineer at... 
    Suggested
    Full time
    Work at office
    Local area
    Immediate start
    2 days per week

    Quadric

    Burlingame, CA
    5 days ago
  • $150k - $200k

    DescriptionAbout QuadricQuadric is redefining edge AI with the industry's first General Purpose...  ...devices. As an AI Performance Modeling Engineer, you will build analytical, cycle-level...  ...that directly informs architecture and product decisions. Balance single-stream latency... 
    Suggested
    Work at office
    Local area

    Quadric

    Burlingame, CA
    21 hours ago
  • $192k - $238k

     ...experiences. Our people-first approach to AI eliminates friction, helping businesses...  ...systems like Salesforce, Marketo, Outreach, product usage data, and intent platforms. Your...  ...value buyer activity across the funnel by engineering contextual data pipelines (web activity,... 
    Suggested
    Flexible hours

    Freshworks

    San Mateo, CA
    4 days ago
  • $110k - $270k

     ...of a machine learning graph, the Quadric GPNPU executes both NN graph code and conventional C++ DSP and control code.RoleThe AI Kernel Engineer in Quadric plays the key role to enable a large number of AI kernels/operators to run efficiently on the Quadric platform. The... 
    Full time
    Work at office
    Local area
    Immediate start
    2 days per week

    Quadric

    Burlingame, CA
    5 days ago
  • $206k - $250k

     ...Full-time /HybridZoox is seeking a highly motivated, hands-on AI Engineer to spearhead the end-to-end development and deployment of our...  ...-starter who thrives on developing, implementing and scaling production-ready AI systems that add business value by solving complex... 
    Full time
    Contract work
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    21 hours ago
  • $134.41k - $181.84k

     ...installation services, mobile plans and products. Today, our brands include Boost Mobile...  ...development, technology innovation or solution engineering, our team members play a vital role in...  ...a skilled and innovative Senior Agentic AI Engineer to join the AI team. This role... 
    Local area
    Flexible hours

    EchoStar

    San Mateo, CA
    5 days ago
  •  ...Role Summary Our client, a rapidly growing AI infrastructure company, is seeking multiple AI Engineers (Enterprise) to help design, build, and deploy production-grade generative AI solutions for enterprise customers. This is a customer-facing, hands-on engineering... 
    Full time
    Remote work
    Flexible hours

    twenty80.io

    San Mateo, CA
    1 day ago
  • $191k - $271k

     ...- Software Systems /Full-time /HybridThe Product Security Threat Analysis and Security Standards...  ...'ll bring a robust background in systems engineering, coupled with a demonstrated passion and...  ...deliverablesPragmatic adoption of AI/LLM toolchains for security analysis and... 
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    2 days ago
  • $180k - $212k

     ...visit About the departmentFranklin Templeton is seeking an AI/ML Lead Engineer to design and implement agents for financial advisors that...  ...clients worldwide.How you will add valueDesign and implement production-grade multi-agent systems using the leading agent... 
    Full time
    Local area
    Worldwide
    Work visa
    3 days per week

    Franklin Templeton

    San Mateo, CA
    3 days ago
  •  ...Roblox San Mateo, CA is hiring a Senior Software Engineer: Assistant to help build an AI‑driven assistant platform that spans desktop and mobile tooling. You will design, implement, test, and deploy services across cloud orchestration, model routing, and tool execution... 

    OneClick Smart Resume

    San Mateo, CA
    1 day ago
  • $150k - $300k

     ...Role: Product Engineer (Frontend / Fullstack) Location: On-site, San Mateo, CA Compensation: $150k-$300k + 0.05-0.25% equity Work...  ...visa sponsorship available) About the Company A well-funded AI + data insights startup ( $20M raised) with Fortune 100... 
    Full time
    Work at office
    Visa sponsorship

    Amadeus Search

    San Mateo, CA
    1 day ago
  • Notable is the leading healthcare AI platform for transforming workforce productivity. Health systems, hospitals, and payers use Notable to improve healthcare...  ...automation for healthcare. As a Senior AI Platform Engineer, you will design, build, and maintain LLM... 
    Full time
    Temporary work
    Work at office
    Remote work
    3 days per week

    Notable

    San Mateo, CA
    2 days ago
  •  ...Product Engineer / Product Manager We're looking for people who have built and shipped products - as a product manager, designer, engineer...  ...fast and deliver value here and now Experience building with AI tools like Claude Code, Cursor, Devin, etc. Good taste for... 
    Work at office
    Flexible hours
    Day shift

    Coframe

    Burlingame, CA
    3 days ago
  •  ...We're looking for a Mechanical/Product Design Engineer who obsesses over form as much as function. You have a sharp eye for aesthetics, a deep command of surfacing CAD, and a track record of shipping beautifully crafted consumer products. You'll own the mechanical design... 
    Contract work

    xdof.ai

    San Mateo, CA
    2 days ago
  • $280.54k - $330.95k

     ...safer, more civil shared experiences for everyone.As a Senior Product Manager in Engineering Acceleration, you will define the vision and strategy for...  ...remaining adaptable as organizational priorities evolve. AI has been transforming how we approach these systems. We’re... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    5 days ago
  • $170k - $220k

     ...their people and places with an integrated, privacy-sensitive AI-powered platform that includes solutions for video...  ...devices are deployed across 170+ countries. About the RoleAs a Product Design Mechanical Engineer at Verkada, you’ll play a key role in designing and... 
    Full time
    Overseas
    Work visa
    Flexible hours
    Shift work

    Verkada

    San Mateo, CA
    5 days ago
  • $148k - $247k

    SummaryJoin Guidewire’s Product Development & Operations (PDO) team, where we deliver operational...  .... Our team is at the forefront of AI, cloud, and data platform adoption, working...  ...teamwork. ¹As a Senior AI/ML Platform Engineer, you will architect and scale the ML platform... 
    Full time
    Part time
    Immediate start
    Flexible hours

    Guidewire Software, Inc.

    San Mateo, CA
    4 days ago
  • $225k - $278k

     ...employee and customer experiences. Our people-first approach to AI eliminates friction, helping businesses reduce complexity, lower...  ...it with us.Job DescriptionWe are seeking a Backend AI Platform Engineer to lead the development of core backend services powering our Agentic... 
    Flexible hours

    Freshworks

    San Mateo, CA
    2 days ago
  • $172k - $300k

     ...SnorkelAt Snorkel, we believe meaningful AI doesn’t start with the model, it starts with...  ...differentiation, high performance, and production-ready systems. We work with some of the...  ...largest organizations to empower scientists, engineers, financial experts, product creators,... 
    Local area

    Snorkel AI

    Redwood City, CA
    5 days ago
  • $150k - $190k

     ...employee and customer experiences. Our people-first approach to AI eliminates friction, helping businesses reduce complexity,...  ...our Finance team as a dedicated business partner to our global Product & Engineering organization. This is a high-impact individual contributor... 
    Flexible hours

    Freshworks

    San Mateo, CA
    21 hours ago
  •  ...is not just a research problem. It’s a full-stack engineering problem, spanning training systems, inference, product architecture, and the tight feedback loops between...  ...ones. At Luma, we are: A leading multimodal AI research lab, having built one of the world’s strongest... 
    Immediate start
    Flexible hours

    Luma

    Redwood City, CA
    14 days ago
  • $190k - $300k

     ...SnorkelAt Snorkel, we believe meaningful AI doesn’t start with the model, it starts with...  ...differentiation, high performance, and production-ready systems. We work with some of the...  ...largest organizations to empower scientists, engineers, financial experts, product creators,... 
    Local area
    Remote work

    Snorkel AI

    Redwood City, CA
    4 days ago
  • $230k - $300k

     ...Amplify Partners, Microsoft, Amazon, and AI visionaries like Geoff Hinton, Yann...  ...expertise on both data research and data engineering necessary to solve this incredibly challenging...  ...through onboarding, deployment, and production rollout of DatologyAI’s platform while serving... 
    Work at office
    Work from home
    Relocation package

    DatologyAI

    Redwood City, CA
    5 days ago
  • $112.5k - $300k

     ...including blood, vaccines, medical supplies, food, and retail products. Our customers include the world’s largest and most prominent...  ...speeds.About You & the RoleZipline is looking for Forward Deployed AI Engineers who will be at the forefront of bringing GenAI into one of the... 
    Work at office
    Local area

    Zipline

    South San Francisco, CA
    5 days ago
  • $185k - $300k

     ...Wells Fargo is seeking a Specialty Software Engineering Senior Manager in technology as part of...  ...-grade solutions, including Generative AI tools. This role combines agile leadership...  ...with a strong focus on GenAI innovation and product delivery. The ideal candidate will manage... 
    Work experience placement
    Relocation package

    Wells Fargo Bank, N.A.

    Menlo Park, CA
    6 hours ago
  • $280.71k

     ...incremental improvements; we strive to build products that are 10x better than anything that...  ...greatest asset: talented scientists, engineers, sales professionals, and visionaries united...  ...a world-class Commercial Data & Applied AI team. We are currently seeking a highly motivated... 
    Full time
    Worldwide
    2 days per week
    3 days per week

    Billiontoone

    Menlo Park, CA
    1 day ago
  • $100k - $150k

     ...commercial success across the lifecycle of their products, portfolios, and organizations. Blue...  ...practice integrates strategy, data, and AI to deliver scalable, technology-enabled...  ...within our portfolio. As an AI Engineer / Senior AI Engineer , you will work across... 
    Full time
    Temporary work
    Immediate start
    Flexible hours

    Blue Matter

    South San Francisco, CA
    1 day ago
  • $147k - $184.8k

     ...science innovation in both the US and China and capitalizing on the strengths of each geographic location.Position Summary:The AI Security Engineer will be a key member of the “Structure Brain” initiative, responsible for designing, implementing, and maintaining security... 
    Contract work
    Work at office
    Remote work

    Structure Therapeutics

    South San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Product Engineer. Be the first to apply!