Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Platform Engineer

$245k - $345k

Whatnot

Join the Future of Commerce with Whatnot! Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it’s trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops. As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact. We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce.

Role

We’re looking for builders—intellectually curious, highly entrepreneurial engineers eager to shape the future of AI and ML at Whatnot. You’ll design and scale the core infrastructure that powers large language model applications across the company, working side by side with machine learning scientists to bring cutting‑edge models into production and unlock entirely new product experiences. This means building systems that make AI dependable and fast at scale—from building retrieval systems to more effectively ground LLM responses in Whatnot’s business context to developing scalable LLM evaluation frameworks and human‑in‑the‑loop feedback mechanisms.

What You’ll Do

  • Own the infrastructure powering LLMs across critical business surfaces—supporting growth, recommendations, trust and safety, fraud, seller tooling, and more.
  • Create robust and scalable LLM evaluation frameworks to measure model performance, guide iteration, and prevent regression via CI/CD.
  • Deploy RAG systems and MCP servers to more effectively ground LLM responses in Whatnot’s business context while enforcing rigorous PII controls.
  • Design efficient human‑in‑the‑loop feedback pipelines that can be used to inform scalable LLM evaluation.
  • Bridge the gap between research and production, helping to transform experimental ideas into scalable solutions.
  • Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot’s ecosystem.

US Based

We offer flexibility to work from home or from one of our global office hubs, and we value in‑person time for planning, problem‑solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.

You

People who do well at Whatnot tend to be comfortable figuring things out as they go, biased toward action, and genuinely curious about what they’re building. They care more about outcomes than credit and stay close to the product and the people using it.

  • Bachelor’s degree in Computer Science, Statistics, Applied Mathematics or a related technical field, or equivalent work experience.
  • 3+ years of software engineering experience building and maintaining production systems for consumer‑scale loads.
  • 1+ years of professional experience developing software in Python.
  • Ability to work autonomously and drive initiatives across multiple product areas and communicate findings with leadership and product teams.
  • Experience with operational, search, and key‑value databases such as PostgreSQL, DynamoDB, Elasticsearch, Redis.
  • Firm grasp of visualization tools for monitoring and logging e.g., DataDog, Grafana.
  • Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink.
  • Professionalism around collaborating in a remote working environment and well‑tested, reproducible work.
  • Exceptional documentation and communication skills.

Compensation

For US‑based applicants: $245,000 - $345,000/year + benefits + stock options.

Benefits

  • Flexible Time off Policy and Company‑wide Holidays (including a spring and winter break)
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
    • Home office setup allowance
    • Monthly allowance for cell phone and internet
  • Care benefits
    • Monthly allowance for wellness
    • Annual allowance towards Childcare
    • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  • Monthly allowance to dogfood the app
    • All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
  • Parental Leave
    • 16 weeks of paid parental leave + one month gradual return to work. Company leave allowances run concurrently with country leave requirements which take precedence.

Equal Opportunity Employment

Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the LLM Platform Engineer in San Francisco, CA vacancy
  • Handshake is hiring a Senior LLM Platform Engineer to join our Data and ML Platform team. This role owns our shared LLM control plane and related infrastructure, enabling production workflows across Handshake’s career marketplace and Handshake AI. You will collaborate with... 
    Suggested
    Remote job

    Handshake

    San Francisco, CA
    1 day ago
  •  ...the world’s top educational institutions Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI...  ...largest scale. About the Role Handshake is hiring a Senior LLM Platform Engineer to join our Data and ML Platform team. This team supports... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    1 day ago
  • Qualified is seeking an experienced software engineer to join the Brain team, powering Piper, our AI SDR product for qualifying leads and...  ...will collaborate with frontend and backend teams, ship real-time LLM features, and contribute to enterprise-grade reliability and... 
    Suggested

    Enboarder

    San Francisco, CA
    1 day ago
  • Talent Stack is seeking a Founding Staff Software Engineer to anchor a small, high‑impact engineering team building AI/LLM products for healthcare tech. You will own features end‑to‑end, ship production code daily, and mentor junior engineers while collaborating closely... 
    Suggested

    Talent Stack

    San Francisco, CA
    2 days ago
  •  ...leading enterprise integration and automation platform (iPaaS) that helps large organizations...  ...lead the developer-facing products for LLM and agentic applications, acting as the...  ...between developers, business goals, and engineering teams to drive the vision and execution... 
    Suggested
    Permanent employment
    Full time
    Immediate start
    Remote work
    Flexible hours

    Chronos Consulting

    San Francisco, CA
    3 days ago
  •  ...About The Role We are looking for a seasoned Staff DevOps and Platform Engineer to own and evolve the infrastructure that powers Liberate’s...  .... Own and improve Canary routing infrastructure for LRA (LLM REST API) via Traefik and GitOps patterns. Maintain and optimize... 
    For contractors
    Remote work

    Liberate

    San Francisco, CA
    1 day ago
  • $170.11k - $237k

    Anyscale is seeking experienced Software Engineers and Research Engineers to enhance its LLM offerings. The role involves building extensions to existing LLMs and developing features for their production deployment. Candidates should have at least 3 years of experience... 
    Flexible hours

    Anyscale

    San Francisco, CA
    1 day ago
  • $248k - $310k

     ...models, ML services and tools including LLM fine-tuning, alignment and optimization,...  ...Make: As a senior staff machine learning engineer, you will be responsible for fine-tuning...  ...products, and contribute to Airbnb’s ML platform architecture and strategy. Your Expertise... 
    Remote job
    Work experience placement

    Nubeero Limited

    San Francisco, CA
    1 day ago
  • $165k - $247k

    Amplitude is the leading AI analytics platform, helping over 4,700 customers—including Atlassian...  ...builds the systems that every Amplitude engineer relies on every day to ship code — and we...  ...— and make it consumable enough that an LLM can safely PR against it.Evolve our CI/CD... 
    Shift work

    Amplitude

    San Francisco, CA
    5 days ago
  • $180k - $250k

    Fluency is hiring a full-time Software Engineer for our AI Platform in San Francisco, CA. The role involves owning and evolving the data platform, running ETL pipelines, and building agent transformation infrastructures. The ideal candidate has strong Python engineering... 
    Full time

    Fluency

    San Francisco, CA
    1 day ago
  •  ...a sellable product. There's no existing platform team to inherit or manage, no legacy system...  ...we need from you: Strong systems engineering background on cloud control planes/serving...  ...–7 person company. Nice-to-haves: LLM-serving infra experience (vLLM, TGI, Ray... 

    General Compute

    San Francisco, CA
    1 day ago
  • $200k - $280k

    # Platform EngineerYour users are the Forward Deployed Engineers. If it does not survive a customer's environment, it does not ship.Apply for this role## The roleA...  ...Knows what an on-call week feels like.* Has shipped LLM features to real users and has opinions about what... 
    Work at office

    Fig Technology Inc.

    San Francisco, CA
    1 day ago
  •  ...the life sciences industry, building the platform that helps the world’s largest pharma and...  ...modern stack. As a Services Platform Engineer you'll ship real, cutting-edge AI features...  ...end - RAG pipelines, agentic workflows and LLM apps on AWS Bedrock and Bedrock Knowledge... 
    Work at office
    Local area
    Remote work
    Work from home

    Veeva Systems, Inc.

    San Francisco, CA
    1 day ago
  • $225k - $280k

     ..., join our team as we help shape a brighter way forward. ESM Platforms Engineering ManagerPurpose of the RoleJLL's Enterprise Service Management...  ...Studio, Moveworks Agent Studio / Developer Hub) — including LLM integration, prompt engineering, and retrieval-augmented generation... 
    Full time
    For contractors
    Local area
    Shift work

    Jones Lang LaSalle

    San Francisco, CA
    5 days ago
  •  ...largest enterprises. Our forward-deployed engineers and strategists embed with client teams,...  .... The Role. You build Varick OS, the platform every agent runs on: the runtime, orchestration...  ...across versions) ~ At least one LLM system shipped to production, with a real... 
    Work at office
    Flexible hours

    Varick Agents LTD.

    San Francisco, CA
    1 day ago
  •  ...COMPANY Braintrust is the agent observability platform. By actively applying intelligence to...  ...listing. Across 1,744 indexed Software Engineer roles in US that do publish one, the middle...  .../APIs, Backend, Python, Cloud, Go, AI/LLM, ML. Braintrust Data is hiring actively... 
    Remote work

    JobLarper

    San Francisco, CA
    4 days ago
  •  ...that way. Role Summary Gravie is seeking a hands-on Staff Platform Engineer to do three things at once: build the golden roads and paved...  ...shared and templated pipelines. Production observability and LLM observability practice, including Datadog. Event-driven... 
    Flexible hours
    Shift work

    Gravie

    San Francisco, CA
    3 days ago
  • $132k - $262k

     ...is a leading mobile-first work execution platform for industrial and frontline teams. More...  ...ours.We’re looking for a Senior AI Platform Engineer to build the shared systems that enable...  ...experience.Experience shipping AI-powered or LLM-integrated backend systems.Comfort... 

    MaintainX

    San Francisco, CA
    5 days ago
  • $150k - $180k

     ...and technology.Job DescriptionSenior AI Platform EngineerLocations: San Francisco, CA / Jacksonville...  ....We are looking for Senior AI Platform Engineers to join our R&D team. These engineers...  ...of AI agents.Evaluate new agentic AI, LLM, and orchestration technologies and recommend... 
    Ongoing contract
    Full time
    Casual work
    Worldwide
    Flexible hours

    SS&C Technologies

    San Francisco, CA
    3 days ago
  •  ...millions of Americans to achieve more.About the RoleThe VP, Platform Engineering is the senior-most leader of Platform Engineering at Happen Bank...  ...AI Infrastructure, including evaluation and selection of AI/LLM models and platforms and a clear point of view on which... 
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    San Francisco, CA
    4 days ago
  •  ...manage the MCP registry. Own the agent platform other teams build on - the deploy...  ...bring with you ~6+ years in software engineering, platform engineering, or DevOps, including...  ...~ Hands-on with LLMs - comfortable with LLM APIs, prompt engineering, and agent development... 

    Logoslabs

    San Francisco, CA
    1 day ago
  • $200k - $230k

     ...technology.Job DescriptionDirector, AI Platform EngineeringLocations: San Francisco, CA...  ...We are seeking a Director of AI Platform Engineering to lead the design, development, and scaling...  ...strategy for multi-agent orchestration, LLM integration, observability, and... 
    Ongoing contract
    Full time
    Casual work
    Work at office
    Worldwide
    Flexible hours

    SS&C Technologies

    San Francisco, CA
    3 days ago
  • $212k - $265k

     ...build real world value.Join Ripple Labs Inc. as the Manager, AI Platform Engineering in Chicago, IL, and spearhead our bold venture in AI platform...  ...systems in productionDeep, current command of AI and modern LLM/GenAI infrastructureJoin us and play a role in advancing the... 
    Full time
    Work at office
    Local area

    Ripple

    San Francisco, CA
    5 days ago
  • $236.7k - $319.5k

     ...next, you’ll fit right in.About the roleAs a Sr Director - AI & Platform Engineering you are accountable for building and operating the enterprise...  ...production operations Hands-on experience building agent and LLM platforms, including agent frameworks, MCP integrations,... 
    Minimum wage

    Gap

    San Francisco, CA
    3 days ago
  •  ...About the Role We're looking for a highly technical Staff Platform Engineer to lead the platform and security foundations of Maestro — Félix...  .... Lead the security model end to end. Treat the LLM and its tools as adversarial. Own identity separation (requester... 
    Remote work

    Felix

    San Francisco, CA
    2 days ago
  • $228k - $363k

     ...the world's first creative entertainment platform, where the entire world can feel the joy...  ...teams build on. As a Senior AI Platform Engineer, you'll build the APIs, SDKs and shared tooling...  ...adopted. ~ Experience with production LLM or agent systems, for external or... 
    Full time
    Work at office
    Local area

    Suno

    San Francisco, CA
    9 hours ago
  • $231k - $340k

     ...frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping...  ...Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll...  ...Have Experience with AI infrastructure, LLM serving, or machine learning platforms.... 

    Harvey, Inc.

    San Francisco, CA
    1 day ago
  • Arena Intelligence is hiring a Software Engineer - Platform to build the core infrastructure for online evaluation systems at scale in San Francisco...  ...years of backend experience, strong Go, and familiarity with LLM APIs, cloud infra, and developer-facing APIs. #J-18808-... 

    Arena Intelligence, Inc.

    San Francisco, CA
    1 day ago
  •  ...creating the future of interactive entertainment. We’re building the platform for worldbuilders, storytellers, and game devs to create and...  ...response back quickly, reliably, and cheaply. We’re hiring an engineer to own that system. You’ll work on provider reliability,... 
    Visa sponsorship

    Pax Historia

    San Francisco, CA
    4 days ago
  • Pax Historia in San Francisco is seeking an engineer to own the system that routes requests across 37+ models and 60k+ daily users. You’ll focus on provider reliability, structured outputs, caching, routing, and monitoring to keep latency low and costs down. We value fast... 
    Visa sponsorship

    Pax Historia

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Platform Engineer. Be the first to apply!