LLM Platform Engineer
$245k - $345kWhatnot
Join the Future of Commerce with Whatnot! Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it’s trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops. As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact. We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce.
Role
We’re looking for builders—intellectually curious, highly entrepreneurial engineers eager to shape the future of AI and ML at Whatnot. You’ll design and scale the core infrastructure that powers large language model applications across the company, working side by side with machine learning scientists to bring cutting‑edge models into production and unlock entirely new product experiences. This means building systems that make AI dependable and fast at scale—from building retrieval systems to more effectively ground LLM responses in Whatnot’s business context to developing scalable LLM evaluation frameworks and human‑in‑the‑loop feedback mechanisms.
What You’ll Do
- Own the infrastructure powering LLMs across critical business surfaces—supporting growth, recommendations, trust and safety, fraud, seller tooling, and more.
- Create robust and scalable LLM evaluation frameworks to measure model performance, guide iteration, and prevent regression via CI/CD.
- Deploy RAG systems and MCP servers to more effectively ground LLM responses in Whatnot’s business context while enforcing rigorous PII controls.
- Design efficient human‑in‑the‑loop feedback pipelines that can be used to inform scalable LLM evaluation.
- Bridge the gap between research and production, helping to transform experimental ideas into scalable solutions.
- Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot’s ecosystem.
US Based
We offer flexibility to work from home or from one of our global office hubs, and we value in‑person time for planning, problem‑solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.
You
People who do well at Whatnot tend to be comfortable figuring things out as they go, biased toward action, and genuinely curious about what they’re building. They care more about outcomes than credit and stay close to the product and the people using it.
- Bachelor’s degree in Computer Science, Statistics, Applied Mathematics or a related technical field, or equivalent work experience.
- 3+ years of software engineering experience building and maintaining production systems for consumer‑scale loads.
- 1+ years of professional experience developing software in Python.
- Ability to work autonomously and drive initiatives across multiple product areas and communicate findings with leadership and product teams.
- Experience with operational, search, and key‑value databases such as PostgreSQL, DynamoDB, Elasticsearch, Redis.
- Firm grasp of visualization tools for monitoring and logging e.g., DataDog, Grafana.
- Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink.
- Professionalism around collaborating in a remote working environment and well‑tested, reproducible work.
- Exceptional documentation and communication skills.
Compensation
For US‑based applicants: $245,000 - $345,000/year + benefits + stock options.
Benefits
- Flexible Time off Policy and Company‑wide Holidays (including a spring and winter break)
- Health Insurance options including Medical, Dental, Vision
- Work From Home Support
- Home office setup allowance
- Monthly allowance for cell phone and internet
- Care benefits
- Monthly allowance for wellness
- Annual allowance towards Childcare
- Lifetime benefit for family planning, such as adoption or fertility expenses
- Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
- Monthly allowance to dogfood the app
- All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
- Parental Leave
- 16 weeks of paid parental leave + one month gradual return to work. Company leave allowances run concurrently with country leave requirements which take precedence.
Equal Opportunity Employment
Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.
#J-18808-Ljbffr- Handshake is hiring a Senior LLM Platform Engineer to join our Data and ML Platform team. This role owns our shared LLM control plane and related infrastructure, enabling production workflows across Handshake’s career marketplace and Handshake AI. You will collaborate with...SuggestedRemote job
- ...the world’s top educational institutions Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI... ...largest scale. About the Role Handshake is hiring a Senior LLM Platform Engineer to join our Data and ML Platform team. This team supports...SuggestedFull timeWork at officeRemote workFlexible hours
- Qualified is seeking an experienced software engineer to join the Brain team, powering Piper, our AI SDR product for qualifying leads and... ...will collaborate with frontend and backend teams, ship real-time LLM features, and contribute to enterprise-grade reliability and...Suggested
- Talent Stack is seeking a Founding Staff Software Engineer to anchor a small, high‑impact engineering team building AI/LLM products for healthcare tech. You will own features end‑to‑end, ship production code daily, and mentor junior engineers while collaborating closely...Suggested
- ...leading enterprise integration and automation platform (iPaaS) that helps large organizations... ...lead the developer-facing products for LLM and agentic applications, acting as the... ...between developers, business goals, and engineering teams to drive the vision and execution...SuggestedPermanent employmentFull timeImmediate startRemote workFlexible hours
- ...About The Role We are looking for a seasoned Staff DevOps and Platform Engineer to own and evolve the infrastructure that powers Liberate’s... .... Own and improve Canary routing infrastructure for LRA (LLM REST API) via Traefik and GitOps patterns. Maintain and optimize...For contractorsRemote work
$170.11k - $237k
Anyscale is seeking experienced Software Engineers and Research Engineers to enhance its LLM offerings. The role involves building extensions to existing LLMs and developing features for their production deployment. Candidates should have at least 3 years of experience...Flexible hours$248k - $310k
...models, ML services and tools including LLM fine-tuning, alignment and optimization,... ...Make: As a senior staff machine learning engineer, you will be responsible for fine-tuning... ...products, and contribute to Airbnb’s ML platform architecture and strategy. Your Expertise...Remote jobWork experience placement$165k - $247k
Amplitude is the leading AI analytics platform, helping over 4,700 customers—including Atlassian... ...builds the systems that every Amplitude engineer relies on every day to ship code — and we... ...— and make it consumable enough that an LLM can safely PR against it.Evolve our CI/CD...Shift work$180k - $250k
Fluency is hiring a full-time Software Engineer for our AI Platform in San Francisco, CA. The role involves owning and evolving the data platform, running ETL pipelines, and building agent transformation infrastructures. The ideal candidate has strong Python engineering...Full time- ...a sellable product. There's no existing platform team to inherit or manage, no legacy system... ...we need from you: Strong systems engineering background on cloud control planes/serving... ...–7 person company. Nice-to-haves: LLM-serving infra experience (vLLM, TGI, Ray...
$200k - $280k
# Platform EngineerYour users are the Forward Deployed Engineers. If it does not survive a customer's environment, it does not ship.Apply for this role## The roleA... ...Knows what an on-call week feels like.* Has shipped LLM features to real users and has opinions about what...Work at office- ...the life sciences industry, building the platform that helps the world’s largest pharma and... ...modern stack. As a Services Platform Engineer you'll ship real, cutting-edge AI features... ...end - RAG pipelines, agentic workflows and LLM apps on AWS Bedrock and Bedrock Knowledge...Work at officeLocal areaRemote workWork from home
$225k - $280k
..., join our team as we help shape a brighter way forward. ESM Platforms Engineering ManagerPurpose of the RoleJLL's Enterprise Service Management... ...Studio, Moveworks Agent Studio / Developer Hub) — including LLM integration, prompt engineering, and retrieval-augmented generation...Full timeFor contractorsLocal areaShift work- ...largest enterprises. Our forward-deployed engineers and strategists embed with client teams,... .... The Role. You build Varick OS, the platform every agent runs on: the runtime, orchestration... ...across versions) ~ At least one LLM system shipped to production, with a real...Work at officeFlexible hours
- ...COMPANY Braintrust is the agent observability platform. By actively applying intelligence to... ...listing. Across 1,744 indexed Software Engineer roles in US that do publish one, the middle... .../APIs, Backend, Python, Cloud, Go, AI/LLM, ML. Braintrust Data is hiring actively...Remote work
- ...that way. Role Summary Gravie is seeking a hands-on Staff Platform Engineer to do three things at once: build the golden roads and paved... ...shared and templated pipelines. Production observability and LLM observability practice, including Datadog. Event-driven...Flexible hoursShift work
$132k - $262k
...is a leading mobile-first work execution platform for industrial and frontline teams. More... ...ours.We’re looking for a Senior AI Platform Engineer to build the shared systems that enable... ...experience.Experience shipping AI-powered or LLM-integrated backend systems.Comfort...$150k - $180k
...and technology.Job DescriptionSenior AI Platform EngineerLocations: San Francisco, CA / Jacksonville... ....We are looking for Senior AI Platform Engineers to join our R&D team. These engineers... ...of AI agents.Evaluate new agentic AI, LLM, and orchestration technologies and recommend...Ongoing contractFull timeCasual workWorldwideFlexible hours- ...millions of Americans to achieve more.About the RoleThe VP, Platform Engineering is the senior-most leader of Platform Engineering at Happen Bank... ...AI Infrastructure, including evaluation and selection of AI/LLM models and platforms and a clear point of view on which...Full timeContract workWork at officeLocal areaRemote workRelocationFlexible hours
- ...manage the MCP registry. Own the agent platform other teams build on - the deploy... ...bring with you ~6+ years in software engineering, platform engineering, or DevOps, including... ...~ Hands-on with LLMs - comfortable with LLM APIs, prompt engineering, and agent development...
$200k - $230k
...technology.Job DescriptionDirector, AI Platform EngineeringLocations: San Francisco, CA... ...We are seeking a Director of AI Platform Engineering to lead the design, development, and scaling... ...strategy for multi-agent orchestration, LLM integration, observability, and...Ongoing contractFull timeCasual workWork at officeWorldwideFlexible hours$212k - $265k
...build real world value.Join Ripple Labs Inc. as the Manager, AI Platform Engineering in Chicago, IL, and spearhead our bold venture in AI platform... ...systems in productionDeep, current command of AI and modern LLM/GenAI infrastructureJoin us and play a role in advancing the...Full timeWork at officeLocal area$236.7k - $319.5k
...next, you’ll fit right in.About the roleAs a Sr Director - AI & Platform Engineering you are accountable for building and operating the enterprise... ...production operations Hands-on experience building agent and LLM platforms, including agent frameworks, MCP integrations,...Minimum wage- ...About the Role We're looking for a highly technical Staff Platform Engineer to lead the platform and security foundations of Maestro — Félix... .... Lead the security model end to end. Treat the LLM and its tools as adversarial. Own identity separation (requester...Remote work
$228k - $363k
...the world's first creative entertainment platform, where the entire world can feel the joy... ...teams build on. As a Senior AI Platform Engineer, you'll build the APIs, SDKs and shared tooling... ...adopted. ~ Experience with production LLM or agent systems, for external or...Full timeWork at officeLocal area$231k - $340k
...frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping... ...Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll... ...Have Experience with AI infrastructure, LLM serving, or machine learning platforms....- Arena Intelligence is hiring a Software Engineer - Platform to build the core infrastructure for online evaluation systems at scale in San Francisco... ...years of backend experience, strong Go, and familiarity with LLM APIs, cloud infra, and developer-facing APIs. #J-18808-...
- ...creating the future of interactive entertainment. We’re building the platform for worldbuilders, storytellers, and game devs to create and... ...response back quickly, reliably, and cheaply. We’re hiring an engineer to own that system. You’ll work on provider reliability,...Visa sponsorship
- Pax Historia in San Francisco is seeking an engineer to own the system that routes requests across 37+ models and 60k+ daily users. You’ll focus on provider reliability, structured outputs, caching, routing, and monitoring to keep latency low and costs down. We value fast...Visa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Platform Engineer. Be the first to apply!
- client platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform manager San Francisco, CA
- power platform San Francisco, CA
- digital platform specialist San Francisco, CA
- director of digital platform San Francisco, CA


