Product Platform - Backend Engineer
Baseten
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
AI is being built by many companies at once. Model labs train more capable models, hyperscalers provide infrastructure, distribution, developers build new AI products, and a growing set of tools gives agents more to work with. Baseten sits at the center of all of it, as the inference platform that developers and large companies use to run AI in production.
We’re hiring a backend/distributed systems engineer to join our Product Platform in following areas:
- Commercialization, billing, and partnerships
- Developer productivity and agentic development
- Observability platform
Please come join our growing team to work on exciting problems. A few sample projects and responsibilities will include
- Design and build scalable telemetry ingest and storage pipelines for metrics, logs, and traces across Baseten’s multi-cloud infrastructure
- Own and evolve core observability platforms, driving migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growth
- Build world class commercialization and billing systems
- Work on some of the most strategic and exciting partnership integrations
- Develop internal infrastructure and tooling that improves developer velocity, CI/CD, and deployment safety.
- Own the internal AI agent platform end to end — architecture, build, rollout, operation, measurement.
- Own Baseten's testing strategy end to end — define the standards, the tiers, and the tooling that engineering teams build against.
- Drive adoption through developer experience — good defaults, clear docs, low friction — not mandate.
- Improve platform reliability through better alerting, incident tooling, and production debugging workflows.
- Lead technical design for cross-team projects and make sound tradeoffs between speed, quality, and long-term maintainability.
- Partner with infrastructure, model performance, and product teams to understand what they need to see and ship faster.
- Raise the engineering bar through code review, mentorship, and clear technical writing.
REQUIREMENTS
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- 5+ years of relevant industry experience, with a focus on building scalable backend systems and platforms.
- Experience building or operating observability systems (logging, metrics, tracing) or internal infrastructure at scale.
- Proficiency in Python, Go, Rust, or a similar backend language.
- A firm grasp of quality and engineering principles: you understand both the what and the why.
- Strong systems-level thinking: you understand how the components of a distributed system interact and how data flows through each part.
- Platform mindset: you build for adoption and self-service, treat internal engineers as customers, and would rather ship a good default than write a style guide.
- Excellent written and verbal communication skills.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
#J-18808-Ljbffr- ...Clay is seeking a backend product engineer to own the systems behind the parts of Clay used daily by customers. You will own a surface end to end, deciding what to build with design and GTM partners, shipping quickly, and watching real customers use it. You will wear...Suggested
- ...ElevenLabs is hiring a backend-focused Safety Engineer to build scalable moderation and abuse-detection systems across our AI platforms. You will own production safety services and collaborate with ML engineers to deploy models at scale. You’ll work remotely with a global...SuggestedRemote work
- ...Baseten is hiring a backend/distributed systems engineer to join our Product Platform in San Francisco. You will design telemetry pipelines, own observability platforms, and build billing systems while enabling faster developer velocity and robust CI/CD. You will work...Suggested
$230k - $290k
...and automate what can be automated successfully over time.Our products are already in production with leading insurers, driving... ...USD*Location: New York, NY (Hybrid)We’re looking for strong backend engineers who love building reliable systems around fragmented, but high...SuggestedWork at officeRemote work$192k - $240k
...usBrex is the intelligent finance platform that enables companies to... ...you need to grow your career.Engineering at BrexEngineering at Brex is... ..., you will help develop new products from concept to launch, whether... ...applications with a focus on backend.Experience building and...SuggestedWork at officeRemote workWork from home$182.3k - $220k
...This is enabled by Ro's vertically integrated platform that helps patients achieve their goals... ...The Role We are looking for a Senior Software Engineer to join the Patient Experience team at Ro. This is a backend, product-focused role. You will partner closely with Product...Local areaFlexible hours- ...Cape in NYC is seeking an experienced Senior/Staff backend engineer to own architecture across Identity & Access, Subscriber Lifecycle, Provisioning... ..., Spam Protection, and Voicemail. You will collaborate with Product, Mobile, and SRE teams to enable new features, re-architect...
- ...Forage is seeking a Product Engineer in New York or San Francisco to build user-facing features with strong backend in Python and Django. You will partner with product managers and designers to translate concepts into scalable services and mentor teammates throughout medium...
- ...Thomson Reuters Foundation is seeking a Lead Product Engineer (Full Stack) to drive backend-focused product development for AI-powered features. You will own end-to-end delivery, shaping APIs and scalable services while collaborating with design and product teams....
$285k
...Make our product dependable enough that public agencies, infrastructure firms, developers... ...surface. We need a senior product engineer to turn those components into one... ...production software, including meaningful backend or platform ownership. Ownership of a product capability...- ...Streamline is seeking an experienced Software Engineer to help build backend systems and foundational infrastructure behind our growing platform. You''ll join a small, highly... ...ownership over the technical foundation of the product and the decisions that shape it as we...
$179k - $224k
A leading financial technology company seeks a Senior AI Engineer to architect, build, and deliver AI-native products. This role emphasizes innovation in AI and requires 3-6+ years of experience in backend engineering, particularly with Python and Golang. You will work...Visa sponsorship$220k - $250k
...Health is the leading technology platform that helps healthcare... ...journey. About The Role The product platform is the layer other product... ...tooling and agent workflows engineers use to ship. The scope grows... ...engineering experience with strong backend depth and the range to work...Remote workFlexible hours- ...only be sent from @Rippling.com addresses.About the HR Product TeamThe HR Product Engineering team is the foundational layer of Rippling's unified workforce... ....What you will doDesign, implement, and test reliable backend services and APIs that power core product features and...Work at office3 days per week
- ...Rippling.com addresses.About the IT Product TeamThe IT Product Engineering team is critical to unifying... ...Identity: Creating the centralized platform for provisioning and de-provisioning... ...doDesign, implement, and test reliable backend services and APIs that power core product...Work at officeRemote work3 days per week
- ...addresses.About the role:Rippling’s Emerging Products teams which span Core Experience, Spend, and IT... ...security, and scale are critical.As a Senior Backend Engineer, you’ll design and build the services, APIs, and platform primitives that power complex workflows across...Work at office3 days per week
- ...Rippling.com addresses.About the HR Product TeamThe HR Product Engineering team is the foundational layer of... ...design and implementation of core backend services and APIs that power critical... ...seamlessly with product, frontend, and platform teams to translate feature goals...Work at office3 days per week
- ...only be sent from @Rippling.com addresses.About the HR Product TeamThe HR Product Engineering team is the foundational layer of Rippling's unified workforce... ....What you will doDevelop and improve both product backend capabilities and user-facing features, working across...Work at office3 days per week
$250k - $300k
...healthcare organization, is hiring a Senior Backend Engineer to join the team in New York. The... ...a real-time clinical monitoring platform, developing services that process high... ...and deploy machine learning models into production. Responsibilities Build and maintain...$180k - $240k
...build the foundation for agent engineering in the real world, helping... ...move from prototypes to production-ready AI agents that teams can... ...have grown to also offer a platform for building, evaluating, deploying... ...We are looking for a Senior Backend Engineer to join us. In this...Work at officeFlexible hours- ...Groq, Inc. is seeking a Kubernetes Platform Engineer to build and operate production software within the GroqMetal platform, delivering Kubernetes as a commercial product for large-scale AI workloads. You will own components end-to-end, improve reliability, and collaborate...Remote work
- ...Alldus in New York is recruiting a Backend Engineer for a growing, venture-backed healthcare startup. You will design... ...to deliver meaningful health insights. Join a product-focused team shaping preventive health platforms, with emphasis on security, reliability and observability...
- ...Rippling is hiring a Software Engineer II, Backend for the Platform Team in New York, NY. You will design and scale backend services, shaping core infrastructure used across HR, IT, and Finance products. You’ll collaborate with cross-functional teams, own features...
- ...The RoleWe're looking for a backend product engineer to own the systems behind the parts of Clay our customers use every day. Clay is a product where the backend is the product — enrichment, signals, workflows, and agents are all surfaces where the engineering decision...
- ...mode, is seeking its first engineering hire outside the founding team... ...significant parts of the platform, and help shape engineering... ...Engineering role. You will write production code every day and interact... ...requires delivering robust backend and frontend work (Python and...
- ...Whatnot is hiring a Backend Engineer for the Messaging Platform team to build backend systems, APIs, and platform capabilities for reliable, scalable,... ...platform quality. The role emphasizes collaboration with product, design, data science, and other engineering teams,...Remote work
- ...Speechify is seeking a backend engineer to own APIs behind payments, subscriptions, auth, and the public TTS API, building scalable services for millions of users across platforms. You will optimize performance, reduce costs, and ensure correctness across distributed...
$180k - $250k
...Platform Engineer (Python/AWS) sought for a fast-growth and cutting-edge data/AI startup in New York. This is a well-funded and former Palantir alumni founded business who have a mission to lead the transformation towards smarter more data driven work for a number of high...- ...LangChain, Inc. is seeking a Senior Backend Engineer to design and build the backend systems powering... ...LangSmith's observability and evals platform at scale. You will work on core... ...development and collaboration with frontend and product teams. The role requires 5+ years in...
- ...Navan is seeking a Staff Engineer in the Flights group to help build and scale Navan’s flagship flight platform that serves customers worldwide. You will be hands-on while... ...across the team, partnering with engineers, product managers, and designers to deliver high-impact...Worldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Platform - Backend Engineer. Be the first to apply!
- data center design engineer New York, NY
- ic design engineer New York, NY
- chief design engineer New York, NY
- product security engineer New York, NY
- system design engineer New York, NY
- digital design engineer New York, NY
- senior product design engineer New York, NY
- senior manager product engineering New York, NY
- network design engineer New York, NY
- senior design verification engineer New York, NY



