Backend Platform Engineer - AI Inference & Observability
BaseTen
Baseten is hiring a backend/distributed systems engineer to join our Product Platform in San Francisco. You will design telemetry pipelines, own observability platforms, and build billing systems while enabling faster developer velocity and robust CI/CD. You will work across multi-cloud infrastructure, partner integrations, and cross-team initiatives to ship reliable, scalable systems for production AI inference. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Backend Platform Engineer - AI Inference & Observability in Seattle, WA vacancy
- Unity is seeking a Senior Backend Engineer to design, build, and operate... ...power our Vector Gamer AI platform, processing billions of daily impressions and model inferences. You'll own low-latency infrastructure... ...-practices in DevOps and observability. The role may include...Suggested
- ...powers mission-critical inference for the world's most dynamic AI companies, like Cursor,... ...us and help build the platform engineers turn to ship AI products... .... We’re hiring a backend/distributed systems engineer... ...agentic development Observability platform Please come...SuggestedFlexible hours
- ...Senior Lead Software Engineer at JPMorgan Chase within... ..., Infrastructure Platforms team, you are an integral... ...platforms optimized for AI/ML workloads.... ...architecture, ML training, and inference. Experience with... .... Proficiency with observability tools like Prometheus...SuggestedFor contractors
- Fluidstack is seeking an experienced engineer to own the observability platform, design API surfaces, and build a production control plane. The role requires fluency with AI tooling, experience in API design, and the ability to work under ambiguity. Candidates will lead...Suggested
- ...Braintrust is the agent observability platform. By actively applying intelligence to agent traces and automatically... ...agents operate in production. This Software Engineer role emphasizes REST/APIs, Backend, Python, Cloud, Go, AI/LLM, and ML, with remote-friendly options and...SuggestedRemote work
- Baseten is hiring an Engineer for the Dedicated Inference team to shape developer experience for deploying and operating AI workloads in production. You’ll build CLI, SDKs, APIs, observability, and debugging workflows that customers rely on daily to manage inference deployments...
- ...powers mission-critical inference for the world's most dynamic AI companies. By uniting... ...us and help build the platform engineers turn to ship AI products... ...authentication.Instrument deep observability (metrics, traces, logs)... ...distributed systems, backend infrastructure, or...Flexible hours
- About Nscale Nscale is the GPU cloud engineered for AI. We provide cost‑effective, high‑... ...future. About The Role As a Staff Observability Platform Engineer, you’ll play a critical role... ...challenges related to model training, inference workloads, GPU utilization, and distributed...
- ...industries through AI transformation. We... ...The first is our inference control plane — open... ...agent-sandboxing platform: hardware-isolated... ...building the fork engine, the guest agent,... ...Run the layer the backend services team builds... ...guest could observe, forge, or exhaust...Full timeRemote workWork visaFlexible hoursDay shift
$175k - $308.5k
We are looking for an engineer to build tooling, automation, and analysis capabilities that strengthen our AI inference platform. This role will focus on developing sophisticated performance... .... Experience with GPU profiling and observability tools (e.g., Nsight, other vendor-...Worldwide$165.6k - $273.4k
...love.Our Vector Gamer AI team sits at the... ...We're hiring a Senior Backend Engineer to build and operate... ..., and scalability of inference systems. Join us and... ...direction of our inference platform, with a focus on low-... ...using monitoring and observability tools like Prometheus...Full timeWork at officeWorldwide$180k - $250k
...Senior Backend Engineer, Managed Services New York, New York,... ...Who We Are Lightning AI is the company behind... ..., we build an end-to‑end platform for developing, training,... ...training, and production inference, with security, observability, and control built in....For contractorsWork at officeWork from homeFlexible hours2 days per week$121.5k - $145.5k
...a seasoned Sr. Software Engineer in the North America Mobility... ...role will sit in the Platform team that focuses on building AI Platform to support the... ...oriented code in our backend services.Develop public... ...evaluation frameworks, observability, and guardrails to ensure...Full timeRemote workFlexible hours- ...Nscale is seeking a Staff Observability Platform Engineer to build and evolve our observability stack, giving deep visibility into GPU clusters, AI workloads, and infrastructure. You will treat observability as a product, define scalable solutions, mentor engineers, and...
- ...WRITER is seeking a high-impact software engineer to lead the next generation of AI-powered platform solutions. You will design secure, scalable backend services and AI integration layers,... ..., and help implement a reliable, observable system that powers enterprise-wide...
- ...Airwallex, the AI-native financial operating system, is seeking a Staff Backend Engineer to shape Growth Engineering. You’ll define the technical architecture, build... ...robust systems with strong reliability and observability. The role demands 8+ years in backend development...
- ...Baseten is hiring an Infrastructure Software Engineer to build and maintain components of our ML inference platform that powers production AI applications. You"ll help developers deploy, scale, and monitor models with high performance. Join a team working on multi-cloud...
- OpenAI is seeking a software engineer to build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop OpenAI-hosted services and partner-side software for long‑lived optimization workflows, generating kernels...
- Fluidstack is seeking a highly capable engineer to own the observability platform, build data pipelines, and define the API surface for our hyperscale infrastructure... ...through IaaS processes. You should be comfortable with AI tooling, distributed systems, and creating scalable...
- Lightning AI is seeking a Senior Software Engineer to design and scale backend systems for AI development. You will work across... ...management, developer tooling, and platform APIs, partnering with... ..., scalable services, improve observability, and help shape the developer...
$200k
...Role: Senior Backend Engineer Location: Bellevue, WA Compensation:... ...partnered with a venture-backed AI infrastructure company... ...spending millions on models, inference, tooling, and AI workflows,... ...This company is building the platform that helps organisations understand...Full timeImmediate start- Apple seeks an engineer to build tooling, automation, and analysis capabilities for the AI inference platform, focusing on benchmarking, capacity projection models, and data pipelines that inform infrastructure teams and capacity planners. You will design real-time performance...
- Vivint Smart Home is seeking a Staff AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. You will create evaluation, observability, safety, and launch-readiness infrastructure to ship AI features with measurable quality and...
$165k - $242k
...CoreWeave, the AI Hyperscaler™ acquired... ...end-to-end platform to develop, deploy... ...agent building, and inference at scale, we’re combining... ...-quality, and observability standards for... ...with software engineering teams to define event... ...applications, backend services, and distributed...Permanent employmentTemporary workCasual workWork at officeFlexible hours- ...thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the... ...for specialized hardware backends, including NVIDIA GPUs (... ...ObservabilityEstablish robust observability frameworks to monitor Time... ..., Kubernetes, and cloud platforms such as AWS, GCP, and...Full timeLocal areaImmediate start
$190k - $240k
...Backend Software Engineer - GenAIArlington, Virginia, United States Or refer someone Job Openings Backend... ...-scaling technology company building AI-enabled software for high-consequence... ..., embedding pipelines, or inference optimizationDeployment experience across...Relocation package$200k - $230k
...Senior Backend Software Engineer – GenAITitle of Role: Senior Backend Software... ...modern command-and-control and AI-enabled software that helps... ...its Generative AI platform to meet significant demand.... ..., storage, data pipelines, observability, and reliabilityBuild scalable...Work at office$164k - $282k
...visionary Staff Software Engineer to lead the... ...generation durable execution platform. This team is tasked with... ...while leveraging AI to automate complex system... ...of experience in backend software development Proficiency... ...systems projects.Observability Expert: Expertise in...Temporary work- ...tailored to each user, and a platform merchants can rely on... ...our marketplace.Our engineering team builds scalable... ...and maintain scalable backend services and systems... ...scalability, reliability, observability, performance, and... ...Familiarity with modern AI-assisted engineering...Local area
$50 - $100 per hour
...boutique focused on AI, crypto,... ..., and its software platform is scaling with it. We are adding an engineer to our existing contract... ...and other model and inference providers. Improve observability, model routing, evaluations... ...Strong platform, backend, infrastructure,...Hourly payContract workRemote work10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Platform Engineer - AI Inference & Observability. Be the first to apply!
Related searches
- senior backend developer Seattle, WA
- back-end developer Seattle, WA
- backend software engineer Seattle, WA
- remote back end developer Seattle, WA
- client platform engineer Seattle, WA
- platform engineering manager Seattle, WA
- platform developer Seattle, WA
- platform engineer Seattle, WA
- data platform engineer Seattle, WA
- senior platform engineer Seattle, WA




