Backend Engineer - LLM Observability (LLM O11y) Team
Honeycomb
Little more about the team: The LLM Observability (LLM O11y) team builds the foundational layer that makes AI workloads observable in Honeycomb. We define how AI systems are represented in telemetry ( spans, traces, token usage, cost, eval signals, etc ), and ensure that data from diverse ecosystems (e.g., LangChain, OpenLLMetry, Braintrust ) is normalized into a consistent OpenTelemetry-based model . This team owns the infrastructure and data model that all downstream AI observability experiences rely on. Our work powers everything from cost analysis to anomaly detection . If you’re excited about defining and building the “source of truth” for how AI systems behave in production, this is th...
- ...Little more about the team: The LLM Observability (LLM O11y) team builds the foundational layer that makes... ...role: Design, build, and deliver backend systems and APIs. You'll architect... ...skills you'll use daily. You'll mentor engineers, share knowledge, and delegate to...SuggestedFull timeFlexible hoursShift work
$183.34k - $206k
...present future, defining observability and raising expectations... ...of 2022 and 2023! The LLM Observability (LLM O11y) team builds the foundational layer... ..., build, and deliver backend systems and APIs. ~Build... ...~Experience mentoring engineers and leading technical design...SuggestedFull timeWork at officeWork from homeHome officeFlexible hours$183.34k - $206k
...present future, defining observability and raising... ...truly love amongst a team of highly talented (... ...the team: The LLM Observability (LLM O11y) team builds the foundational... ...build, and deliver backend systems and APIs.... .... You'll mentor engineers, share knowledge, and...SuggestedFull timeWork at officeLocal areaRemote workWork from homeHome officeVisa sponsorshipFlexible hoursShift work- ...transparency, trading engine speed, deep liquidity,... ...stack, including frontend, backend, and AI-powered... ...data integrations, and LLM-powered capabilities. We... ...security, and infrastructure teams to understand user... ...systems. Experience with observability, monitoring, alerting,...SuggestedFull timeWork from home
- ...transparency, trading engine speed, deep liquidity,... ...Responsibility Contribute to backend and/or full-stack... ...deployment of AI/LLM capabilities based on business... ...effectively across teams. Requirements Currently... ...(AWS/GCP/Azure), or observability (Prometheus/Grafana/ELK...SuggestedFull timeFixed term contractInternshipWork from home
- ...Development and implementation Backend service for the AI Chatbot... ...Explore and integrate the LLM applications to improve chatbot... ..., and maintainable code using engineering best practices guide junior engineers... ...knowledge. Good cross-team communication skills. Familiarity...Remote jobFull timeCasual workFlexible hours
- ...designed to augment clinical teams, automate routine... ...models (ASR, TTS, Speech-LLM) — from architecture, training... ...strategies. Mentor engineers on data curation, fine-... .... Collaborate with backend/ML-ops for production readiness, observability, and health metrics....Remote work
$70k - $100k
...company as one of its first backend engineers. The company builds AI voice... ...directly with the founding team, and ship into real customer... ...payer portals Own reliability, observability, and performance of agent... ...Nice to Have: Experience with LLM agents or deployed AI models...Remote workVisa sponsorship$148k - $201k
...Censys is seeking a Senior Software Engineer to join our SOC/TH team focused on AI and LLMs . The SOC-TH... ...~Strong proficiency in Python for backend and API services development. ~Familiarity... ...and designing regression testing for LLM pipelines. ~Ability to rapidly...Full time- ...contractors) Department: Engineering About Hamming AI... ...the fastest engineering teams in the world. We prod... ...and scale across our LLM-enabled platform, shipping... ...services. Level-up observability : deepen OpenTelemetry... ...experience running distributed backends with real-time/...Full timeFor contractorsImmediate startRemote work
$70 - $80 per hour
...Description CTG is seeking to fill an AI Engineer (LLM / Generative AI) opening for our premier... ...AI workflows ~Develop scalable backend applications using object-oriented programming... ...~Collaborate with cross-functional teams to design technical solutions aligned with...Hourly payContract workFor contractors- ...0k - $220kJoin a cutting-edge team building next-generation AI systems... ...as a full-time Senior AI Engineer II. You’ll work with modern technologies... ...with production-level ML/LLM systems Programming experience... ..., or applied AI architectures Backend engineering expertise across...Full timeRemote workFlexible hours
- ...that are agent assist backend services and scalable... ...the frontend platform team, ML teams, infra team,... ...strong versatile backend engineers who want to work at... ...Agents, Virtual Agents, or LLM-based systems is a... ...of system reliability, observability, and security in...Full timeWork at officeLocal areaRemote workWork from homeHome office
- ...Beacon AI We’re a fast-moving team of aviators, engineers, and operators building an... .... You will ship LLM-powered product features end... ...Choose and tune vector backends such as OpenSearch, pgvector... ...You keep things simple and observable. RAG and tools depth: You...Permanent employmentFull timeLocal areaRemote work3 days per week
- Role Description We're looking for a Sr Backend Engineer for Nerve team, our AI pod. Nerve team builds the AI layer of SigNoz: Noz (observability AI teammate inside SigNoz), the SigNoz MCP server, AI SRE, and LLM/GenAI observability. What you'll work on: ~Noz, AI teammate...Full timeRemote work
- ...Description We're seeking a Senior Backend Engineer to help build and scale the... ..., and collaborating across teams to integrate with machine... ...~Familiarity with voice or LLM-powered systems (e.g., STT,... ...deployment, monitoring, or observability. Benefits ~Build mission...Permanent employmentFull timeRemote workWorldwide
- ...models. We are seeking a Senior Full-Stack Engineer to lead the development of a proof-of-concept prototype that integrates LLM-based analysis into existing CI/CD workflows... ...Proficiency in Python (FastAPI) or Node.js for backend; React or Vue for frontend. - Experience...Full timeContract workRemote work
- ...We're looking for a senior backend engineer to help build and scale the... ...processing. Analytics and observability : Designing our data layer... ...ecosystem support and good LLM integration (Prisma, WorkOS,... ...or bring genuine joy to the team. Strong foundations let us move...Full timeLive inWork at officeNight shift
$160k - $210k
...Description ClickUp is hiring a Senior Backend Engineer - AI Product to join the AI Engineering team and build the backend services... ...services that are reliable, observable, and tightly integrated with the... .... ~Familiarity with LLM integration patterns: RAG, function...Full timeRemote workShift work- ...join our experienced engineers and leaders! Responsibilities... ...~Build and ship backend services as part of... ...architecture, with AI agents and LLM-powered features as a... ...to latency, cost, and observability. ~Raise the bar and... ...of autonomy. ~The team. Collaborative. Fun....Full timeWork at officeRemote workFlexible hours
- Role Description As our Senior Backend Engineer, you’ll design and build the... ...with founders and ML teams to deliver end-to-end agent... ...containerization (Docker, Kubernetes) and observability tools (Prometheus, Grafana)... ...~Knowledge of LLM APIs, prompt pipelines, and...Full time
- ...We are looking for a Senior Backend Engineer (GoLang) with deep Go expertise to join the Gateways team. This is a hands-on individual... ...) product ~AI Gateway for LLM traffic management ~MCP... ...availability, scalability, and observability requirements ~Stay current...Full time
- ...domains. AI agents and LLM-driven workflows are a... ...retried, branched, and kept observable inside the orchestrator... ...in the Kestra engine ~Build and maintain... ...together with the product team ~Keep AI executions... ...demos Requirements ~Backend: Java, Micronaut ~Frontend...Full timeRemote workWork from homeWorldwideHome office
- ...Description We’re hiring a Senior Backend Engineer to own meaningful parts of... ...and the application teams who build on top of your work... ...job. ~Treat performance, observability, and operational health as part... ...observability tooling. ~LLM and vector DB familiarity....Full timeRemote work
- ...Description We're a lean, high-agency team. Engineers here own real scope: there's... .... If you write solid backend systems, take ownership... ...production operation ~Own the observability stack: structured logging (... ..., internal tooling, or LLM-integrated workflows that saved...Full time
- ...Description We’re looking for a Backend Software Engineer (US-based)to join our team in a full-time, remote role. You’... ...backend services that support CV/LLM workflows, analytics, and... ...emphasis on latency, throughput, and observability . Support experimentation while...Remote jobFull time
- ...large language models (LLMs). We are seeking a Senior Full-Stack Engineer to design and deliver the prototype end-to-end. ~Own the... ...FastAPI) or Node.js and React. ~Proven experience integrating LLM APIs (such as OpenAI GPT-4, Anthropic Claude) into production systems...Full timeContract workFreelanceRemote work
$170k - $180k
...anxiety and depression. Vida's team of Obesity Medicine-... ...looking for a highly skilled Backend Software Engineer IV to design, build, and scale... ...~ Strong understanding of observability, profiling, and performance... ...Experience integrating AI/LLM models or working alongside...Permanent employmentFull timeLocal areaRemote workVisa sponsorshipWork visa- ...We are looking for a Senior Backend Engineer to build Dwelly’s internal Data... ...records. ~Use LLM APIs pragmatically for schema... ...operations and integration teams. Qualifications ~Strong... ...workflows. Experience with observability, logging, monitoring and CI/...Full timeRemote work
$140k - $160k
...We’re looking for a Senior Backend Engineer with deep Django expertise to... ...Improve system reliability, observability, and operational readiness in... ...the broader engineering team ~Implement secure authentication... ...Have Experience with AI/LLM-enabled products or backend...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Engineer - LLM Observability (LLM O11y) Team. Be the first to apply!
















