Senior Backend Engineer- AI Agents

Role Description

As a Senior Engineer – AI Agents, you will play a critical role in building the scalable backend systems that power Level AI’s next-generation AI Agents. These systems operate in real-time, high-volume enterprise environments and are central to delivering intelligent, production-grade AI experiences.

You will work at the intersection of distributed systems, cloud infrastructure, and AI-powered applications—bringing agentic AI capabilities into production at scale.

• Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
• Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)
• Build systems for agent memory, context management, and state persistence across interactions
• Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services
• Implement evaluation (evals) frameworks to measure agent performance, accuracy, and reliability
• Enable continuous improvement loops (feedback → retraining → deployment) for AI agents in production
• Design and manage event-driven, asynchronous workflows for complex agent tasks
• Optimize systems for high throughput, low latency, and cost-efficient inference at scale
• Build and maintain robust APIs and service layers (REST / gRPC) for agent capabilities
• Partner closely with Applied AI / ML teams to productionize models and agent behaviours
• Collaborate with Product and Solutions teams to translate real customer workflows into agentic systems
• Drive best practices in observability, monitoring, safety, and guardrails for AI systems
• Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms

Qualifications

• 5+ years of experience in backend engineering, distributed systems, or platform engineering
• Strong experience building high-scale, production-grade backend systems
• Experience designing systems for real-time processing, streaming, or event-driven architectures
• Strong understanding of API design (REST, gRPC) and microservices architectures
• Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
• Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
• Strong fundamentals in system design, concurrency, and performance optimization

Requirements

• Experience working with LLMs, conversational AI, or AI-powered products in production
• Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
• Experience building or integrating RAG pipelines, vector databases, or retrieval systems
• Exposure to evaluation systems (offline/online evals, A/B testing for AI systems)
• Understanding of prompting strategies, context windows, and model behavior optimization
• Experience with real-time decisioning systems or workflow orchestration engines

Benefits

• Competitive compensation with performance-based upside
• Flexible vacation policy
• Health insurance coverage
• Work with a globally distributed, high-impact team
• Opportunity to build cutting-edge AI products at scale
• Regular team offsites and in-person collaboration