Sr. Software Engineer - AI Agent and LLM Applications

Sr. Software Engineer - AI Agent and LLM ApplicationsDate: Oct 14, 2026Location: San Jose, California, United StatesCompany: Super Micro ComputerJob Req ID: 30247About Supermicro: Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job Summary: We are building an AI Agent–powered platform to handle customer issues related to AI Servers and Racks. The system will interact with customers via chatbot, analyze issue tickets, and generate troubleshooting steps for the on-site service team. This role focuses on the design, implementation, and system integration of the Agent platform.Essential Duties and Responsibilities:Design and implement Multi-Agent or Tool-using Agent systems (using OpenClaw or other agent frameworks)Define, develop, and maintain Tools / Function Calling interfaces that agents can invokeIntegrate with external systems (ticket systems, databases, monitoring data, automation workflows, etc.)Build and optimize the RAG pipeline and integrate the existing Knowledge BaseSupport hybrid deployment and switching between cloud models (e.g., Grok) and local models (e.g., Ollama)Implement agent execution flows, error handling, human-in-the-loop, and escalation mechanismsCollaborate with the Automation team to ensure stable Tool interfaces and proper access controlEstablish basic logging, tracing, and observabilityQualifications:Experience in LLM applications or AI Agent development (2+ years of experience is preferred)Hands-on experience building Tool-using Agents or Multi-Agent systemsFamiliarity with Function Calling / Tool Use and agent orchestrationExperience implementing RAG (vector databases, embeddings, retrieval tuning)Strong Python skills with API design and system integration experienceExperience with at least one major LLM API and local model deployment solutionsAbility to communicate effectively with cross-functional teams (Automation, Domain SMEs)Experience integrating with ITSM, technical support, operations, or monitoring systems is a plusHands-on experience with frameworks such as OpenClaw, LangGraph, CrewAI, or AutoGen is a plusExperience with agent observability, cost control, or production deployment is a plusExperience implementing human-in-the-loop or escalation mechanisms is a plusSalary Range $160,000 - $200,000 The salary offered will depend on several factors, including your location, level, education, training, specific skills, years of experience, and comparison to other employees already in this role. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in bonus and equity award programs.EEO Statement Supermicro is an Equal Opportunity Employer and embraces diversity in our employee population. It is the policy of Supermicro to provide equal opportunity to all qualified applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or special disabled veteran, marital status, pregnancy, genetic information, or any other legally protected status.