Senior Software Engineer, AI Platform

Senior Software Engineer, AI PlatformThe isolved Senior Software Engineer, AI Platform role owns both program execution and technical direction, leading ~20 engineers across domain teams (Tax, Benefits, Time, Payroll, Shared Logic), alongside two Engineering Managers and a Data Architect. The position blends delivery leadership with deep technical involvement, serving as a key decision-maker, escalation point for complex challenges, and ultimate owner of program outcomes.Core Job DutiesDesign and build a scalable LLM gateway with model routing, prompt management, cost attribution, rate limiting, and cachingDevelop and operate RAG pipelines, embedding services, and vector search infrastructure for platform-wide useImplement platform-level cost optimization strategies, including semantic caching and model selection by workloadBuild and maintain agentic runtime infrastructure, including orchestration, state management, and human-in-the-loop patternsDevelop extensible MCP server and tool ecosystems for product team integrationDesign and support multi-agent coordination patterns using modern frameworks and protocolsEstablish comprehensive AI observability, including usage, latency, cost tracking, and distributed tracingImplement AI governance controls, including access management, audit logging, content filtering, and security protectionsBuild AI incident detection and response capabilities, including monitoring for failures, hallucinations, and cost anomaliesCreate developer-friendly SDKs across languages (Python, .NET, TypeScript) to simplify platform adoptionDefine "paved road" patterns for common AI use cases and support onboarding of product teamsBuild automated evaluation pipelines and continuously monitor production quality and model performanceMinimum Qualifications5+ years of professional software engineering experience, with Python as your primary language2+ years building production LLM-powered systems - inference, RAG, agentic patterns, or AI infrastructureDeep Python expertise - this is the primary language for AI platform workWorking proficiency in C#/.NET - the platform serves teams that live in C#, so interop is real and mattersStrong hands-on experience with agentic frameworks - Semantic Kernel, LangGraph, LangChain, or you've built your ownProduction experience with RAG architecture: chunking strategies, embedding models, vector search, retrieval quality, and the failure modes that don't show up in demosAzure AI Foundry / Azure OpenAI experience - model deployment, API integration, observability toolingExperience building internal platforms or SDKs that other engineers depend on - you understand what makes a platform feel good to useStrong grasp of AI observability: token usage, latency, cost tracking, and distributed tracing across multi-agent workflowsPreferred:Experience with TypeScript and building developer SDKs or toolingHands-on experience with AI evaluation frameworks (LLM-as-judge, automated regression testing)Knowledge of AI governance practices, including access control, audit logging, and security safeguardsFamiliarity with container-based deployments (e.g., Azure Container Apps) and infrastructure-as-code (Terraform)Awareness of AI regulatory frameworks such as NIST AI RMF or ISO/IEC 42001About isolvedisolved is a leading provider of human capital management (HCM) solutions that combines modern technology with expert services and support. Purpose-built for People Heroes™, isolved gives HR, payroll and benefits leaders the tools and insights to streamline operations and deliver employee experiences that matter. isolved People Cloud™ is a connected HCM platform with built-in artificial intelligence (AI) and analytics that brings together HR, payroll, benefits, workforce management and talent management in one experience. Built on a legacy of 40 years in the market, isolved is trusted by more than 200,000 employers and used by 9 million U.S. employees, representing about one in 20 American workers.EEO Statementisolved is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. isolved is a progressive and open-minded meritocracy. If you are smart and good at what you do, come as you are.Disability AccommodationVisit for more information regarding our incredible culture and focus on our employee experience. Visit for a comprehensive list of our employee total rewards offerings.