Platform Engineer

NetDocuments is committed to providing an excellent candidate experience and will never ask you to engage in recruitment activity without phone, video, and in person meetings and communications from emails using the @netdocuments.com domain. If you have any concerns or questions about communications you have received, please send them to View email address on click.appcast.io so our team members can review.About NetDocumentsAt NetDocuments, we're shaping the future of legal work. We believe legal professionals should spend less time searching for information and managing documents, and more time solving complex problems, serving clients, and delivering meaningful outcomes. That's why we're building technology that helps organizations work smarter, collaborate more effectively, and unlock the full value of their institutional knowledge.Our team is redefining what's possible for legal technology. NetDocuments is the trusted intelligent document management platform for legal professionals and the company behind the industry's first and only legal context graph—a breakthrough that gives legal professionals and AI a richer understanding of how matters, documents, people, and knowledge connect across an organization while respecting enterprise-grade security, governance, permissions, and ethical walls.Innovation is only part of our story. We believe our greatest strength is our people. We foster a collaborative, inclusive, and high-performing culture where curiosity is encouraged, diverse perspectives are valued, and employees are empowered to make a meaningful impact. Whether you're building products, serving customers, or supporting the business, your work helps shape the future of one of the world's most trusted legal technology platforms.That commitment to our employees and customers has earned us recognition as one of the nation's top workplaces, including:Four consecutive appearances on the Inc. 5000 list of America's Fastest-Growing Private CompaniesFive-time Top Workplace USA winnerFive-time Salt Lake Tribune Top WorkplaceMultiple Top Workplaces Culture Excellence awards recognizing innovation, employee appreciation, work-life flexibility, and compensation & benefitsIf you're excited to solve meaningful challenges, work alongside talented colleagues, and help define the next generation of legal technology, we'd love to meet you.Your opportunity for impact:NetDocuments is seeking an in-office LLM Platform Engineer who will replace our gateway with a real platform: a gateway that every internal model request flows through, with identity, budgets, routing, and audit built in.You will own that gateway end to end — building it, running it, and being the person paged when it breaks. You will make AI spend attributable to the team and use case that generated it, and you will own the path a business team follows to get a new AI use case approved and provisioned. Our Corporate AI function owns AI strategy; you own the platform it depends on.To be clear about where this sits: this is an internal business systems role. You will build and run the platform NetDocuments employees use to do their own work, not the customer facing product. It lives in Corporate IT Operations alongside identity, endpoint, and collaboration services, and it reports to the Senior Manager, Corporate IT Operations.What your contributions will be:AI Gateway Operations Deploy, configure, and operate the AI gateway that fronts internal large language model traffic, including the provider connections behind itIntegrate the gateway with Microsoft Entra ID for single sign on and role based access, and manage virtual API keys through scoping, rotation, and revocationOwn gateway availability, latency, and capacity, including upgrades and change managementImplement request path controls such as redaction, data loss prevention, and audit logging to meet Security, Compliance, and FedRAMP requirementsModel Routing and Cost Control Implement and tune routing policy so requests are served by the appropriate model by default rather than by user selectionBuild spend attribution by team, application, use case, and API key across both seat based and API based consumptionConfigure and enforce budgets, rate limits, and hard stops, replacing manually administered per person spend capsFind and reduce avoidable consumption, including retry loops, oversized context, and wrong model defaults, and supply the usage data behind vendor and renewal decisionsUse Case Intake and Provisioning Run the intake path that takes a team from an AI use case request to provisioned, governed accessCoordinate review with Security, Compliance, and Legal, and provision approved use cases with the right access, budget, and logginMaintain the register of approved use cases and drive down the time from request to accessIncident Response and Reliability Act as first responder for gateway outages, provider degradation, authentication failures, rate limit events, and runaway spendMaintain runbooks and escalation paths, and cross train the Corporate IT Operations team so gateway support is not single threadedRun post incident review and drive corrective actions to closureReporting and Documentation Provide a weekly AI platform update covering spend, adoption, gateway health, incidents, and risksProduce monthly attribution and utilization reporting for Finance and leadership, and supply the underlying data to Business Intelligence for adoption dashboardsDocument gateway configuration, provider connections, routing policy, and operational proceduresOther duties as assignedRequired experience and education:Platform Operations & Reliability Engineering — 4-5 years operating a cloud production service that other teams depend on, including on call ownership and the habit of fixing causes rather than symptoms. AWS or AzureAPI Gateway, Reverse Proxy & Service Mesh Engineering — hands on production experience with Envoy, Kong, LiteLLM, Portkey, NGINX, or similar, at the configuration and code level rather than through a vendor consoleAuthentication & Authorization Engineering — OIDC, OAuth 2.0, SAML, role-based access control design, and credential lifecycle management for both human and service identitiesBackend & Systems Engineering — Python or Go at middleware level, plus infrastructure as code and containerized deploymentObservability & Instrumentation — metrics, structured logging, and distributed tracing, with the instinct to produce telemetry rather than only consume dashboards. Attribution is an instrumentation problem before it is a finance problemUsage-Based Cost Attribution & Chargeback — you have made consumption spend attributable, forecastable, and enforceable. This role is measured substantially on financial outcomesProcess Design, Technical Documentation & Stakeholder Reporting — you automate coordination workflows rather than personally chasing them, and you write clearly for readers who are not engineersBachelor's degree — Computer Science, Engineering, or a related field, or equivalent practical experienceIdeally you will have:Microsoft Entra ID specifically, as it is our identity provider; large language model API behavior including token accounting, streaming, and context limits; MCP and tool calling architectures; data loss prevention or data classification on a request path; SOC 2, ISO 27001, or FedRAMP environments; and SQL or Snowflake.What You’ll Love About NetDocumentsThe People! 90% healthcare premiums company covered HSA company contribution 401K match at 4% with immediate vesting Flexible PTO (typically 3 to 4 weeks a year) 10 paid holidays Monthly contributions for life activities & wellness Access to LinkedIn learning with monthly dedicated time to explore Compensation TransparencyThe compensation range for this position is:  $110,000 - $120,000The posted cash compensation for this position includes on target earnings, base salary and variable if applicable. Some roles may qualify for overtime pay. Individual compensation packages are determined based on various factors specific to each candidate, such as career level, skills, experience, geographic location, qualifications, and other job-related considerations #LI-ONSITEEqual Opportunity NetDocuments is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind. All employment decisions are based on business needs, job requirements, individual qualifications, without regard to race, color, religion, sex, (including pregnancy), national origin, age, physical and mental disability, marital status, sexual orientation, gender identity and/or expression, military and veteran status, or any other status protected by laws or regulations in the locations where we operate. NetDocuments believes diversity and inclusion among our employees is critical to our success, and we are committed to providing a work environment free of discrimination and harassment.