Platform Engineer - AI Engineering

Responsibilities

• Configure and manage multi-engine API gateways with dynamic routing rules, rate limits, and fallback logic for LLM requests.
• Migrate and integrate firm-wide tools into the centralized management plane so AI traffic is securely logged and governed.
• Manage AI services in enterprise landing zones, including Azure OpenAI instances, model deployments, and API key generation, in partnership with the Cloud team.
• Write Go and Python code for the usage dashboard synchronization loop and automated progressive-friction mechanisms such as alerts.
• Register and route self-hosted, on-premise models within the AI gateways in partnership with the Inference Infrastructure pod.

Requirements

• Strong backend programming experience in Go and/or Python.
• Hands-on experience with API design, integration, and platform or cloud engineering concepts.
• Familiarity with API gateways, proxy configuration, or distributed system networking.
• Strong interest in the LLM ecosystem and the technical mechanics of AI tooling.
• Collaborative approach and focus on writing clean, maintainable code.

Benefits

• Comprehensive medical, pharmacy, dental, and vision insurance.
• 401k with discretionary employer match.
• Short- and long-term disability insurance.
• Life and AD&D insurance.
• Health savings accounts and flexible spending accounts.
• Annual discretionary bonus eligibility.