Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office

Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office Location New York Business Area Engineering and CTO Ref # 10053871 Description & Requirements About the Team Bloomberg’s CTO Office is the future-looking technical and product arm of Bloomberg L.P. We envision, design, and prototype the next generation of infrastructure, hardware, and applications that power the Bloomberg Terminal and beyond. Our work spans AI platforms, cloud infrastructure, open-source stewardship, and generative AI innovation. For over a decade, Bloomberg has been at the forefront of applying artificial intelligence, ML, and NLP to financial intelligence, powering products in sentiment analysis, classification, document understanding, recommendation, and generative AI. Critical to this effort are our AI platforms, which enable teams to rapidly and robustly build, deploy, evaluate, govern, and operate AI systems at scale. As Bloomberg expands its investment in Generative and Agentic AI, we are scaling the model, cloud, compute, data, and infrastructure foundations that power the next generation of intelligent products across Terminal, Enterprise, and client-facing experiences. What’s In It For You We are looking for a Technical Product Manager to define and execute foundational capabilities for AI Infrastructure: the cloud, compute, data, networking, and runtime foundations behind Bloomberg’s AI platforms and AI-powered products. You will help shape how teams experiment with, access, deploy, serve, and operate AI models across a range of infrastructure environments, while turning rapidly evolving model, cloud, and compute capabilities into reliable and reusable platform services. You will help define common platform abstractions and paved paths that give product teams consistent ways to access AI infrastructure, while allowing the underlying models, hardware, and cloud environments to evolve. This role sits at the intersection of AI Platforms, agentic systems, cloud infrastructure, and distributed systems. You will work across engineering and product teams to improve the scalability, reliability, performance, and efficiency of Bloomberg’s AI infrastructure while preserving flexibility as models, providers, hardware, and workload patterns evolve. This is a cross-cutting role by design. You’ll need to be comfortable working across product and organizational boundaries, identifying common infrastructure needs, establishing platform direction, and driving alignment in an area where both the technology and the architecture are evolving quickly. Why This Matters The infrastructure behind modern AI systems is becoming increasingly heterogeneous. Product teams may need to choose between frontier and specialized models, managed APIs and internally hosted models, public and private cloud infrastructure, different accelerator technologies, and different serving or training patterns. Increasingly, teams must also decide where workloads execute and where data resides. Data locality, network topology, accelerator availability, regulatory constraints, and cloud placement can have significant implications for quality, latency, throughput, capacity, availability, security, and cost. Bloomberg needs common infrastructure foundations that allow product teams to take advantage of advances in AI without independently solving model hosting, provider integration, capacity management, reliability, and cloud infrastructure challenges. We’ll trust you to Define and drive the vision for Bloomberg’s AI Infrastructure, with a focus on infrastructure across models, compute, and cloudWork directly with AI product and engineering teams to understand their requirements for model quality, performance, scale, reliability, and cost, and translate common needs into reusable platform capabilitiesPartner deeply with engineering to deliver scalable, resilient system architecturePartner with cloud and infrastructure teams to advance hybrid and multi-cloud capabilities, including portability, resilience, scalability, and integration with model and cloud providersEvaluate advances across cloud platforms, model providers, infrastructure services, model-serving technologies, accelerators, and emerging AI infrastructure capabilities, and translate them into pragmatic platform opportunities and roadmap decisionsEstablish product metrics and strategies for improving latency, throughput, availability, utilization, capacity, and cost efficiency across AI workloadsPartner deeply with Engineering and stakeholders across AI Platforms, Cloud, Security, and other infrastructure organizations to align priorities, dependencies, and investmentsAnticipate how AI workloads and infrastructure requirements will evolve, balancing standardization and paved paths with flexibility and choice You’ll Need to Have 5+ years of experience in technical product management, ideally within AI, platform, cloud, compute, or infrastructure domainsExperience building, operating, or product managing large-scale platform infrastructure used by internal or external developersExperience with public cloud platforms such as AWS, GCP, or Azure, and familiarity with hybrid or multi-cloud architectureStrong understanding of distributed systems, service-to-service communication, API Gateways, Kubernetes, cloud-native architectures, and service reliabilityTechnical fluency in the tradeoffs involved in operating AI workloads, including latency, throughput, availability, scalability, accelerator utilization, and costFamiliarity working with AI or GenAI systems, with LLMs, generative AI, and their production requirementsProven ability to work cross-functionally with engineering, security, product, and platform organizationsExcellent communication and storytelling skills, with the ability to translate between user needs, business priorities, and technical architecture, and influence across diverse teams We’d Love to See A degree in Computer Science, Engineering, related technical disciplines, or prior equivalent practical experienceExperience with GPU or accelerator infrastructure, HPC workloads, capacity planning, scheduling, or multi-tenant resource managementExperience with AI infrastructure platforms, MLOps, inference or training platforms, model gateways, inference techniques, model-as-a-service offerings, model optimizationContributions to open-source infrastructure, AI, or developer ecosystemsFamiliarity with financial services or other large-scale, regulated enterprise environments Why Join Us You will play a pivotal role in shaping Bloomberg’s AI future by building the infrastructure foundations that enable trusted, scalable, and production-ready AI systems. This is an opportunity to help define how AI systems operate at enterprise scale. You will work alongside world-class engineers, architects, researchers, and product leaders while helping establish the trusted infrastructure foundation that powers Bloomberg’s next generation of AI innovation. Salary Range = 140,000 - 295,000 USD Annual + Benefits + BonusThe referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level. We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns. Discover what makes Bloomberg unique - watch our podcast series for an inside look at our culture, values, and the people behind our success.