Senior Software Engineer - Infrastructure

Overview

The Infrastructure team in Finetuning, Inference and Training (FIT) group is looking for a Senior Software Engineer who loves to build scalable, highly available, and secure microservices that run in Kubernetes. The Infrastructure team focuses on managing a large fleet of Azure Kubernetes Services (AKS) that represents the control and data plane services for AI Platform.

The team focuses on: Managing Kubernetes Cluster Deployments at Scale. Secure Control and Data Plane assets from malicious attacks and unauthorized access using industry standard tools and frameworks. Automate monitors and critical alerts using best in class observability tools such as: Azure Monitor, Prometheus, Azure Data Explorer, Grafana. Automate CI/CD deployments using YAML builds and releases.

We build tools to increase the observability of the applications running in the Kubernetes clusters, improve the speed, security, and reliability of our deployments, secure our supply chain and services, and debug production with ease. We use the best of open source, like Prometheus, Grafana, KEDA and Istio, and build solutions to enable AI Platform to deliver a global service that handles large scale Microsoft Foundry training and inferencing workloads.

As a Senior Infrastructure Engineer, you will design and automate secure, highly available Kubernetes low-latency/high throughput services and the systems that deploy, observe, and operate them at scale. You will deepen your expertise in cloud infrastructure, 1P/3P model deployments, network Isolation, distributed systems, reliability engineering, security, and production operations while partnering with software engineers and service teams.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

As a Senior Software Engineer on our team, you will drive the design, development, and support of the platform that powers Microsoft Foundry Infrastructure team. You’ll work across teams to help make the whole organization successful. Your responsibilities will include the following:

• Extensive experience with Kubernetes cluster creation, management, and optimization. Hands-on experience with CPU/GPU support in Kubernetes.

• Expert level knowledge around security and compliance experience for Kubernetes.

• Extensive experience developing Infrastructure as Code (IaC) and Configuration as Code (CaC) solutions using tools like YAML, Bicep, and Helm.

• Solid understanding of networking in k8s for inter, intra and external pod-to-pod, control and data plane communications.

• Write clean and concise code with unit tests.

• Design, implement, and support new features as well as extend existing systems.

• Investigate live site issues and implement and deploy fixes.

• Participate in an on-call rotation.

• Security Configuration and Compliance: Configure, update, and maintain security tools used for endpoint security, log collection and reporting, vulnerability, and compliance scanning. Hardening and compliance with best practices, benchmarks, and remediate vulnerabilities as reported by security.

• Uses appropriate artificial intelligence (AI) tools and practices across the software development lifecycle (SDLC) in a disciplined manner. Takes responsibility for the content of their AI-generated changes to artifacts, reviewing all changes and applying appropriate tooling and processes with minimal guidance.

• Build and operate large-scale Kubernetes-based infrastructure that powers Microsoft Foundry, focusing on reliability, security, scalability, and observability.

• Own platform engineering areas including AKS fleet management, monitoring and alerting, CI/CD automation, and production operations.

• Drive operational excellence by troubleshooting live-site issues, participating in on-call, and continuously improving service quality and engineering practices.

• Provide technical leadership through architecture decisions, cross-team collaboration, code and design reviews, and raising the engineering quality bar across the organization.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

• OR equivalent experience

Other Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Preferred Qualifications:

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

• OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

• OR equivalent experience

• Experience in K8s platform design and implementation at scale

• 5+ years of experience with coding in one of C#, Python, Go, Rust, Java, C or C++.

• Experience with improving service operations or engineering fundamentals

• Excellent collaboration skills, team player, thrive to make a difference

• Excellent architecture and design skills

#AIINFRA

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations. (