Principal Software Engineer, ML & Distributed Systems
$142.8k - $274.8kMicrosoft
Overview We are looking for a Principal Software Engineer to design, build, and operationalize machine learning systems and hyperscale distributed services that power Microsoft's AI experiences. This is a role for an engineer who is equally at home training and shipping ML models and building the large-scale distributed infrastructure that serves them — and who has the appetite to do both. You will own systems end to end: from model development and evaluation, through the serving and orchestration layers, to reliable operation at hyperscale. MSN is a personalized content feed powering user experiences across Microsoft. Our mission is to empower every person on the planet to be informed, entertained, and inspired. With nearly 30 years of history, MSN has evolved into a premier content destination with high-quality content, AI-powered user-controlled personalization, and massive global reach. Over the past 4 years, AI and Machine Learning technologies have fueled massive growth, transforming MSN’s content moderation, personalization, and content entry points.Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Design, build, and operationalize scalable ML and deep learning models using containers and orchestration platforms (e.g., Kubernetes).
- Develop and refine LLM prompt and fine-tuning strategies, build evaluation pipelines, and continuously optimize model quality, latency, and cost.
- Architect, implement, and operate multi-tiered distributed services at hyperscale, with high availability, fault tolerance, and low latency.
- Build model serving and inference infrastructure, including caching, batching, GPU capacity management, and A/B experimentation at scale.
- Design scalable APIs, data pipelines, and feature/signal stores that ensure efficient, secure, and reliable data flow between ML systems and product surfaces.
- Drive live-site excellence: instrumentation, monitoring, capacity planning, and incident response for ML-backed services.
- Collaborate with applied scientists, data scientists, backend engineers, and product teams to translate requirements into production ML systems.
- Participate in code reviews and architectural discussions, and mentor engineers across both ML and systems disciplines.
Qualifications
Required Qualifications:- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Proven experience designing, developing, and operating multi-tiered distributed services at scale.
- Hands-on experience building, deploying, and operating machine learning systems in production (model training, evaluation, and/or LLM-based applications).
- Experience working through full product cycles, from initial design to final delivery.
- Experience with LLM application patterns: prompt engineering, RAG, fine-tuning, and model evaluation frameworks.
- Experience with ML infrastructure: distributed training, inference optimization, GPU capacity management, and orchestration platforms such as Kubernetes.
- Experience with large-scale data systems (streaming, caching such as Redis, feature stores) and experimentation platforms.
- Demonstrated ability to work across the ML/systems boundary and a strong desire to keep doing both.
$142.8k - $274.8k
...: Less than 25%Profession: Software EngineeringDiscipline: Software... ....We are looking for a Principal Software Engineer to design, build, and operationalize hyperscale distributed systems that power Microsoft’s content... ...reliable data flow between ML systems and product...SuggestedOngoing contractLocal area$145k - $155k
...and all the way up to ML/AI with a unified platform... ...and optimization Distributed query execution and scheduling... ...Vectorized execution engine Data security... ...Storage management system What we look for:... ...projects We are hiring Software Engineer - New Grads, Distributed...SuggestedFull timeWorldwide$142.8k - $274.8k
...advertising market already online. Search engines, web publishers, major ad networks,... ...of this effort, working on large distributed systems with low latency and high throughput.... ...that will unleash your potential. As a Principal Software Engineer and member of this team,...SuggestedOngoing contractFull timeWork at officeLocal area$142.8k - $274.8k
...Hardware and Infrastructure Engineering (SCHIE) is the team... ...firmware and platform software stack that powers... ...infrastructure. We are seeking a Principal Software Engineer to... .... These services distribute critical updates to... ...challenging distributed systems and platform...SuggestedOngoing contractFull timeWork at officeLocal areaWorldwide$157.7k - $213.8k
...improve their business. Founded by engineers — and customer obsessed — we leap... ...SQL query engines. As a software engineer on the Runtime team at Databricks... ...be building the next generation distributed data storage and processing systems that can outperform specialized...SuggestedLocal areaWorldwide$142.8k - $274.8k
...Infrastructure builds the platforms, systems, and operating mechanisms that enable... ...inference on Azure. You will work across distributed storage, Kubernetes, GPU clusters,... ...cost-efficient infrastructure. As a Principal Software Engineer, Storage Infrastructure, you will design...Ongoing contractFull timeLocal areaRemote work$142.8k - $274.8k
...customer-grounded quality system for Copilot. Our mission is... ...innovation. We are looking for a Principal Software Engineer to architect and build the... ...and delivering large-scale distributed systems, data platforms,... ..., agent systems, or AI/ML platforms. Demonstrated...Ongoing contractFull timeLocal areaShift work$142.8k - $274.8k
...workflows and end user interfaces. We are looking for a Principal Software Engineer to emphasize technical leadership, architectural... ...technologies and cloud-based architectures to build large-scale distributed systems and AI/ML, Agency experience. #MSFTSecurity #Entra,...Ongoing contractFull timeLocal areaShift work$142.8k - $274.8k
...looking for a highly experienced Principal Software Engineer to help define the... ...interfaces, and end-to-end system design. Design, build, and... ...and delivering large-scale distributed systems, cloud platforms, developer... .... Experience with AI/ML platforms, generative AI,...Ongoing contractFull timeLocal area$142.8k - $274.8k
...and platform reliability. This Principal Software Engineer role owns core architectural and technical... ...deep expertise in low-latency distributed systems solid leadership in large-scale refactoring... ...systems. Experience working with ML-driven decision systems or...Ongoing contractFull timeWork at officeLocal area$142.8k - $274.8k
...Model as a Service, Azure ML, Cognitive Services, and the... ...content. We are looking for a Principal Software Engineer - Responsible AI who is... ..., and develop large-scale distributed cloud services and solutions... ...services and distributed systems. ~4+ years of technical engineering...Ongoing contractFull timeWork at officeLocal area$229k - $412k
...advanced AI-native platform. We work on large scale distributed systems, processing almost 3 trillion events per day and this... ...detected in their environments. This is a Principal Software Development Engineer (SDE) role in the CTIO team that delivers the cutting...Permanent employmentWork experience placementWork at officeLocal areaRemote work$264k - $379.5k
...gets done.We are hiring a Principal Software Engineer for our Anti-Abuse team. The... ...routingDesign intelligent mitigation systems that automatically throttle... ...engineering experience in distributed systems, cloud platform... ...detection, adversarial ML, or platform trust and...$133k - $222k
...Excellence, and Advance with Innovation.As our Principal Software Engineer, you will be driving and supporting... ...equipment and various JBT Marel systems using computer vision for the food processing... ..., object recognition.Experience in AI/ML integration.Experience in applied math...Full timeTemporary workLocal areaWork from home$142.8k - $274.8k
...Less than 25%Profession: Software EngineeringDiscipline:... ...heart of the Windows ML ecosystem, powering experiences... ...frameworks, execution engines, and hardware... ...partners, and operating system components to define the... ...Windows.We are looking for a Principal Software Engineer to...Ongoing contractWork at officeLocal areaWorldwideShift work$190.5k - $300k
...OpportunityChewy is seeking a Principal Software Engineer to provide technical leadership... ...scalable, resilient, and extensible systems spanning cloud-native services, distributed architectures, APIs, event-... ...architecting or integrating AI/ML-enabled applications, including...Local areaFlexible hours$110k - $220k
...Home OfficeJoin Walmart as a Principal Software Engineer for the Colony Platform... ...platforms. You will shape system architecture, influence engineering... ...that are executed by a distributed process engine. This... ...Experience working with AI/ML ecosystems in production environments...Full timeContract workTemporary workPart timeLocal area$260k - $345k
...goal of enabling human life on Mars. PRINCIPAL SOFTWARE ENGINEER, CDN (STARLINK) At SpaceX we're... ...world's most advanced broadband internet system. Starlink is the world's largest... ...pivotal in this effort, building scalable distributed systems that underly the future...Temporary workWorldwideWeekend work$280k - $402.5k
.... We design and build frameworks, systems and services that keep Snowflake secure.As a Principal Software Engineer II on the Product Security team, you... ...security, software engineering, distributed systems, software infrastructure, AI/ML, applied cryptography, threat modeling...$142.8k - $274.8k
...and other digital platforms. As a Principal Software Engineering Manager , you will lead a team of engineers... ..., cloud services, or large-scale distributed systems. ~ Hands-on experience designing... .... ~ Experience delivering AI/ML or generative AI solutions, such as...Ongoing contractFull timeLocal area$200k - $285k
...enabling human life on Mars. PRINCIPAL SOFTWARE ENGINEER (PLATFORM TEAM)The Platform... ...gateways and proxy systems that allow engineers and operators... ...operating large-scale AI/ML platforms, internal developer... ...Deep expertise in MLOps, distributed compute, model lifecycle management...Permanent employmentTemporary work$225k - $345k
...of enabling human life on Mars. PRINCIPAL SECURITY SOFTWARE ENGINEER (STARLINK) At SpaceX we're leveraging... ...s most advanced broadband internet system. Starlink is the world's largest... ...solutions for operating systems, distributed systems, or other enterprise/large-...Temporary workWork at officeWorldwideMonday to FridayFlexible hoursWeekend work$132k - $264k
...Segment: Home OfficeRole summary: The Principal Software Engineer leads platform engineering efforts... ...multiple teams, integrating AI/ML capabilities and ensuring high availability... ...response.Expertise in designing distributed systems optimized for real-time data processing...Full timeTemporary workPart time$118.7k
...a tool, it's your playground. Our engineers work on scalable systems, cloud services, and customer-facing... ...scalable, reliable services, with distributed-systems scope varying by team. * Participate... ...control systems Knowledge of software development lifecycle, including...Full timeSummer workInternshipSeasonal workSummer internshipWork at officeLocal areaWorldwideMonday to Friday$142.8k - $274.8k
...Overview We are looking for a Principal Software Engineer to provide hands-on technical leadership for... ...platform, a highly sensitive, large-scale distributed data platform supporting critical... .... The role requires deep distributed-systems expertise and the ability to reason...Ongoing contractFull timeLocal areaImmediate start$117.2k - $313.7k
...You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public Cloud - Distributed Systems Software Engineer posting, recruiters...Full time$142.8k - $274.8k
...lives around the world. We are hiring a Principal Software Engineer / Architect to help define the future... ...secure, resilient, and globally distributed platforms while driving the architectural... ...and service teams can build secure systems without compromising developer productivity...Ongoing contractFull timeLocal area$149.8k - $262.2k
...Description It all started when engineer Fred Luddy wrote code... ...a Senior Staff Software Engineer (IC5 Level)... ...You will partner with principal and distinguished... ...reviews for stateful systems. You will spend significant... ...— particularly around distributed-systems and data-...Permanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$149.8k - $262.2k
...Description It all started when engineer Fred Luddy wrote code... ...are seeking a Staff Software Engineer (IC4 Level)... ...senior, staff, and principal engineers to align... ...skills in Go (or another systems language with a... ...Personas We approach our distributed world of work with flexibility...Permanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$165.6k - $296.4k
...s mission to redefine how software is built and experienced.... ...performance. We are seeking a Principal Software Engineer to join the team and help... ...through best practices in system design, testing, security,... ...-scale cloud services and distributed systems ~4+ years of...Ongoing contractFull timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Engineer, ML & Distributed Systems. Be the first to apply!
- principal software engineer Redmond, WA
- healthcare systems engineer Redmond, WA
- mission system engineer Redmond, WA
- senior staff systems engineer Redmond, WA
- senior windows systems engineer Redmond, WA
- systems engineer Redmond, WA
- unix linux systems engineer Redmond, WA
- digital communications systems engineer Redmond, WA
- application system engineer Redmond, WA
- operations support system engineer Redmond, WA





