Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Engineer, ML & Distributed Systems

$142.8k - $274.8k
Full-time

Microsoft

Overview We are looking for a Principal Software Engineer to design, build, and operationalize machine learning systems and hyperscale distributed services that power Microsoft's AI experiences. This is a role for an engineer who is equally at home training and shipping ML models and building the large-scale distributed infrastructure that serves them — and who has the appetite to do both. You will own systems end to end: from model development and evaluation, through the serving and orchestration layers, to reliable operation at hyperscale. MSN is a personalized content feed powering user experiences across Microsoft. Our mission is to empower every person on the planet to be informed, entertained, and inspired. With nearly 30 years of history, MSN has evolved into a premier content destination with high-quality content, AI-powered user-controlled personalization, and massive global reach. Over the past 4 years, AI and Machine Learning technologies have fueled massive growth, transforming MSN’s content moderation, personalization, and content entry points.Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.

Responsibilities

  • Design, build, and operationalize scalable ML and deep learning models using containers and orchestration platforms (e.g., Kubernetes).
  • Develop and refine LLM prompt and fine-tuning strategies, build evaluation pipelines, and continuously optimize model quality, latency, and cost.
  • Architect, implement, and operate multi-tiered distributed services at hyperscale, with high availability, fault tolerance, and low latency.
  • Build model serving and inference infrastructure, including caching, batching, GPU capacity management, and A/B experimentation at scale.
  • Design scalable APIs, data pipelines, and feature/signal stores that ensure efficient, secure, and reliable data flow between ML systems and product surfaces.
  • Drive live-site excellence: instrumentation, monitoring, capacity planning, and incident response for ML-backed services.
  • Collaborate with applied scientists, data scientists, backend engineers, and product teams to translate requirements into production ML systems.
  • Participate in code reviews and architectural discussions, and mentor engineers across both ML and systems disciplines.

Qualifications

Required Qualifications:
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
Preferred Qualifications:
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Proven experience designing, developing, and operating multi-tiered distributed services at scale.
  • Hands-on experience building, deploying, and operating machine learning systems in production (model training, evaluation, and/or LLM-based applications).
  • Experience working through full product cycles, from initial design to final delivery.
  • Experience with LLM application patterns: prompt engineering, RAG, fine-tuning, and model evaluation frameworks.
  • Experience with ML infrastructure: distributed training, inference optimization, GPU capacity management, and orchestration platforms such as Kubernetes.
  • Experience with large-scale data systems (streaming, caching such as Redis, feature stores) and experimentation platforms.
  • Demonstrated ability to work across the ML/systems boundary and a strong desire to keep doing both.
#MicrosoftAI #Software Engineer #ML engineer Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. --- Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Software Engineer, ML & Distributed Systems in Redmond, WA vacancy
  • $142.8k - $274.8k

     ...: Less than 25%Profession: Software EngineeringDiscipline: Software...  ....We are looking for a Principal Software Engineer to design, build, and operationalize hyperscale distributed systems that power Microsoft’s content...  ...reliable data flow between ML systems and product... 
    Suggested
    Ongoing contract
    Local area

    Microsoft

    Redmond, WA
    1 day ago
  • $145k - $155k

     ...and all the way up to ML/AI with a unified platform...  ...and optimization Distributed query execution and scheduling...  ...Vectorized execution engine Data security...  ...Storage management system What we look for:...  ...projects We are hiring Software Engineer - New Grads, Distributed... 
    Suggested
    Full time
    Worldwide

    Databricks

    Bellevue, WA
    4 days ago
  • $142.8k - $274.8k

     ...advertising market already online. Search engines, web publishers, major ad networks,...  ...of this effort, working on large distributed systems with low latency and high throughput....  ...that will unleash your potential. As a Principal Software Engineer and member of this team,... 
    Suggested
    Ongoing contract
    Full time
    Work at office
    Local area

    Microsoft

    Redmond, WA
    1 day ago
  • $142.8k - $274.8k

     ...Hardware and Infrastructure Engineering (SCHIE) is the team...  ...firmware and platform software stack that powers...  ...infrastructure. We are seeking a Principal Software Engineer to...  .... These services distribute critical updates to...  ...challenging distributed systems and platform... 
    Suggested
    Ongoing contract
    Full time
    Work at office
    Local area
    Worldwide

    Microsoft

    Redmond, WA
    7 days ago
  • $157.7k - $213.8k

     ...improve their business. Founded by engineers — and customer obsessed — we leap...  ...SQL query engines. As a software engineer on the Runtime team at Databricks...  ...be building the next generation distributed data storage and processing systems that can outperform specialized... 
    Suggested
    Local area
    Worldwide

    DataBricks

    Bellevue, WA
    4 days ago
  • $142.8k - $274.8k

     ...Infrastructure builds the platforms, systems, and operating mechanisms that enable...  ...inference on Azure. You will work across distributed storage, Kubernetes, GPU clusters,...  ...cost-efficient infrastructure. As a Principal Software Engineer, Storage Infrastructure, you will design... 
    Ongoing contract
    Full time
    Local area
    Remote work

    Microsoft

    Redmond, WA
    2 days ago
  • $142.8k - $274.8k

     ...customer-grounded quality system for Copilot. Our mission is...  ...innovation. We are looking for a Principal Software Engineer to architect and build the...  ...and delivering large-scale distributed systems, data platforms,...  ..., agent systems, or AI/ML platforms. Demonstrated... 
    Ongoing contract
    Full time
    Local area
    Shift work

    Microsoft

    Redmond, WA
    2 days ago
  • $142.8k - $274.8k

     ...workflows and end user interfaces. We are looking for a Principal Software Engineer to emphasize technical leadership, architectural...  ...technologies and cloud-based architectures to build large-scale distributed systems and AI/ML, Agency experience. #MSFTSecurity #Entra,... 
    Ongoing contract
    Full time
    Local area
    Shift work

    Microsoft

    Redmond, WA
    2 days ago
  • $142.8k - $274.8k

     ...looking for a highly experienced Principal Software Engineer to help define the...  ...interfaces, and end-to-end system design. Design, build, and...  ...and delivering large-scale distributed systems, cloud platforms, developer...  .... Experience with AI/ML platforms, generative AI,... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    1 day ago
  • $142.8k - $274.8k

     ...and platform reliability. This Principal Software Engineer role owns core architectural and technical...  ...deep expertise in low-latency distributed systems solid leadership in large-scale refactoring...  ...systems. Experience working with ML-driven decision systems or... 
    Ongoing contract
    Full time
    Work at office
    Local area

    Microsoft

    Redmond, WA
    9 days ago
  • $142.8k - $274.8k

     ...Model as a Service, Azure ML, Cognitive Services, and the...  ...content. We are looking for a Principal Software Engineer - Responsible AI who is...  ..., and develop large-scale distributed cloud services and solutions...  ...services and distributed systems. ~4+ years of technical engineering... 
    Ongoing contract
    Full time
    Work at office
    Local area

    Microsoft

    Redmond, WA
    2 days ago
  • $229k - $412k

     ...advanced AI-native platform. We work on large scale distributed systems, processing almost 3 trillion events per day and this...  ...detected in their environments. This is a Principal Software Development Engineer (SDE) role in the CTIO team that delivers the cutting... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Redmond, WA
    a month ago
  • $264k - $379.5k

     ...gets done.We are hiring a Principal Software Engineer for our Anti-Abuse team. The...  ...routingDesign intelligent mitigation systems that automatically throttle...  ...engineering experience in distributed systems, cloud platform...  ...detection, adversarial ML, or platform trust and... 

    Snowflake

    Bellevue, WA
    1 day ago
  • $133k - $222k

     ...Excellence, and Advance with Innovation.As our Principal Software Engineer, you will be driving and supporting...  ...equipment and various JBT Marel systems using computer vision for the food processing...  ..., object recognition.Experience in AI/ML integration.Experience in applied math... 
    Full time
    Temporary work
    Local area
    Work from home

    JBT Corporation

    Redmond, WA
    2 days ago
  • $142.8k - $274.8k

     ...Less than 25%Profession: Software EngineeringDiscipline:...  ...heart of the Windows ML ecosystem, powering experiences...  ...frameworks, execution engines, and hardware...  ...partners, and operating system components to define the...  ...Windows.We are looking for a Principal Software Engineer to... 
    Ongoing contract
    Work at office
    Local area
    Worldwide
    Shift work

    Microsoft

    Redmond, WA
    1 day ago
  • $190.5k - $300k

     ...OpportunityChewy is seeking a Principal Software Engineer to provide technical leadership...  ...scalable, resilient, and extensible systems spanning cloud-native services, distributed architectures, APIs, event-...  ...architecting or integrating AI/ML-enabled applications, including... 
    Local area
    Flexible hours

    Chewy

    Bellevue, WA
    2 days ago
  • $110k - $220k

     ...Home OfficeJoin Walmart as a Principal Software Engineer for the Colony Platform...  ...platforms. You will shape system architecture, influence engineering...  ...that are executed by a distributed process engine. This...  ...Experience working with AI/ML ecosystems in production environments... 
    Full time
    Contract work
    Temporary work
    Part time
    Local area

    Walmart

    Bellevue, WA
    3 days ago
  • $260k - $345k

     ...goal of enabling human life on Mars. PRINCIPAL SOFTWARE ENGINEER, CDN (STARLINK) At SpaceX we're...  ...world's most advanced broadband internet system. Starlink is the world's largest...  ...pivotal in this effort, building scalable distributed systems that underly the future... 
    Temporary work
    Worldwide
    Weekend work

    SpaceX

    Redmond, WA
    1 day ago
  • $280k - $402.5k

     .... We design and build frameworks, systems and services that keep Snowflake secure.As a Principal Software Engineer II on the Product Security team, you...  ...security, software engineering, distributed systems, software infrastructure, AI/ML, applied cryptography, threat modeling... 

    Snowflake

    Bellevue, WA
    4 days ago
  • $142.8k - $274.8k

     ...and other digital platforms. As a Principal Software Engineering Manager , you will lead a team of engineers...  ..., cloud services, or large-scale distributed systems. ~ Hands-on experience designing...  .... ~ Experience delivering AI/ML or generative AI solutions, such as... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    7 hours ago
  • $200k - $285k

     ...enabling human life on Mars. PRINCIPAL SOFTWARE ENGINEER (PLATFORM TEAM)The Platform...  ...gateways and proxy systems that allow engineers and operators...  ...operating large-scale AI/ML platforms, internal developer...  ...Deep expertise in MLOps, distributed compute, model lifecycle management... 
    Permanent employment
    Temporary work

    SpaceX

    Redmond, WA
    6 days ago
  • $225k - $345k

     ...of enabling human life on Mars. PRINCIPAL SECURITY SOFTWARE ENGINEER (STARLINK) At SpaceX we're leveraging...  ...s most advanced broadband internet system. Starlink is the world's largest...  ...solutions for operating systems, distributed systems, or other enterprise/large-... 
    Temporary work
    Work at office
    Worldwide
    Monday to Friday
    Flexible hours
    Weekend work

    SpaceX

    Redmond, WA
    3 days ago
  • $132k - $264k

     ...Segment: Home OfficeRole summary: The Principal Software Engineer leads platform engineering efforts...  ...multiple teams, integrating AI/ML capabilities and ensuring high availability...  ...response.Expertise in designing distributed systems optimized for real-time data processing... 
    Full time
    Temporary work
    Part time

    Walmart

    Bellevue, WA
    4 days ago
  • $118.7k

     ...a tool, it's your playground. Our engineers work on scalable systems, cloud services, and customer-facing...  ...scalable, reliable services, with distributed-systems scope varying by team. * Participate...  ...control systems Knowledge of software development lifecycle, including... 
    Full time
    Summer work
    Internship
    Seasonal work
    Summer internship
    Work at office
    Local area
    Worldwide
    Monday to Friday

    Amazon

    Redmond, WA
    4 days ago
  • $142.8k - $274.8k

     ...Overview We are looking for a Principal Software Engineer to provide hands-on technical leadership for...  ...platform, a highly sensitive, large-scale distributed data platform supporting critical...  .... The role requires deep distributed-systems expertise and the ability to reason... 
    Ongoing contract
    Full time
    Local area
    Immediate start

    Microsoft

    Redmond, WA
    2 days ago
  • $117.2k - $313.7k

     ...You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public Cloud - Distributed Systems Software Engineer posting, recruiters... 
    Full time

    Salesforce

    Bellevue, WA
    4 days ago
  • $142.8k - $274.8k

     ...lives around the world. We are hiring a Principal Software Engineer / Architect to help define the future...  ...secure, resilient, and globally distributed platforms while driving the architectural...  ...and service teams can build secure systems without compromising developer productivity... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    3 days ago
  • $149.8k - $262.2k

     ...Description It all started when engineer Fred Luddy wrote code...  ...a Senior Staff Software Engineer (IC5 Level)...  ...You will partner with principal and distinguished...  ...reviews for stateful systems. You will spend significant...  ...— particularly around distributed-systems and data-... 
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Kirkland, WA
    3 days ago
  • $149.8k - $262.2k

     ...Description It all started when engineer Fred Luddy wrote code...  ...are seeking a Staff Software Engineer (IC4 Level)...  ...senior, staff, and principal engineers to align...  ...skills in Go (or another systems language with a...  ...Personas We approach our distributed world of work with flexibility... 
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Kirkland, WA
    3 days ago
  • $165.6k - $296.4k

     ...s mission to redefine how software is built and experienced....  ...performance. We are seeking a Principal Software Engineer to join the team and help...  ...through best practices in system design, testing, security,...  ...-scale cloud services and distributed systems ~4+ years of... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer, ML & Distributed Systems. Be the first to apply!