Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer II AI Infrastructure

$102.1k - $202.2k
Full-time

Microsoft Corporation

Overview

Team Purpose

The future of AI and cloud computing depends on highly reliable scalable and efficient distributed systems and our team is building the platform that powers that future.

As part of the AI Infra team you will work on large-scale infrastructure that supports some of the worlds most demanding cloud services and AI workloads. The infrastructure you will work on powers OpenAI and OSS model hosting large-scale inferencing and the backend for Microsoft Copilots across the largest capacity fleets in the industry. You will help design and build foundational systems that enable reliability performance and operational excellence at global scale.

Role Summary

As a Software Engineer II you will design develop and operate distributed systems that power mission-critical cloud services. You will collaborate across engineering disciplines to build resilient scalable and highly available platforms leveraging strong software engineering fundamentals and data-driven decision making. You will contribute throughout the software development lifecycle from architecture and implementation to deployment monitoring and continuous improvement.

This opportunity will allow you to:

- Accelerate your technical and career growth by solving complex distributed systems challenges at cloud scale.

- Develop deep expertise in large-scale infrastructure reliability engineering system architecture and operational excellence.

- Hone your collaboration and leadership skills while working across teams to deliver high-impact solutions that serve millions of users and workloads.

Microsoft Culture

Microsofts mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect integrity and accountability to create a culture of inclusion where everyone can thrive at work and beyond

Responsibilities

Responsibilities

- Design develop test deploy and operate large-scale distributed systems and platform services that deliver reliable scalable secure and high-performance experiences.

- Build and enhance infrastructure capabilities resource management services and workload orchestration solutions that optimize system efficiency utilization availability and performance.

- Develop software and platform features that support capacity management service scalability policy-driven decision making workload placement prioritization and operational flexibility across distributed environments.

- Collaborate with engineers product stakeholders and cross-functional partners to define technical requirements influence architecture decisions and deliver high-quality solutions that address customer and business needs.

- Develop test and maintain control plane services written in C# hosted on Kubernetes (AKS) clusters. .

- Analyze complex production issues identify root causes and implement sustainable solutions that enhance scalability maintainability efficiency and service health. Provide operational support and DRI (on-call) responsibilities for the service.

- Contribute to engineering best practices through technical design reviews code quality initiatives knowledge sharing mentorship and a culture of innovation accountability inclusion and continuous learning.

Qualifications

Required Qualifications:

  • Bachelors Degree in Computer Science or related technical field AND 2 years technical engineering experience with coding in languages including but not limited to C C C# Java JavaScript or Python
    • OR equivalent experience.

Preferred Qualifications:

  • Masters Degree in Computer Science or related technical field AND 3 years technical engineering experience with coding in languages including but not limited to C C C# Java JavaScript or Python
  • OR Bachelors Degree in Computer Science or related technical field AND 5 years technical engineering experience with coding in languages including but not limited to C C C# Java JavaScript or Python
    • OR equivalent experience.
  • OOP ( Object Oriented Programming) proficiency and practical familiarity with common code design patterns
  • 2years of experience withservice developmentin a distributed environmentina dev-ops roleincluding concurrencymanagementand stateful resource management
  • Hands-on experience with public cloud services at the IaaS level

#AIINFRA



Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102100 - $202200 per year. There is a different range applicable to specific work locations within the San Francisco Bay area and New York City metropolitan area and the base pay range for this role in those locations is USD $133800 - $219200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
position will be open for a minimum of 5 days with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age ancestry citizenship color family or medical care leave gender identity or expression genetic information immigration status marital status medical condition national origin physical or mental disability political affiliation protected veteran or military status race ethnicity religion sex (including pregnancy) sexual orientation or any other characteristic protected by applicable local laws regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process read more about requesting accommodations.


Required Experience:

IC

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Software Engineer II AI Infrastructure in Washington DC vacancy
  • $102.1k - $202.2k

     ...Overview Team Purpose The future of AI and cloud computing depends on highly...  ...team you will work on large-scale infrastructure that supports some of the worlds most...  ...global scale. Role Summary As a Software Engineer II you will design develop and operate distributed... 
    Suggested
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    1 day ago
  •  ...deploy advanced data pipelines and infrastructure for Amperity’s customer data platform...  ...code reviews and mentor SDE I engineers and interns. Use AI code assistants responsibly while validating...  ...3+ years developing enterprise software. ~3+ years building applications... 
    Suggested
    Full time
    Work at office
    Remote work

    Amperity

    Washington DC
    1 day ago
  •  ...information security functions. Services range from infrastructure design and operations, system and software lifecycle implementations, enabling the mobile...  ...highly collaborative Agile teams. The Software Engineer II, AI works with cross-functional teams and customers... 
    Suggested
    Home office
    Visa sponsorship
    Work visa

    AARP

    Washington DC
    5 days ago
  • $102.1k - $202.2k

     ...the Azure Monitor team we are looking for a Software Engineer II and Senior Software Engineer to help build...  ...and security at scale and shape how AI-assisted and AI-agentic capabilities are safely applied to infrastructure operations. You will work on services that... 
    Suggested
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    1 day ago
  •  ...are seeking a talented and experienced Software Engineer II to join our team. We’re a trailblazing...  ...ownership and help lead the charge in AI / ML solutions that make an impact in...  ...Collaborate with DevOps to optimize infrastructure and ensure smooth deployment and monitoring... 
    Suggested
    Full time
    Live in
    Flexible hours

    Belva.ai

    Washington DC
    2 days ago
  • $102.1k - $202.2k

     ...continues to advance with new devices AI-powered experiences and...  ...Windows experience. We develop engineering tools automation frameworks and infrastructure that help identify investigate...  ...customers worldwide. As a Software Engineer II on the Windows Compatibility team... 
    Ongoing contract
    Full time
    Local area
    Worldwide

    Microsoft

    Washington DC
    1 day ago
  • $102.1k - $202.2k

     ...organizations to thrive in the era of AI-powered work. As part of Microsoft 365...  ...business signals. Were hiring a Backend Software Engineer II to help deliver intuitive AI-powered...  .... Build manage and maintain Azure infrastructure across environments including compute... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    1 day ago
  • $143.7k - $194.4k

     ...at massive scale. Were looking for a Software Development Engineer II with deep data engineering expertise...  ...own the large-scale data infrastructure that powers intelligent decision-making...  ...production datasets - Experience using AI coding assistants or agentic development... 
    Full time
    Flexible hours

    Amazon

    Washington DC
    1 day ago
  • $102.1k - $202.2k

     ...Overview Join the Azure AI Platform air gapped engineering team as a Software Engineer II delivering secure scalable and mission critical AI infrastructure for Microsofts most sensitive cloud environments. We build foundational services that power Azure Machine Learning... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    1 day ago
  • $125k - $165k

     ...with the ultimate goal ofenabling human life on Mars. SOFTWARE ENGINEER AI INFRASTRUCTURE (STARSHIELD) At SpaceX were leveraging our experience in...  ...applicant must be a (i) U.S. citizen or national (ii) U.S. lawful permanent resident (aka green card holder) (... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Immediate start
    Monday to Friday
    Weekend work

    SpaceX

    Washington DC
    1 day ago
  • $165k - $270k

     ...the ultimate goal ofenabling human life on Mars. SR. SOFTWARE ENGINEER AI INFRASTRUCTURE (STARSHIELD) At SpaceX were leveraging our experience in...  ...regulations applicant must be a (i) U.S. citizen or national (ii) U.S. lawful permanent resident (aka green card holder) (... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Immediate start
    Monday to Friday
    Weekend work

    SpaceX

    Washington DC
    1 day ago
  • $143.7k - $194.4k

     ...across multiple cloud environments. As a Software Development Engineer II on this team you will design and...  ...and external services ingest infrastructure metadata and security findings at scale...  ...differences. With the rapid expansion of AI reshaping how customers manage... 
    Permanent employment
    Full time
    Temporary work
    Internship
    Flexible hours

    Amazon

    Washington DC
    1 day ago
  • $143.7k - $194.4k

     ...'ll architect and implement software security protocols across Wide...  ...mission-critical cloud infrastructure. If Arlington, VA (Arlington...  ...availability target. Generative AI & Accelerated Development -...  ...our team members develop your engineering expertise so you feel... 
    Internship
    Work at office
    Flexible hours

    Amazon Development Center U.S., Inc.

    Arlington, VA
    11 hours ago
  • $165.2k - $223.6k

    As part of the AWS Applied AI Solutions organization, we have...  ...door to that place: the client software people use to securely access...  ...for a Software Development Engineer to design, build, and operate...  ...the early build-out of agent infrastructure on the scale of a mature AWS... 
    Internship
    Local area
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Amazon Web Services, Inc.

    Washington DC
    11 hours ago
  •  ...radiating out globally. Powered by advanced AI technology, we provide global...  ...decision systems. Our team develops AI infrastructure and machine learning systems that enable...  .... We are looking for exceptional Software Engineers who are passionate about AI infrastructure... 
    Internship

    Mintegral

    Washington DC
    1 day ago
  •  ...way for the travel industry. ARC is looking for a talented Software Engineer II to join our team! In this role, you will provide product...  ...Python, Java, and React. ~ Working knowledge of integrating AI and LLM APIs into production applications, with some knowledge... 
    Internship
    Work at office
    Work from home
    Flexible hours

    Airlines Reporting Corporation

    Arlington, VA
    3 days ago
  • A technology solutions provider is seeking an experienced individual for the position of Infrastructure Management - Level II in Arlington, VA. The role involves designing, configuring, and maintaining servers, as well as troubleshooting complex infrastructure issues.... 

    ActioNet, Inc.

    Arlington, VA
    5 days ago
  • $167.85k - $209.75k

     ...Senior Software Engineer, AI/ML Platforms and Infrastructure – Brain Health Accelerator The Allen Institut e accelerates science for a healthier world through large-scale research designed to answer some of the most complex questions in biology. Our multi-disciplinary... 
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Work visa
    Relocation package

    Allen Institute

    Washington DC
    more than 2 months ago
  • $10,500 per month

     ...Palantir builds the world's leading software for data-driven decisions and operations...  ...children, and more. The Role Software Engineers at Palantir drive large-scale transformation through data, AI and world-leading infrastructure that supports mission-critical... 
    Work experience placement
    Internship
    Work at office
    Remote work
    Work from home
    Worldwide

    Palantir Technologies

    Washington DC
    4 days ago
  • $184k - $259.44k

     ...Software Engineer, Frontier AI Infrastructure Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. As a part of this team, you will own the model inference layer - enabling... 
    Full time
    Work at office
    3 days per week
    Early shift

    Scale AI

    Washington DC
    5 days ago
  • $180k - $230k

     ...Senior Software Engineer, Infrastructure District Partners has been engaged by a rapidly growing technology company building advanced software platforms and AI-driven capabilities for complex, mission-critical environments. Following a significant recent funding round... 
    2 days per week

    District Partners

    Arlington, VA
    2 days ago
  • $102.1k - $202.2k

     ...than 1.6 billion endpoints protected and productive. As a Software Engineer II - Full Stack you will design develop and validate software...  ...analysis and prevent customer-impacting issues. You will use AI-powered development tools to accelerate implementation... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    1 day ago
  • $102.1k - $202.2k

     ...Framework the Model Context Protocol (MCP) Microsoft Graph Dataverse Dynamics 365 Teams and Outlook. Were looking for a Software Engineer II to join our AI incubation team and work side by side with a Principal engineer on rapid prototyping. Youll take a new agent idea... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Washington DC
    1 day ago
  •  ...Skills Python AWS AI Job Description: People...  ...Analytics and Compensation Engineering team is looking for an SDEI...  ...team for modernizing tools and infrastructure serving business...  ...non-internship professional software development experience ~2... 
    Internship

    Ampcus Inc.

    Washington DC
    1 day ago
  • $143.7k - $194.4k

     ...Are you excited about building software that operates at massive scale and directly impacts...  ...millions of customers As a Software Development Engineer II at Amazon you will design implement and...  ...and approachesincluding generative AI capabilitiesto recommend and adopt improvements... 
    Permanent employment
    Full time
    Internship
    Flexible hours

    Amazon

    Washington DC
    1 day ago
  • $106k - $169k

     ...governments realize their greatest potential. Title and Summary Software Engineer II - Blockchain Overview: Mastercard is looking for a...  ...will also have the opportunity to work alongside cutting-edge AI tools and agentic systems as part of our broader innovation... 
    Full time
    Contract work
    Part time
    Worldwide
    Flexible hours
    3 days per week

    Mastercard

    Arlington, VA
    17 days ago
  • $123k - $165k

     ...Job Posting Title: Software Engineer II Req ID: Job Description: Disney Entertainment and ESPN Product & Technology Technology...  ...and performance. This role is encouraged to leverage modern AI tools to enhance development workflows and productivity. We... 
    Full time

    The Walt Disney Company

    Washington DC
    1 day ago
  • $143.7k - $194.4k

     ...AWS Applied AI Solutions (AAIS) is building toward a future where every business innovates with Amazon AI teammates. To...  ...internal teams and external customers Were looking for a Software Development Engineer II to join our team where youll take ownership of multiple services... 
    Permanent employment
    Full time
    Internship
    Flexible hours

    Amazon

    Washington DC
    1 day ago
  • $79.2k - $209.5k

     ...Job Description At Oracle Cloud Infrastructure (OCI), we build the future of the cloud...  ...on API design and correctness. Use AI-assisted engineering tools and agentic workflows to...  ...Qualifications ~8+ years of professional software engineering experience, with a track... 
    Temporary work
    Flexible hours

    Oracle

    Washington DC
    3 days ago
  •  ...About Airwallex Airwallex is the AI-native financial operating system for a real...  ...started in Melbourne in 2015 to build the infrastructure global commerce runs on. Were the...  ...and team. We are looking for a Senior Software Engineer to build the infrastructure that powers... 
    Full time

    Airwallex

    Washington DC
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer II AI Infrastructure. Be the first to apply!