Software Engineer II AI Infrastructure
$102.1k - $202.2kMicrosoft Corporation
Team Purpose
The future of AI and cloud computing depends on highly reliable scalable and efficient distributed systems and our team is building the platform that powers that future.
As part of the AI Infra team you will work on large-scale infrastructure that supports some of the worlds most demanding cloud services and AI workloads. The infrastructure you will work on powers OpenAI and OSS model hosting large-scale inferencing and the backend for Microsoft Copilots across the largest capacity fleets in the industry. You will help design and build foundational systems that enable reliability performance and operational excellence at global scale.
Role Summary
As a Software Engineer II you will design develop and operate distributed systems that power mission-critical cloud services. You will collaborate across engineering disciplines to build resilient scalable and highly available platforms leveraging strong software engineering fundamentals and data-driven decision making. You will contribute throughout the software development lifecycle from architecture and implementation to deployment monitoring and continuous improvement.
This opportunity will allow you to:
- Accelerate your technical and career growth by solving complex distributed systems challenges at cloud scale.
- Develop deep expertise in large-scale infrastructure reliability engineering system architecture and operational excellence.
- Hone your collaboration and leadership skills while working across teams to deliver high-impact solutions that serve millions of users and workloads.
Microsoft Culture
Microsofts mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect integrity and accountability to create a culture of inclusion where everyone can thrive at work and beyond
ResponsibilitiesResponsibilities
- Design develop test deploy and operate large-scale distributed systems and platform services that deliver reliable scalable secure and high-performance experiences.
- Build and enhance infrastructure capabilities resource management services and workload orchestration solutions that optimize system efficiency utilization availability and performance.
- Develop software and platform features that support capacity management service scalability policy-driven decision making workload placement prioritization and operational flexibility across distributed environments.
- Collaborate with engineers product stakeholders and cross-functional partners to define technical requirements influence architecture decisions and deliver high-quality solutions that address customer and business needs.
- Develop test and maintain control plane services written in C# hosted on Kubernetes (AKS) clusters. .
- Analyze complex production issues identify root causes and implement sustainable solutions that enhance scalability maintainability efficiency and service health. Provide operational support and DRI (on-call) responsibilities for the service.
- Contribute to engineering best practices through technical design reviews code quality initiatives knowledge sharing mentorship and a culture of innovation accountability inclusion and continuous learning.
QualificationsRequired Qualifications:
- Bachelors Degree in Computer Science or related technical field AND 2 years technical engineering experience with coding in languages including but not limited to C C C# Java JavaScript or Python
- OR equivalent experience.
Preferred Qualifications:
- Masters Degree in Computer Science or related technical field AND 3 years technical engineering experience with coding in languages including but not limited to C C C# Java JavaScript or Python
- OR Bachelors Degree in Computer Science or related technical field AND 5 years technical engineering experience with coding in languages including but not limited to C C C# Java JavaScript or Python
- OR equivalent experience.
- OOP ( Object Oriented Programming) proficiency and practical familiarity with common code design patterns
- 2years of experience withservice developmentin a distributed environmentina dev-ops roleincluding concurrencymanagementand stateful resource management
- Hands-on experience with public cloud services at the IaaS level
#AIINFRA
Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102100 - $202200 per year. There is a different range applicable to specific work locations within the San Francisco Bay area and New York City metropolitan area and the base pay range for this role in those locations is USD $133800 - $219200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
position will be open for a minimum of 5 days with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age ancestry citizenship color family or medical care leave gender identity or expression genetic information immigration status marital status medical condition national origin physical or mental disability political affiliation protected veteran or military status race ethnicity religion sex (including pregnancy) sexual orientation or any other characteristic protected by applicable local laws regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process read more about requesting accommodations.
Required Experience:
IC
- ...deploy advanced data pipelines and infrastructure for Amperity’s customer data platform... ...code reviews and mentor SDE I engineers and interns. Use AI code assistants responsibly while validating... ...3+ years developing enterprise software. ~3+ years building applications...SuggestedFull timeWork at officeRemote work
- ...information security functions. Services range from infrastructure design and operations, system and software lifecycle implementations, enabling the mobile... ...highly collaborative Agile teams. The Software Engineer II, AI works with cross-functional teams and customers...SuggestedHome officeVisa sponsorshipWork visa
$102.1k - $202.2k
...the Azure Monitor team we are looking for a Software Engineer II and Senior Software Engineer to help build... ...and security at scale and shape how AI-assisted and AI-agentic capabilities are safely applied to infrastructure operations. You will work on services that...SuggestedOngoing contractFull timeLocal area- ...are seeking a talented and experienced Software Engineer II to join our team. We’re a trailblazing... ...ownership and help lead the charge in AI / ML solutions that make an impact in... ...Collaborate with DevOps to optimize infrastructure and ensure smooth deployment and monitoring...SuggestedFull timeLive inFlexible hours
$102.1k - $202.2k
...organizations to thrive in the era of AI-powered work. As part of Microsoft 365... ...business signals. Were hiring a Backend Software Engineer II to help deliver intuitive AI-powered... .... Build manage and maintain Azure infrastructure across environments including compute...SuggestedOngoing contractFull timeLocal area$102.1k - $202.2k
...continues to advance with new devices AI-powered experiences and... ...Windows experience. We develop engineering tools automation frameworks and infrastructure that help identify investigate... ...customers worldwide. As a Software Engineer II on the Windows Compatibility team...Ongoing contractFull timeLocal areaWorldwide$143.7k - $194.4k
...at massive scale. Were looking for a Software Development Engineer II with deep data engineering expertise... ...own the large-scale data infrastructure that powers intelligent decision-making... ...production datasets - Experience using AI coding assistants or agentic development...Full timeFlexible hours$102.1k - $202.2k
...Overview Join the Azure AI Platform air gapped engineering team as a Software Engineer II delivering secure scalable and mission critical AI infrastructure for Microsofts most sensitive cloud environments. We build foundational services that power Azure Machine Learning...Ongoing contractFull timeLocal area$165k - $270k
...the ultimate goal ofenabling human life on Mars. SR. SOFTWARE ENGINEER AI INFRASTRUCTURE (STARSHIELD) At SpaceX were leveraging our experience in... ...regulations applicant must be a (i) U.S. citizen or national (ii) U.S. lawful permanent resident (aka green card holder) (...Permanent employmentFull timeTemporary workWork at officeImmediate startMonday to FridayWeekend work$125k - $165k
...with the ultimate goal ofenabling human life on Mars. SOFTWARE ENGINEER AI INFRASTRUCTURE (STARSHIELD) At SpaceX were leveraging our experience in... ...applicant must be a (i) U.S. citizen or national (ii) U.S. lawful permanent resident (aka green card holder) (...Permanent employmentFull timeTemporary workWork at officeImmediate startMonday to FridayWeekend work$143.7k - $194.4k
...across multiple cloud environments. As a Software Development Engineer II on this team you will design and... ...and external services ingest infrastructure metadata and security findings at scale... ...differences. With the rapid expansion of AI reshaping how customers manage...Permanent employmentFull timeTemporary workInternshipFlexible hours- ...radiating out globally. Powered by advanced AI technology, we provide global... ...decision systems. Our team develops AI infrastructure and machine learning systems that enable... .... We are looking for exceptional Software Engineers who are passionate about AI infrastructure...Internship
- ...way for the travel industry. ARC is looking for a talented Software Engineer II to join our team! In this role, you will provide product... ...Python, Java, and React. ~ Working knowledge of integrating AI and LLM APIs into production applications, with some knowledge...InternshipWork at officeWork from homeFlexible hours
- A technology solutions provider is seeking an experienced individual for the position of Infrastructure Management - Level II in Arlington, VA. The role involves designing, configuring, and maintaining servers, as well as troubleshooting complex infrastructure issues....
$167.85k - $209.75k
...Senior Software Engineer, AI/ML Platforms and Infrastructure – Brain Health Accelerator The Allen Institut e accelerates science for a healthier world through large-scale research designed to answer some of the most complex questions in biology. Our multi-disciplinary...Work at officeLocal areaRemote workVisa sponsorshipWork visaRelocation package$10,500 per month
...Palantir builds the world's leading software for data-driven decisions and operations... ...children, and more. The Role Software Engineers at Palantir drive large-scale transformation through data, AI and world-leading infrastructure that supports mission-critical...Work experience placementInternshipWork at officeRemote workWork from homeWorldwide$180k - $230k
...Senior Software Engineer, Infrastructure District Partners has been engaged by a rapidly growing technology company building advanced software platforms and AI-driven capabilities for complex, mission-critical environments. Following a significant recent funding round...2 days per week$184k - $259.44k
...Software Engineer, Frontier AI Infrastructure Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. As a part of this team, you will own the model inference layer - enabling...Full timeWork at office3 days per weekEarly shift$102.1k - $202.2k
...than 1.6 billion endpoints protected and productive. As a Software Engineer II - Full Stack you will design develop and validate software... ...analysis and prevent customer-impacting issues. You will use AI-powered development tools to accelerate implementation...Ongoing contractFull timeLocal area$123k - $165k
...Job Posting Title: Software Engineer II Req ID: Job Description: Disney Entertainment and ESPN Product & Technology Technology... ...and performance. This role is encouraged to leverage modern AI tools to enhance development workflows and productivity. We...Full time$143.7k - $194.4k
...AWS Applied AI Solutions (AAIS) is building toward a future where every business innovates with Amazon AI teammates. To... ...internal teams and external customers Were looking for a Software Development Engineer II to join our team where youll take ownership of multiple services...Permanent employmentFull timeInternshipFlexible hours$102.1k - $202.2k
...Framework the Model Context Protocol (MCP) Microsoft Graph Dataverse Dynamics 365 Teams and Outlook. Were looking for a Software Engineer II to join our AI incubation team and work side by side with a Principal engineer on rapid prototyping. Youll take a new agent idea...Ongoing contractFull timeLocal area$106k - $169k
...governments realize their greatest potential. Title and Summary Software Engineer II - Blockchain Overview: Mastercard is looking for a... ...will also have the opportunity to work alongside cutting-edge AI tools and agentic systems as part of our broader innovation...Full timeContract workPart timeWorldwideFlexible hours3 days per week- ...Skills Python AWS AI Job Description: People... ...Analytics and Compensation Engineering team is looking for an SDEI... ...team for modernizing tools and infrastructure serving business... ...non-internship professional software development experience ~2...Internship
$143.7k - $194.4k
...Are you excited about building software that operates at massive scale and directly impacts... ...millions of customers As a Software Development Engineer II at Amazon you will design implement and... ...and approachesincluding generative AI capabilitiesto recommend and adopt improvements...Permanent employmentFull timeInternshipFlexible hours$79.2k - $209.5k
...Job Description At Oracle Cloud Infrastructure (OCI), we build the future of the cloud... ...on API design and correctness. Use AI-assisted engineering tools and agentic workflows to... ...Qualifications ~8+ years of professional software engineering experience, with a track...Temporary workFlexible hours- ...About Airwallex Airwallex is the AI-native financial operating system for a real... ...started in Melbourne in 2015 to build the infrastructure global commerce runs on. Were the... ...and team. We are looking for a Senior Software Engineer to build the infrastructure that powers...Full time
$282k - $332k
Senior Software Engineer - AI Infrastructure Laurel, MD ** An active TS//SCI clearance with polygraph is required for this role ** Bitwise is a leading provider of mission-focused intelligence solutions that advance national security for the Intelligence Community and Department...Extra incomeContract workFlexible hoursNight shift- ...About Airwallex Airwallex is the AI-native financial operating system for a real... ...in Melbourne in 2015 to build the infrastructure global commerce runs on. Were the regulated... ...team is on a mission to turn everyday software engineers into superheroes. The team builds and...Full time
$119.8k - $234.7k
...the Artificial Intelligence Infrastructure organization you will build... ...developer experience reliability engineering and Artificial Intelligence... ...Summary: As a Senior Software Engineer you will design build... ...of Artificial Intelligence (AI) models and services across...Ongoing contractFull timeLocal areaWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer II AI Infrastructure. Be the first to apply!
- junior software developer Washington DC
- scientific software engineer Washington DC
- intel software engineer Washington DC
- director software engineering Washington DC
- software engineer Washington DC
- software engineer mainframe Washington DC
- software engineer student Washington DC
- senior robotics software engineer Washington DC
- financial software developer Washington DC
- graduate software developer Washington DC



