Software Engineer II - AI Infrastructure
$102.1k - $202.2kMicrosoft Corporation
Software Engineer Role Software engineer role in Cloud + AI team, enabling secure, scalable, and high-performance AI experiences across multimodal verticals, including real-time audio interaction, image generation, video generation and AI safety systems. You will contribute across the full technology stack, from APIs and platform services to the inference infrastructure serving cutting-edge AI models at massive scale. You'll work on systems that power real-world products used by millions of customers while helping advance the reliability, safety, and efficiency of AI platforms. This role is based in either Mountain View, CA or Redmond, WA. We are looking for engineers who thrive in fast-paced environments, enjoy tackling complex technical challenges, and excel in collaborative teams. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities Implement AI Systems: Design and build scalable, reliable architectures that meet high-performance requirements for AI systems including inference backends and API interfaces. Apply knowledge of distributed systems principles to create robust solutions. Debug and Optimize Across the Stack: dive deep into existing components to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity. Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions. Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes. Full-Stack Engagement: engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions. Qualifications Required Qualifications: Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Preferred Qualifications: Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Core technical competencies: distributed systems, scalable architecture, API design, understanding of ML/AI fundamentals and practical applications, experience in delivering AI-based solutions. Familiarity with relevant tools, frameworks, or programming languages: Kubernetes, Azure Devops, Docker, AI / ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, LangChain. Optional experience with OpenAI API / Azure OpenAI. Communication and collaboration abilities. Problem-solving and decision-making under ambiguity. Strategic thinking and adaptability. Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year. This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations. Microsoft Corporation
$194k - $349k
...security with the world’s most advanced AI-native platform. We work on large scale distributed... .... CrowdStrike is seeking a Senior Engineer II for our Policy Management team. As a key... ...team is responsible for the cloud-side software and user interfaces that provide...SuggestedPermanent employmentWork experience placementWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week$102.1k - $202.2k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:... ...globally distributed data infrastructure supporting analytics,... ...business intelligence, and AI-powered experiences.Our Universal... ....We are seeking a Software Engineer II to build the next generation...SuggestedOngoing contractLocal area3 days per week$102.1k - $202.2k
...Less than 25%Profession: Software EngineeringDiscipline:... ...'s Azure Data engineering team is leading the transformation... ...for the age of AI, powering a new class... ...for a Software Engineer II to help build and... ...are safely applied to infrastructure operations. You will work...SuggestedOngoing contractLocal area3 days per week$102.1k - $202.2k
...foundations that power the next generation of AI experiences. Our team is developing a... .... We are hiring an experienced Software Engineer II and a Senior Software Engineer to join... ...compute, AI models, and cloud infrastructure. Contribute to technical design and implementation...SuggestedOngoing contractLocal area$102.1k - $202.2k
...where reliability, secure engineering, observability, and efficient... .... We are seeking a Software Engineer II who is passionate about distributed... ...peers and teammates Apply AI-assisted engineering tools... ...troubleshooting Familiarity with CI/CD, infrastructure automation, deployment...SuggestedOngoing contractLocal area- Job Description: Software Engineer II 3-4 years of experience required Onsite in Redmond, WA Job... ...integration to day-to-day hands-on lab and infrastructure support. In addition to core... ...this role requires a strong grasp of AI technologies and hands-on proficiency...
$20k
...possible, with the ultimate goal of enabling human life on Mars.SOFTWARE ENGINEER, AI INFRASTRUCTURE (STARSHIELD) At SpaceX we’re leveraging our experience in... ..., applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder),...Permanent employmentTemporary workWork at officeImmediate startMonday to FridayWeekend work$165k - $270k
...with the ultimate goal of enabling human life on Mars.SR. SOFTWARE ENGINEER, AI INFRASTRUCTURE (STARSHIELD) At SpaceX we’re leveraging our experience in... ..., applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder),...Permanent employmentTemporary workWork at officeImmediate startMonday to FridayWeekend work$102.1k - $202.2k
...and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference... ...-use data and feedback. We are hiring both Software Engineer II and Senior Software Engineers to join our team...Ongoing contractFull timeLocal area$184k - $287.5k
...at the forefront of the generative AI revolution, building the software and systems that power the world’s... ...are looking for a Senior Software Engineer to lead the bring-up, triage,... ...debugging of large-scale AI clusters, infrastructure, and end-to-end workloads, setting...Full timeRemote work$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on developing... ...innovation. We are seeking an AI infrastructure software engineer to join our team. You'll be instrumental in...Full timeRemote work$143.7k - $194.4k
...reliable connectivity.This role is for a Software Engineer who will design, implement, and operate... ...or lakehouse, and to support agentic AI capabilities on top. You’ll build these... ...a globally distributed vector database infrastructure capable of managing billions of embeddings...Permanent employmentInternshipFlexible hours$143.7k - $194.4k
...building the next generation of AI-powered planning and... ...looking for an experienced Software Development Engineer to help shape the technical... ...operational systems. As an SDE II in this team, you will own... ...data tools on a shared AI infrastructure backbone, enabling intelligent...Temporary workInternshipFlexible hours$119.8k - $234.7k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:... ...operational health of the infrastructure that powers Microsoft 365... .... As a Senior Software Engineer, you will design, build, and... ...security, data platforms, and AI-assisted operations to improve...Ongoing contractLocal areaWorldwide3 days per week$102.1k - $202.2k
Overview Are you a software engineer who loves code, moves fast, and enjoys solving problems at scale? Are you excited about AI and want to build the platform that makes AI reliable... ...the world? Do AI, Big Data, cloud infrastructure, Docker, Kubernetes, and distributed...Ongoing contractLocal area$143.7k - $194.4k
...massive scale. We're looking for a Software Development Engineer II with deep data engineering expertise... ...independently own the large-scale data infrastructure that powers intelligent decision-... ...production datasets- Experience using AI coding assistants or agentic...Flexible hours$143.7k - $194.4k
...you passionate about developing software applications and services for... ...Join the Amazon Leo Satellite Engineering and Mechanicals Development team at the forefront of AI-assisted electrical design for... ...Key job responsibilitiesAs a SDE II on th team- You will design, develop...Permanent employmentInternshipFlexible hours$143.7k - $194.4k
...Internet Service Provider (ISP) customers, and we need a Software Development Engineer II. You will build the backend-for-frontend layer, the service... ...countries.- Use agentic development workflows and generative AI tools to deliver faster, and improve the system with AWS...Permanent employmentFlexible hours$102.1k - $202.2k
..., simplified solutions. We are looking to hire Senior Software Engineers and Software Engineer IIs for our teams! The Microsoft Security organization accelerates... ...testing practices. Experience building or integrating AI/ML-powered systems or workflows, including safe...Ongoing contractLocal area- Software Engineer II Microsoft has an exciting opportunity for a Software Engineer II in the Cloud+AI Azure Data team. As part of a core product engineering group, you will develop features, improvements, enhancements, and bugfixes within Azure Data products which are used...Local areaWorldwide
$102.1k - $202.2k
Overview The AI Transformation team within Microsoft Frontier Company is reimagining... ...of working.Our team brings together engineering, applied AI, program leadership, and... ...accelerate transformation at scale. As a Software Engineer II/ Sr. Software Engineer , you will bring...Ongoing contractLocal area$102.1k - $202.2k
Overview The AI Frameworks team at Microsoft develops the AI software used to train and deploy the world's most advanced AI... ...at the intersection of compiler engineering, programming language design, algorithmic... ...are seeking Software Engineers II and/or Senior Software Engineer -...Ongoing contractLocal area$182k - $242k
Senior Software Engineer II Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform... ..., CoreWeave combines superior infrastructure performance with deep technical...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$102.1k - $202.2k
...security product designed for the realities of AI-era defense. Project Perception... ...clear, trustworthy actions. As a Full-Stack Software Engineer, you will take hands-on technical leadership... .... We are looking for Software Engineer II and Senior Software Engineers who are...Ongoing contractLocal area$119.8k - $234.7k
Overview Join our team within AI Infrastructure, where we are building the AI data-plane that powers all LLM inferencing workloads across... ..., Mistral, Cohere, Llama, and more. As a Senior Software Engineer , you will shape the future of one of the largest and fastest...Ongoing contractLocal area$174k - $252k
Software Engineer Google's software engineers develop the next-generation technologies that change... ...architecture built by the Technical Infrastructure team to keep it running. From developing... ...best and fastest experience possible. The AI and Infrastructure team is redefining...Worldwide$147k - $210k
Software Engineer Google's software engineers develop the next-generation technologies that change how billions of users connect, explore... ...changing the world, across many product areas, including AI & Infrastructure, Cloud, YouTube, Search, Ads and more! Our Engineering...Full time$115k - $207k
...we’ve redefined modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems,... ...able to prove it — is a high-stakes problem. We're looking for a Software Engineer to design and build the systems, metrics, and dashboards that...Permanent employmentWork experience placementWork at officeLocal areaRemote work$70 - $80 per hour
...checkpoints, evaluation pipelines, serving infrastructure, and failure modes Integrate these... ...across various domains including audio engineers, SDEs, research scientists, TPMs etc. Serve... ..., or status as a protected veteran. AI Statement: By applying, you acknowledge...Hourly payContract work$194k - $349k
...ve redefined modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems... ...detected in their environments. This is a Senior Software Development Engineer 2 role in the engineering team that delivers the sensor (lightweight...Permanent employmentWork experience placementWork at officeLocal areaRemote work2 days per week3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer II - AI Infrastructure. Be the first to apply!
- senior software design engineer Redmond, WA
- software web developer Redmond, WA
- senior software engineer Redmond, WA
- software developer fintech Redmond, WA
- scientific software engineer Redmond, WA
- new graduate software engineer Redmond, WA
- senior software engineer ruby on rails Redmond, WA
- intel software engineer Redmond, WA
- graduate software developer no experience Redmond, WA
- software developer positions Redmond, WA



