Software Engineer II & Senior Software Engineer - AI Inference and Serving (CoreAI)
$102.1k - $202.2kMicrosoft
Job ID: 200066242Posted: 2026-11-17Location: United States, Washington, RedmondSalary: USD $102,100 - $202,200 per yearEmployment type: Full-TimeWork site: 3 days / week in-officeRole type: Individual ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software EngineeringCompany: MicrosoftOverviewMicrosoft Foundry helps developers and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference faster, more reliable and more efficient for customers.We are hiring both Software Engineer II and Senior Software Engineers to join our team. As a Software Engineer on the Foundry inference team, you will own a serving component from design to production. Your work will reduce customer latency and improve serving efficiency.ResponsibilitiesProfile execution, memory and dependency bottlenecks.Improve cache-aware routing, admission control, continuous batching or KV-cache management within your area.Validate time-to-first-token, tail latency and cost per token through load and failure testing.Build secure, tenant-isolated systems with automated testing, observability, reliable recovery and safe releases.Participate in operational support and improve services using production feedback.Preserve model quality and numerical correctness.Use reproducible benchmarks to improve throughput, latency and cost.Pursue near-linear throughput scaling where workloads permit, across agreed GPU and node configurations.Build provider-aware serving stacks and integrate with supported training/post-training stacks for OpenAI, Anthropic, Microsoft AI (MAI) and open-source models.QualificationsRequired Qualifications:Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.Other Qualifications:Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.Preferred Qualifications:5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.Proven experience coding in C++, C#, Rust, Go, Java or Python, with networking and concurrency fundamentals.Proven experience with software engineering fundamentals, debugging skills and clear cross-team communication.Experience shipping and operating gateways, model-serving runtimes or accelerator software.Experience with containerized services, Kubernetes, and serving runtimes such as vLLM, SGLang or TensorRT-LLM.#coreaiSoftware Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
$102.1k - $202.2k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:... ...Microsoft CoreAI Speech Team is building speech... ...power the next generation of AI experiences. Our team is developing... ...an experienced Software Engineer II and a Senior Software Engineer to join our...SeniorOngoing contractLocal area3 days per week$102.1k - $202.2k
...Less than 25%Profession: Software EngineeringDiscipline:... ...Microsoft CoreAI Speech and Languages Teams... ...the next generation of AI experiences. We are hiring software engineers for opportunities across... ...both Software Engineer II and Senior Software Engineers.You...SeniorOngoing contractLocal area3 days per week$182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...at About the Team Senior engineers are area owners who lead designs... ...evolve our Kubernetes-native inference platform and meet strict P99... ...vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe). Experience...SeniorFull timeTemporary workCasual workWork at officeFlexible hoursShift work$102.1k - $202.2k
...MicrosoftOverviewThe future of AI will be built... ...Managers (PM II and Senior PM) to join... ...team within CoreAI. You will help... ..., model serving and... ...Partner deeply with engineering and research teams... ...management or software developmentOR... ...models, model inference, AI...SeniorOngoing contractLocal areaShift work3 days per week$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote... ...ServiceNow is the AI control tower for... ...intelligent software and smart user experiences... ....We are seeking a Senior Staff Software Engineer - AI/ML Inference Engineering to lead... ...algorithmsModel-serving and runtime...SeniorWork experience placementWork at officeImmediate startRemote workFlexible hours$102.1k - $202.2k
...Less than 25%Profession: Software EngineeringDiscipline:... ...using Generative AI. Our work enables developers... ...transformative software. CoreAI Cloud Foundation team... ...AI workloads. Besides serving a multitude of industry... ...customers creates challenging engineering opportunities in areas...Ongoing contractLocal area3 days per week$102.1k - $202.2k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software... ...solutions. We are looking to hire Senior Software Engineers and Software Engineer IIs for our teams! The Microsoft... ...building or integrating AI/ML-powered systems or workflows, including...SeniorOngoing contractLocal area3 days per week$119.8k - $234.7k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software... ...infrastructure!We are looking for a Senior Software Engineer - CoreAI to join the Azure Functions Platform... ...and help define how cloud-native and AI-powered applications are built on Azure...SeniorOngoing contractLocal area3 days per week$102.1k - $202.2k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software... ...Security Organization, we are building AI-powered capabilities that help defenders... ...agent did and whyWe are hiring Software Engineer II(s) + Senior Software Engineer(s) to build the services...SeniorOngoing contractLocal area3 days per week$102.1k - $202.2k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:... ...for the realities of AI-era defense. Project Perception... .... As a Full-Stack Software Engineer, you will take hands-on technical... ...for Software Engineer II and Senior Software Engineers who are self...SeniorOngoing contractLocal area3 days per week$102.1k - $202.2k
...Overview The AI Frameworks team at Microsoft develops the AI software used to train and deploy the... ...intersection of compiler engineering, programming language... ...Software Engineers II and/or Senior Software Engineer -... ...with AI frameworks, AI inference systems, AI kernel...SeniorOngoing contractFull timeLocal area$152k - $204k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...at . What You’ll Do: Senior engineers are area owners who lead... ...evolve our Kubernetes-native inference platform and meet strict P99... ...vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe). Experience with...SeniorFull timeTemporary workCasual workWork at officeFlexible hoursShift work$139k - $204k
...is The Essential Cloud for AI™. Built for pioneers by... ...rendering, and real-time inference. Our stack is engineered for speed, scale, and cost... ...role We are looking for Senior Software Engineer to help us understand... ...priority models and serving configurations. Benchmark...SeniorFull timeTemporary workCasual workWork at officeFlexible hours$119.8k - $234.7k
...Overview Core AI is at the forefront of Microsoft... ...mission to redefine how software is built and... ...critical role in enabling engineering excellence across Microsoft... ...the data platform that serves key engineering artifacts... ...major product lines. As a Senior Software Engineer on...SeniorOngoing contractFull timeTemporary workLocal area$102.1k - $202.2k
...of intelligent agents and generative AI systems. Within CoreAI, the Foundry Agents organization is... ...evaluate and optimize agents. As a Software Engineer II within Foundry Agents, you will contribute... ...infrastructure with support from senior team members Participate in...Ongoing contractFull timeLocal area$194k - $349k
...with the world’s most advanced AI-native platform. We work on... ...new skills, mentor junior and senior developers and contribute to... ...CrowdStrike is seeking a Senior Engineer II for our Policy Management... ...responsible for the cloud-side software and user interfaces that...SeniorPermanent employmentWork experience placementWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week$119.8k - $234.7k
...Less than 25%Profession: Software EngineeringDiscipline:... ...System (DNS), and a Senior Software Engineer, Cloud Platform our... ...designed to replace legacy IIS-based (Internet... ...artificial intelligence (AI) tools and practices across... ...of transactions and serving hundreds of millions...SeniorOngoing contractWork at officeLocal area3 days per week$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means... ..., post-training, inference. Our objective is to deliver... ...an AI infrastructure software engineer to join our team. You'... ...of AI systems.As a senior DGX Cloud AI... ...The GPU, our invention, serves as the visual cortex of...SeniorFull timeRemote work- ...The Essential Cloud for AI™. Built for pioneers by pioneers... ...2025. Learn more at Senior Deployment Engineer - LLM Inference & Optimization About the... ..., memory consumption, serving infrastructure, and... ...+ years of experience in software engineering, ML engineering...SeniorFull timeTemporary workCasual workWork at officeFlexible hours
$102.1k - $202.2k
...SciencesCompany: MicrosoftOverviewThe CoreAI Platform and Tools... ...experiences that leverage the latest AI technology while upholding... ...Applied Scientist II and a Senior Applied Scientist with a proven... ...closely with the Responsible AI engineering team to deliver these mitigations...SeniorOngoing contractLocal area3 days per week$143.7k - $194.4k
...at massive scale. We're looking for a Software Development Engineer II with deep data engineering expertise to... ...) that ingest, transform, and serve large volumes of supply-chain data.• Own... ...production datasets- Experience using AI coding assistants or agentic development...Flexible hours$142.8k - $274.8k
...Less than 25%Profession: Software EngineeringDiscipline:... ...-enabled world. The CoreAI organization at Microsoft... ...builds the end-to-end AI stack and is core to Azure... ...customers are better served. Within CoreAI, the Foundry... ...a Principal Software Engineering Manager who is...Ongoing contractWork at officeLocal area3 days per week$102.1k - $202.2k
...Overview As a Software Engineer II in Agentic Engineering Productivity, you will... ...services the team owns and serve as an escalation point during... ...workflows, beyond personal use of AI coding assistants. Ability... ...building relationships with senior technical and business...Ongoing contractFull timeLocal area$119.8k - $234.7k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software... ...secure cloud foundation behind Azure AI Search and enterprise AI applications.... ...with confidence.Job Purpose OverviewAs a Senior Software Engineer, you will build infrastructure that...SeniorOngoing contractLocal area3 days per week$119.8k - $234.7k
...innovative Web Data Platform Team as a Senior Software Engineer and help us revolutionize the future of... ...that powers Bing Search and Microsoft AI training scenarios, empowers data scientists... ...to unlock new possibilities and serve a growing array of use cases and customers...SeniorOngoing contractFull timeWork at officeLocal area$142.8k - $274.8k
...Less than 25%Profession: Software EngineeringDiscipline:... ...you want to lead engineers who work directly on Java... ...Horizons division within CoreAI, the Java, Python and Go... ...being the most common. AI-first engineering is part... ...products that also serve third-party customers....Ongoing contractLocal area3 days per week$182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...more at About the Role As a Senior Software Engineer II (IC4) on the AI Workload Orchestration... ...to support modern AI training and inference workflows. It complements SUNK (Slurm...SeniorFull timeTemporary workCasual workWork at officeFlexible hours$119.8k - $234.7k
...the secure cloud foundation behind Azure AI Search and enterprise AI applications.... ...Core Compute team within Microsoft's CoreAI organization in Redmond, WA. You will... ...supports its live-site operations. As a Senior Software Engineer - CoreAI , you will build and maintain...SeniorOngoing contractFull timeLocal area3 days per week$168.1k - $227.4k
...implements and operates the software stack to manage beam planning... ...services and Applications with AI native initiatives that... ...are looking for a Sr. Software Engineer to serve as the technical leader for Network... ...bar.A day in the lifeAs a Senior Software Development Engineer...SeniorPermanent employmentInternshipFlexible hours$236k - $330k
...this new era, we seek AI-native thinkers across... ...state of the art in LLM inference systems and... ...stack—from distributed serving and runtime systems to... ...We embrace AI-native engineering, using AI not only as... ...approaches to accelerate software development, experimentation...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer II & Senior Software Engineer - AI Inference and Serving (CoreAI). Be the first to apply!
- senior software design engineer Redmond, WA
- software web developer Redmond, WA
- senior software engineer Redmond, WA
- software developer fintech Redmond, WA
- scientific software engineer Redmond, WA
- new graduate software engineer Redmond, WA
- senior software engineer ruby on rails Redmond, WA
- intel software engineer Redmond, WA
- graduate software developer no experience Redmond, WA
- software developer positions Redmond, WA





