Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer II & Senior Software Engineer - AI Inference and Serving (CoreAI)

$102.1k - $202.2k

Microsoft

Job ID: 200066242Posted: 2026-11-17Location: United States, Washington, RedmondSalary: USD $102,100 - $202,200 per yearEmployment type: Full-TimeWork site: 3 days / week in-officeRole type: Individual ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software EngineeringCompany: MicrosoftOverviewMicrosoft Foundry helps developers and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference faster, more reliable and more efficient for customers.We are hiring both Software Engineer II and Senior Software Engineers to join our team. As a Software Engineer on the Foundry inference team, you will own a serving component from design to production. Your work will reduce customer latency and improve serving efficiency.ResponsibilitiesProfile execution, memory and dependency bottlenecks.Improve cache-aware routing, admission control, continuous batching or KV-cache management within your area.Validate time-to-first-token, tail latency and cost per token through load and failure testing.Build secure, tenant-isolated systems with automated testing, observability, reliable recovery and safe releases.Participate in operational support and improve services using production feedback.Preserve model quality and numerical correctness.Use reproducible benchmarks to improve throughput, latency and cost.Pursue near-linear throughput scaling where workloads permit, across agreed GPU and node configurations.Build provider-aware serving stacks and integrate with supported training/post-training stacks for OpenAI, Anthropic, Microsoft AI (MAI) and open-source models.QualificationsRequired Qualifications:Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.Other Qualifications:Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.Preferred Qualifications:5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.Proven experience coding in C++, C#, Rust, Go, Java or Python, with networking and concurrency fundamentals.Proven experience with software engineering fundamentals, debugging skills and clear cross-team communication.Experience shipping and operating gateways, model-serving runtimes or accelerator software.Experience with containerized services, Kubernetes, and serving runtimes such as vLLM, SGLang or TensorRT-LLM.#coreaiSoftware Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer II & Senior Software Engineer - AI Inference and Serving (CoreAI) in Redmond, WA vacancy
  • $102.1k - $202.2k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:...  ...Microsoft CoreAI Speech Team is building speech...  ...power the next generation of AI experiences. Our team is developing...  ...an experienced Software Engineer II and a Senior Software Engineer to join our... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    3 days ago
  • $102.1k - $202.2k

     ...Less than 25%Profession: Software EngineeringDiscipline:...  ...Microsoft CoreAI Speech and Languages Teams...  ...the next generation of AI experiences. We are hiring software engineers for opportunities across...  ...both Software Engineer II and Senior Software Engineers.You... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...at  About the Team Senior engineers are area owners who lead designs...  ...evolve our Kubernetes-native inference platform and meet strict P99...  ...vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe). Experience... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    6 days ago
  • $102.1k - $202.2k

     ...MicrosoftOverviewThe future of AI will be built...  ...Managers (PM II and Senior PM) to join...  ...team within CoreAI. You will help...  ..., model serving and...  ...Partner deeply with engineering and research teams...  ...management or software developmentOR...  ...models, model inference, AI... 
    Senior
    Ongoing contract
    Local area
    Shift work
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $201.3k - $352.3k

     ...DescriptionIt all started when engineer Fred Luddy wrote...  ...ServiceNow is the AI control tower for...  ...intelligent software and smart user experiences...  ....We are seeking a Senior Staff Software Engineer - AI/ML Inference Engineering to lead...  ...algorithmsModel-serving and runtime... 
    Senior
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Kirkland, WA
    3 days ago
  • $102.1k - $202.2k

     ...Less than 25%Profession: Software EngineeringDiscipline:...  ...using Generative AI. Our work enables developers...  ...transformative software. CoreAI Cloud Foundation team...  ...AI workloads. Besides serving a multitude of industry...  ...customers creates challenging engineering opportunities in areas... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    3 days ago
  • $102.1k - $202.2k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software...  ...solutions. We are looking to hire Senior Software Engineers and Software Engineer IIs for our teams! The Microsoft...  ...building or integrating AI/ML-powered systems or workflows, including... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    14 hours ago
  • $119.8k - $234.7k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software...  ...infrastructure!We are looking for a Senior Software Engineer - CoreAI to join the Azure Functions Platform...  ...and help define how cloud-native and AI-powered applications are built on Azure... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    2 days ago
  • $102.1k - $202.2k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software...  ...Security Organization, we are building AI-powered capabilities that help defenders...  ...agent did and whyWe are hiring Software Engineer II(s) + Senior Software Engineer(s) to build the services... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    3 days ago
  • $102.1k - $202.2k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:...  ...for the realities of AI-era defense. Project Perception...  .... As a Full-Stack Software Engineer, you will take hands-on technical...  ...for Software Engineer II and Senior Software Engineers who are self... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $102.1k - $202.2k

     ...Overview The AI Frameworks team at Microsoft develops the AI software used to train and deploy the...  ...intersection of compiler engineering, programming language...  ...Software Engineers II and/or Senior Software Engineer -...  ...with AI frameworks, AI inference systems, AI kernel... 
    Senior
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    10 hours ago
  • $152k - $204k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...at  . What You’ll Do: Senior engineers are area owners who lead...  ...evolve our Kubernetes-native inference platform and meet strict P99...  ...vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe). Experience with... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    3 days ago
  • $139k - $204k

     ...is The Essential Cloud for AI™. Built for pioneers by...  ...rendering, and real-time inference. Our stack is engineered for speed, scale, and cost...  ...role We are looking for Senior Software Engineer to help us understand...  ...priority models and serving configurations. Benchmark... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    3 days ago
  • $119.8k - $234.7k

     ...Overview Core AI is at the forefront of Microsoft...  ...mission to redefine how software is built and...  ...critical role in enabling engineering excellence across Microsoft...  ...the data platform that serves key engineering artifacts...  ...major product lines. As a Senior Software Engineer on... 
    Senior
    Ongoing contract
    Full time
    Temporary work
    Local area

    Microsoft

    Redmond, WA
    1 day ago
  • $102.1k - $202.2k

     ...of intelligent agents and generative AI systems. Within CoreAI, the Foundry Agents organization is...  ...evaluate and optimize agents. As a Software Engineer II within Foundry Agents, you will contribute...  ...infrastructure with support from senior team members Participate in... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    1 day ago
  • $194k - $349k

     ...with the world’s most advanced AI-native platform. We work on...  ...new skills, mentor junior and senior developers and contribute to...  ...CrowdStrike is seeking a Senior Engineer II for our Policy Management...  ...responsible for the cloud-side software and user interfaces that... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week
    Redmond, WA
    16 days ago
  • $119.8k - $234.7k

     ...Less than 25%Profession: Software EngineeringDiscipline:...  ...System (DNS), and a Senior Software Engineer, Cloud Platform our...  ...designed to replace legacy IIS-based (Internet...  ...artificial intelligence (AI) tools and practices across...  ...of transactions and serving hundreds of millions... 
    Senior
    Ongoing contract
    Work at office
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    2 days ago
  • $184k - $287.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means...  ..., post-training, inference. Our objective is to deliver...  ...an AI infrastructure software engineer to join our team. You'...  ...of AI systems.As a senior DGX Cloud AI...  ...The GPU, our invention, serves as the visual cortex of... 
    Senior
    Full time
    Remote work

    Nvidia

    Redmond, WA
    2 days ago
  •  ...The Essential Cloud for AI™. Built for pioneers by pioneers...  ...2025. Learn more at  Senior Deployment Engineer - LLM Inference & Optimization About the...  ..., memory consumption, serving infrastructure, and...  ...+ years of experience in software engineering, ML engineering... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    6 days ago
  • $102.1k - $202.2k

     ...SciencesCompany: MicrosoftOverviewThe CoreAI Platform and Tools...  ...experiences that leverage the latest AI technology while upholding...  ...Applied Scientist II and a Senior Applied Scientist with a proven...  ...closely with the Responsible AI engineering team to deliver these mitigations... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    3 days ago
  • $143.7k - $194.4k

     ...at massive scale. We're looking for a Software Development Engineer II with deep data engineering expertise to...  ...) that ingest, transform, and serve large volumes of supply-chain data.• Own...  ...production datasets- Experience using AI coding assistants or agentic development... 
    Flexible hours

    Amazon

    Bellevue, WA
    14 hours ago
  • $142.8k - $274.8k

     ...Less than 25%Profession: Software EngineeringDiscipline:...  ...-enabled world. The CoreAI organization at Microsoft...  ...builds the end-to-end AI stack and is core to Azure...  ...customers are better served. Within CoreAI, the Foundry...  ...a Principal Software Engineering Manager who is... 
    Ongoing contract
    Work at office
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $102.1k - $202.2k

     ...Overview As a Software Engineer II in Agentic Engineering Productivity, you will...  ...services the team owns and serve as an escalation point during...  ...workflows, beyond personal use of AI coding assistants. Ability...  ...building relationships with senior technical and business... 
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    10 hours ago
  • $119.8k - $234.7k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software...  ...secure cloud foundation behind Azure AI Search and enterprise AI applications....  ...with confidence.Job Purpose OverviewAs a Senior Software Engineer, you will build infrastructure that... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $119.8k - $234.7k

     ...innovative Web Data Platform Team as a Senior Software Engineer and help us revolutionize the future of...  ...that powers Bing Search and Microsoft AI training scenarios, empowers data scientists...  ...to unlock new possibilities and serve a growing array of use cases and customers... 
    Senior
    Ongoing contract
    Full time
    Work at office
    Local area

    Microsoft

    Redmond, WA
    3 days ago
  • $142.8k - $274.8k

     ...Less than 25%Profession: Software EngineeringDiscipline:...  ...you want to lead engineers who work directly on Java...  ...Horizons division within CoreAI, the Java, Python and Go...  ...being the most common. AI-first engineering is part...  ...products that also serve third-party customers.... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    6 hours ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...more at  About the Role As a Senior Software Engineer II (IC4) on the AI Workload Orchestration...  ...to support modern AI training and inference workflows. It complements SUNK (Slurm... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    27 days ago
  • $119.8k - $234.7k

     ...the secure cloud foundation behind Azure AI Search and enterprise AI applications....  ...Core Compute team within Microsoft's CoreAI organization in Redmond, WA. You will...  ...supports its live-site operations. As a Senior Software Engineer - CoreAI , you will build and maintain... 
    Senior
    Ongoing contract
    Full time
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $168.1k - $227.4k

     ...implements and operates the software stack to manage beam planning...  ...services and Applications with AI native initiatives that...  ...are looking for a Sr. Software Engineer to serve as the technical leader for Network...  ...bar.A day in the lifeAs a Senior Software Development Engineer... 
    Senior
    Permanent employment
    Internship
    Flexible hours

    Amazon

    Redmond, WA
    3 days ago
  • $236k - $330k

     ...this new era, we seek AI-native thinkers across...  ...state of the art in LLM inference systems and...  ...stack—from distributed serving and runtime systems to...  ...We embrace AI-native engineering, using AI not only as...  ...approaches to accelerate software development, experimentation... 
    Senior

    Snowflake

    Bellevue, WA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer II & Senior Software Engineer - AI Inference and Serving (CoreAI). Be the first to apply!