Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, AI Infrastructure

$119.8k - $234.7k
Full-time

Microsoft

Overview Every time someone uses Azure OpenAI Service, their request needs to reach the right graphics processing unit (GPU), in the right region, at the right moment. Our team makes that happen. We build the platform that decides how AI traffic flows across Microsoft's global infrastructure, so services like Azure OpenAI and Microsoft Copilot stay fast and reliable. You'll join a supportive, connected team that keeps these experiences fair and dependable for every customer while making the most of every GPU we run. As a Senior Software Engineer, AI Infrastructure on our team, you'll design, build, and run services that route and prioritize AI requests and match them to available computing capacity. You'll own the design of key parts of our platform, work with partner teams to bring new AI models and capabilities to customers, and help keep our services healthy in production. This opportunity will allow you to deepen your knowledge of distributed systems at global scale, learn how the world's leading AI models are served, and grow as a technical leader and mentor on your team. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities

  • Design - Own the design of key parts of our platform for routing AI traffic and managing computing capacity. Write design proposals, compare options, and make sure designs meet goals for speed, reliability, scale, and cost.
  • Coding - Write clear, secure, well-tested code and set a good example for the team. Give thoughtful, timely code reviews that help others grow.
  • Implement - Break work into clear, dependable milestones with program managers. Use feature flags and gradual rollouts to test changes safely, measure their impact, and roll back quickly when needed.
  • Reliability and Supportability - Take part in the on-call rotation as a designated responsible individual (DRI). Add monitoring and dashboards, improve troubleshooting guides, and help reduce how often incidents happen.
  • Understand User Requirements - Work with product managers and partner teams to understand what customers need and turn those needs into clear technical requirements.
  • Engineering Excellence - Build security, privacy, and compliance into every stage of your work, from design to deployment. Automate testing and releases, and share what you learn with the team.
  • AI-Native Development - Use artificial intelligence (AI) tools across the software development lifecycle (SDLC), from writing code and tests to investigating live issues. Take responsibility for AI-generated work and help teammates do the same.
  • Embody our [Culture]( and [Values](
Qualifications Required Qualifications:
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
  • OR equivalent experience.
Other Requirements
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Preferred Qualifications
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
  • OR Bachelor's Degree in Computer Science or related technical field
  • AND 8+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
  • OR equivalent experience.
  • 3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP).
  • 2+ years of experience with systems that route or schedule traffic, or that allocate computing resources.
  • Experience with Python, Docker, and Kubernetes.
  • Experience with AI or machine learning (ML) infrastructure, such as serving models in production or managing GPU fleets.
  • Experience delivering projects with partner teams, from design through launch and operation.
  • Experience being on call for highly available services and improving monitoring to reduce incidents.
#AIINFRA The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about [ requesting accommodations. ](
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, AI Infrastructure in Redmond, WA vacancy
  • $119.8k - $234.7k

    Overview Join our team within AI Infrastructure, where we are building the AI data-plane that powers all LLM inferencing workloads...  ..., Anthropic, Mistral, Cohere, Llama, and more. As a  Senior Software Engineer , you will shape the future of one of the largest and fastest... 
    Senior
    Ongoing contract
    Local area

    Microsoft Corporation

    Redmond, WA
    1 day ago
  • $184k - $287.5k

     ...the forefront of the generative AI revolution, building the software and systems that power the world...  ...workloads. We are looking for a Senior Software Engineer to lead the bring-up, triage, benchmarking...  ...of large-scale AI clusters, infrastructure, and end-to-end workloads,... 
    Senior
    Full time
    Remote work

    Nvidia

    Redmond, WA
    3 days ago
  • $165k - $270k

     ...with the ultimate goal of enabling human life on Mars.SR. SOFTWARE ENGINEER, AI INFRASTRUCTURE (STARSHIELD) At SpaceX we’re leveraging our experience...  ...system availabilityMentor and train junior engineersAs a senior engineer you must lead the team to technical excellence... 
    Senior
    Permanent employment
    Temporary work
    Work at office
    Immediate start
    Monday to Friday
    Weekend work

    SpaceX

    Redmond, WA
    4 days ago
  • $119.8k - $234.7k

     ...Less than 25%Profession: Software EngineeringDiscipline: Software...  ...using Generative AI. Our work enables developers...  ...customers.We are looking for a Senior/Principal Software Engineer who will define the future...  ...of the core AI Infrastructure services that support large... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    2 days ago
  • $152k - $241.5k

    NVIDIA is looking for a creative SW engineer to join the team. SONiC open source NOS team is responsible for design and integration on various...  ...in Networking protocolsProven experience with AI tools for development or developing agents.Experience with C++ and... 
    Senior
    Full time

    Nvidia

    Redmond, WA
    3 days ago
  • $168.1k - $227.4k

     ...implements and operates the software stack to manage beam...  ...and Applications with AI native initiatives...  ...and terrestrial network infrastructure that connects into...  ...looking for a Sr. Software Engineer to serve as the...  ...A day in the lifeAs a Senior Software Development Engineer... 
    Senior
    Permanent employment
    Internship
    Flexible hours

    Amazon

    Redmond, WA
    4 days ago
  • $194k - $349k

     ...with the world’s most advanced AI-native platform. We work on...  ...new skills, mentor junior and senior developers and contribute to the...  ...CrowdStrike is seeking a Senior Engineer II for our Policy Management...  ...responsible for the cloud-side software and user interfaces that... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week
    Redmond, WA
    17 days ago
  • $184k - $287.5k

     ...developing advanced multi-rack, multi-tenant AI/ML datacenters with NVIDIA GB200, and upcoming GB300 GPUs. NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider)...  ...(Prometheus, OpenTelemetry), and infrastructure-as-code.Excellent communication-able to... 
    Senior
    Full time
    Remote work

    Nvidia

    Redmond, WA
    3 days ago
  • $119.8k - $234.7k

     ...computing (HPC) and cloud infrastructure that Microsoft Quantum engineers and scientists use to...  ...collaborate closely with software engineers physicists hardware...  ...about our team visit a Senior Quantum Software Engineer...  ...artificial intelligence (AI) tools to accelerate... 
    Senior
    Ongoing contract
    Permanent employment
    Full time
    Local area
    Remote work

    Microsoft

    Redmond, WA
    6 days ago
  • $148.5k - $223.9k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with...  ...Salesforce.Our Public Cloud engineering teams are responsible for innovating...  ....Your Impact:Deliver cloud infrastructure automation tools, frameworks...  ...required4+ years backend software development experienceDeep... 
    Senior
    Full time

    Salesforce

    Bellevue, WA
    1 day ago
  • $184k - $287.5k

     ...framework for building high-performance, software-defined, cloud-native Radio Access...  ...systems. We are seeking a self-motivated senior software engineer to drive development, performance and...  ...for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA... 
    Senior
    Full time
    Remote work

    Nvidia

    Redmond, WA
    2 days ago
  • $184k - $287.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research...  ...seeking an AI infrastructure software engineer to join our team. You'll be...  ...of AI systems.As a senior DGX Cloud AI Infrastructure software... 
    Senior
    Full time
    Remote work

    Nvidia

    Redmond, WA
    3 days ago
  • $174k - $252k

    Software Engineer Google's software engineers develop the next-generation technologies that change how billions of users connect, explore...  ...-stack as we continue to push technology forward. The AI and Infrastructure team is redefining what's possible. We empower Google... 
    Senior
    Temporary work
    Worldwide

    CompliancePoint

    Kirkland, WA
    1 day ago
  • $119.8k - $234.7k

     ...Microsoft is considered one of the leaders in Software as a Service in the world of business...  ...and delivered. We are looking for a Senior Software Engineer to join the Azure Bot Service team,...  ...Microsoft. With the rapid pace of AI innovation, our team is uniquely positioned... 
    Senior
    Ongoing contract
    Local area

    Microsoft Corporation

    Redmond, WA
    1 day ago
  • $119.8k - $234.7k

     ...businesses on the Internet today. Search engines, publishers, ad networks, and ad...  ...advertisers with industry-leading platforms, AI-powered experiences, and data-driven insights...  ...worldwide. We are looking for a Senior Software Engineer who is passionate about building... 
    Senior
    Ongoing contract
    Work at office
    Local area
    Worldwide

    Microsoft Corporation

    Redmond, WA
    1 day ago
  • $139k - $242k

    Senior Software Engineer, Server Fleet Infrastructure Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    1 day ago
  • $125k - $165k

     ...actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars. SOFTWARE ENGINEER, AI INFRASTRUCTURE (STARSHIELD) At SpaceX we're leveraging our experience in building rockets and spacecraft to deploy the... 
    Temporary work
    Work at office
    Immediate start
    Monday to Friday
    Weekend work

    SpaceX

    Redmond, WA
    3 days ago
  • $164k - $295k

     ...and we’ve redefined modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems,...  ...components of our new cloud architecture, collaborating with our most senior technologists Deliver low-latency and highly scalable services... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    2 days per week
    Redmond, WA
    18 days ago
  •  ...enterprise. To usher in this new era, we seek AI-native thinkers across every function...  ...done.Snowflake runs large scale cloud infrastructure to deliver its own service — production...  ...optimization of our cloud spend.AS A SOFTWARE ENGINEER AT SNOWFLAKE YOU WILL:Design, develop,... 
    Senior

    Snowflake

    Bellevue, WA
    3 days ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ..., CoreWeave combines superior infrastructure performance with deep technical expertise...  ...About this role We're looking for a Senior Engineer to be a driving force on CoreWeave's Benchmarking... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    4 days ago
  • $224k - $356.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means advancing the...  ...GPUs, networking, storage, and software stacks. We are seeking a Senior Performance Engineer to characterize workloads, establish...  ...technically diverse team of infrastructure experts to unlock more... 
    Senior
    Full time
    Remote work

    Nvidia

    Redmond, WA
    4 days ago
  •  ...combine global expertise in AI, automation, and network transformation...  ...will be on streamlining software delivery, minimizing manual...  ...contribute to establishing engineering best practices and standards...  ...through scripting and Infrastructure as Code (IaC) tools (preferrable... 
    Senior
    Immediate start
    Worldwide

    Reailize

    Redmond, WA
    4 days ago
  • $80 - $85 per hour

     ...Immediate need for a talented Senior Software Engineer . This is a 06+months contract opportunity with long-term potential and is located in...  ...laws. By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid... 
    Senior
    Contract work
    Local area
    Immediate start

    Pyramid Consulting, Inc

    Redmond, WA
    1 day ago
  • $217.2k - $288.4k

     ...and running the world's best data and AI infrastructure platform, so our customers can focus on...  ...are central to their missions.Our engineering teams build highly technical products...  ...data from bad actors. We are looking for senior leaders such as yourselves to create the... 
    Senior
    Local area
    Worldwide

    DataBricks

    Bellevue, WA
    3 days ago
  • $200k - $287.5k

     ...enterprise. To usher in this new era, we seek AI-native thinkers across every function...  ...the future of how work gets done.Senior Software Engineer — Cortex TrainingThe Snowflake ML...  ...an engineer who thrives in the ML infrastructure layer and brings a solid understanding... 
    Senior

    Snowflake

    Bellevue, WA
    3 days ago
  • $152k - $241.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An...  ...looking for an experienced Compiler Infrastructure Engineer to join our Compute Compiler Team, with...  ...patch queues, rebasing strategies)Strong software engineering fundamentals with an emphasis... 
    Senior
    Full time
    Remote work

    Nvidia

    Redmond, WA
    1 day ago
  • $164k - $295k

     ...with the world’s most advanced AI-native platform. We work on...  ...CrowdStrike is seeking a Senior Software Developer in Test (SDET) to...  ...contract, and chaos/resilience engineering. Cybersecurity experience is...  ...-wide testing tools and infrastructure Define and drive testing... 
    Senior
    Permanent employment
    Contract work
    Work experience placement
    Work at office
    Local area
    2 days per week
    3 days per week
    Redmond, WA
    a month ago
  • $147k - $210k

    Software Engineer Google's software engineers develop the next-generation technologies that change how billions of users connect, explore...  ...changing the world, across many product areas, including AI & Infrastructure, Cloud, YouTube, Search, Ads and more! Our Engineering... 
    Full time

    CompliancePoint

    Kirkland, WA
    1 day ago
  • $148.5k - $223.9k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with...  ...ExperienceOur Public Cloud engineering teams are responsible for innovating...  ...Be DoingDeliver cloud infrastructure automation tools, frameworks...  ...Minimum of 5+ years of backend software development experience (... 
    Senior
    Full time
    Work experience placement

    Salesforce

    Bellevue, WA
    4 days ago
  • $200k - $287.5k

     ...of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by...  ...help redefine the future of how work gets done.We are hiring a Senior Software Engineer for our Cloud Security team. This team reduces risk to... 
    Senior
    Work at office

    Snowflake

    Bellevue, WA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, AI Infrastructure. Be the first to apply!