Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior and/or Principal Software Engineer- AI Infrastructure

$142.8k - $274.8k
Full-time

Microsoft Corporation

Overview The Microsoft AI Frameworks team, develops the software, performance systems, and engineering tools that enable state-of-the-art AI models to run reliably and efficiently at cloud scale. We work across model architectures, frameworks, compilers, runtimes, libraries, observability, benchmarking, and hardware platforms—including NVIDIA and AMD GPUs and Microsoft silicon. Our Senior and/or Principal Software Engineers - AI Frameworks partner with model developers, researchers, hardware teams, and production services to accelerate model onboarding, improve performance and reliability, reduce deployment time and hardware footprint, and turn performance insights into durable platform capabilities. This is a hands-on individual-contributor role for engineers who enjoy solving ambiguous, end-to-end systems problems. Successful candidates combine strong software engineering fundamentals with curiosity about AI workloads, disciplined measurement, and a willingness to work across organizational boundaries to deliver production impact. As a Senior Software Engineer, you will own significant components and projects across AI performance, benchmarking, automation, and developer tooling. You will independently translate model and platform needs into robust software, investigate complex performance and reliability issues, and collaborate with partner teams to deliver measurable improvements into production. As a Principal Software Engineer, you will set technical direction and lead high-impact initiatives spanning AI frameworks, performance engineering, benchmarking, and tooling. You will identify systemic opportunities, align teams around durable architectures and success measures, and remain hands-on in the design and delivery of solutions that improve model velocity, platform efficiency, and production reliability. At Microsoft, our mission to empower every person and every organization on the planet to achieve more guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone.

Responsibilities

As a Senior Software Engineer:
  • Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
  • Build automation and observability that detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding.
  • Drive scoped projects from problem definition through deployment, balancing delivery speed, maintainability, reliability, and measurable customer or capacity impact.
  • Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions.
  • Contribute to technical design reviews, engineering standards, operational health, and mentoring of other engineers.
  • Embody Microsoft’s culture and values.
As a Principal Software Engineer:
  • Define technical vision, architecture, and multi-release strategy for critical AI framework, performance, benchmarking, or developer-productivity capabilities.
  • Lead ambiguous, cross-stack investigations and investments spanning models, frameworks, compilers, runtimes, systems, services, and silicon.
  • Establish common measurement, automation, observability, and engineering mechanisms that turn one-off analyses into scalable platform capabilities.
  • Drive measurable improvements in model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.
  • Influence architecture and priorities across teams; align researchers, product groups, infrastructure owners, and hardware partners around clear decisions and execution plans.
  • Provide hands-on technical leadership through prototypes, critical-path implementation, design and code reviews, complex debugging, and operational readiness.
  • Raise the engineering bar by mentoring senior engineers, developing technical leaders, and advancing standards for quality, maintainability, and inclusive collaboration.
  • Embody Microsoft’s culture and values.

Qualifications

Required/Minimum Qualifications:
  • Bachelor’s Degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience.
Other Requirements:
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Additional or preferred qualifications for Senior Software Engineer:
  • Experience building and operating complex software systems
  • Practical knowledge of performance analysis, benchmarking, automation, or developer tooling
  • Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime
  • Familiarity with GPU software and profiling technologies such as CUDA, ROCm, Triton, or equivalent
  • Demonstrated cross-team collaboration and technical ownership
Additional or preferred qualifications for Principal Software Engineer:
  • Extensive experience designing and shipping complex, high-performance or distributed software systems
  • Experience in software architecture, computer architecture, and accelerator-aware optimization
  • Experience with AI/ML workloads and frameworks
  • Demonstrated leadership of cross-team technical initiatives from strategy through production
  • Track record of creating reusable platforms, influencing senior stakeholders, and mentoring technical leaders
#AIInfra Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. --- Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior and/or Principal Software Engineer- AI Infrastructure in San Francisco, CA vacancy
  • $190k - $240k

     ...~= 11 or Python ~= 3.7 ~ Proficiency using AI-powered development tools (e.g., Claude Code) across the full software development lifecycle - including design, prototyping...  ...to push the boundaries of productivity and engineering outcomes. Bonus skills Experience with... 
    Suggested
    Work at office
    Local area
    Home office
    Flexible hours

    Highnote

    San Francisco, CA
    3 days ago
  • # Senior DevOps & Infrastructure EngineerTuring · , CABack to resultsSenior DevOps & Infrastructure EngineerTuring...  ..., Turing works with frontier AI labs to generate high-quality...  ...that improve model capabilities in software engineering, enterprise knowledge work, and... 
    Senior
    Remote work

    Linuxassociation

    San Francisco, CA
    2 days ago
  •  ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of...  ...possible. The Lambda Infrastructure Engineering organization forges the foundation of...  ...We're looking for an experienced Senior Software Engineer to join our storage team. You... 
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    lambda

    San Francisco, CA
    3 days ago
  • $250k - $350k

     ...About the Role Join the infrastructure team at an applied AI company building data and evaluation systems for AI development. You will create the...  ...scalability reliability and performance. Partner with engineering teams to provide platform services that help them build... 
    Senior
    Full time
    Visa sponsorship

    Wintermeyer Ventures

    San Francisco, CA
    17 days ago
  • $180k - $220k

     ...Description Job Description Our client is an early-stage healthcare AI company building personalized care assistants for Medicare...  ..., payers, eligibility services, clinical partners, and claims infrastructure so delivered care turns into accurate claims and reliable... 
    Senior
    H1b
    Remote work
    Work from home
    Relocation
    Relocation package

    Raydar

    San Francisco, CA
    1 day ago
  • $401k

     ...collaborative security culture.About the RoleOpenAI is seeking a Principal Software Engineer to join the Infrastructure Security (InfraSec) team. InfraSec safeguards the...  ..., and the critical services that power our frontier AI models. Our charter spans everything from bare-metal... 
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • $180k - $240k

     ...Description Job Description Senior Platform Engineer Location: San Francisco, CA...  ...Focus: Platform Engineering, AWS Infrastructure, Developer Experience, AI Coding Agents, Healthcare AI...  ...observe, and operate production software. This role owns engineering enablement... 
    Senior
    Full time
    Local area

    NxT Level

    San Francisco, CA
    8 days ago
  • $180k - $240k

     ...bring the world's critical infrastructure into service faster by better...  ...capital projects.  The AI buildout runs on physical things...  ...We're looking for a Senior Platform Engineer to build the cloud foundation...  ...way to build, ship and run software also the easiest way. This... 
    Senior
    For contractors
    Work at office

    Foresight Works Ltd

    San Francisco, CA
    10 days ago
  • $166k - $225k

     ...and running the world's best data and AI infrastructure platform so our customers can use...  ...to improve their business. Founded by engineers — and customer obsessed — we leap at...  ...we're only getting started. As a Senior Software Engineer on the Infrastructure teams,... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Databricks

    San Francisco, CA
    7 days ago
  • $160k - $280k

     ...About the Role We're looking for a software engineer to build the Kubernetes-native control plane...  ..., right-sizing), and think about GPU infrastructure as software to be engineered. A product...  ...in Rust or Go. About Together AI Together AI, the AI Native Cloud, is... 
    Senior
    Full time

    Together AI

    San Francisco, CA
    7 days ago
  •  ...depthfirst We believe that software is the foundation of modern...  ...training and scaling security AI agents to discover zero-day vulnerabilities...  ...deep expertise in data, infrastructure, security and AI, with...  ...As one of our first security engineers, you'll own the security... 
    Senior
    Full time
    Work at office

    depthfirst

    San Francisco, CA
    3 days ago
  • $160k - $180k

     ...Description About Sapience AI Sapience AI is the...  ...with two platform engineers (DevOps and platform engineering...  ...to, the Sapience AI | Senior Lead Engineer,...  ...-operated stateful infrastructure must pass before release...  ...what exists. – Enough software engineering to be... 
    Senior
    Remote work
    Shift work
    Night shift

    Sapience AI Corporation

    San Francisco, CA
    20 days ago
  • $150k - $250k

     ...Principal Full Stack Software EngineerJITX is revolutionizing circuit board design by making it code-first. Instead of dragging components around in a GUI, engineers write code—or have AI write it for them—to define their circuit boards. We're a ~12-person startup building... 
    Immediate start

    JITX

    San Francisco, CA
    5 days ago
  • $160k - $190k

     ...'re seeking an exceptional Senior Platform Engineer to serve as a technical lead...  ...generation of our platform infrastructure, with a focus on...  ...Design Platform Services: Using AI-assisted engineering to design...  ...engineering, SRE, security, and software teams to support and scale... 
    Senior
    Full time
    Contract work
    Temporary work
    Remote work
    Shift work

    Doma Technology LLC

    San Francisco, CA
    4 days ago
  • $300 per month

     .... As the only vertically integrated AI infrastructure company built from the ground up, we own...  ...Crusoe’s Data Center Infrastructure Engineering (DCIE) team is fundamental to our mission...  ...a highly skilled and motivated Software Engineer to join Crusoe’s Data Center... 
    Senior
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • Zscaler is seeking a Senior Sales Engineer to join our team. This fully remote role based in Germany will present the Zscaler cloud security platform to prospective customers and translate goals into engaging, relevant recommendations, acting as a trusted advisor through... 
    Senior
    Remote job

    Remote

    San Francisco, CA
    2 days ago
  •  ...research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people...  ...truly understand each other. The Role We're hiring a Senior Software Engineer (Infrastructure) to be a technical driver across teams. You're the flywheel... 
    Senior
    Flexible hours

    Tavus

    San Francisco, CA
    4 days ago
  •  ...individual questions. We’re exploring how AI can make powerful learning tools more...  .... Our work brings together product engineering, design, AI research, and education to...  ...around the world. About the Role As a Principal Software Engineer on the ChatGPT Learning team,... 
    Full time
    Work at office
    Relocation package
    3 days per week

    OpenAI

    San Francisco, CA
    11 days ago
  •  ...Were looking for a product-minded Principal Software Engineer to set technical direction build the...  ...your focus you may scale generalist infrastructure and identity-related integrations across...  ...intersection of backend engineering and applied AI or work on the product experience... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    23 days ago
  • $250k - $300k

     ...only vertically integrated AI infrastructure company built from the ground...  ...is building the physical and software backbone that powers the...  ...position reporting into Network Engineering, with the mandate to set...  ...5+ years as an architect or senior technical lead designing production... 
    Senior
    Full time
    Temporary work
    Flexible hours

    Crusoe

    San Francisco, CA
    12 days ago
  • $60 - $70 per hour

    Senior Technical Recruiter - AI Infrastructure and Engineering $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Salary Range $60 - $70 Job Description About the Mission We support companies building large-scale AI systems - performance... 
    Senior
    Remote work

    The Leadership Agency Inc.

    San Francisco, CA
    1 day ago
  • $142.8k - $274.8k

     ...organization at Microsoft builds the end-to-end AI stack and is core to Azure AI...  ...Services, and the global Azure AI infrastructure for running the largest AI workloads...  ...multimodal content. We are looking for a Principal Software Engineer - Responsible AI who is passionate... 
    Ongoing contract
    Full time
    Work at office
    Local area

    Microsoft

    San Francisco, CA
    2 days ago
  •  ...world.The role:We are looking for a Principal Software Engineer to own the long-term networking...  ....You will lead how we use AI to run networking and infrastructure. We are moving toward an AI-accelerated...  ...and talent: Mentor Staff and Senior Staff engineers and emerging... 
    Remote work

    SoFi

    San Francisco, CA
    2 days ago
  • $148.5k - $223.9k

     ...duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with...  ...immediate opportunities for senior software developers who want...  ...products over public cloud infrastructure - AWS/Azure/GCP. Proven... 
    Senior
    Full time
    Immediate start

    Salesforce

    San Francisco, CA
    11 days ago
  • $276k - $414k

     ...other digital services.Snap Engineering teams build fun and...  ...forefront.We’re looking for a Principal Software Engineer to join the Ads Platform...  ...ads formats and backend infrastructure and solutions to deliver more...  ...the entire companyUtilize AI tools and high velocity engineering... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    San Francisco, CA
    1 day ago
  • $300 per month

     ...only vertically integrated AI infrastructure company built from the ground...  ...At Crusoe, our Production Engineering team ensures the reliability...  ...platform. We’re looking for a Senior Production Engineer with a strong...  ...Bring to the Team Strong software engineering background —... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    15 days ago
  • $197.3k - $313.7k

     ...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive...  ...utilitiesMaintain and service our infrastructure using IaC (Terraform) for our AWS accountsAI...  ...and debugging live production issues.Software engineering fundamentalsOOP (required):... 
    Full time

    Salesforce

    San Francisco, CA
    4 days ago
  • £55.7k - £83.5k per year

    Technical Engineering 5+ years Backend Development The opportunity Unity Spark is our...  ...shared, and played on the web. As a Senior Backend Infrastructure Engineer on the Spark team, you will...  ...editing. Our team moves fast and uses AI coding tools every day. That shifts... 
    Senior
    Work at office
    Worldwide
    Relocation package
    Shift work

    Game Companies

    San Francisco, CA
    2 days ago
  • Workleap seeks a Senior AI Developer to join the Product Ops team and shape the AI-powered agent platform. You will own production-ready...  ...delivery with cross-functional partners in Product, Engineering, and Data Science. Remote work is supported, with collaboration... 
    Senior
    Remote job

    Remote

    San Francisco, CA
    4 days ago
  •  ...enterprise data and AI platform on Databricks. Our Data Engineers, Data Scientists,...  ...build on. As a Principal Data Engineer, you...  ...platform frameworks and infrastructure that make...  ...standards: Mentor senior and staff engineers...  ...About You10+ years of software or data platform engineering... 
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior and/or Principal Software Engineer- AI Infrastructure. Be the first to apply!