Senior and/or Principal Software Engineer- AI Infrastructure
$142.8k - $274.8kMicrosoft Corporation
Overview The Microsoft AI Frameworks team, develops the software, performance systems, and engineering tools that enable state-of-the-art AI models to run reliably and efficiently at cloud scale. We work across model architectures, frameworks, compilers, runtimes, libraries, observability, benchmarking, and hardware platforms—including NVIDIA and AMD GPUs and Microsoft silicon. Our Senior and/or Principal Software Engineers - AI Frameworks partner with model developers, researchers, hardware teams, and production services to accelerate model onboarding, improve performance and reliability, reduce deployment time and hardware footprint, and turn performance insights into durable platform capabilities. This is a hands-on individual-contributor role for engineers who enjoy solving ambiguous, end-to-end systems problems. Successful candidates combine strong software engineering fundamentals with curiosity about AI workloads, disciplined measurement, and a willingness to work across organizational boundaries to deliver production impact. As a Senior Software Engineer, you will own significant components and projects across AI performance, benchmarking, automation, and developer tooling. You will independently translate model and platform needs into robust software, investigate complex performance and reliability issues, and collaborate with partner teams to deliver measurable improvements into production. As a Principal Software Engineer, you will set technical direction and lead high-impact initiatives spanning AI frameworks, performance engineering, benchmarking, and tooling. You will identify systemic opportunities, align teams around durable architectures and success measures, and remain hands-on in the design and delivery of solutions that improve model velocity, platform efficiency, and production reliability. At Microsoft, our mission to empower every person and every organization on the planet to achieve more guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone.
Responsibilities
As a Senior Software Engineer:- Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
- Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
- Build automation and observability that detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding.
- Drive scoped projects from problem definition through deployment, balancing delivery speed, maintainability, reliability, and measurable customer or capacity impact.
- Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions.
- Contribute to technical design reviews, engineering standards, operational health, and mentoring of other engineers.
- Embody Microsoft’s culture and values.
- Define technical vision, architecture, and multi-release strategy for critical AI framework, performance, benchmarking, or developer-productivity capabilities.
- Lead ambiguous, cross-stack investigations and investments spanning models, frameworks, compilers, runtimes, systems, services, and silicon.
- Establish common measurement, automation, observability, and engineering mechanisms that turn one-off analyses into scalable platform capabilities.
- Drive measurable improvements in model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.
- Influence architecture and priorities across teams; align researchers, product groups, infrastructure owners, and hardware partners around clear decisions and execution plans.
- Provide hands-on technical leadership through prototypes, critical-path implementation, design and code reviews, complex debugging, and operational readiness.
- Raise the engineering bar by mentoring senior engineers, developing technical leaders, and advancing standards for quality, maintainability, and inclusive collaboration.
- Embody Microsoft’s culture and values.
Qualifications
Required/Minimum Qualifications:- Bachelor’s Degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Experience building and operating complex software systems
- Practical knowledge of performance analysis, benchmarking, automation, or developer tooling
- Familiarity with AI/ML frameworks such as PyTorch, TensorFlow, or ONNX Runtime
- Familiarity with GPU software and profiling technologies such as CUDA, ROCm, Triton, or equivalent
- Demonstrated cross-team collaboration and technical ownership
- Extensive experience designing and shipping complex, high-performance or distributed software systems
- Experience in software architecture, computer architecture, and accelerator-aware optimization
- Experience with AI/ML workloads and frameworks
- Demonstrated leadership of cross-team technical initiatives from strategy through production
- Track record of creating reusable platforms, influencing senior stakeholders, and mentoring technical leaders
$190k - $240k
...~= 11 or Python ~= 3.7 ~ Proficiency using AI-powered development tools (e.g., Claude Code) across the full software development lifecycle - including design, prototyping... ...to push the boundaries of productivity and engineering outcomes. Bonus skills Experience with...SuggestedWork at officeLocal areaHome officeFlexible hours- # Senior DevOps & Infrastructure EngineerTuring · , CABack to resultsSenior DevOps & Infrastructure EngineerTuring... ..., Turing works with frontier AI labs to generate high-quality... ...that improve model capabilities in software engineering, enterprise knowledge work, and...SeniorRemote work
- ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ...possible. The Lambda Infrastructure Engineering organization forges the foundation of... ...We're looking for an experienced Senior Software Engineer to join our storage team. You...SeniorFull timeWork at officeLocal areaWork from homeFlexible hours
$250k - $350k
...About the Role Join the infrastructure team at an applied AI company building data and evaluation systems for AI development. You will create the... ...scalability reliability and performance. Partner with engineering teams to provide platform services that help them build...SeniorFull timeVisa sponsorship$180k - $220k
...Description Job Description Our client is an early-stage healthcare AI company building personalized care assistants for Medicare... ..., payers, eligibility services, clinical partners, and claims infrastructure so delivered care turns into accurate claims and reliable...SeniorH1bRemote workWork from homeRelocationRelocation package$401k
...collaborative security culture.About the RoleOpenAI is seeking a Principal Software Engineer to join the Infrastructure Security (InfraSec) team. InfraSec safeguards the... ..., and the critical services that power our frontier AI models. Our charter spans everything from bare-metal...Work at officeLocal areaRemote workFlexible hours$180k - $240k
...Description Job Description Senior Platform Engineer Location: San Francisco, CA... ...Focus: Platform Engineering, AWS Infrastructure, Developer Experience, AI Coding Agents, Healthcare AI... ...observe, and operate production software. This role owns engineering enablement...SeniorFull timeLocal area$180k - $240k
...bring the world's critical infrastructure into service faster by better... ...capital projects. The AI buildout runs on physical things... ...We're looking for a Senior Platform Engineer to build the cloud foundation... ...way to build, ship and run software also the easiest way. This...SeniorFor contractorsWork at office$166k - $225k
...and running the world's best data and AI infrastructure platform so our customers can use... ...to improve their business. Founded by engineers — and customer obsessed — we leap at... ...we're only getting started. As a Senior Software Engineer on the Infrastructure teams,...SeniorLocal areaWorldwideFlexible hours$160k - $280k
...About the Role We're looking for a software engineer to build the Kubernetes-native control plane... ..., right-sizing), and think about GPU infrastructure as software to be engineered. A product... ...in Rust or Go. About Together AI Together AI, the AI Native Cloud, is...SeniorFull time- ...depthfirst We believe that software is the foundation of modern... ...training and scaling security AI agents to discover zero-day vulnerabilities... ...deep expertise in data, infrastructure, security and AI, with... ...As one of our first security engineers, you'll own the security...SeniorFull timeWork at office
$160k - $180k
...Description About Sapience AI Sapience AI is the... ...with two platform engineers (DevOps and platform engineering... ...to, the Sapience AI | Senior Lead Engineer,... ...-operated stateful infrastructure must pass before release... ...what exists. – Enough software engineering to be...SeniorRemote workShift workNight shift$150k - $250k
...Principal Full Stack Software EngineerJITX is revolutionizing circuit board design by making it code-first. Instead of dragging components around in a GUI, engineers write code—or have AI write it for them—to define their circuit boards. We're a ~12-person startup building...Immediate start$160k - $190k
...'re seeking an exceptional Senior Platform Engineer to serve as a technical lead... ...generation of our platform infrastructure, with a focus on... ...Design Platform Services: Using AI-assisted engineering to design... ...engineering, SRE, security, and software teams to support and scale...SeniorFull timeContract workTemporary workRemote workShift work$300 per month
.... As the only vertically integrated AI infrastructure company built from the ground up, we own... ...Crusoe’s Data Center Infrastructure Engineering (DCIE) team is fundamental to our mission... ...a highly skilled and motivated Software Engineer to join Crusoe’s Data Center...SeniorFull timeTemporary work- Zscaler is seeking a Senior Sales Engineer to join our team. This fully remote role based in Germany will present the Zscaler cloud security platform to prospective customers and translate goals into engaging, relevant recommendations, acting as a trusted advisor through...SeniorRemote job
- ...research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people... ...truly understand each other. The Role We're hiring a Senior Software Engineer (Infrastructure) to be a technical driver across teams. You're the flywheel...SeniorFlexible hours
- ...individual questions. We’re exploring how AI can make powerful learning tools more... .... Our work brings together product engineering, design, AI research, and education to... ...around the world. About the Role As a Principal Software Engineer on the ChatGPT Learning team,...Full timeWork at officeRelocation package3 days per week
- ...Were looking for a product-minded Principal Software Engineer to set technical direction build the... ...your focus you may scale generalist infrastructure and identity-related integrations across... ...intersection of backend engineering and applied AI or work on the product experience...Full timeWork at officeRelocation package
$250k - $300k
...only vertically integrated AI infrastructure company built from the ground... ...is building the physical and software backbone that powers the... ...position reporting into Network Engineering, with the mandate to set... ...5+ years as an architect or senior technical lead designing production...SeniorFull timeTemporary workFlexible hours$60 - $70 per hour
Senior Technical Recruiter - AI Infrastructure and Engineering $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Salary Range $60 - $70 Job Description About the Mission We support companies building large-scale AI systems - performance...SeniorRemote work$142.8k - $274.8k
...organization at Microsoft builds the end-to-end AI stack and is core to Azure AI... ...Services, and the global Azure AI infrastructure for running the largest AI workloads... ...multimodal content. We are looking for a Principal Software Engineer - Responsible AI who is passionate...Ongoing contractFull timeWork at officeLocal area- ...world.The role:We are looking for a Principal Software Engineer to own the long-term networking... ....You will lead how we use AI to run networking and infrastructure. We are moving toward an AI-accelerated... ...and talent: Mentor Staff and Senior Staff engineers and emerging...Remote work
$148.5k - $223.9k
...duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with... ...immediate opportunities for senior software developers who want... ...products over public cloud infrastructure - AWS/Azure/GCP. Proven...SeniorFull timeImmediate start$276k - $414k
...other digital services.Snap Engineering teams build fun and... ...forefront.We’re looking for a Principal Software Engineer to join the Ads Platform... ...ads formats and backend infrastructure and solutions to deliver more... ...the entire companyUtilize AI tools and high velocity engineering...Full timeLive inWork at officeLocal area$300 per month
...only vertically integrated AI infrastructure company built from the ground... ...At Crusoe, our Production Engineering team ensures the reliability... ...platform. We’re looking for a Senior Production Engineer with a strong... ...Bring to the Team Strong software engineering background —...SeniorTemporary work$197.3k - $313.7k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...utilitiesMaintain and service our infrastructure using IaC (Terraform) for our AWS accountsAI... ...and debugging live production issues.Software engineering fundamentalsOOP (required):...Full time£55.7k - £83.5k per year
Technical Engineering 5+ years Backend Development The opportunity Unity Spark is our... ...shared, and played on the web. As a Senior Backend Infrastructure Engineer on the Spark team, you will... ...editing. Our team moves fast and uses AI coding tools every day. That shifts...SeniorWork at officeWorldwideRelocation packageShift work- Workleap seeks a Senior AI Developer to join the Product Ops team and shape the AI-powered agent platform. You will own production-ready... ...delivery with cross-functional partners in Product, Engineering, and Data Science. Remote work is supported, with collaboration...SeniorRemote job
- ...enterprise data and AI platform on Databricks. Our Data Engineers, Data Scientists,... ...build on. As a Principal Data Engineer, you... ...platform frameworks and infrastructure that make... ...standards: Mentor senior and staff engineers... ...About You10+ years of software or data platform engineering...Full timeContract workWork at officeLocal areaRemote workRelocationFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior and/or Principal Software Engineer- AI Infrastructure. Be the first to apply!
- principal software engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA




