Software Dev Engineer II, SageMaker Compute Governance
$143.7k - $194.4kAmazon
Training and running large AI models takes enormous amounts of expensive accelerated compute, and most of it sits idle. Across the industry, a large share of GPU capacity is paid for but never does useful work because jobs cannot find it, cannot share it, or cannot see it and use it efficiently. We build the services that closes that gap.We are looking for a Software Development Engineer to help build the systems that put idle or inefficiently used GPUs to work. You will design and build distributed backend services that let organizations pool capacity across many clusters and accounts, route it to the workloads that need it most, and see exactly how it is being used. This is deep systems work at the intersection of large-scale distributed systems, container orchestration, and cloud infrastructure, and it directly changes how much value customers get from every GPU they pay for.You will own services end to end, from design through launch and operation in production, and your work will ship to some of the largest AI compute customers in the world.Key job responsibilitiesDesign, build, and operate distributed backend services that manage and share accelerated compute across multiple clusters and accounts.Build scheduling and capacity-sharing capabilities that move compute to the highest-priority workloads and reclaim it when priorities change.Build zero-touch usage and guidance systems that collect, aggregate, and report how compute is consumed, at scale and in near real time.Own your services in production: define operational metrics, respond to issues, and continuously improve reliability, latency, and cost.Write clear design documents, participate in design and code reviews, and raise the engineering bar for the team.Collaborate with product, design, and partner engineering teams to turn customer problems into shipped features.Mentor other engineers and contribute to a culture of ownership, quality, and customer focus.A day in the lifeMost days start with a short team stand-up, then it is mostly building. You might design a service that lets one cluster borrow idle capacity from another, then write it up for a design review where the team pokes holes in it before any code is written. Hard problems get their own deep-dive whiteboard session. Other days lean toward operations, chasing down why a workload did not get the capacity it should have. You will not be handed fully specified tasks; you will have the independence to help decide what to build, then build it.About the teamWe help customers get the most out of the accelerated compute they pay for. Our mission is simple to say and hard to do: make sure every accelerator a customer pays for is doing useful work, and make that easy to see and control. Cost reduction is one important part of that, but the bigger idea is the engine that delivers compute to the workloads that need it most, in as little time as possible.Our customers run some of the largest AI training and inference workloads in the world, and they feel the impact of our work directly in how much they can do with their infrastructure. We care about depth, we own our work end to end, and we build in the open where we can.Basic qualifications- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- 1+ years of software development engineer or related occupational experience- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience- 1+ years of Object Oriented Design experience- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field- Experience programming with at least one software programming languagePreferred qualification - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience- Bachelor's degree in computer science or equivalentAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .USA, WA, BELLEVUE - 143,700.00 - 194,400.00 USD annually
$165.2k - $223.6k
...Description Employer: Amazon Web Services, Inc. Position: Software Dev Engineer II - AMZ26548.2 Location: Cupertino, CA Multiple... ...Qualifications Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field and one...SuggestedLocal areaRelocation package- ...Employer: Amazon Development Center U.S., Inc. Position: Software Dev Engineer II - AMZ26511.2 Location: Santa Clara, CA Multiple Positions Available: Design, develop, implement, test, and document embedded or distributed software applications, tools...Suggested
$165.2k - $223.6k
...learning workload in the cloud. With Amazon SageMaker, AWS is building customer-facing services to empower data scientists and software engineers in their deep learning endeavors. As our... ...drive building our next-generation AI compute platform that’s optimized for LLMs and...SuggestedInternshipLocal areaWork from homeFlexible hours$194k - $349k
...operations on the endpoint, and performs rich correlation and computation to identify malicious events and blocks malicious... ...threats detected in their environments. This is a Sr. Software Development Engineer II (SDE) role in the CTIO team that is bringing multiple...SuggestedPermanent employmentWork experience placementWork at officeLocal areaRemote work$165.2k - $223.6k
...of us that includes solving highly complex engineering and algorithmic problems. We are looking for passionate and talented Software Development Engineers to join us to... ...AWS. You’ll have a sound understanding of computer science fundamentals and practical industry...SuggestedInternshipLocal areaWorldwideFlexible hours$165.2k - $223.6k
The future of personal computing is being reimagined for agentic AI, and the software that brings it to life has to be fast, reliable, and delightful from the very... ...of Alexa-powered personal devices, and we need engineers who want to build the systems and experiences that...InternshipLocal areaFlexible hours$165.2k - $223.6k
...paced innovative company that is developing software that no one has attempted before. If you... ...The team offers a unique blend of hard computer science problems and an opportunity to... ...- 1+ years of software development engineer or related occupational experience- 1+ years...InternshipLocal areaFlexible hours$190k - $212k
...its High Performance Compute (HPC) team to accelerate... ...Science, Computer Engineering, Electrical Engineering... ...performance-critical C++ software in production. ~... ...information. To conform to U.S. Government export regulations... ...citizen or national, (ii) U.S. lawful,...Permanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week$75k - $120k
...architectural updates, and hardware/software integration modules before... ...Early Career Software Dev QA Engineer (0-2 years of experience) to... ...Bachelor's or Master's degree in Computer Science, Computer... ...enterprises, service providers, and government organizations choose...Full timeInternshipWorldwideHome office$182k - $242k
...deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a... ...March 2025. Learn more at . About the Role As a Senior Software Engineer II (IC4) on the AI Workload Orchestration Platform team, you...Full timeTemporary workCasual workWork at officeFlexible hours$21 - $40 per hour
...the Fortune 1 as you explore our HQ in Northwest Arkansas! Software Engineer Intern: We're looking for Backend, Front end, and Full... ...based on job profile and business needs. Desired Majors: Computer Science, Computer Engineering, Information Systems, Software...Hourly payMinimum wageSummer workInternshipSummer internshipWork at officeRelocationHome office$232k - $261k
...its High Performance Compute (HPC) team to accelerate... ...them. Mentor other engineers on modern C++, image... ...years of professional software engineering experience... ...information. To conform to U.S. Government export regulations... ...citizen or national, (ii) U.S. lawful,...Permanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week- ...intelligence. Our group of scientists, engineers, and designers is dedicated... ..., training recipes, governance and trustworthiness, and... ...pioneering work in generative computing and generative programming for... ...As an AI Software Engineer Intern, you will engage...Full timeContract workPart timeFixed term contractInternshipShift work
$110k
Fortune 500 clients and government agencies trust eGain AI knowledge... ...and maintain AI-powered software tools, services, and applications... ...’s degree in Computer Science or a related field from... ...the position title “Software Engineer, II” in the email subject.CompensationThe...Work at office$135.7k - $181k
.... We are seeking exceptional engineers to join our team and help us... ...the Talent Management product dev team, you will build features... ...looking for FrontEnd or FullStack Software Engineers to help us design,... ...understanding of fundamental computer science algorithms and...Work at officeRemote workFlexible hours$165.2k - $223.6k
...builds the AWS Neuron SDK, the software development kit used to... ...hardware-software boundary, our engineers build systematic infrastructure... ...ML functions, ensuring every compute unit is fine-tuned for optimal... ...technology.As a Software Engineer II - AI/ML, you will design and implement...InternshipLocal areaFlexible hours$193.3k - $261.5k
...solving real world data management and governance challenges. Come build large scale... ...less architecture. We are looking for software engineers to join our growing team!As a Software... ...adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s...InternshipLocal areaFlexible hoursNight shiftDay shift$81.5k - $141.3k
...JOB DESCRIPTION:We are seeking an experienced, high caliber Software Engineer II. Performs moderate risk/moderate complexity specialized level... ...:Bachelor’s degree in relevant engineering discipline, computer science, related engineering fieldMinimum 2 years of experience...Shift work$194k - $349k
...operations on the endpoint, and performs rich correlation and computation to identify malicious events and blocks malicious... ...threats detected in their environments. This is a Senior Software Development Engineer (SDE) role in the CTIO team that delivers the cutting edge...Permanent employmentWork experience placementWork at officeLocal areaRemote work$135k - $160k
...of enabling human life on Mars. SOFTWARE ENGINEER, LOW LATENCY COMPUTING (STARLINK) At SpaceX we're leveraging... ....00 - $160,000.00/per year Level II: $155,000.00 - $185,000.00/per year... ...Employer; employment with SpaceX is governed on the basis of merit, competence...Temporary workInternshipWorldwideWeekend work$142k - $177.5k
...Infrastructure team builds the software that helps engineers understand and improve... ...metric definitions, computing results and retrieving them... ...with our recruiting system; (ii) carrying out, analyzing and... ..., regulatory and corporate governance obligations; (v) recordkeeping...Full timeContract workLocal area$140k - $160k
...Software Engineer II On AndroidRecs Experience turns Tinder's recommendation systems into flexible, reliable, and easy-to-use product capabilities... ...code and protecting sensitive information.A BS or MS in Computer Science, Engineering, or a related discipline is welcome but...Full timeWork experience placementWork at officeWorldwideFlexible hours$240k - $267k
...the High Performance Compute (HPC) team, to define... ...center of gravity for software architecture, computation... ...leads in Electrical Engineering and Product to drive the... .... To conform to U.S. Government export regulations applicable... ...citizen or national, (ii) U.S. lawful,...Permanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week$165.2k - $223.6k
Want to work on next generation software services that build AWS Network? And design, build... ...facing routers. In this software dev engineer position, you will be designing, building... ...Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a...InternshipLocal areaWorldwideFlexible hours$160k - $260k
...CrowdStrike is seeking a Senior Engineer II for our Policy Management... ...for the cloud-side software and user interfaces that provide... ...the company.CrowdStrike is a computer security company, but we do... ...fingerprint check(s) consistent with government customer requirements....Permanent employmentFull timeWork experience placementWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week$112k - $137k
Job-ID: 20693Category: Software-Dev QALocation: Sunnyvale, CA, United StatesSchedule: Full... ...Technology: You will be the very first engineer to power on, validate, and stress-test... ...Requirement: Bachelor’s or master’s degree in computer science/Engineering, or equivalent Must...Full time$193.3k - $261.5k
...help. You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security... ...results-oriented, Senior Software Dev Engineer.What do we do here? Amazon... ...systems experience- Master's degree in computer science or equivalent- Experience...InternshipLocal areaFlexible hours- Introduction At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products... ...world. Your Role and Responsibilities As a Senior Software Engineer II on the Fleet Management Unified Deployment team, you will play...Full timeTemporary workPart time
$210k - $257k
...Title : Staff DevOps Engineer Location : Mountain... ...AI security and governance platform enterprises trust... ...clusters, multi-tenant compute, autoscaling, and cluster... .... Partner with dev teams from... ...serving experience (vLLM, SageMaker). Open source development...Work at office2 days per week$171k
...and capital efficiency no one else can match.We are seeking a Software Engineer II to build the data infrastructure for AV Labs: the systems... ...and telemetry data.Run large batch workloads on distributed compute, and improve their throughput, cost, and failure behavior.Own...Full timeWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Dev Engineer II, SageMaker Compute Governance. Be the first to apply!
- software engineer internship remote Santa Clara, CA
- software engineer remote Santa Clara, CA
- graduate software developer no experience Santa Clara, CA
- work from home software developer Santa Clara, CA
- information technology software engineer Santa Clara, CA
- senior software engineer remote Santa Clara, CA
- rust software engineer Santa Clara, CA
- junior software developer remote Santa Clara, CA
- software engineer travel Santa Clara, CA
- startup software engineer Santa Clara, CA





