Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Dev Engineer II, SageMaker Compute Governance

$143.7k - $194.4k

Amazon

Training and running large AI models takes enormous amounts of expensive accelerated compute, and most of it sits idle. Across the industry, a large share of GPU capacity is paid for but never does useful work because jobs cannot find it, cannot share it, or cannot see it and use it efficiently. We build the services that closes that gap.We are looking for a Software Development Engineer to help build the systems that put idle or inefficiently used GPUs to work. You will design and build distributed backend services that let organizations pool capacity across many clusters and accounts, route it to the workloads that need it most, and see exactly how it is being used. This is deep systems work at the intersection of large-scale distributed systems, container orchestration, and cloud infrastructure, and it directly changes how much value customers get from every GPU they pay for.You will own services end to end, from design through launch and operation in production, and your work will ship to some of the largest AI compute customers in the world.Key job responsibilitiesDesign, build, and operate distributed backend services that manage and share accelerated compute across multiple clusters and accounts.Build scheduling and capacity-sharing capabilities that move compute to the highest-priority workloads and reclaim it when priorities change.Build zero-touch usage and guidance systems that collect, aggregate, and report how compute is consumed, at scale and in near real time.Own your services in production: define operational metrics, respond to issues, and continuously improve reliability, latency, and cost.Write clear design documents, participate in design and code reviews, and raise the engineering bar for the team.Collaborate with product, design, and partner engineering teams to turn customer problems into shipped features.Mentor other engineers and contribute to a culture of ownership, quality, and customer focus.A day in the lifeMost days start with a short team stand-up, then it is mostly building. You might design a service that lets one cluster borrow idle capacity from another, then write it up for a design review where the team pokes holes in it before any code is written. Hard problems get their own deep-dive whiteboard session. Other days lean toward operations, chasing down why a workload did not get the capacity it should have. You will not be handed fully specified tasks; you will have the independence to help decide what to build, then build it.About the teamWe help customers get the most out of the accelerated compute they pay for. Our mission is simple to say and hard to do: make sure every accelerator a customer pays for is doing useful work, and make that easy to see and control. Cost reduction is one important part of that, but the bigger idea is the engine that delivers compute to the workloads that need it most, in as little time as possible.Our customers run some of the largest AI training and inference workloads in the world, and they feel the impact of our work directly in how much they can do with their infrastructure. We care about depth, we own our work end to end, and we build in the open where we can.Basic qualifications- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- 1+ years of software development engineer or related occupational experience- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience- 1+ years of Object Oriented Design experience- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field- Experience programming with at least one software programming languagePreferred qualification - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience- Bachelor's degree in computer science or equivalentAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .USA, WA, BELLEVUE - 143,700.00 - 194,400.00 USD annually

Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Software Dev Engineer II, SageMaker Compute Governance in Santa Clara, CA vacancy
  • $165.2k - $223.6k

     ...Description Employer: Amazon Web Services, Inc. Position: Software Dev Engineer II - AMZ26548.2 Location: Cupertino, CA Multiple...  ...Qualifications Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field and one... 
    Suggested
    Local area
    Relocation package

    Amazon

    Cupertino, CA
    4 days ago
  •  ...Employer: Amazon Development Center U.S., Inc. Position: Software Dev Engineer II - AMZ26511.2 Location: Santa Clara, CA Multiple Positions Available: Design, develop, implement, test, and document embedded or distributed software applications, tools... 
    Suggested

    Amazon

    Santa Clara, CA
    2 days ago
  • $165.2k - $223.6k

     ...learning workload in the cloud. With Amazon SageMaker, AWS is building customer-facing services to empower data scientists and software engineers in their deep learning endeavors. As our...  ...drive building our next-generation AI compute platform that’s optimized for LLMs and... 
    Suggested
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Santa Clara, CA
    3 days ago
  • $194k - $349k

     ...operations on the endpoint, and performs rich correlation and computation to identify malicious events and blocks malicious...  ...threats detected in their environments. This is a Sr. Software Development Engineer II (SDE) role in the CTIO team that is bringing multiple... 
    Suggested
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Sunnyvale, CA
    a month ago
  • $165.2k - $223.6k

     ...of us that includes solving highly complex engineering and algorithmic problems. We are looking for passionate and talented Software Development Engineers to join us to...  ...AWS. You’ll have a sound understanding of computer science fundamentals and practical industry... 
    Suggested
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    Santa Clara, CA
    1 day ago
  • $165.2k - $223.6k

    The future of personal computing is being reimagined for agentic AI, and the software that brings it to life has to be fast, reliable, and delightful from the very...  ...of Alexa-powered personal devices, and we need engineers who want to build the systems and experiences that... 
    Internship
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    4 days ago
  • $165.2k - $223.6k

     ...paced innovative company that is developing software that no one has attempted before. If you...  ...The team offers a unique blend of hard computer science problems and an opportunity to...  ...- 1+ years of software development engineer or related occupational experience- 1+ years... 
    Internship
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    2 days ago
  • $190k - $212k

     ...its High Performance Compute (HPC) team to accelerate...  ...Science, Computer Engineering, Electrical Engineering...  ...performance-critical C++ software in production. ~...  ...information. To conform to U.S. Government export regulations...  ...citizen or national, (ii) U.S. lawful,... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    12 hours ago
  • $75k - $120k

     ...architectural updates, and hardware/software integration modules before...  ...Early Career Software Dev QA Engineer (0-2 years of experience) to...  ...Bachelor's or Master's degree in Computer Science, Computer...  ...enterprises, service providers, and government organizations choose... 
    Full time
    Internship
    Worldwide
    Home office

    Fortinet

    Sunnyvale, CA
    3 days ago
  • $182k - $242k

     ...deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a...  ...March 2025. Learn more at . About the Role As a Senior Software Engineer II (IC4) on the AI Workload Orchestration Platform team, you... 
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $21 - $40 per hour

     ...the Fortune 1 as you explore our HQ in Northwest Arkansas! Software Engineer Intern: We're looking for Backend, Front end, and Full...  ...based on job profile and business needs. Desired Majors: Computer Science, Computer Engineering, Information Systems, Software... 
    Hourly pay
    Minimum wage
    Summer work
    Internship
    Summer internship
    Work at office
    Relocation
    Home office

    Walmart

    Sunnyvale, CA
    12 hours ago
  • $232k - $261k

     ...its High Performance Compute (HPC) team to accelerate...  ...them. Mentor other engineers on modern C++, image...  ...years of professional software engineering experience...  ...information. To conform to U.S. Government export regulations...  ...citizen or national, (ii) U.S. lawful,... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    12 hours ago
  •  ...intelligence. Our group of scientists, engineers, and designers is dedicated...  ..., training recipes, governance and trustworthiness, and...  ...pioneering work in generative computing and generative programming for...  ...As an AI Software Engineer Intern, you will engage... 
    Full time
    Contract work
    Part time
    Fixed term contract
    Internship
    Shift work

    IBM

    San Jose, CA
    4 days ago
  • $110k

    Fortune 500 clients and government agencies trust eGain AI knowledge...  ...and maintain AI-powered software tools, services, and applications...  ...’s degree in Computer Science or a related field from...  ...the position title “Software Engineer, II” in the email subject.CompensationThe... 
    Work at office

    eGain Communications

    Sunnyvale, CA
    4 days ago
  • $135.7k - $181k

     .... We are seeking exceptional engineers to join our team and help us...  ...the Talent Management product dev team, you will build features...  ...looking for FrontEnd or FullStack Software Engineers to help us design,...  ...understanding of fundamental computer science algorithms and... 
    Work at office
    Remote work
    Flexible hours

    Eightfold

    Santa Clara, CA
    1 day ago
  • $165.2k - $223.6k

     ...builds the AWS Neuron SDK, the software development kit used to...  ...hardware-software boundary, our engineers build systematic infrastructure...  ...ML functions, ensuring every compute unit is fine-tuned for optimal...  ...technology.As a Software Engineer II - AI/ML, you will design and implement... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $193.3k - $261.5k

     ...solving real world data management and governance challenges. Come build large scale...  ...less architecture. We are looking for software engineers to join our growing team!As a Software...  ...adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s... 
    Internship
    Local area
    Flexible hours
    Night shift
    Day shift

    Amazon

    Palo Alto, CA
    4 days ago
  • $81.5k - $141.3k

     ...JOB DESCRIPTION:We are seeking an experienced, high caliber Software Engineer II. Performs moderate risk/moderate complexity specialized level...  ...:Bachelor’s degree in relevant engineering discipline, computer science, related engineering fieldMinimum 2 years of experience... 
    Shift work

    Abbott

    Sunnyvale, CA
    2 days ago
  • $194k - $349k

     ...operations on the endpoint, and performs rich correlation and computation to identify malicious events and blocks malicious...  ...threats detected in their environments. This is a Senior Software Development Engineer (SDE) role in the CTIO team that delivers the cutting edge... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Sunnyvale, CA
    a month ago
  • $135k - $160k

     ...of enabling human life on Mars. SOFTWARE ENGINEER, LOW LATENCY COMPUTING (STARLINK) At SpaceX we're leveraging...  ....00 - $160,000.00/per year Level II: $155,000.00 - $185,000.00/per year...  ...Employer; employment with SpaceX is governed on the basis of merit, competence... 
    Temporary work
    Internship
    Worldwide
    Weekend work

    SpaceX

    Palo Alto, CA
    2 days ago
  • $142k - $177.5k

     ...Infrastructure team builds the software that helps engineers understand and improve...  ...metric definitions, computing results and retrieving them...  ...with our recruiting system; (ii) carrying out, analyzing and...  ..., regulatory and corporate governance obligations; (v) recordkeeping... 
    Full time
    Contract work
    Local area

    Rivian

    Palo Alto, CA
    2 days ago
  • $140k - $160k

     ...Software Engineer II On AndroidRecs Experience turns Tinder's recommendation systems into flexible, reliable, and easy-to-use product capabilities...  ...code and protecting sensitive information.A BS or MS in Computer Science, Engineering, or a related discipline is welcome but... 
    Full time
    Work experience placement
    Work at office
    Worldwide
    Flexible hours

    Match Group

    Palo Alto, CA
    5 days ago
  • $240k - $267k

     ...the High Performance Compute (HPC) team, to define...  ...center of gravity for software architecture, computation...  ...leads in Electrical Engineering and Product to drive the...  .... To conform to U.S. Government export regulations applicable...  ...citizen or national, (ii) U.S. lawful,... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    1 day ago
  • $165.2k - $223.6k

    Want to work on next generation software services that build AWS Network? And design, build...  ...facing routers. In this software dev engineer position, you will be designing, building...  ...Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a... 
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    Santa Clara, CA
    12 hours ago
  • $160k - $260k

     ...CrowdStrike is seeking a Senior Engineer II for our Policy Management...  ...for the cloud-side software and user interfaces that provide...  ...the company.CrowdStrike is a computer security company, but we do...  ...fingerprint check(s) consistent with government customer requirements.... 
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week

    CrowdStrike

    Sunnyvale, CA
    1 day ago
  • $112k - $137k

    Job-ID: 20693Category: Software-Dev QALocation: Sunnyvale, CA, United StatesSchedule: Full...  ...Technology: You will be the very first engineer to power on, validate, and stress-test...  ...Requirement: Bachelor’s or master’s degree in computer science/Engineering, or equivalent Must... 
    Full time

    Fortinet

    Sunnyvale, CA
    4 days ago
  • $193.3k - $261.5k

     ...help. You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security...  ...results-oriented, Senior Software Dev Engineer.What do we do here? Amazon...  ...systems experience- Master's degree in computer science or equivalent- Experience... 
    Internship
    Local area
    Flexible hours

    Amazon

    Santa Clara, CA
    12 hours ago
  • Introduction At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products...  ...world. Your Role and Responsibilities As a Senior Software Engineer II on the Fleet Management Unified Deployment team, you will play... 
    Full time
    Temporary work
    Part time

    IBM

    San Jose, CA
    2 hours ago
  • $210k - $257k

     ...Title : Staff DevOps Engineer Location : Mountain...  ...AI security and governance platform enterprises trust...  ...clusters, multi-tenant compute, autoscaling, and cluster...  .... Partner with dev teams from...  ...serving experience (vLLM, SageMaker). Open source development... 
    Work at office
    2 days per week

    WitnessAI

    Mountain View, CA
    5 days ago
  • $171k

     ...and capital efficiency no one else can match.We are seeking a Software Engineer II to build the data infrastructure for AV Labs: the systems...  ...and telemetry data.Run large batch workloads on distributed compute, and improve their throughput, cost, and failure behavior.Own... 
    Full time
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Dev Engineer II, SageMaker Compute Governance. Be the first to apply!