Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer II, Backend (ML Training & Serving) [Remote]

$133k - $183k
Full-time

jobgether

United States
  • Remote job

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineer II, Backend (ML Training & Serving) based in the United States.

This role focuses on building and scaling the backend infrastructure that powers machine learning training and serving platforms.
You will work at the intersection of distributed systems, ML infrastructure, and platform engineering to enable reliable model development and deployment.
The position offers the opportunity to design durable systems that improve engineering velocity and support critical business decisions.
You will collaborate with engineers across teams, contribute to technical solutions, and help shape shared platforms used at scale.
The ideal candidate is passionate about backend engineering, system reliability, and creating tools that empower other developers.
This is an environment that values ownership, thoughtful execution, continuous learning, and strong cross-functional collaboration

Accountabilities:

The Software Engineer II, Backend (ML Training & Serving) will contribute to the design, development, and operation of core machine learning infrastructure while partnering with engineering teams to deliver scalable solutions. Key responsibilities include:

  • Building, improving, and maintaining backend systems that support machine learning model training and serving workflows.
  • Breaking down complex technical projects into actionable milestones, delivering high-quality solutions through iterative development.
  • Designing and implementing reliable software components while considering scalability, performance, operational needs, and long-term maintainability.
  • Collaborating with engineers and stakeholders across teams to evaluate technical trade-offs, communicate constraints, and support effective decision-making.
  • Monitoring system health through metrics, improving reliability, and contributing to operational excellence, including support for production systems and on-call responsibilities.
  • Reviewing code, debugging issues, sharing technical knowledge, and contributing to a culture of engineering excellence.
  • Participating in team development initiatives, including mentoring, interviews, and activities that strengthen the engineering community.

Requirements:

The ideal candidate combines strong backend engineering skills with experience building reliable software systems and collaborating in a fast-paced technical environment. Required qualifications include:

  • 1.5+ years of professional experience as a software engineer.
  • Experience designing, developing, and launching backend systems using Python or Kotlin.
  • Familiarity with distributed systems concepts and technologies such as AWS, MySQL, and Kubernetes.
  • Ability to translate business or technical problems into scalable software solutions involving multiple components.
  • Strong programming skills with a focus on writing clear, tested, maintainable, and extensible code.
  • Comfort navigating large codebases, debugging existing systems, and providing constructive feedback through code reviews.
  • A proactive approach to professional growth, including seeking feedback and continuously improving technical skills.
  • Strong written and verbal communication skills, with the ability to collaborate effectively with global engineering teams.

Benefits:

The role offers a competitive compensation package and a range of benefits designed to support employees’ professional growth, well-being, and flexibility.

  • Competitive base salary range of $133,000 - $183,000 CAD per year depending on location, experience, and job-related skills.
  • Equity opportunities as part of the overall compensation package.
  • Remote-first work environment with flexibility to work from approved locations within the country of employment.
  • Health, dental, and vision coverage with premiums fully covered for employees and eligible dependents.
  • Flexible spending allowances for technology, food, lifestyle needs, and family-related expenses.
  • Wellness days and competitive vacation and holiday schedules to support rest and recharge.
  • Learning and development programs to support career growth.
  • Parental benefits and employee resource/community groups.
  • Employee stock purchase plan opportunities.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Software Engineer II, Backend (ML Training & Serving) [Remote] in United States vacancy
  •  ...What you'll do As a Software Engineer on the Credit Limit Engineering team,...  ...banks to pull real-time data, ML‑powered credit models that assess...  ...of financial transactions, serving ML models with strict latency...  ...experience with a focus on backend development. 1+ year of experience... 
    Suggested
    Full time
    Work at office
    Remote work
    Work from home
    3 days per week

    EngineersOfAI

    Seattle, WA
    3 days ago
  •  ..., bill pay, and travel software, Brex enables founders...  ...need to grow your career. Engineering at Brex Engineering at...  ...pull real‑time data, ML‑powered credit models that...  ...transactions, serving ML models with strict latency...  ...experience with a focus on backend development. 1+ year of... 
    Suggested
    Full time
    Work at office
    Remote work
    Work from home
    3 days per week

    EngineersOfAI

    New York, NY
    3 days ago
  • $123k - $175k

    Software Engineer II, Early Career, Google Cloud AI Career Catalyst Program Early...  ...). Experience within AI/ML and Infrastructure technical...  ...infrastructure, this team serves as the architectural foundation...  ..., and relevant education or training. US: $123000 - $175000 (USD... 
    Training
    Full time
    Internship
    Work at office

    Google

    Sunnyvale, CA
    4 days ago
  • $171k

     .... As a Machine Learning Engineer on this team, you will focus...  .... You will leverage our ML platform to build models that serve critical use cases across...  ...closely with Product, Backend Engineering, and Platform...  ...ability to develop complex software systems scaling to... 
    Suggested
    Full time
    Work at office
    Remote work

    Uber

    San Francisco, CA
    1 day ago
  • Affirm is hiring a Software Engineer II to join the ML Training & Serving engineering team. You will help build and operate infrastructure enabling model training and serving across the company. The role sits at the intersection of distributed systems, ML infrastructure... 
    Training
    Remote job

    Affirm

    Miami, FL
    1 day ago
  • Affirm is seeking a Software Engineer II to join the ML Training & Serving engineering team, building critical infrastructure for training and serving models across the company. You'll work at the intersection of distributed systems, ML infrastructure, and platform engineering... 
    Training
    Remote job

    Affirm

    Palo Alto, CA
    1 day ago
  • $153k - $207k

     ...packaging and advertising to ML-powered personalization. As a Senior iOS Engineer on the Ads team, you'll...  ...bottom line. The team owns ad serving, mediation and demand, in-...  ...will... Collaborate on software projects with product design and backend aspects Develop, release,... 
    Full time
    Work experience placement

    Duolingo

    New York, NY
    2 days ago
  • $160k - $250k

    About The Role CrowdStrike is looking for a Senior Cloud Engineer II to join our growing Sensor Foundations team. The cloud side of the Sensor...  ...to have prior security industry experience. We will mentor and train in security topics as needed. We do expect a strong interest in... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    2 days per week

    CrowdStrike

    Sunnyvale, CA
    4 days ago
  • $106k - $169k

     ...potential. Title and Summary Software Engineer II - Backend/Platform Agentic AI Who...  ...experience in applied AI/ML (LLM integration, RAG...  ..., agentic workflows, model serving, or inference services) •...  ...periodic mandatory security trainings in accordance with Mastercard... 
    Full time
    Part time
    Worldwide
    Flexible hours

    Mastercard

    Arlington, VA
    a month ago
  • $185.4k - $232.05k

     ...in 2024. Product & Software Excellence: We were...  ...a Senior Software Engineer, Applied AI to own...  ...work cross‑team with backend and platform engineers, with the ML/LLM Ops platform...  ...against the ML/LLM Ops serving platform and the...  ...product, not model training. Real‑World / Real... 
    Training
    Full time
    Work at office
    Flexible hours

    LVT Corp

    Seattle, WA
    4 days ago
  • $125k - $175k

     ...for a talented and passionate Software Engineer II to join our MLOps team,...  ...development and optimization of ML cloud infrastructure. In...  ...ML lifecycle including model training and evaluation as well as monitoring...  ..., and benefits, with equity serving as a key differentiator that... 
    Training
    Full time
    Work at office
    Relocation

    Whoop

    Boston, MA
    6 days ago
  •  ...for you to take your software engineering career to the next level...  ...a Software Engineer II at JPMorgan Chase within...  ...Investment Bank, you serve as a seasoned member of...  ...Caregivers. Formal training or certification on software...  ...Familiarity with backend JavaScript frameworks... 
    Training

    VetJobs

    Tampa, FL
    4 days ago
  • $120.4k - $198.7k

     ...role; the skills, education, training, credentials and experience...  ...across the enterprise. As a Software Engineer II for the Enterprise AI...  ...junior engineers on the team, serving as an informal technical lead...  ...environments. Familiarity with ML observability and drift... 
    Training
    Work experience placement
    Local area

    Travelers

    Saint Paul, MN
    14 days ago
  •  ...application and custom software development portfolio....  ...assets. The Senior Software Engineer II drives the engineering...  ...React and Typescript, backend development using C#,...  ...ingestion Time‑series ML pipelines, forecasting...  ...cross‑team initiatives and serve as a liaison between... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Immediate start
    Work visa
    Flexible hours

    RWE

    Austin, TX
    3 days ago
  • $119k - $221k

     ...carriers and the customers they serve. We build AI-powered software that keeps everyone in the...  ...for a Sr. Software Engineer II (DevOps) to help us build...  ...efficiency Build and maintain AI/ML infrastructure and...  ...enables reporting, BI, and AI training workflows Implement... 
    Training
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Hi Marley

    Boston, MA
    4 days ago
  • $125k - $175k

     ...insights into users’ fitness, health, and recovery. As a Software Engineer II (Backend) in the Healthcare group, you will help build and...  ...skills, experience, performance, and relevant education or training. In addition to the base salary, the successful candidate... 
    Training
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    4 days ago
  • $147k - $211k

     ...years of experience with software development in one or...  ..., and software test engineering. About the Job Google...  ...and accessible. As a backend engineer, you will work...  ...(search, storage, serving) and machine intelligence...  ...relevant education or training. US: $147000 - $21100... 
    Training

    Google

    Mountain View, CA
    2 days ago
  •  ...surrounded by talented engineers and tech leaders from...  ...Role As a Senior Software Engineer, Backend specializing in...  ...of scalable APIs to serve robot control systems...  ...retrieval systems for training datasets and inference...  ...Collaborate with ML engineers to optimize... 
    Training
    Work at office

    Chef Robotics

    San Francisco, CA
    more than 2 months ago
  • $143k - $286k

    Position Summary... As a Staff Software Engineer, you’ll be a technical leader who...  ...direction for and evolves the backend microservices, data pipelines, and ML-serving infrastructure that power...  ...the full model lifecycle from training through production serving. Hands... 
    Training
    Full time
    Temporary work
    Part time
    Work at office
    Flexible hours

    Walmart

    Sunnyvale, CA
    4 days ago
  • $117.5k - $157.5k

     ...global organization of engineers, product developers,...  .... Job Summary As a Software Engineer II, you will design and...  ...experience. 3+ years of backend development...  ...Practical experience in AI/ML engineering, with knowledge...  ...ML: developing, training, or fine‑tuning models... 
    Training
    Worldwide

    Disney Media & Entertainment Distribution

    Glendale, CA
    1 day ago
  • $125k - $175k

     ...daily lives. WHOOP is hiring a Software Engineer II to join the Business Systems...  ...design and implement the backend systems that power WHOOP’s...  ..., and benefits, with equity serving as a key differentiator that...  ..., and relevant education or training. In addition to the base salary... 
    Training
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    1 day ago
  • $182k - $242k

     ...job orchestration. They came to train models. Instead, they’re doing...  ...work in a tight loop with the backend team, enabling RL training runs...  ...building distributed systems, ML infrastructure, or developer platforms...  ...(i) U.S. citizen or national, (ii) U.S. lawful permanent resident... 
    Training
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Seattle, WA
    3 days ago
  •  ...deep expertise spanning hardware and software. Join us in shaping a future where...  ...secure, maintainable, self-serve core infrastructure that engineering teams can rely on and operate independently...  ...and evolution of a modern ML training infrastructure — scalable, reproducible... 
    Training
    Full time
    Contract work
    Flexible hours

    Sesame

    San Francisco, CA
    4 days ago
  • $130k - $175k

     ...Senior Ground Software Engineer I/II As a Senior Ground Software Engineer I/II...  ...in Long Beach, CA, you will serve as a technical authority for...  ...to Have Active TS clearance. Backend – Python, Golang, and/or Rust...  ...leaves of absence, compensation, and training. #J-18808-Ljbffr... 
    Training
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Rocket Lab

    Long Beach, CA
    4 days ago
  • $125k

     ...employee. For us, it also serves as a practical...  ...As part of the Growth Engineering organization, our work...  ...a talented Frontend Software Engineer II to join our Signup &...  ...you'll work alongside backend engineers to build complete...  ...education or training; and other business and... 
    Training
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours

    Scribd

    Phoenix, AZ
    3 days ago
  •  ...The IT Solutions Engineer / Analyst II works alongside AI...  ...the supporting software and integration layers...  ...and supporting backend and front‑end...  ...effectively with AI/ML engineers and...  ...be called upon to serve as a member of the...  ...employment, and training for all positions... 
    Training
    Permanent employment
    Local area
    Work from home
    Home office

    Arizona Public Service Company

    Phoenix, AZ
    1 day ago
  • $85k - $130k

    The Role As a Senior Software Engineer II on the Data Products team, you will act as a...  ...allow bioinformatics scientists, ML and Agent developers to rapidly develop...  ..., and test complex production backend web services in TypeScript, serving as a standard‑bearer for code... 

    Tempus AI

    Chicago, IL
    4 days ago
  • $100.6k - $199k

    Software Engineer II - Microsoft Teams Microsoft Teams is revolutionizing how the world collaborates,...  ...solutions that leverage data science and AI/ML models, while contributing to mobile...  ...science workflows and mobile integration. Serve as a Designated Responsible Individual (... 
    Local area

    Microsoft

    Mountain View, CA
    4 days ago
  • $145k - $207k

    Role Description As a Software Engineer on the Marketplace team, you’ll work...  ...and maintaining the backend which powers search ~Supporting ML pipelines and model serving infrastructure ~Collaborating...  ...and relevant education and training, to determine compensation that... 
    Training
    Full time

    Apartment List

    Remote
    1 day ago
  • $165k - $242k

    What You’ll Do: Senior engineers are area owners who lead designs, raise engineering standards...  ...(vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe). Experience with CUDA kernels...  ...defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer II, Backend (ML Training & Serving) [Remote]. Be the first to apply!