Software Engineer II, Backend (ML Training & Serving) [Remote]
$133k - $183kjobgether
- Remote job
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineer II, Backend (ML Training & Serving) based in the United States.
This role focuses on building and scaling the backend infrastructure that powers machine learning training and serving platforms.
You will work at the intersection of distributed systems, ML infrastructure, and platform engineering to enable reliable model development and deployment.
The position offers the opportunity to design durable systems that improve engineering velocity and support critical business decisions.
You will collaborate with engineers across teams, contribute to technical solutions, and help shape shared platforms used at scale.
The ideal candidate is passionate about backend engineering, system reliability, and creating tools that empower other developers.
This is an environment that values ownership, thoughtful execution, continuous learning, and strong cross-functional collaboration
Accountabilities:
The Software Engineer II, Backend (ML Training & Serving) will contribute to the design, development, and operation of core machine learning infrastructure while partnering with engineering teams to deliver scalable solutions. Key responsibilities include:
- Building, improving, and maintaining backend systems that support machine learning model training and serving workflows.
- Breaking down complex technical projects into actionable milestones, delivering high-quality solutions through iterative development.
- Designing and implementing reliable software components while considering scalability, performance, operational needs, and long-term maintainability.
- Collaborating with engineers and stakeholders across teams to evaluate technical trade-offs, communicate constraints, and support effective decision-making.
- Monitoring system health through metrics, improving reliability, and contributing to operational excellence, including support for production systems and on-call responsibilities.
- Reviewing code, debugging issues, sharing technical knowledge, and contributing to a culture of engineering excellence.
- Participating in team development initiatives, including mentoring, interviews, and activities that strengthen the engineering community.
Requirements:
The ideal candidate combines strong backend engineering skills with experience building reliable software systems and collaborating in a fast-paced technical environment. Required qualifications include:
- 1.5+ years of professional experience as a software engineer.
- Experience designing, developing, and launching backend systems using Python or Kotlin.
- Familiarity with distributed systems concepts and technologies such as AWS, MySQL, and Kubernetes.
- Ability to translate business or technical problems into scalable software solutions involving multiple components.
- Strong programming skills with a focus on writing clear, tested, maintainable, and extensible code.
- Comfort navigating large codebases, debugging existing systems, and providing constructive feedback through code reviews.
- A proactive approach to professional growth, including seeking feedback and continuously improving technical skills.
- Strong written and verbal communication skills, with the ability to collaborate effectively with global engineering teams.
Benefits:
The role offers a competitive compensation package and a range of benefits designed to support employees’ professional growth, well-being, and flexibility.
- Competitive base salary range of $133,000 - $183,000 CAD per year depending on location, experience, and job-related skills.
- Equity opportunities as part of the overall compensation package.
- Remote-first work environment with flexibility to work from approved locations within the country of employment.
- Health, dental, and vision coverage with premiums fully covered for employees and eligible dependents.
- Flexible spending allowances for technology, food, lifestyle needs, and family-related expenses.
- Wellness days and competitive vacation and holiday schedules to support rest and recharge.
- Learning and development programs to support career growth.
- Parental benefits and employee resource/community groups.
- Employee stock purchase plan opportunities.
How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
- ...What you'll do As a Software Engineer on the Credit Limit Engineering team,... ...banks to pull real-time data, ML‑powered credit models that assess... ...of financial transactions, serving ML models with strict latency... ...experience with a focus on backend development. 1+ year of experience...SuggestedFull timeWork at officeRemote workWork from home3 days per week
- ..., bill pay, and travel software, Brex enables founders... ...need to grow your career. Engineering at Brex Engineering at... ...pull real‑time data, ML‑powered credit models that... ...transactions, serving ML models with strict latency... ...experience with a focus on backend development. 1+ year of...SuggestedFull timeWork at officeRemote workWork from home3 days per week
$123k - $175k
Software Engineer II, Early Career, Google Cloud AI Career Catalyst Program Early... ...). Experience within AI/ML and Infrastructure technical... ...infrastructure, this team serves as the architectural foundation... ..., and relevant education or training. US: $123000 - $175000 (USD...TrainingFull timeInternshipWork at office$171k
.... As a Machine Learning Engineer on this team, you will focus... .... You will leverage our ML platform to build models that serve critical use cases across... ...closely with Product, Backend Engineering, and Platform... ...ability to develop complex software systems scaling to...SuggestedFull timeWork at officeRemote work- Affirm is hiring a Software Engineer II to join the ML Training & Serving engineering team. You will help build and operate infrastructure enabling model training and serving across the company. The role sits at the intersection of distributed systems, ML infrastructure...TrainingRemote job
- Affirm is seeking a Software Engineer II to join the ML Training & Serving engineering team, building critical infrastructure for training and serving models across the company. You'll work at the intersection of distributed systems, ML infrastructure, and platform engineering...TrainingRemote job
$153k - $207k
...packaging and advertising to ML-powered personalization. As a Senior iOS Engineer on the Ads team, you'll... ...bottom line. The team owns ad serving, mediation and demand, in-... ...will... Collaborate on software projects with product design and backend aspects Develop, release,...Full timeWork experience placement$160k - $250k
About The Role CrowdStrike is looking for a Senior Cloud Engineer II to join our growing Sensor Foundations team. The cloud side of the Sensor... ...to have prior security industry experience. We will mentor and train in security topics as needed. We do expect a strong interest in...TrainingPermanent employmentWork experience placementWork at officeLocal area2 days per week$106k - $169k
...potential. Title and Summary Software Engineer II - Backend/Platform Agentic AI Who... ...experience in applied AI/ML (LLM integration, RAG... ..., agentic workflows, model serving, or inference services) •... ...periodic mandatory security trainings in accordance with Mastercard...Full timePart timeWorldwideFlexible hours$185.4k - $232.05k
...in 2024. Product & Software Excellence: We were... ...a Senior Software Engineer, Applied AI to own... ...work cross‑team with backend and platform engineers, with the ML/LLM Ops platform... ...against the ML/LLM Ops serving platform and the... ...product, not model training. Real‑World / Real...TrainingFull timeWork at officeFlexible hours$125k - $175k
...for a talented and passionate Software Engineer II to join our MLOps team,... ...development and optimization of ML cloud infrastructure. In... ...ML lifecycle including model training and evaluation as well as monitoring... ..., and benefits, with equity serving as a key differentiator that...TrainingFull timeWork at officeRelocation- ...for you to take your software engineering career to the next level... ...a Software Engineer II at JPMorgan Chase within... ...Investment Bank, you serve as a seasoned member of... ...Caregivers. Formal training or certification on software... ...Familiarity with backend JavaScript frameworks...Training
$120.4k - $198.7k
...role; the skills, education, training, credentials and experience... ...across the enterprise. As a Software Engineer II for the Enterprise AI... ...junior engineers on the team, serving as an informal technical lead... ...environments. Familiarity with ML observability and drift...TrainingWork experience placementLocal area- ...application and custom software development portfolio.... ...assets. The Senior Software Engineer II drives the engineering... ...React and Typescript, backend development using C#,... ...ingestion Time‑series ML pipelines, forecasting... ...cross‑team initiatives and serve as a liaison between...Permanent employmentFull timeTemporary workWork at officeImmediate startWork visaFlexible hours
$119k - $221k
...carriers and the customers they serve. We build AI-powered software that keeps everyone in the... ...for a Sr. Software Engineer II (DevOps) to help us build... ...efficiency Build and maintain AI/ML infrastructure and... ...enables reporting, BI, and AI training workflows Implement...TrainingWork at officeLocal areaFlexible hours2 days per week3 days per week$125k - $175k
...insights into users’ fitness, health, and recovery. As a Software Engineer II (Backend) in the Healthcare group, you will help build and... ...skills, experience, performance, and relevant education or training. In addition to the base salary, the successful candidate...TrainingFull timeWork at officeRelocation$147k - $211k
...years of experience with software development in one or... ..., and software test engineering. About the Job Google... ...and accessible. As a backend engineer, you will work... ...(search, storage, serving) and machine intelligence... ...relevant education or training. US: $147000 - $21100...Training- ...surrounded by talented engineers and tech leaders from... ...Role As a Senior Software Engineer, Backend specializing in... ...of scalable APIs to serve robot control systems... ...retrieval systems for training datasets and inference... ...Collaborate with ML engineers to optimize...TrainingWork at office
$143k - $286k
Position Summary... As a Staff Software Engineer, you’ll be a technical leader who... ...direction for and evolves the backend microservices, data pipelines, and ML-serving infrastructure that power... ...the full model lifecycle from training through production serving. Hands...TrainingFull timeTemporary workPart timeWork at officeFlexible hours$117.5k - $157.5k
...global organization of engineers, product developers,... .... Job Summary As a Software Engineer II, you will design and... ...experience. 3+ years of backend development... ...Practical experience in AI/ML engineering, with knowledge... ...ML: developing, training, or fine‑tuning models...TrainingWorldwide$125k - $175k
...daily lives. WHOOP is hiring a Software Engineer II to join the Business Systems... ...design and implement the backend systems that power WHOOP’s... ..., and benefits, with equity serving as a key differentiator that... ..., and relevant education or training. In addition to the base salary...TrainingFull timeWork at officeRelocation$182k - $242k
...job orchestration. They came to train models. Instead, they’re doing... ...work in a tight loop with the backend team, enabling RL training runs... ...building distributed systems, ML infrastructure, or developer platforms... ...(i) U.S. citizen or national, (ii) U.S. lawful permanent resident...TrainingPermanent employmentTemporary workCasual workWork at officeFlexible hours- ...deep expertise spanning hardware and software. Join us in shaping a future where... ...secure, maintainable, self-serve core infrastructure that engineering teams can rely on and operate independently... ...and evolution of a modern ML training infrastructure — scalable, reproducible...TrainingFull timeContract workFlexible hours
$130k - $175k
...Senior Ground Software Engineer I/II As a Senior Ground Software Engineer I/II... ...in Long Beach, CA, you will serve as a technical authority for... ...to Have Active TS clearance. Backend – Python, Golang, and/or Rust... ...leaves of absence, compensation, and training. #J-18808-Ljbffr...TrainingWork experience placementWork at officeLocal areaFlexible hours$125k
...employee. For us, it also serves as a practical... ...As part of the Growth Engineering organization, our work... ...a talented Frontend Software Engineer II to join our Signup &... ...you'll work alongside backend engineers to build complete... ...education or training; and other business and...TrainingWork at officeLocal areaRemote workHome officeFlexible hours- ...The IT Solutions Engineer / Analyst II works alongside AI... ...the supporting software and integration layers... ...and supporting backend and front‑end... ...effectively with AI/ML engineers and... ...be called upon to serve as a member of the... ...employment, and training for all positions...TrainingPermanent employmentLocal areaWork from homeHome office
$85k - $130k
The Role As a Senior Software Engineer II on the Data Products team, you will act as a... ...allow bioinformatics scientists, ML and Agent developers to rapidly develop... ..., and test complex production backend web services in TypeScript, serving as a standard‑bearer for code...$100.6k - $199k
Software Engineer II - Microsoft Teams Microsoft Teams is revolutionizing how the world collaborates,... ...solutions that leverage data science and AI/ML models, while contributing to mobile... ...science workflows and mobile integration. Serve as a Designated Responsible Individual (...Local area$145k - $207k
Role Description As a Software Engineer on the Marketplace team, you’ll work... ...and maintaining the backend which powers search ~Supporting ML pipelines and model serving infrastructure ~Collaborating... ...and relevant education and training, to determine compensation that...TrainingFull time$165k - $242k
What You’ll Do: Senior engineers are area owners who lead designs, raise engineering standards... ...(vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe). Experience with CUDA kernels... ...defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer II, Backend (ML Training & Serving) [Remote]. Be the first to apply!
- ngo software engineer United States
- software engineer matlab simulink United States
- software developer United States
- software developer internship no experience United States
- software developer apprenticeship United States
- junior software developer United States
- part time software developer remote United States
- financial software developer United States
- senior software engineer ruby on rails United States
- software engineer amazon United States


