Software Engineer, ML Infra & Distributed Systems (Staff & Principal)
$227.2k - $417kTubi
About the Role As a Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world‑class machine learning inference platforms that power essential services such as personalized recommendations, search, and content understanding across Tubi. Open Positions Staff Software Engineer Principal Software Engineer Additional Details: As a Principal Engineer on the ML Infrastructure team, you will be a technical leader and visionary, driving the evolution of our machine learning platform. You will tackle the most complex and impactful technical challenges, shaping the architecture and technology choices that enable our ML capabilities to scale and deliver exceptional user experiences. You will be a key influencer, bridging the gap between engineering and product, and a mentor to senior engineers, fostering a culture of technical excellence and continuous improvement. Your work will be used by millions of users. Responsibilities Design and build scalable, high‑throughput, and low‑latency distributed systems using Scala. Build reusable components and services that serve various ML applications such as Personalization, Search, Ads, and Exploration. Partner closely with ML engineers to understand their challenges and limitations and develop scalable solutions. Proactively recommend solutions to keep our ML Inference stack state of the art. Take a data‑driven approach to identifying and optimizing latency, cost, and efficiency of our infrastructure. Lead large‑scale cross‑functional refactorings if necessary. Mentor other engineers on the team on system design, effective incident management, interviewing, leveraging LLMs for work, etc. Collaborate with ML, Product, and cross‑functional engineering teams to define the long‑term vision and architecture for ML Infrastructure at Tubi. Your Background Experience designing and building scalable, distributed systems in any modern backend language (e.g., Scala, Java, Python, Go, C++); experience with Scala or JVM‑based language is a plus. Strong experience with AWS or an equivalent cloud platform. Experience building online microservices at scale with low‑latency serving. Experience with both SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra), message brokers (e.g., Kafka), and caches (e.g., Redis). Experience with containerization technologies such as Docker or Kubernetes. Led the response and resolution efforts for multiple major, large‑scale incidents. Bonus Familiarity with machine learning infrastructure such as inference engines (e.g., torschserve, triton, vLLM), vector stores (e.g., LanceDB, FAISS), feature stores (e.g., Feast), ElastiCache, model‑training orchestration, etc. Understanding of ML model training pipelines and model internals. Experience with Recommender Systems, Search, Autocomplete, and Ads ML is a plus. Previous experience with Akka, Erlang, Elixir, or Go. Proficient in data‑driven analysis of complex A/B testing results. About Tubi Tubi is a free streaming service that entertains over 100 million monthly active users, offering the world’s largest collection of Hollywood movies and TV shows, thousands of creator‑led stories, and hundreds of Tubi Originals made for passionate fans. Headquartered in San Francisco and founded in 2014, Tubi is part of Tubi Media Group, a division of Fox Corporation. Pursuant to state and local pay disclosure requirements, the pay range for this role—dependent on education, skills, experience, and location—is listed annually below. This role is also eligible for an annual discretionary bonus, long‑term incentive plan, and various benefits including medical, dental, vision, insurance, a 401(k) plan, paid time off, and other benefits in accordance with applicable plan documents. High‑cost labor markets such as Los Angeles, New York City, and San Francisco.
$227,200–$417,000 USD
Benefits For US‑based non‑exempt Tubi employees, the FOX Employee Benefits summary accurately captures Vacation and Sick Time. For all salaried/exempt employees, Tubi offers a Flexible Time off Policy in lieu of the FOX Vacation policy. For all full‑time, regular employees, Tubi offers a generous Parental Leave Program allowing 12 weeks of paid bonding leave within the first year of birth, adoption, surrogacy, or foster placement of a child, in addition to applicable government leave programs and the FOX short‑term disability policy. For all full‑time, regular employees, Tubi offers a monthly wellness reimbursement. We are an equal‑opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider qualified applicants with criminal histories consistent with applicable law. #J-18808-Ljbffr Tubi- Etsy is looking for a Senior Scala Engineer I to build and scale their... ...centralized Feature Store and a distributed serving layer that supports various ML teams at Etsy. This full-time position... ...solid background in distributed systems, experience with JVM performance,...SuggestedFull time
$227.2k - $417k
Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning and Product... ...should have experience with distributed systems, AWS, and modern backend languages...SuggestedFlexible hours$132k - $150k
...and operates real-world systems in demanding industrial environments... ...Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a... ...systems, databases, and distributed backend services. You... ...designing or supporting AI/ML systems in production is...SuggestedWork experience placementLive inWork at officeVisa sponsorshipFlexible hours- ...Distributed Systems Software Engineer, Python / Go 3 months ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features... ...deployment capabilities to new clouds and developing AI/ML pipelines for automatic analysis of test results. A...SuggestedFull timeLocal areaRemote workWorldwide
$192k
...’ll design and build backend systems that turn real-time operational... ...bar through mentorship and engineering standards. You’ll partner closely... .... Design event‑driven and distributed systems that are resilient,... ...similar). You’ve integrated ML/AI capabilities into production...SuggestedFull timeWork at officeFlexible hours- A pioneering AI company in New York is seeking a skilled engineer to architect and optimize AI training infrastructure. The role involves working with distributed training systems and large-scale data pipelines. Ideal candidates have experience in performance optimization...
- ...Founding Software Engineer – OuterSignal Join to apply for the Founding... ...Do Architect and own core systems that process millions of orders... ..., ideally with backend infra + distributed systems Experience in a fast... ...TS (Node), with some Python/ML exposure a plus Experience...
$160k - $220k
...freely. Our team has built SW, ML, and HW products across... ...experienced infrastructure engineer to help build Stream, a new... ...-maintenance, and reliable distributed inference system Lead observability and oncall... ...2+ years working in a big infra teams (Google / Meta / etc)...Summer work- Amazon Development Center U.S., Inc. is seeking a Software Development Engineer to design, develop, test, and deploy distributed machine learning systems for a worldwide customer base. You will work with AI/LLM technologies to deliver high-visibility AWS services, influence...Worldwide
- ...Reports to: Vangie Shue - Principal Engineering Manager About... ...emerging Agentic AI systems. This is a rare opportunity... ...We're looking for a Staff or Principal Platform... ...operationalizing AI/ML systems, and you... ..., cloud services and distributed systems using tools such...Worldwide
- Etsy is seeking a Senior Scala Engineer I to build and scale their machine learning infrastructure. You will be responsible for a... ...Recommendations. The ideal candidate has a strong background in distributed systems with over 5 years of experience, fluency in Scala, and...Full timeWork at office
$180k - $360k
...and help build the platform engineers turn to to ship AI products.... ...source models. This work spans distributed systems, model serving, and... ...product, model performance, and infra, helping to define how developers... ...fundamentals and curiosity. ML experience is a plus, but...Flexible hours- ...broke down, and the engineer pulls the trace... ...building the operating system for product... ...decade of teams ship software. We're looking for... ...work close to the AI/ML and product teams,... ..., or melting the infra bill Real-time... ...You're fluent in distributed-systems tradeoffs:...Immediate startVisa sponsorship
$180k - $200k
Lightning AI seeks a Storage Infrastructure Engineer to join their Infrastructure Engineering team... ...role involves building and managing storage systems for AI/ML workloads at scale. Responsibilities include operating distributed storage systems like VAST and Ceph and...Remote job$229.9k - $262.4k
...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do you love building and pioneering in the technology space? Do you enjoy... ...committed to pioneering and responsibly implementing AI/ML across Capital One. We achieve this by building platforms...Full timePart timeInternshipLocal area- Senior Lead Software Engineer, Back‑End Distributed Systems (AWS, Go, Kubernetes, MCP, Lua, Python) Do you love building and pioneering in the technology space... ...SageMaker, Databricks, or another comprehensive ML platform Experience leveraging interactive AI tooling...Internship
- ...collaborative team of engineers, researchers, and designers... ...for a Full Stack Software Engineer who’s excited... ...You’ll help us design systems that are not only user... ...vision models, and custom ML pipelines Work with... ...working with distributed systems and large-scale...Second job
$175k - $275k
...Union Square). About the Role Backend engineering at Mirage isn’t narrowly defined.... ...and machine learning—building the systems, services, APIs, and ML pipelines that power all of our product... ...technical challenges across distributed systems, scaling, concurrency, and...Local areaNight shift- ...creating customized AI systems that they can run on... .... Our teams are distributed between Europe, North... ...product managers, platform engineers, and AI/ML teams to design,... ...in Computer Science, Software Engineering, or equivalent... ...(only for leads & staff engineers) - 60 min Culture...Relocation package
- Overview As the Senior Scala Engineer I, you will be responsible for... ...emphasis on building a distributed low latency serving layer that... ...architectures that involve distributed systems, machine learning and... ...Senior Engineering Manager, ML Systems. In addition to salary...Full timeWork at officeLocal area
- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid... ...Series A-C / high-growth AI infra) About the Role We’re... ..., kernel optimisation, distributed compute, and high-performance... ...Collaborate closely with ML researchers and infra engineers...Permanent employment
$190k - $261.25k
...improve their business. Founded by engineers — and customer obsessed — we... ..., latency, and efficiency of distributed AI workloads Collaborate with platform, infra, and ML teams to deliver seamless end‑to... ...Python Experience with distributed systems, scalable APIs, or cloud‑native...$112.24k - $140.3k
...Role As a full‑stack Senior Software Engineer at ITHAKA, you will work on... ...and maintaining large‑scale, distributed web applications. In this role... ...version control system such as Git in a collaborative... ...building and operating LLM‑ or ML‑backed systems in production...$204.5k - $267k
...About the Position We're hiring Software Engineers to help implement what... ...traditional SWE role and it's not an ML research role – it's for... ...lifecycle, building systems that accelerate how we find,... ...maintainable code, you understand distributed systems and cloud...Permanent employmentWork at officeLocal areaRelocation3 days per week$213k - $263k
...technically hands‑on Senior Software Engineer to design and... ...will report to the Sr. Staff Manager. You will: Drive... ...developers, sim and analysis infra teams to translate... ..., focused on backend systems or APIs. Extensive... ...experience building scalable, distributed systems and developer‑...Full timeRemote work- ...The Role This is a generalist software engineering role on the team building... ...infrastructure that keeps our systems observable and reliable in... ...disciplinary domain (robotics, ML, experimental automation),... ...is welcome Deep comfort with distributed systems: timeouts, retries,...
$150k - $180k
...performance marketing. The Role As a Software Engineer at Moxxi, you’ll play a... ...and CRM to scaling backend systems for real‑time ad delivery... ...in advertising technology, distributed systems, and machine learning... ...scale. Familiarity with AI/ML‑powered ad optimizations, A/...$150k - $250k
...spanning research into self‑constructing systems, the development of the most... ...business. What We Are Looking For As a Software Engineer Back End you will help design, build... ...workflows. Implement best practices for ML/AI Ops, distributed computing, and scalable service...Work at office3 days per week$200k - $250k
...range is provided by X4 Engineering. Your actual pay will... ...brightest minds in software development & tech | Recruitment... ...| Energy | Trading | ML | AI | Finance | DeFi... ...trade management system. In this position, you... ..., focusing on distributed systems, designing & improving...Full timeWork at office$180k - $360k
...Role We’re seeking a GPU Kernel Engineer to join our team at the... ...performance GPU kernels for key ML operations, including matrix... ...bottlenecks using tools like Nsight Systems, Nsight Compute, and Torch... ...in GEMM tuning and distributed/multi‑GPU compute Contributions...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Infra & Distributed Systems (Staff & Principal). Be the first to apply!
- ngo software engineer New York, NY
- software developer New York, NY
- software developer internship no experience New York, NY
- software developer apprenticeship New York, NY
- junior software developer New York, NY
- part time software developer remote New York, NY
- financial software developer New York, NY
- senior software engineer ruby on rails New York, NY
- software engineer amazon New York, NY
- senior software design engineer New York, NY

