Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, ML Infra & Distributed Systems (Staff & Principal)

$227.2k - $417k

Tubi

About the Role As a Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world‑class machine learning inference platforms that power essential services such as personalized recommendations, search, and content understanding across Tubi. Open Positions Staff Software Engineer Principal Software Engineer Additional Details: As a Principal Engineer on the ML Infrastructure team, you will be a technical leader and visionary, driving the evolution of our machine learning platform. You will tackle the most complex and impactful technical challenges, shaping the architecture and technology choices that enable our ML capabilities to scale and deliver exceptional user experiences. You will be a key influencer, bridging the gap between engineering and product, and a mentor to senior engineers, fostering a culture of technical excellence and continuous improvement. Your work will be used by millions of users. Responsibilities Design and build scalable, high‑throughput, and low‑latency distributed systems using Scala. Build reusable components and services that serve various ML applications such as Personalization, Search, Ads, and Exploration. Partner closely with ML engineers to understand their challenges and limitations and develop scalable solutions. Proactively recommend solutions to keep our ML Inference stack state of the art. Take a data‑driven approach to identifying and optimizing latency, cost, and efficiency of our infrastructure. Lead large‑scale cross‑functional refactorings if necessary. Mentor other engineers on the team on system design, effective incident management, interviewing, leveraging LLMs for work, etc. Collaborate with ML, Product, and cross‑functional engineering teams to define the long‑term vision and architecture for ML Infrastructure at Tubi. Your Background Experience designing and building scalable, distributed systems in any modern backend language (e.g., Scala, Java, Python, Go, C++); experience with Scala or JVM‑based language is a plus. Strong experience with AWS or an equivalent cloud platform. Experience building online microservices at scale with low‑latency serving. Experience with both SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra), message brokers (e.g., Kafka), and caches (e.g., Redis). Experience with containerization technologies such as Docker or Kubernetes. Led the response and resolution efforts for multiple major, large‑scale incidents. Bonus Familiarity with machine learning infrastructure such as inference engines (e.g., torschserve, triton, vLLM), vector stores (e.g., LanceDB, FAISS), feature stores (e.g., Feast), ElastiCache, model‑training orchestration, etc. Understanding of ML model training pipelines and model internals. Experience with Recommender Systems, Search, Autocomplete, and Ads ML is a plus. Previous experience with Akka, Erlang, Elixir, or Go. Proficient in data‑driven analysis of complex A/B testing results. About Tubi Tubi is a free streaming service that entertains over 100 million monthly active users, offering the world’s largest collection of Hollywood movies and TV shows, thousands of creator‑led stories, and hundreds of Tubi Originals made for passionate fans. Headquartered in San Francisco and founded in 2014, Tubi is part of Tubi Media Group, a division of Fox Corporation. Pursuant to state and local pay disclosure requirements, the pay range for this role—dependent on education, skills, experience, and location—is listed annually below. This role is also eligible for an annual discretionary bonus, long‑term incentive plan, and various benefits including medical, dental, vision, insurance, a 401(k) plan, paid time off, and other benefits in accordance with applicable plan documents. High‑cost labor markets such as Los Angeles, New York City, and San Francisco.

$227,200–$417,000 USD

Benefits For US‑based non‑exempt Tubi employees, the FOX Employee Benefits summary accurately captures Vacation and Sick Time. For all salaried/exempt employees, Tubi offers a Flexible Time off Policy in lieu of the FOX Vacation policy. For all full‑time, regular employees, Tubi offers a generous Parental Leave Program allowing 12 weeks of paid bonding leave within the first year of birth, adoption, surrogacy, or foster placement of a child, in addition to applicable government leave programs and the FOX short‑term disability policy. For all full‑time, regular employees, Tubi offers a monthly wellness reimbursement. We are an equal‑opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider qualified applicants with criminal histories consistent with applicable law. #J-18808-Ljbffr Tubi

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, ML Infra & Distributed Systems (Staff & Principal) in New York, NY vacancy
  • Etsy is looking for a Senior Scala Engineer I to build and scale their...  ...centralized Feature Store and a distributed serving layer that supports various ML teams at Etsy. This full-time position...  ...solid background in distributed systems, experience with JVM performance,... 
    Suggested
    Full time

    Etsy

    New York, NY
    3 days ago
  • $227.2k - $417k

    Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning and Product...  ...should have experience with distributed systems, AWS, and modern backend languages... 
    Suggested
    Flexible hours

    Tubi

    New York, NY
    3 days ago
  • $132k - $150k

     ...and operates real-world systems in demanding industrial environments...  ...Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a...  ...systems, databases, and distributed backend services. You...  ...designing or supporting AI/ML systems in production is... 
    Suggested
    Work experience placement
    Live in
    Work at office
    Visa sponsorship
    Flexible hours

    CVector - Industrial AI

    New York, NY
    16 days ago
  •  ...Distributed Systems Software Engineer, Python / Go 3 months ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features...  ...deployment capabilities to new clouds and developing AI/ML pipelines for automatic analysis of test results. A... 
    Suggested
    Full time
    Local area
    Remote work
    Worldwide

    Canonical

    New York, NY
    5 days ago
  • $192k

     ...’ll design and build backend systems that turn real-time operational...  ...bar through mentorship and engineering standards. You’ll partner closely...  .... Design event‑driven and distributed systems that are resilient,...  ...similar). You’ve integrated ML/AI capabilities into production... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Twenty Inc.

    New York, NY
    3 days ago
  • A pioneering AI company in New York is seeking a skilled engineer to architect and optimize AI training infrastructure. The role involves working with distributed training systems and large-scale data pipelines. Ideal candidates have experience in performance optimization... 

    Reflection AI

    New York, NY
    3 days ago
  •  ...Founding Software Engineer – OuterSignal Join to apply for the Founding...  ...Do Architect and own core systems that process millions of orders...  ..., ideally with backend infra + distributed systems Experience in a fast...  ...TS (Node), with some Python/ML exposure a plus Experience... 

    Outersignal

    New York, NY
    2 days ago
  • $160k - $220k

     ...freely. Our team has built SW, ML, and HW products across...  ...experienced infrastructure engineer to help build Stream, a new...  ...-maintenance, and reliable distributed inference system Lead observability and oncall...  ...2+ years working in a big infra teams (Google / Meta / etc)... 
    Summer work

    Sandbar Inc

    New York, NY
    2 days ago
  • Amazon Development Center U.S., Inc. is seeking a Software Development Engineer to design, develop, test, and deploy distributed machine learning systems for a worldwide customer base. You will work with AI/LLM technologies to deliver high-visibility AWS services, influence... 
    Worldwide

    Amazon Development Center U.S., Inc.

    New York, NY
    3 days ago
  •  ...Reports to: Vangie Shue - Principal Engineering Manager About...  ...emerging Agentic AI systems. This is a rare opportunity...  ...We're looking for a Staff or Principal Platform...  ...operationalizing AI/ML systems, and you...  ..., cloud services and distributed systems using tools such... 
    Worldwide

    AppGate

    New York, NY
    3 days ago
  • Etsy is seeking a Senior Scala Engineer I to build and scale their machine learning infrastructure. You will be responsible for a...  ...Recommendations. The ideal candidate has a strong background in distributed systems with over 5 years of experience, fluency in Scala, and... 
    Full time
    Work at office

    Etsy

    New York, NY
    3 days ago
  • $180k - $360k

     ...and help build the platform engineers turn to to ship AI products....  ...source models. This work spans distributed systems, model serving, and...  ...product, model performance, and infra, helping to define how developers...  ...fundamentals and curiosity. ML experience is a plus, but... 
    Flexible hours

    Baseten

    New York, NY
    3 days ago
  •  ...broke down, and the engineer pulls the trace...  ...building the operating system for product...  ...decade of teams ship software. We're looking for...  ...work close to the AI/ML and product teams,...  ..., or melting the infra bill Real-time...  ...You're fluent in distributed-systems tradeoffs:... 
    Immediate start
    Visa sponsorship

    Interfere, Inc.

    New York, NY
    2 days ago
  • $180k - $200k

    Lightning AI seeks a Storage Infrastructure Engineer to join their Infrastructure Engineering team...  ...role involves building and managing storage systems for AI/ML workloads at scale. Responsibilities include operating distributed storage systems like VAST and Ceph and... 
    Remote job

    Lightning AI

    New York, NY
    3 days ago
  • $229.9k - $262.4k

     ...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do you love building and pioneering in the technology space? Do you enjoy...  ...committed to pioneering and responsibly implementing AI/ML across Capital One. We achieve this by building platforms... 
    Full time
    Part time
    Internship
    Local area

    Capital One

    New York, NY
    2 days ago
  • Senior Lead Software Engineer, Back‑End Distributed Systems (AWS, Go, Kubernetes, MCP, Lua, Python) Do you love building and pioneering in the technology space...  ...SageMaker, Databricks, or another comprehensive ML platform Experience leveraging interactive AI tooling... 
    Internship

    Capital One

    New York, NY
    3 days ago
  •  ...collaborative team of engineers, researchers, and designers...  ...for a Full Stack Software Engineer who’s excited...  ...You’ll help us design systems that are not only user...  ...vision models, and custom ML pipelines Work with...  ...working with distributed systems and large-scale... 
    Second job

    Alexandria Technology, Inc.

    New York, NY
    2 days ago
  • $175k - $275k

     ...Union Square). About the Role Backend engineering at Mirage isn’t narrowly defined....  ...and machine learning—building the systems, services, APIs, and ML pipelines that power all of our product...  ...technical challenges across distributed systems, scaling, concurrency, and... 
    Local area
    Night shift

    Mirage

    New York, NY
    4 days ago
  •  ...creating customized AI systems that they can run on...  .... Our teams are distributed between Europe, North...  ...product managers, platform engineers, and AI/ML teams to design,...  ...in Computer Science, Software Engineering, or equivalent...  ...(only for leads & staff engineers) - 60 min Culture... 
    Relocation package

    Mistral AI

    New York, NY
    30 minutes ago
  • Overview As the Senior Scala Engineer I, you will be responsible for...  ...emphasis on building a distributed low latency serving layer that...  ...architectures that involve distributed systems, machine learning and...  ...Senior Engineering Manager, ML Systems. In addition to salary... 
    Full time
    Work at office
    Local area

    Etsy

    New York, NY
    3 days ago
  •  ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid...  ...Series A-C / high-growth AI infra) About the Role We’re...  ..., kernel optimisation, distributed compute, and high-performance...  ...Collaborate closely with ML researchers and infra engineers... 
    Permanent employment
    New York, NY
    more than 2 months ago
  • $190k - $261.25k

     ...improve their business. Founded by engineers — and customer obsessed — we...  ..., latency, and efficiency of distributed AI workloads Collaborate with platform, infra, and ML teams to deliver seamless end‑to...  ...Python Experience with distributed systems, scalable APIs, or cloud‑native... 

    Databricks

    New York, NY
    2 days ago
  • $112.24k - $140.3k

     ...Role As a full‑stack Senior Software Engineer at ITHAKA, you will work on...  ...and maintaining large‑scale, distributed web applications. In this role...  ...version control system such as Git in a collaborative...  ...building and operating LLM‑ or ML‑backed systems in production... 

    ITHAKA

    New York, NY
    2 days ago
  • $204.5k - $267k

     ...About the Position We're hiring Software Engineers to help implement what...  ...traditional SWE role and it's not an ML research role – it's for...  ...lifecycle, building systems that accelerate how we find,...  ...maintainable code, you understand distributed systems and cloud... 
    Permanent employment
    Work at office
    Local area
    Relocation
    3 days per week

    Formationbio

    New York, NY
    2 days ago
  • $213k - $263k

     ...technically hands‑on Senior Software Engineer to design and...  ...will report to the Sr. Staff Manager. You will: Drive...  ...developers, sim and analysis infra teams to translate...  ..., focused on backend systems or APIs. Extensive...  ...experience building scalable, distributed systems and developer‑... 
    Full time
    Remote work

    Waymo

    New York, NY
    2 days ago
  •  ...The Role This is a generalist software engineering role on the team building...  ...infrastructure that keeps our systems observable and reliable in...  ...disciplinary domain (robotics, ML, experimental automation),...  ...is welcome Deep comfort with distributed systems: timeouts, retries,... 

    Radical AI

    New York, NY
    2 days ago
  • $150k - $180k

     ...performance marketing. The Role As a Software Engineer at Moxxi, you’ll play a...  ...and CRM to scaling backend systems for real‑time ad delivery...  ...in advertising technology, distributed systems, and machine learning...  ...scale. Familiarity with AI/ML‑powered ad optimizations, A/... 

    Moxxi Digital

    New York, NY
    2 days ago
  • $150k - $250k

     ...spanning research into self‑constructing systems, the development of the most...  ...business. What We Are Looking For As a Software Engineer Back End you will help design, build...  ...workflows. Implement best practices for ML/AI Ops, distributed computing, and scalable service... 
    Work at office
    3 days per week

    Distyl

    New York, NY
    2 days ago
  • $200k - $250k

     ...range is provided by X4 Engineering. Your actual pay will...  ...brightest minds in software development & tech | Recruitment...  ...| Energy | Trading | ML | AI | Finance | DeFi...  ...trade management system. In this position, you...  ..., focusing on distributed systems, designing & improving... 
    Full time
    Work at office

    X4 Engineering

    New York, NY
    2 days ago
  • $180k - $360k

     ...Role We’re seeking a GPU Kernel Engineer to join our team at the...  ...performance GPU kernels for key ML operations, including matrix...  ...bottlenecks using tools like Nsight Systems, Nsight Compute, and Torch...  ...in GEMM tuning and distributed/multi‑GPU compute Contributions... 
    Flexible hours

    Baseten

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, ML Infra & Distributed Systems (Staff & Principal). Be the first to apply!