Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff ML Systems Engineer, Distributed Systems

FieldAI

Job Description

Job Description

FieldAI’s Irvine team is where embodied AI meets real robots, real sensors, and real field deployments. Based in the heart of Southern California’s robotics ecosystem, we build risk-aware, reliable, field-ready AI systems that solve the hardest problems in robotics and unlock the full potential of embodied intelligence. If you want your work to ship, get tested on hardware, and improve through real deployments, Irvine is the place. We go beyond typical data-driven approaches or pure transformer-only architectures, combining rigorous engineering with learning systems proven in globally deployed solutions that deliver results today and get better every time our robots run in the field.

We are seeking a Staff ML Systems Engineer to architect and build the distributed infrastructure that powers large-scale machine learning workflows across the organization.

This role sits at the intersection of machine learning, distributed systems, and platform engineering. You will be responsible for designing scalable systems that support data processing, model training, evaluation, and post-processing pipelines while enabling ML teams to efficiently develop, operate, and scale production-grade workflows.

You will play a critical role in defining the architectural patterns, tooling, and infrastructure that underpin our machine learning platform.

What You'll Get To Do
  • Design and build scalable distributed machine learning pipelines across data processing, model training, evaluation, and post-processing workflows.
  • Architect distributed execution systems, including parallelization strategies, workload scheduling, resource allocation, and fault tolerance mechanisms.
  • Develop reusable abstractions, frameworks, and libraries that simplify distributed pipeline development.
  • Optimize performance across distributed CPU and GPU environments, improving throughput, utilization, and reliability.
  • Design systems that effectively manage data partitioning, memory utilization, serialization overhead, and compute efficiency.
  • Partner closely with ML engineers, data engineers, and infrastructure teams to productionize research workflows and enable large-scale model development.
  • Establish best practices and engineering standards for distributed machine learning infrastructure.
  • Evaluate and guide decisions around distributed computing frameworks, infrastructure technologies, and system design trade-offs.
  • Improve observability, debugging, monitoring, and operational tooling for distributed systems at scale.
What You Have
  • 5+ years of experience building distributed systems, backend infrastructure, machine learning platforms, or large-scale data processing systems.
  • Strong Python programming skills, including experience with concurrency, performance optimization, and systems development.
  • Experience with distributed computing frameworks such as Ray, Spark, Dask, Flink, or similar technologies.
  • Experience designing and scaling data pipelines or machine learning workflows.
  • Strong system design skills with demonstrated expertise in scalability, reliability, and performance optimization.
  • Experience diagnosing and resolving bottlenecks in distributed environments.
  • Ability to work cross-functionally and drive technical decisions across multiple teams.
The Extras That Set You Apart
  • Experience building infrastructure for machine learning training and inference systems.
  • Familiarity with modern ML frameworks such as PyTorch or TensorFlow.
  • Experience with multi-node or multi-GPU training architectures, including DDP, FSDP, DeepSpeed, or similar technologies.
  • Experience operating Kubernetes-based infrastructure and large-scale cloud systems.
  • Deep understanding of distributed systems concepts including data locality, serialization costs, scheduling, and resource management.
  • Experience with distributed debugging, observability, and workflow orchestration platforms.
  • Proven ability to establish technical direction and influence architecture across organizations.

Our salary range is highly competitive with the market, but we take into consideration an individual's background and experience in determining final salary. Base pay offered may vary depending on geographic location, job-related knowledge, skills, and experience.

In addition to competitive compensation, FieldAI offers comprehensive benefits, equity participation, and the opportunity to contribute to cutting-edge advancements in AI and robotics.

Our salary range is generous and we consider each individual’s background and experience when determining final compensation. Base pay may vary based on role scope, job-related knowledge, skills, experience, and the Irvine, California market.

Why Join FieldAI in Irvine?

In Irvine, you will work where the robots are. Our local team builds and tests systems on real hardware with real sensors, then ships them to operate in unstructured, previously unknown environments around the world. We are solving one of robotics’ hardest challenges: reliable deployment outside the lab. Our Field Foundational Models™ raise the bar for perception, planning, localization, and manipulation, with an emphasis on explainability and safety for real-world use.

You will collaborate with a world-class team that thrives on creativity, resilience, and bold thinking. We bring deep experience from organizations such as DeepMind, NASA JPL, Boston Dynamics, NVIDIA, Amazon, Tesla Autopilot, Cruise, Zoox, Toyota Research Institute, and SpaceX, along with a track record of field deployments and strong performance in DARPA challenge segments.

Be Part of the Next Robotics Revolution

We are looking for builders who want their work to leave the whiteboard and show up on robots. If you enjoy tackling tough, uncharted questions and working across disciplines, you will find your people here. Our teams span AI, software, robotics engineering, product, field deployment, and technical communication, all focused on shipping systems that perform in the real world.

Our headquarters is in Irvine, and we partner closely with teams there as well as colleagues across the US and around the world. Join us in Southern California and help define what dependable, field-ready autonomy looks like.

We value diverse perspectives and are committed to fostering an inclusive workplace. We evaluate candidates and employees based on merit, qualifications, and performance, and we do not discriminate on the basis of race, color, gender, national origin, ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, or any other legally protected status.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the Staff ML Systems Engineer, Distributed Systems in Washington DC vacancy
  • $174.9k - $261.3k

     ...world! The Data Labeling Engineering team designs, builds, and operates...  ...engineering , and AI/ML , defining the strategies,...  ...leadership, and direct impact on systems that unblock the next...  ...experience building robust distributed platforms and applications... 
    Suggested
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Washington DC
    1 day ago
  • $184.5k

     ...satisfaction. This Senior Machine Learning Engineer role is part of the Distribution & Supply team which sits within our...  ...the machine learning–driven systems that power how our travel supply is...  ...business and customer problems into clear ML‑driven solutions, selecting... 
    Suggested

    Expedia Group

    Washington DC
    more than 2 months ago
  • $152k - $241.5k

    Sr Software Engineer - Distributed Systems Engineer, EDA InfrastructureNVIDIA is hiring engineers to build and scale the infrastructure that supports our Electronic Design Automation (EDA) workloads. We are looking for engineers with strong programming skills, a deep understanding... 
    Suggested
    Full time
    Remote work

    Nvidia

    Washington DC
    2 days ago
  •  ...technology company in Virginia seeks a Lead Machine Learning Engineer to design and implement AI-driven solutions in risk management...  ..., programming experience with Python, and extensive work with distributed computing on cloud platforms. A Master's degree is preferred,... 
    Suggested

    Capital One

    Mc Lean, VA
    5 days ago
  • We Are: Our Utility Industry, Transmission & Distribution Practice is powering the progress to a safe, connected, and sustainable planet....  ...functional teams to deliver impactful outcomes. Whether supporting a system implementation, business process improvement initiative,... 
    Suggested
    Work at office
    Local area
    Flexible hours

    Accenture

    Arlington, VA
    3 days ago
  •  ...The work Machine Learning Engineers make machine learning and AI...  ...artifacts. · Model-serving systems and APIs designed for appropriate...  ...operations, or an enterprise ML platform. Some openings will...  ...SQL, Java, model frameworks, distributed-processing tools, cloud ML... 
    Full time

    Opendatajobs

    Washington DC
    1 day ago
  • $120k - $180k

     ...a highly motivated Machine Learning (ML) Engineer with an active security clearance to deliver...  ...to power the services, servers, distributed systems, and backend architecture. The successful...  ...At Capgemini, we are committed to our staff’s professional development and offer a... 
    Full time
    For contractors
    Local area
    Flexible hours

    Capgemini Government Solutions

    Washington DC
    1 day ago
  •  ...We're seeking a skilled Machine Learning Engineer to build and deploy production ML systems for the next-generation data management and artificial intelligence...  ...-constrained environments Familiarity with distributed training across multiple GPUs/nodes Experience... 
    Remote job
    Full time
    Local area
    Home office
    Relocation package
    Flexible hours

    Spear AI

    Washington DC
    1 day ago
  • $175k - $215k

     ...The Perception team builds the system which learns the spatial-...  ...diverse set of sensors, enabling engineers like you to (1) develop...  ...require a diverse skill set of ML and geometric algorithms, onboard...  ...methods and recipes for distributed fine-tuning enabling multiple... 
    Full time
    Remote work

    Waymo

    Washington DC
    1 day ago
  •  ...Distribution & Standards Engineer — Engineer / Senior/Lead Position Overview We are seeking an experienced Distribution & Standards Engineer to...  ...procurement, and other technical teams to ensure electric system standards promote safety, reliability, regulatory... 

    ROI Agency

    Washington DC
    26 days ago
  •  ...Position Overview: KSA Integration is seeking a Data Scientist / ML Engineer to support the Marine Corps Logistics Plans (LP) Division’s...  ...AI/ML solutions into existing Marine Corps logistics systems and workflows. Collaborate with government stakeholders to... 
    Full time
    For contractors
    Work experience placement
    Summer work
    Flexible hours

    Ksa Integration

    Washington DC
    1 day ago
  • Senior Systems Engineer - HPE Campus and BranchThis role has been designated as ‘Remote/Teleworker’, which means you will primarily work...  ...operating systems.Experience designing and supporting large campus, distributed enterprise, and branch networking environments.Hands-on... 
    Full time
    Work experience placement
    Local area
    Immediate start
    Remote work
    Work from home

    Hewlett Packard Enterprise

    Washington DC
    7 hours ago
  • DescriptionSystems Engineer - HPC and GPU Infrastructure - TS/SCI Xcelerate Solutions is looking for a mid-career Systems Engineer - HPC & GPU Infrastructure with a deep understanding...  .../Grafana for monitoringKnowledge of distributed resource scheduling... 

    Xcelerate Solutions

    Bethesda, MD
    2 days ago
  •  ...data analysis for complex, mission-critical systems in the US Department of Defense (DOD), is seeking a Systems Engineer to be part of our Advanced Capabilities team...  ...developmental testing.Conduct architecture analysis for distributed combat systems (hardware/software/network).... 
    Full time
    Work at office
    Immediate start

    Innovative Defense Technologies

    Arlington, VA
    1 day ago
  • ASRC Federal Agile Decision Sciences LLC is seeking a Space Systems Engineer to provide systems engineering, technical coordination, and...  ...program and project reviews.Coordinate meetings, capture and distribute meeting minutes, maintain action item tracking, and follow up... 
    Work at office
    Shift work
    3 days per week

    ASRC Federal Holding Company

    Greenbelt, MD
    1 day ago
  • $131.3k - $237.35k

     ...exciting opening for you, as our next TS/SCI cleared Senior Systems Engineer, to play a critical role with design, engineering, development...  ...of a production/enterprise systems at scaleKnowledge of distributed systems concepts (e.g., idempotency, eventual consistency)Experience... 
    Full time
    Contract work
    For contractors
    Remote work
    Flexible hours

    Leidos

    Bethesda, MD
    4 days ago
  • $119.7k - $199.3k

     ...Events, Communications, Customer Care, Engineering & Product, Finance, Human Resources, Legal...  ...design, build, and scale production AI/ML systems that power the next generation of...  ...including data structures, algorithms, APIs, distributed systems, testing, and system design.... 
    Full time
    Part time

    Washington Post

    Washington DC
    3 days ago
  • $203k - $258.6k

     ...researchers, machine learning engineers, data engineers, and...  ...generative AI, large-scale data systems, and networking, developing Large...  ...build and improve the data and ML systems that power our LLMs...  ...contamination, coverage, bias, and distribution shifts.Build reliable and... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work

    CISCO Systems

    Washington DC
    3 days ago
  • $142.65k - $213.98k

     ...The platform unifies multiple ML/AI models to extract curated...  ...looking for a **mid-level Backend Engineer** to join our **Machine...  ...building **scalable backend systems** that power ML workloads, including...  ....Implement asynchronous and distributed processing patterns (workers,... 
    Full time
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Comcast

    Washington DC
    2 days ago
  •  ...Active Full Scope PolygraphWe are seeking an experienced Senior System Engineer (Level 3) to support a mission-critical program within the...  ...SkillsFamiliarity with shared storage solutions (NAS, SAN, distributed storage such as Ceph)Virtualization and containerization... 
    Temporary work

    Kroll

    Washington DC
    3 days ago
  •  ..., a leading defense technology company, is seeking a Senior Systems Engineer to be part of our Advanced Capabilities team and based out of...  ...and implementing systems architecture for scalable and distributed applications. Understanding of different Software Development... 
    Full time
    Work at office
    Immediate start

    Innovative Defense Technologies

    Arlington, VA
    1 day ago
  • $148.5k - $223.9k

     ...the right place! Agentforce is the future of AI, and you are the future of Salesforce.This role is for a Senior Machine Learning Engineer within the Trust Intelligence Platform team who will architect data-driven strategies for threat detection across the security organization... 
    Full time

    Salesforce

    Washington DC
    2 days ago
  • $135k - $230k

     ...data analysis for complex, mission-critical systems in the US Department of Defense (DOD), is seeking a Cybersecurity Systems Engineer Navy Mission to be part of our Advanced...  ...of Red Hat or similar Linux distributions.Experience working with networking within... 
    Full time
    Work at office
    Immediate start

    Innovative Defense Technologies

    Arlington, VA
    1 day ago
  •  ...Technologies (IDT), a leading defense technology company, is seeking a Systems Engineer to be based out of one of IDT’s offices (Arlington, VA,...  ...Stand Out:Knowledge of modern AESA or DBF radar designs, distributed Kill Chains and Combat System, and management of distributed... 
    Full time
    Work at office
    Immediate start

    Innovative Defense Technologies

    Arlington, VA
    1 day ago
  • $98k - $163k

    Job Family:Systems EngineeringTravel Required:Up to 10%Clearance Required:Active Top Secret...  ...seeking a highly capable Senior Systems Engineer to support a large-scale federal...  ...services, and virtualized platforms across distributed environments.Configure, administer, and... 
    Full time
    Flexible hours

    Guidehouse

    Washington DC
    2 days ago
  • $113.2k - $237.8k

    Job Title: Senior Systems Engineer - Radar & Avionics IntegrationJob Category: Information TechnologyTime Type: Full timeMinimum Clearance...  ...subsystem requirements, particularly in cooling and power distribution.Applying knowledge and experience in radar and sensor systems... 
    Contract work
    Work experience placement
    Local area
    Remote work
    Flexible hours
    2 days per week

    CACI International

    Washington DC
    4 days ago
  • $170k

    Washington, United StatesProducts - Engineering /Fulltime /HybridOver 50,000...  ...Software Engineer (GenAI, ML): Experience: 5+...  ...high-performance multi-agent systems that perceive, learn, and act...  ...building and operating large-scale distributed systems on cloud platforms such... 
    Full time
    Worldwide
    Shift work

    Extreme Networks, Inc.

    Washington DC
    7 hours ago
  • $151.3k - $261.5k

     ...design or architecture for new and existing systems, focusing on design patterns,...  ...a mentor or tech lead, or have led an engineering team. I am knowledgeable in machine...  ...responsible for spearheading the development of distributed training support within PyTorch, as... 
    Full time
    Internship

    Annapurna Labs (U.S.) Inc.

    Washington DC
    4 days ago
  • Distributed Systems Software Engineer, Python / Go Join to apply for the Distributed Systems Software Engineer, Python / Go role at Canonical Distributed...  ...deployment capabilities to new clouds and developing AI/ML pipelines for automatic analysis of test results. A successful... 
    Full time
    Local area
    Remote work
    Worldwide

    Canonical

    Washington DC
    1 day ago
  •  ...AI/ML Engineer Arlington, VA 540 is seeking an AI/ML Engineer to support a mission-critical...  ...and building secure, reliable AI/ML systems that directly support mission outcomes....  ...data pipelines, feature engineering, distributed data processing, and data versioning... 
    Temporary work
    Work at office
    Local area
    Flexible hours

    540

    Arlington, VA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff ML Systems Engineer, Distributed Systems. Be the first to apply!