Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Systems Engineer - LLM Infra & Governance

TRM Labs

A tech-driven company focused on blockchain solutions is seeking a Senior ML Systems Engineer. In this role, you will build reusable workflows, automate model versioning, and deploy scalable AI systems. Candidates should have strong programming skills, experience with scalable infrastructure, and a deep understanding of ML Ops best practices. The position offers a competitive salary range with the opportunity to contribute to significant national security initiatives in a fast-paced environment. #J-18808-Ljbffr TRM Labs

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Engineer - LLM Infra & Governance in San Francisco, CA vacancy
  •  ...Senior AI/ML Engineer — LLM & Agent Stack Every production AI system, whether it's powering customer support, writing code, analyzing...  ...agents and enforce governance. A unified compute layer to run...  ...building distributed systems, infra, or ML platforms. ~ Deep practical... 
    Senior

    TrueFoundry

    San Francisco, CA
    4 days ago
  •  ...company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for...  .... You will design distributed training systems and optimize GPU utilization while collaborating...  ...have over 5 years of experience in ML infrastructure and a strong background... 
    Senior

    Baseten

    San Francisco, CA
    2 days ago
  • A dynamic tech company in San Francisco is seeking a seasoned ML Infrastructure Engineer to lead the development of innovative AI product systems. This role entails scaling ML product development infrastructure, collaborating with cross-functional teams, and mentoring junior... 
    Senior

    Lightfield

    San Francisco, CA
    2 days ago
  •  ...CTGT is the deterministic governance layer that enables the most...  ..., model-agnostic system that enforces policy, prevents...  ...bridging the gap between LLM capabilities and domain-specific...  ...fundamentals?" CTGT's Senior Machine Learning Engineer will operate deep within the... 
    Suggested

    CTGT

    San Francisco, CA
    8 hours ago
  • $204k - $259k

     ...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology...  ...used throughout Waymo's systems, both onboard autonomous...  ...experience Experience in ML engineering and applied...  ...We prefer: ML infra experience: training, evaluating... 
    Senior
    Full time
    Temporary work
    Remote work

    Waymo

    San Francisco, CA
    8 hours ago
  • Arena Intelligence, Inc. in San Francisco, CA, is seeking a Senior Software Engineer (Infrastructure) to lead the design of scalable data and API systems. The role involves architecting real-time data pipelines, ensuring performance and reliability, and mentoring engineers... 
    Senior

    Arena Intelligence, Inc.

    San Francisco, CA
    1 day ago
  • A leading AI research company in San Francisco seeks Senior/Staff Engineers skilled in distributed systems and large-scale ML training. Responsibilities include designing systems optimized for low-bandwidth conditions and implementing robust training strategies. Ideal... 
    Senior
    Remote work

    Pluralis Research

    San Francisco, CA
    2 days ago
  •  ...is looking to enhance its Silicon Valley engineering team with skilled professionals in AI research...  ...role involves building production-grade LLM pipelines and integrating AI features...  ...candidate will have a strong background in AI/ML engineering, with experience in Python,... 
    Senior

    HopHR

    San Francisco, CA
    1 day ago
  • HopHR is building its Silicon Valley engineering team in San Francisco and seeks a skilled AI/ML Engineer. This role focuses on developing production-grade AI systems and involves significant responsibilities in building LLM pipelines and optimizing RAG architectures. The... 
    Senior
    Work at office

    HopHR

    San Francisco, CA
    2 days ago
  •  ...Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and...  ...components. Ideal candidates should have strong software engineering skills and experience with ML inference systems, particularly in Python and C++. This... 
    Senior

    Gimlet Labs

    San Francisco, CA
    5 days ago
  • $204k - $259k

     ...states. The Perception team builds the system which learns the spatial-temporal...  ...from a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently...  ...focus on large-scale model development (LLM, VLM, or similar foundation models). ~... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  • $131.4k - $235.95k

    Autodesk, Inc. is seeking a Senior Machine Learning Engineer for MLOps in San Francisco. You will ensure AI-powered experiences meet high standards for reliability and scalability. Key responsibilities include automating model testing, managing inference services, and... 
    Senior

    Autodesk, Inc.

    San Francisco, CA
    3 days ago
  •  ...Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on experience with modern... 
    Senior

    Reflection AI

    San Francisco, CA
    2 days ago
  •  ...company based in Seattle is looking for a Senior Machine Learning Engineer who will design and implement AI-...  ...responsible for building autonomous systems and collaborating on cutting-edge research...  ...will bring over 8 years of ML experience, proficiency in PyTorch or... 
    Senior

    DocuSign, Inc.

    San Francisco, CA
    3 days ago
  • DocuSign, Inc. in San Francisco, California is seeking a Senior Machine Learning Engineer to redefine global services operations. You will design autonomous multi-agent systems using Reinforcement Learning and develop deep learning models for high-volume time series data... 
    Senior
    Work at office
    2 days per week

    DocuSign, Inc.

    San Francisco, CA
    1 day ago
  • A leading AI infrastructure company is seeking a Senior ML Performance Engineer to design a comprehensive performance testing platform for large language models. This role requires a minimum of 7 years in performance engineering and strong experience with GPU programming... 
    Senior

    Amadeus Search

    San Francisco, CA
    4 days ago
  •  ...Member of Technical Staff focused on building and optimizing ML inference systems in San Francisco. The role involves designing end-to-end...  ...real-world workloads. Candidates should have strong software engineering skills, experience with ML inference systems, and... 

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  •  ...on cutting-edge AI research and development. The role involves building and scaling training and inference infrastructure, designing ML kernels, and optimizing performance. Ideal candidates should have a passion for addressing ambitious challenges at the intersection of... 

    Mirendil

    San Francisco, CA
    2 days ago
  • A pioneering AI company in the San Francisco Bay Area is seeking an ML Ops Engineer to automate model training, deployment, and governance processes. The ideal candidate will have extensive MLOps experience and be proficient in tools like Kubernetes and Terraform. This... 

    Fabrion

    San Francisco, CA
    4 days ago
  • $172.5k - $210k

    A cutting-edge AI infrastructure firm located in San Francisco is seeking a Senior Systems Performance Engineer. This role involves leading hardware evaluations and optimizing AI systems for performance. Candidates should have over 5 years of experience, proficiency in... 
    Senior

    Epoch Biodesign

    San Francisco, CA
    4 days ago
  • $200k

    A tech startup in San Francisco is seeking senior or staff-level engineers to design and maintain their global cloud infrastructure. Ideal candidates...  ...engineering experience, a strong understanding of systems at scale, and a passion for optimizing performance and reliability... 
    Senior
    Full time

    Convex

    San Francisco, CA
    4 days ago
  •  ...Walrus, a decentralized storage network, ensuring high standards of reliability and performance. Candidates should have over 5 years of systems/network programming experience, with skills in Rust, C, or C++. A Bachelor’s degree in Computer Science or related field is... 
    Senior

    Alumni Ventures

    San Francisco, CA
    3 days ago
  • $240k - $270k

     .... That’s where you come in. As an AI/ML Engineer, you’ll join a growing team focused on...  ...opportunities * Prototype and productionize AI systems that feel intuitive but do a lot under...  ...all without moving data or breaking governance. Sigma supports a spreadsheet interface... 
    Senior
    Full time
    Work at office
    Flexible hours

    Sigma Computing

    San Francisco, CA
    8 hours ago
  • A pioneering tech startup in neurotechnology is seeking a Senior Machine Learning Infrastructure Engineer to design and scale critical infrastructure powering ML applications. This role involves creating robust data pipelines and optimizing modeling processes, essential... 
    Senior

    Echo Neurotechnologies

    San Francisco, CA
    2 days ago
  • $165k - $195k

    Quanata, LLC is seeking a Senior Systems Engineer in San Francisco to manage and support enterprise-level IT systems. The role includes implementing critical IT infrastructure, optimizing reliability, and driving project execution. Ideal candidates should have 6-8 years... 
    Senior
    Remote job

    Quanata, LLC

    San Francisco, CA
    5 days ago
  • $240k

     ...The Team: Convex has assembled a team of engineers who have built and designed some of the...  ...team has a lot of experience running large systems at scale, and as our customers and...  ...experience designing and operating large-scale infra, we’d love to talk! This is a hands-on role... 
    Senior
    Full time
    Work at office
    Remote work
    Shift work
    Night shift

    Convex

    San Francisco, CA
    2 days ago
  •  ...ML Infrastructure Engineer In this role you will help scale and optimize our training systems and core model code. You'll own critical infrastructure for large-scale training,...  ...researchers: Translate research needs into infra capabilities and guide best practices for... 

    Physical Intelligence

    San Francisco, CA
    1 day ago
  •  ...and real-world responsibility in mind. Our ML team comes from a culture of academic...  ...frontier research for their next generation of LLM products. Join us if you: Wish to...  ...attacks. Collaborate with our engineering team to deliver real-world applications of... 
    Local area
    Shift work

    Dynamo AI

    San Francisco, CA
    4 days ago
  •  ...problem end-to-end: the scheduling systems, the placement logic, the...  ...seamless. The Team The ML Infrastructure team supports...  ...You will work closely with ML Infra (training systems), data platform...  ...have: - Strong software engineering fundamentals - Experience building... 
    Flexible hours

    Physical Intelligence

    San Francisco, CA
    1 day ago
  •  ...strong foundation in low-level operating systems concepts including multi-threading, memory...  ...inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom...  ...contributions and staying current with ML infrastructure developments Bring practical... 
    Work at office

    Reducto

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Systems Engineer - LLM Infra & Governance. Be the first to apply!