Senior ML Systems Engineer - LLM Infra & Governance
TRM Labs
A tech-driven company focused on blockchain solutions is seeking a Senior ML Systems Engineer. In this role, you will build reusable workflows, automate model versioning, and deploy scalable AI systems. Candidates should have strong programming skills, experience with scalable infrastructure, and a deep understanding of ML Ops best practices. The position offers a competitive salary range with the opportunity to contribute to significant national security initiatives in a fast-paced environment. #J-18808-Ljbffr TRM Labs
- ...Senior AI/ML Engineer — LLM & Agent Stack Every production AI system, whether it's powering customer support, writing code, analyzing... ...agents and enforce governance. A unified compute layer to run... ...building distributed systems, infra, or ML platforms. ~ Deep practical...Senior
- ...company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for... .... You will design distributed training systems and optimize GPU utilization while collaborating... ...have over 5 years of experience in ML infrastructure and a strong background...Senior
- A dynamic tech company in San Francisco is seeking a seasoned ML Infrastructure Engineer to lead the development of innovative AI product systems. This role entails scaling ML product development infrastructure, collaborating with cross-functional teams, and mentoring junior...Senior
- ...CTGT is the deterministic governance layer that enables the most... ..., model-agnostic system that enforces policy, prevents... ...bridging the gap between LLM capabilities and domain-specific... ...fundamentals?" CTGT's Senior Machine Learning Engineer will operate deep within the...Suggested
$204k - $259k
...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology... ...used throughout Waymo's systems, both onboard autonomous... ...experience Experience in ML engineering and applied... ...We prefer: ML infra experience: training, evaluating...SeniorFull timeTemporary workRemote work- Arena Intelligence, Inc. in San Francisco, CA, is seeking a Senior Software Engineer (Infrastructure) to lead the design of scalable data and API systems. The role involves architecting real-time data pipelines, ensuring performance and reliability, and mentoring engineers...Senior
- A leading AI research company in San Francisco seeks Senior/Staff Engineers skilled in distributed systems and large-scale ML training. Responsibilities include designing systems optimized for low-bandwidth conditions and implementing robust training strategies. Ideal...SeniorRemote work
- ...is looking to enhance its Silicon Valley engineering team with skilled professionals in AI research... ...role involves building production-grade LLM pipelines and integrating AI features... ...candidate will have a strong background in AI/ML engineering, with experience in Python,...Senior
- HopHR is building its Silicon Valley engineering team in San Francisco and seeks a skilled AI/ML Engineer. This role focuses on developing production-grade AI systems and involves significant responsibilities in building LLM pipelines and optimizing RAG architectures. The...SeniorWork at office
- ...Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and... ...components. Ideal candidates should have strong software engineering skills and experience with ML inference systems, particularly in Python and C++. This...Senior
$204k - $259k
...states. The Perception team builds the system which learns the spatial-temporal... ...from a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently... ...focus on large-scale model development (LLM, VLM, or similar foundation models). ~...SeniorFull timeRemote work$131.4k - $235.95k
Autodesk, Inc. is seeking a Senior Machine Learning Engineer for MLOps in San Francisco. You will ensure AI-powered experiences meet high standards for reliability and scalability. Key responsibilities include automating model testing, managing inference services, and...Senior- ...Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on experience with modern...Senior
- ...company based in Seattle is looking for a Senior Machine Learning Engineer who will design and implement AI-... ...responsible for building autonomous systems and collaborating on cutting-edge research... ...will bring over 8 years of ML experience, proficiency in PyTorch or...Senior
- DocuSign, Inc. in San Francisco, California is seeking a Senior Machine Learning Engineer to redefine global services operations. You will design autonomous multi-agent systems using Reinforcement Learning and develop deep learning models for high-volume time series data...SeniorWork at office2 days per week
- A leading AI infrastructure company is seeking a Senior ML Performance Engineer to design a comprehensive performance testing platform for large language models. This role requires a minimum of 7 years in performance engineering and strong experience with GPU programming...Senior
- ...Member of Technical Staff focused on building and optimizing ML inference systems in San Francisco. The role involves designing end-to-end... ...real-world workloads. Candidates should have strong software engineering skills, experience with ML inference systems, and...
- ...on cutting-edge AI research and development. The role involves building and scaling training and inference infrastructure, designing ML kernels, and optimizing performance. Ideal candidates should have a passion for addressing ambitious challenges at the intersection of...
- A pioneering AI company in the San Francisco Bay Area is seeking an ML Ops Engineer to automate model training, deployment, and governance processes. The ideal candidate will have extensive MLOps experience and be proficient in tools like Kubernetes and Terraform. This...
$172.5k - $210k
A cutting-edge AI infrastructure firm located in San Francisco is seeking a Senior Systems Performance Engineer. This role involves leading hardware evaluations and optimizing AI systems for performance. Candidates should have over 5 years of experience, proficiency in...Senior$200k
A tech startup in San Francisco is seeking senior or staff-level engineers to design and maintain their global cloud infrastructure. Ideal candidates... ...engineering experience, a strong understanding of systems at scale, and a passion for optimizing performance and reliability...SeniorFull time- ...Walrus, a decentralized storage network, ensuring high standards of reliability and performance. Candidates should have over 5 years of systems/network programming experience, with skills in Rust, C, or C++. A Bachelor’s degree in Computer Science or related field is...Senior
$240k - $270k
.... That’s where you come in. As an AI/ML Engineer, you’ll join a growing team focused on... ...opportunities * Prototype and productionize AI systems that feel intuitive but do a lot under... ...all without moving data or breaking governance. Sigma supports a spreadsheet interface...SeniorFull timeWork at officeFlexible hours- A pioneering tech startup in neurotechnology is seeking a Senior Machine Learning Infrastructure Engineer to design and scale critical infrastructure powering ML applications. This role involves creating robust data pipelines and optimizing modeling processes, essential...Senior
$165k - $195k
Quanata, LLC is seeking a Senior Systems Engineer in San Francisco to manage and support enterprise-level IT systems. The role includes implementing critical IT infrastructure, optimizing reliability, and driving project execution. Ideal candidates should have 6-8 years...SeniorRemote job$240k
...The Team: Convex has assembled a team of engineers who have built and designed some of the... ...team has a lot of experience running large systems at scale, and as our customers and... ...experience designing and operating large-scale infra, we’d love to talk! This is a hands-on role...SeniorFull timeWork at officeRemote workShift workNight shift- ...ML Infrastructure Engineer In this role you will help scale and optimize our training systems and core model code. You'll own critical infrastructure for large-scale training,... ...researchers: Translate research needs into infra capabilities and guide best practices for...
- ...and real-world responsibility in mind. Our ML team comes from a culture of academic... ...frontier research for their next generation of LLM products. Join us if you: Wish to... ...attacks. Collaborate with our engineering team to deliver real-world applications of...Local areaShift work
- ...problem end-to-end: the scheduling systems, the placement logic, the... ...seamless. The Team The ML Infrastructure team supports... ...You will work closely with ML Infra (training systems), data platform... ...have: - Strong software engineering fundamentals - Experience building...Flexible hours
- ...strong foundation in low-level operating systems concepts including multi-threading, memory... ...inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom... ...contributions and staying current with ML infrastructure developments Bring practical...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Engineer - LLM Infra & Governance. Be the first to apply!
- machine learning ai engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- entry level machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA

