Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Member of Technical Staff, ML Systems

$180k - $230k
Full-time

True Talent Solutions Partners

About the Role

Help build and optimize the training and inference systems behind image, video, and world-model workloads. You will improve performance across GPU kernels, distributed execution, and multi-node serving, working with a team focused on making advanced models faster and more efficient.

What You'll Do

  • Optimize training and inference performance for image, video, diffusion, and world-model workloads.

  • Profile bottlenecks at the kernel, memory, system, and cluster levels using Nsight and related tools.

  • Implement low-level GPU optimizations using CUDA and Triton.

  • Design and improve distributed training and inference engines for diffusion models.

  • Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, or RoCE.

  • Build benchmarks and regression tests to preserve performance gains in production.

  • Contribute to hardware-aware kernel, runtime, and model co-design.

What We're Looking For

  • At least two years of experience in deep learning training or inference systems, distributed systems, or related work, including at least one year of hands-on ML systems or GPU performance work in your current or most recent role.

  • A degree in computer science or a related quantitative field, with strong computer science and machine learning fundamentals. New graduates should have a strong academic background.

  • Direct experience writing kernels for NVIDIA GPUs using CUDA, CUTLASS, Triton, or PTX.

  • Authorship of core features in an inference or training framework, rather than deployment or integration work alone.

  • Experience improving inference or training performance across kernels, runtimes, or distributed execution.

  • Experience optimizing diffusion, video, image, or other multimodal workloads is valuable.

  • Primary experience in GPU-based ML systems, rather than AMD, FPGA, or custom-accelerator work.

Compensation & Benefits

Base salary is $180,000 to $230,000 USD annually. Visa sponsorship is available.

Location

On-site in Menlo Park, California, United States.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Member of Technical Staff, ML Systems in Menlo Park, CA vacancy
  • $144.36k - $199.39k

     ...Technology Lab (liftlab) is seeking a Senior Research Scientist, AI Agent...  ...before it reaches a faculty member or a publication. The...  ...who directs and certifies AI systems that do the work. Core Duties...  ...direction to more junior research staff and set the working standards... 
    Senior

    SLAC

    Palo Alto, CA
    1 day ago
  •  ...engineers closely to design, implement and iterate agentic AI systems with customers. With your strong technical competence, strategic thinking and customer engagement...  ...who Has exceptional engineering skills. Has deep ML knowledge with meaningful implementation track records... 
    Senior

    Leadout Capital

    Palo Alto, CA
    2 days ago
  • $180k - $230k

     ...About the Role Join an AI systems team building high-performance training and inference infrastructure for image, video, and world-model...  ...inference systems, or distributed systems, including hands-on ML systems or GPU performance work. Experience optimizing inference... 
    Suggested
    Full time
    Visa sponsorship

    True Talent Solutions Partners

    Menlo Park, CA
    2 days ago
  •  ...small exceptional team across silicon, systems, software and frontier AI. Our team...  ...SoCs in the world. What You'll Do As a Member of the Technical Staff on the Design Verification & Validation...  ...domain-specific expertise to our AI/ML teams, including architectural and microarchitectural... 
    Suggested
    Night shift

    Architect Labs

    Palo Alto, CA
    3 days ago
  • $230k - $350k

     ...Job Description Job Description Member of Technical Staff, Inference Systems Company: Confidential — founded by Stanford alumni with deep AI infrastructure experience Location: Palo Alto, CA (on-site 5 days per week) Compensation: $230,000 - $350,000 + competitive... 
    Suggested
    Full time
    H1b
    Visa sponsorship

    Transparent Search Group

    Palo Alto, CA
    6 days ago
  •  ...neural networks directly to the device physics rather than relying on layers of inefficient abstraction. The Role As a Member of Technical Staff, System Software (Runtime & Firmware), you will be a foundational member of our small, multi-disciplinary R&D team and have... 
    Work at office

    Unconventional AI

    Mountain View, CA
    1 day ago
  • $200k - $350k

     ...post-training challenges, building the systems that turn expert human knowledge into...  ...advancing AI. The Role We are hiring a Member of Technical Staff, Evals to help define how frontier AI...  .... What we're looking for PhD in ML/AI, computer science, data science, or... 
    Full time
    Work at office
    Flexible hours

    Handshake

    Mountain View, CA
    18 days ago
  •  ...datasets. Design experiments and evaluations that distinguish real improvements from noise. Build rigorous, reproducible ML research systems for rapid experimentation. Develop and deploy production models and signals that remain effective over time. Use real-... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    Poesis

    Menlo Park, CA
    5 days ago
  •  ...engineers and scientists to develop the evaluation metrics and systems that drive frontier LLM performance. You\'ll design the frameworks...  ...(or equivalent experience). At least 2 years of experience in ML evaluation, applied ML research, or a related engineering role.... 

    Inception Labs

    Palo Alto, CA
    1 day ago
  • $115k - $165k

     ...and hundreds of teams and colleges. The Senior CRM Developer works embedded within an agile...  ...Partner with marketers, analysts, and technical leads to challenge assumptions and align...  ...technology stack to surrounding systems via REST APIs, enabling data flows that... 
    Senior
    Temporary work
    Work at office
    Worldwide

    Fanatics Commerce

    Redwood City, CA
    5 days ago
  • GEICO is seeking a Senior Staff AI engineer to join our AI organization. This role leads design, architecture and deployment of GenAI workflows...  ...with AI and software engineers to build scalable, multi-system AI/ML platforms and drive architectural excellence. The ideal... 
    Senior

    GEICO

    Palo Alto, CA
    1 day ago
  • Member of Technical Staff, Infrastructure Intern Spend a summer building production software on the platform enterprises use to run agentic apps...  ...Sycamore Sycamore is building the trusted agent operating system for the enterprise. Our platform helps companies build, deploy... 
    Full time
    Summer work
    Internship

    Sycamore Services

    Palo Alto, CA
    3 days ago
  •  ...vision Implement user-facing frontends in TypeScript/React, working closely with product Design scalable APIs and systems that interface with our ML pipelines and edge device fleet Collaborate on infrastructure and architecture decisions from the ground up Tackle... 

    Coram AI

    Sunnyvale, CA
    2 days ago
  •  ...that AI can be personal, empathetic, and contextually aware. Member of Technical Staff, Backend wanted in Palo Alto, California to Responsible for designing, developing, and maintaining backend software systems and infrastructure that support scalable enterprise... 

    Inflection AI, Inc.

    Palo Alto, CA
    2 days ago
  • $180k

     ...context data recipes. Develop robust and diverse evaluation for mid-training checkpoints. BASIC QUALIFICATIONS: Expertise in ML and large model scaling, with familiarity across all kinds of scaling laws. Strong ability to design ML experiments.... 
    Temporary work

    SpaceXSI

    Palo Alto, CA
    3 days ago
  • $180k

     ...driven media experiences for Grok users worldwide. As a Product Safety Engineer on the Imagine team, you will build the critical safety systems and infrastructure that ensure Grok's multimodal generation capabilities (images, video, audio, and beyond) are powerful,... 
    Temporary work
    Worldwide

    SpaceXSI

    Palo Alto, CA
    5 days ago
  •  ...Design and build agent-driven workflows and systems for complex investment problems. Develop...  ...agents reliably in production. Help shape the technical direction of Poesis’s agent platform and contribute as an early team member. Requirements Experience building... 
    Full time
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    Poesis

    Menlo Park, CA
    5 days ago
  •  ...models and agents. Build reliable, scalable, and reproducible systems for feature generation, backtesting, and model evaluation....  ...signals to assess their performance and weaknesses. Explain technical findings and experimental results to technical and nontechnical... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    Poesis

    Menlo Park, CA
    5 days ago
  •  ...that you will help lead.As the technical lead for Search Serving, you...  ...Product to determine where new ML capabilities can meaningfully...  ...build high quality agentic search systems, addressing tail latency,...  ...simplify fragmented systems, mentor senior engineers, and align technical... 
    Senior
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    4 days ago
  • $200k - $300k

     ...About the Role Join an early-stage team building AI systems for financial markets. In this founding-level role, you will work across trading systems, data infrastructure, and research, taking ideas from initial exploration through production. What You'll Do Own... 
    Full time
    Internship
    Visa sponsorship

    True Talent Solutions Partners

    Palo Alto, CA
    2 days ago
  • $172.5k - $260.1k

     ...Experience We are looking for a highly skilled and experienced Lead Member of Technical Staff (LMTS) to serve as a technical leader and frontend-focused...  ...and maintain resilient, accessible, and performant web systems, optimizing Core Web Vitals, caching strategies, CDN... 

    Salesforce, Inc.

    Palo Alto, CA
    1 day ago
  • $200k - $300k

     ...experience, including demonstrated progression in one role. Experience building or evaluating production AI or machine learning systems, especially agents or LLM-powered products. Strong Python skills. Familiarity with Django, React, and TypeScript. Experience... 
    Full time
    Work at office

    Clera

    Palo Alto, CA
    8 days ago
  • $334k

     ...Engineering teams build fun and technically sophisticated products...  ....We’re looking for a Senior Principal Software...  ..., data science, and ML teams to improve advertiser...  ..., and distributed systems, with the judgment to choose...  ...and expect our team members to work in an office 4+... 
    Senior
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    4 days ago
  • $119.8k - $234.7k

     ...(AI) Infrastructure Engineering Systems team at Microsoft builds the cloud...  ...to help shape both the technical direction and the solutions.Role Summary As a Senior or Principal Software Engineer,...  ...environments.Familiarity with AI/ML infrastructure concepts, such as... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    3 days ago
  • $230k - $260k

     ...knowledge into specialized AI at scale. The Role We are seeking a highly technical and strategic Senior Product Manager with deep AI/ML expertise to lead development across our agentic data systems, synthetic data systems, evaluations, and data-acceleration initiatives.... 
    Senior
    Temporary work
    Local area

    Snorkel AI

    Redwood City, CA
    1 day ago
  •  ...performance hardware and robot systems to the infrastructure and...  ...We hire across levels — from senior/MTS to staff. This is a customer-facing...  ...model development Communicate technical findings clearly to both...  ...What We're Looking For Strong ML research and engineering skills... 

    Rhoda AI

    Mountain View, CA
    5 days ago
  •  ...across the stack, from polished React interfaces to the full-stack systems that power them, and you'll partner directly with founders,...  ...in Computer Science, Software Engineering, Math, or a related technical field, with an expected graduation in 2027 or 2028. Comfortable... 
    Full time
    Internship
    Summer internship
    Work at office
    Flexible hours

    Armadin

    Palo Alto, CA
    1 day ago
  •  ...world. Why this role exists We need a Backend Engineer to build the systems that orchestrate GPU clusters for AI workloads. You'll create...  ...GPU or HPC cluster management experience Understanding of ML,AI workload patterns and requirements Experience with high-value... 
    Senior
    Hourly pay
    Full time
    Work at office
    Work from home
    Visa sponsorship

    SproutsAI

    Palo Alto, CA
    1 day ago
  • $150k - $210k

     ...About Clockwork Systems Software Driven Fabrics to increase GPU...  ...at the systems layer Core technical skills: Strong C/C in systems...  ...networking (RDMA InfiniBand) ML framework or runtime internals...  ...we grow stronger together. Required Experience: Senior IC... 
    Senior
    Full time

    Clockwork.io

    Palo Alto, CA
    4 days ago
  • $198k - $326k

     ...opportunity for every member of the global...  ..., best-in-class AI/ML infrastructure, Kubernetes...  ..., API design and systems design, and your...  ...our company.As a Sr. Staff Software Engineer, you will be a key technical leader and role...  ...EngineeringExperience level: Mid-Senior LevelIndustry:... 
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Sunnyvale, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Member of Technical Staff, ML Systems. Be the first to apply!