Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Tech Lead, Distributed Pre-Training Evals & Scale

Anthropic

Anthropic is seeking an experienced tech lead for the Evals Infrastructure team in San Francisco to own the distributed systems that measure model performance at scale. You will lead a team, collaborate with researchers, and ensure fast, reliable evals with reproducible results. The role blends hands-on engineering with people leadership in a hybrid office setting, shaping how we evaluate and ship safe AI at scale. #J-18808-Ljbffr Anthropic

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Tech Lead, Distributed Pre-Training Evals & Scale in San Francisco, CA vacancy
  •  ...looking for an experienced tech lead to join our Evals Infrastructure team,...  ..., and trustworthy at scale. In this role you'll...  ...the large scale distributed systems that orchestrate...  ...our frontier model training Own eval throughput...  ...wall-clock time on the pre-train eval suite... 
    Training
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • A leading AI technology firm in New York is seeking a talented individual to build and optimize their training and inference frameworks for large language models. The ideal candidate will...  ...in multi-node training and large-scale ML systems. This position offers a competitive... 
    Training

    Scale AI

    San Francisco, CA
    3 days ago
  • $117.2k - $260.1k

     ...ambition meets action. Tech meets trust. And innovation...  ...career at the company leading workforce...  ...durable and available distributed storage for public clouds...  ...reliability, availability and scale.The team is seeking a highly...  ..., promotion, benefits, training, assessment of job... 
    Training
    Full time

    Salesforce

    San Francisco, CA
    5 hours ago
  • $290.4k - $363k

    Scale's LLM post-training platform team builds our internal distributed framework for large language model training. The platform powers MLEs, researchers, data scientists...  ...full-stack technologies that power the world's leading models, and help enterprises and governments... 
    Training
    Full time

    Scale AI

    San Francisco, CA
    5 hours ago
  • $117.2k - $313.7k

     ...ambition meets action. Tech meets trust. And innovation...  ...career at the company leading workforce...  ...components/frameworks in distributed filesystems in an ever-...  ...technology to provide scale and efficiency. Design...  ..., promotion, benefits, training, assessment of job performance... 
    Training
    Full time
    Immediate start
    Remote work

    Salesforce

    San Francisco, CA
    1 day ago
  • $160k - $194k

     ...and built by pioneers in grid-scale batteries, energy markets,...  ...Software Engineer focusing on Distributed Systems at Verse, you will work...  ...a Great Place to Work? - Lead with Empathy: We lift each other...  ...conditions, experience and training, licensure and certifications... 
    Training
    Full time
    Remote work
    Flexible hours

    Ad Verse

    San Francisco, CA
    1 day ago
  • $270k - $365k

     ...the role We're looking for our first Pre-Sales Program Lead to build the programs that take this team...  ...Minimum qualifications Have built or scaled the pre-sales side of a services or...  ...equivalent combination of education, training, and/or experience Required field of study... 
    Training
    Contract work
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  • $342k

     ...infrastructure that powers large-scale AI systems. We design and...  ...seeking a CPU & Storage Technical Lead to define and drive the...  ...storage systems are optimized for training, inference, and supporting...  ..., SSD qualification, RAID, distributed storage, object/file systems,... 
    Training
    Local area

    OpenAI

    San Francisco, CA
    3 days ago
  •  ...a hands‑on Engineering Lead who can own the full technical...  ...Ownership Design, train, and fine‑tune ML...  ...remediate model drift, data distribution shifts, and performance...  ...guidance to scale Athia to handle 10M+ monthly...  ...foundations. 2+ years in a Tech Lead or Staff Engineer... 
    Training
    Shift work

    jobr.pro

    San Francisco, CA
    3 days ago
  • $248.8k - $311k

    Scale AI is the data engine for the entire AI industry. Our mission...  ...Overview As the Technical Lead Manager (TLM) for the Physical...  ...utilize massive datasets for pre-training and fine-tuning generalist...  ...Experience with large-scale distributed training across GPU clusters... 
    Training
    Full time

    3M HEALTHCARE

    San Francisco, CA
    1 day ago
  •  ...constraints of robotic platforms. About the Role As a Software Engineer, Distributed Data Systems, you will design and scale the infrastructure that powers large-scale multimodal training and evaluation at OpenAI. You’ll manage distributed data pipelines,... 
    Training
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  • Overview Scale's LLM post-training platform team builds our internal distributed framework for large language model training. The platform powers MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. It also serves as... 
    Training

    Scale AI

    San Francisco, CA
    5 days ago
  • $160k - $225k

     ...improve their business.Training and customizing state-of...  ...platform for large-scale GPU training and fine-tuning...  ...-tuning open models to pre-training frontier-scale...  ...and capacity, distributed training performance, fault...  ...production training jobs.Lead end-to-end engineering... 
    Training
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    5 hours ago
  • $228k - $250k

     ...springboard for building and scaling payroll businesses.Engineering...  ...is stuck.About this roleAs a Tech Lead Manager at Check, you'll be...  ...Office PolicyThe Check team is distributed across the US. Roles can be...  ...Check does not use E-Verify to pre-screen applicants.... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours
    Night shift

    Check Technologies

    San Francisco, CA
    4 days ago
  • $216.2k - $270.25k

    Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative...  ...in Python, working with distributed systems, data pipelines, and...  ..., and relevant education or training. Scale employees in eligible...  ...that power the world's leading models, and help enterprises... 
    Training
    Full time

    Scale AI

    San Francisco, CA
    5 hours ago
  • $405k

     ...real engineering and knowledge work at scale. As an Engineering Manager on these teams...  ...and operating large-scale platforms or distributed systems Have 1+ years of management experience...  ...an equivalent combination of education, training, and/or experience Required field of... 
    Training
    Work at office
    Visa sponsorship
    Flexible hours

    Menlo Ventures

    San Francisco, CA
    1 day ago
  • $117.2k - $313.7k

     ...ambition meets action. Tech meets trust. And innovation...  ...career at the company leading workforce...  ...the future of Salesforce.Distributed Systems Software Engineer...  ...and maintaining a large scale distributed systems engineering...  ..., promotion, benefits, training, assessment of job... 
    Training
    Full time

    Salesforce

    San Francisco, CA
    5 hours ago
  • $166k - $225k

     ...-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions...  ...will be building the next generation distributed data storage and processing systems that...  ...experience, relevant certifications and training, and specific work location. Based on... 
    Training
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • Crusoe is seeking a Senior Software Engineer to help scale Crusoe Cloud's container registry. You will own core services, drive performance, and ensure reliability as the platform grows. You’ll guide architecture decisions, review code, and stay hands-on while mentoring... 
    Full time

    Crusoe

    San Francisco, CA
    3 days ago
  • $160k - $225k

     ...Francisco. You will be instrumental in building and scaling systems for large-scale GPU training, ensuring high throughput and resilience in training...  ...accelerators. The role demands 5+ years of experience in distributed systems, proficiency with GPU training infrastructure... 
    Training

    Cacheflow

    San Francisco, CA
    3 days ago
  • $227.2k - $417k

     ...freedom to explore new frameworks, lead critical cross-functional...  ...our ML capabilities to scale and deliver exceptional user...  ...throughput, and low latency distributed systems using ScalaBuild reusable...  .... Feast), ElastiCache, model training orchestration, etc.Understanding... 
    Training
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    5 hours ago
  • B Capital is seeking a talented engineer in San Francisco to build and scale distributed training systems for machine learning models. The ideal candidate will have strong experience in distributed training frameworks, debug GPU compute systems, and optimize training throughput... 
    Training

    B Capital

    San Francisco, CA
    3 days ago
  • $230k - $385k

     ...Automation team at OpenAI scales the organization by applying...  ...leverage the full extent of our tech (both public and pre-released) to accomplish...  ...to design and build an evals infrastructure that measures...  ...PostgresExperience designing and scaling distributed systems, APIs, or data... 
    Internship
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    5 hours ago
  • $200k

     ...reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time...  ...on team placement, you may: Build and scale large distributed data pipelines for pre-training Design filtering, mixture... 
    Training
    Full time
    Relocation
    Visa sponsorship

    Magic

    San Francisco, CA
    1 day ago
  • $170k - $216k

     ...develop multi-modal models and techniques at scale. Our mission is to build a stable...  ...hybrid role, you will report to a Technical Lead Manager. You Will Dive deep into...  ...exact work location, experience, relevant training and education, and skill level. Your recruiter... 
    Training
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  •  ...optimizations. Build large-scale, real-time...  ...SLOs. Design tight training and inference iteration...  ...RESPONSIBILITIES: Own and lead Voice AI product areas...  ...Kubernetes), service meshes, or distributed scheduling....  ...customer-facing engineering: pre-sales prototyping,... 
    Training
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...design, implement, and optimize software for training cutting-edge AI models. You will work...  ...to post-training optimization, and help scale models in a dynamic, remote-friendly...  ...track record in large-scale training and distributed infrastructure is essential. #J-18808-Ljbffr... 
    Training
    Remote job

    Jobzhr

    San Francisco, CA
    3 days ago
  • $117.2k - $313.7k

     ...ambition meets action. Tech meets trust. And innovation...  ...career at the company leading workforce...  ...future of Salesforce. Distributed Systems Software Engineer...  ...and maintaining a large scale distributed systems engineering...  ..., promotion, benefits, training, assessment of job... 
    Training

    Salesforce

    San Francisco, CA
    2 days ago
  • $216k - $270k

     ...to this new reality, leading platform companies are...  ...build LLMs at billion scale, while large enterprises...  ...(RLHF) during pre-training, fine-tuning, and production...  ...governments, and large tech companies.You will:Drive...  ...deep understanding of distributed systems and public... 
    Training
    Full time
    Live in

    Scale AI

    San Francisco, CA
    1 day ago
  • $190k - $300k

     ...knowledge into specialized AI at scale. The AI landscape has gone...  ...Snorkeler! As an Applied AI Engineer (Pre-Sales), you will partner...  ...-sales engagements. You will lead technical discovery and solution...  ..., and relevant education or training. Locations New York; San Francisco... 
    Training
    Remote work

    Equinox

    San Francisco, CA
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Tech Lead, Distributed Pre-Training Evals & Scale. Be the first to apply!