Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff — Research Engineering, Evaluation

Full-time

causal

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.

 

To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.

 

Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.

We look for research engineers who are excited to tackle unsolved problems. Progress is only as trustworthy as its measurement. As our model, data, and reasoning efforts multiply, every team needs to know, precisely and comparably, whether a change made the model better. Your mission is to build the central evaluation framework that the entire research organization runs on: the pipelines, the metrics, and the tools that turn results into shared understanding.

Responsibilities

  • Design and build a central, reusable evaluation framework that every model and every team runs through

  • Implement evaluation pipelines, benchmark suites, and baselines that make model quality measurable and comparable across efforts

  • Build the visualization and dashboard tools that turn raw results into shared, actionable understanding for the whole team

  • Establish sound statistical methodology for evaluation, so teams can distinguish real improvements from noise

  • Partner with research and domain teams to translate what "good" means in each domain into standardized, automated metrics

What we're looking for

We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.

  • Strong software engineering skills and experience building data or evaluation pipelines at scale

  • Experience turning research or model outputs into metrics, benchmarks, and visualizations that teams rely on

  • Solid grasp of probability and statistics, with the judgment to design evaluations that measure what they claim to

  • Full-stack range: comfortable building both backend pipelines and the frontend tools people read results in

  • Owns deliverables end-to-end, from collecting requirements to autonomously driving execution

Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff — Research Engineering, Evaluation in San Francisco, CA vacancy
  • $180k - $290k

     ...platforms. We're a small, fast growing research lab competing with the largest companies...  ...cleanly separated into “research” or “engineering.” A promising architecture only matters...  ...for this role. The common thread is deep technical ownership: you should be able to make... 
    Suggested
    Full time
    Work at office
    2 days per week

    Black Forest Labs

    San Francisco, CA
    4 days ago
  •  ...Preference Model is a superintelligence data research company. We build RL environments for...  ...for machine learning Research Engineers or Research Scientists to push the frontier...  ...directions. What You Will Do: Train and evaluate models on our proprietary RL... 
    Suggested
    Full time
    Visa sponsorship
    Relocation package

    Preference-Model

    San Francisco, CA
    1 hour ago
  •  ...Preference Model is a superintelligence data research company. We build RL environments for...  ...hiring experienced Machine Learning Engineers to design and build reinforcement...  ...environments, conducting experiments and evaluations, delivering your work into production training... 
    Suggested
    Visa sponsorship
    Relocation package

    Preference-Model

    San Francisco, CA
    3 hours ago
  •  ...fleet of affordable, durable robots. We're looking for a research engineer to help us train increasingly capable models across enormous...  ...representation learning, reinforcement learning, data processing, evaluation, and the infrastructure required to support all of it.... 
    Suggested
    Full time

    pantograph

    San Francisco, CA
    3 hours ago
  •  ...Mission Reflection is a research lab making...  ...capabilities. As a member of the Data Team, your...  ...This role is ideal for engineers who love building distributed...  ...and solving the unique technical challenges of collecting...  ...used in training and evaluating large language models... 
    Suggested
    Full time
    Work at office
    Visa sponsorship

    Reflection AI

    San Francisco, CA
    4 days ago
  •  ...About Anthrogen Anthrogen is engineering post-modality biology. Today's modalities reflect historical contingencies in biological...  ...systems that run at scale. · Work shoulder-to-shoulder with researchers, turning ideas into robust infrastructure. · Take hard, ambiguous... 
    Full time

    anthrogen

    San Francisco, CA
    3 hours ago
  •  ...giving our team access to technical problems spanning...  ...About the role As a Member of Technical Staff, Compiler, you will build...  ...them. This also includes evaluating and integrating agent-driven...  ...will work directly with engineers and researchers working on LLM architecture... 
    Full time

    gimlet

    San Francisco, CA
    3 hours ago
  •  ...Perplexity is seeking experienced ML engineers to design, build, and...  ...user. Build the data and evaluation foundations that let these...  ...with usage. Help shape the technical direction of ranking,...  ...constantly learn outside of it. Research is essential to them and never... 
    Full time

    Perplexity

    San Francisco, CA
    4 days ago
  •  ...intelligent systems to learn, evaluate, and interact within...  ...are looking for exceptional engineers to help build the simulation...  ...Role We're looking for a Member of Technical Staff – Simulation Engineer to build...  ..., machine learning, and research teams Nice to Have... 
    Full time

    Moonlake

    San Francisco, CA
    3 hours ago
  • $200k - $400k

     ...agents based on real humans. Our research pioneered the field of AI-based simulation...  .... About the Role As a Member of Technical Staff, Model Evaluations at Simile, you will help define...  ...and product evaluation, research engineering, and related fields. Your workstream... 
    Full time
    Flexible hours

    simile

    San Francisco, CA
    3 hours ago
  •  ...on their most consequential data, evaluation, and post-training challenges, building...  ...better. You will work alongside engineers, researchers, operators, and builders from...  ...system. The Role We are hiring a Member of Technical Staff to help build the data systems that... 
    Full time
    Work at office
    Flexible hours

    handshake

    San Francisco, CA
    3 hours ago
  •  ...Product Hunt), Charlie Songhurst (Board Member, Meta), and Michael Jones (Former...  ...United Nations, UChicago, and Oxford engineers and researchers. Our omnichannel agents are supporting...  ...custom performance and quality evaluations for our agents Minimum Qualifications... 
    Full time
    Internship
    Worldwide

    krew

    San Francisco, CA
    3 hours ago
  •  ...Job Description – Member of Technical Staff (Language Model Evaluations) Location: San Francisco, CA (on-site, 5...  ...benchmarking company. We support labs, engineers and enterprises to understand AI...  ..., working directly with their research teams; our commercial team owns... 
    Full time
    Work at office

    artificialanalysis

    San Francisco, CA
    3 hours ago
  •  ...high-impact former founders, ML engineers, roboticists, and data leads...  .... THE ROLE As a Member of Technical Staff, you will work directly with...  ...fluent : Deep understanding of evaluations, RL, and how LLMs and Agents work. Research-oriented — Able to read papers... 
    Full time

    abundant

    San Francisco, CA
    3 hours ago
  • $200k - $400k

     ...generative agents based on real humans. Our research pioneered the field of AI-based...  ...About the Role As a Product Engineer - Member of Technical Staff, you will be responsible for...  ...Policy: To ensure a fair and thorough evaluation for all applicants, Simile observes... 
    Full time
    Internship
    Flexible hours

    simile

    San Francisco, CA
    3 hours ago
  •  ...About the role We are hiring Members of Technical Staff across research, product and agents. We use one title...  ...spend a quarter building the evaluation harness that decides whether a bank...  ...day, the SDK and integrations their engineers use, and the data that connects all... 
    Live in
    Relocation package
    Flexible hours

    Harbor Inc

    San Francisco, CA
    5 days ago
  •  ...Mixedbread is an applied AI research and technology company building next...  ..., LLM-augmented retrieval, evaluation systems, agentic search, and high...  ...the role We are looking for a Member of Technical Staff to work across research, engineering, product, and customer-facing... 

    Mixedbread

    San Francisco, CA
    1 day ago
  • $2,000 per month

     ...anyone in the world. Job Summary We’re hiring Members of Technical Staff — the general research/engineering seat. If you have a seriously compelling research...  ...Run research bets on Build data: train, evaluate, ablate, and ship what works Design and train... 
    Work at office
    Relocation package

    Build AI

    San Francisco, CA
    12 hours ago
  •  ...About Polymath Polymath is an applied research lab focused on advancing long-horizon agent capabilities through reinforcement...  ...angels. About the role We’re hiring a Founding Member of Technical Staff - Engineering to build the systems that power our RL and contributor... 
    Full time
    Work at office

    polymath

    San Francisco, CA
    3 hours ago
  •  ...Kinetic Systems is a healthcare AI research lab. We partner with frontier labs and healthcare organizations to help make...  ..., and other great investors.   The Role As a Member of Technical Staff (Engineering) , you’ll be closely involved in all aspects of engineering... 
    Full time

    kineticsystems

    San Francisco, CA
    3 hours ago
  • $300k - $400k

     ...frontier AI R&D across scientific disciplines. We are building a frontier AI research company and training our own models end-to-end. The Role We are looking for a Security Engineer. You'll work across cloud infrastructure, ML systems, and product surfaces to... 
    Full time

    Mirendil

    San Francisco, CA
    4 days ago
  • $250k - $400k

     ...environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work,...  ...deployment signals into better data, evaluations, and more capable models....  ...'s products, platforms, and technical strategy. Explore new... 

    Turing

    San Francisco, CA
    20 days ago
  • $225k - $275k

     ...friction shows up as a tax on every researcher trying to build something ambitious....  ...AMD. We're looking for researchers, engineers and organizations who agree with the...  ...do with it though, so we're hiring a Member of Technical Staff for Product Engineering to own the surface... 
    16 hours
    Full time
    Live in
    Work at office
    Relocation package
    Night shift

    sf-tensor

    San Francisco, CA
    3 hours ago
  • $175k - $265k

     ...logistics. We're hiring Product Engineers to bridge the gap between...  ..., product decisions, and technical direction Help define what...  ...like at Pallet as an early team member Who You Are ~6+ years...  ...Generous salary and equity for all staff ~ 401k option; helping you... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Shift work

    Pallet

    San Francisco, CA
    2 hours ago
  •  ...the models can do six months before the world does. We are trusted by the best frontier model providers like OpenAI to rigorously evaluate the capabilities of state-of-the-art multimodal models across design, web dev, game dev, image, video, audio, slide generation,... 
    Relocation
    Visa sponsorship
    Flexible hours

    intelligence

    San Francisco, CA
    3 hours ago
  • $180k - $300k

     ...TL;DR: We're hiring engineers who can build a complex AI-native...  ...build next. What used to take research teams weeks per study, we do...  ...engagement. The bottleneck is evaluating those qualitative outputs....  ...together. You're highly technical. Most of our team started coding... 
    Full time
    Shift work

    listenlabs

    San Francisco, CA
    3 hours ago
  •  ...fast to do what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft....  ...pipelines for data processing, conduct data ablations to evaluate quality, and experiment with data mixtures to enhance model... 
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    San Francisco, CA
    7 days ago
  • $170k - $230k

     ...enterprises, AI startups, and the AI research community, including LG AI...  ...across Mithril's three core engineering areas — Consumption (the...  ...Francisco. We expect team members to primarily work from their...  .... All applicants are evaluated without regard to race, color... 
    Work at office
    Local area
    Flexible hours
    1 day per week

    Mithril

    San Francisco, CA
    2 hours ago
  • $197.3k - $313.7k

     ...efforts. Job Category Software Engineering Job Details About...  ...individual strengths of each team member while encouraging everyone on...  ...and reliably Critically evaluate code (human or AI-generated)...  ...Our Person If... ~ A related technical degree required ~3+ years... 
    Full time
    Work at office
    Flexible hours
    3 days per week

    Salesforce

    San Francisco, CA
    3 hours ago
  •  ...take a big swing at the most ambitious engineering challenge of our careers. Everyone working...  ...your experience, and share as much technical detail about Sail as you want to hear....  ...work with agents in a systematic way, and evaluate them clearly and objectively # Come... 
    Work at office

    sail

    San Francisco, CA
    3 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff — Research Engineering, Evaluation. Be the first to apply!