Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff — Research Engineering, Evaluation

Causal Labs

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it. To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather. Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN. We look for research engineers who are excited to tackle unsolved problems. Progress is only as trustworthy as its measurement. As our model, data, and reasoning efforts multiply, every team needs to know, precisely and comparably, whether a change made the model better. Your mission is to build the central evaluation framework that the entire research organization runs on: the pipelines, the metrics, and the tools that turn results into shared understanding. Responsibilities Design and build a central, reusable evaluation framework that every model and every team runs through Implement evaluation pipelines, benchmark suites, and baselines that make model quality measurable and comparable across efforts Build the visualization and dashboard tools that turn raw results into shared, actionable understanding for the whole team Establish sound statistical methodology for evaluation, so teams can distinguish real improvements from noise Partner with research and domain teams to translate what "good" means in each domain into standardized, automated metrics What we\'re looking for We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains. Strong software engineering skills and experience building data or evaluation pipelines at scale Experience turning research or model outputs into metrics, benchmarks, and visualizations that teams rely on Solid grasp of probability and statistics, with the judgment to design evaluations that measure what they claim to Full-stack range: comfortable building both backend pipelines and the frontend tools people read results in Owns deliverables end-to-end, from collecting requirements to autonomously driving execution #J-18808-Ljbffr Causal Labs

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff — Research Engineering, Evaluation in San Francisco, CA vacancy
  • $180k - $290k

    Member of Technical Staff - Research Engineer About Black Forest Labs We're the team behind Latent Diffusion, Stable Diffusion, and FLUX—foundational technologies that changed how the world creates images and video. We’re creating the generative models that power how people... 
    Suggested
    Remote work
    Worldwide
    2 days per week

    BlackForestLabs

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...populated by generative agents based on real humans. Our research pioneered the field of AI-based simulation, proving...  ...D'Angelo, and Guillermo Rauch. About the Role As a Member of Technical Staff in Evaluations Engineering, you will build the systems that enable Simile to... 
    Suggested
    Flexible hours

    Simile

    San Francisco, CA
    2 days ago
  •  ...Github, Gmail, Notion, Salesforce, etc. We are a small team of engineers wrangling problems from context to search, that help us...  ...top of our agentic harness and app sandboxes Qualifications research you can independently execute against the research goals you... 
    Suggested

    Composio

    San Francisco, CA
    15 hours ago
  • About Polymath Polymathisan applied research lab focused on advancing long‑...  ...team. About the role We’re hiring a Member of Technical Staff - Engineering to build the infrastructure and systems...  ...makes it possible to train and evaluate autonomous agents in complex, realistic... 
    Suggested

    Polymath

    San Francisco, CA
    5 days ago
  • $125k - $200k

    Member of Technical Staff - Product Engineer Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on...  ...and most influential research in AI evaluation like FinanceBench , Lynx , SimpleSafetyTests... 
    Suggested
    Work at office

    Patronus AI, Inc.

    San Francisco, CA
    3 days ago
  •  ...architecting what comes next. We believe great talent powers great technology. The Liquid team is a community of world-class engineers, researchers, and builders creating the next generation of AI. Whether you're helping shape model architectures, scaling our dev... 

    Liquid AI

    San Francisco, CA
    2 days ago
  •  ...Mission Reflection is a research lab making...  ...model capabilities. As a member of the Data Team, your...  ...This role is ideal for engineers who love building distributed...  ...solving the unique technical challenges of collecting...  ...used in training and evaluating large language models... 
    Work at office
    Visa sponsorship

    Visa Hunt

    San Francisco, CA
    2 days ago
  • $200k - $400k

     ...agents based on real humans. Our research pioneered the field of AI-based simulation...  ...Rauch. About the Role As a Member of Technical Staff, Model Evaluations at Simile, you will build the...  ...evaluation, model training, and research engineering. Others may bring exceptional... 
    Flexible hours

    Simile

    San Francisco, CA
    15 hours ago
  •  ...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate...  ...Germany and Paris. Join us! Why this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    San Francisco, CA
    5 days ago
  •  ...Location Type On-site Department Engineering Our Mission Reflection’s...  ...states. Our team of AI researchers and company builders come from...  ...but from better data. As a member of the Data Team, your mission...  ...Run experiments to evaluate crawling strategies, extraction... 
    Full time
    Relocation package

    B Capital

    San Francisco, CA
    5 days ago
  • Member of Technical Staff - Applied AI Engineer Valthos | Posted Mar 3 Full-time Negotiable Advanced (5-10 yrs)...  ...and executing on the Valthos-wide research and development roadmap Develop,...  ...Develop, build, and apply evaluation frameworks to rigorously assess model... 
    Full time
    Work at office

    Valthos

    San Francisco, CA
    2 days ago
  • $150k - $250k

     ...Product Hunt), Charlie Songhurst (Board Member, Meta), and Michael Jones (Former...  ...United Nations, UChicago, and Oxford engineers and researchers. Our omnichannel agents are supporting...  ...custom performance and quality evaluations for our agents Minimum Qualifications... 
    Full time
    Internship
    Worldwide

    Krew

    San Francisco, CA
    10 days ago
  • Job Description - Member Of Technical Staff (Language Model Evaluations) Location: San Francisco (preferred), Sydney,...  ...benchmarking company. We support labs, engineers and enterprises to understand AI...  ..., working directly with their research teams; our commercial team owns... 

    Artificial Analysis

    San Francisco, CA
    4 days ago
  •  ...Perplexity is seeking experienced ML engineers to design, build, and...  ...user. Build the data and evaluation foundations that let these...  ...with usage. Help shape the technical direction of ranking,...  ...constantly learn outside of it. Research is essential to them and never... 
    Full time

    Perplexity®️

    San Francisco, CA
    1 day ago
  • $60k - $240k

    Member of Technical Staff - Data Quality Engineer (Pre-training) Join to apply for the Member of Technical Staff -...  ...even nation states. Our team of AI researchers and company builders come from...  ...data pipelines, QA systems, or evaluation workflows for pre‑training data... 
    Relocation package

    Reflection AI

    San Francisco, CA
    2 days ago
  • Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build...  ...to all. Role Overview Reflection AI is looking for a Member of Technical Staff - IT Engineer. In this role, you’ll be expected to manage a broad... 
    Work at office
    Visa sponsorship

    Reflection

    San Francisco, CA
    4 days ago
  • $300 per month

     ...team run by scientists and engineers from leading institutions across...  ..., tool integrations, and evaluation frameworks. Develop reusable...  ...field insights and internal research into product direction –...  ...Data Science, or a related technical field. Proficiency in Python... 
    Full time
    Work at office

    Edison Scientific Inc.

    San Francisco, CA
    1 day ago
  • $240k - $295k

     ...mechanism. The real product is a scalable risk engine, our Stand World Model . We stay when...  ...engine designed to manage agents and evaluations at scale. This includes coordinating...  ...Experience partnering with an applied‑science or research team and shipping their work into a... 
    Full time
    Contract work
    Temporary work
    H1b
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours

    Stand Insurance

    San Francisco, CA
    4 days ago
  •  ...In-person collaboration. Join a lean, staff-level team (ex-Affirm, Uber, DoorDash,...  ...equity. About the Role We’re looking for a Member of Technical Staff to help reshape how the insurance...  ...services insurance. As a Product Engineer at Fulcrum, you’ll build and enhance our... 
    Work at office
    Immediate start
    Relocation

    Fulcrum, Inc.

    San Francisco, CA
    2 days ago
  • $225k - $275k

     ...friction shows up as a tax on every researcher trying to build something ambitious....  ...AMD. We're looking for researchers, engineers and organizations who agree with the...  ...do with it though, so we're hiring a Member of Technical Staff for Product Engineering to own the surface... 
    16 hours
    Full time
    Live in
    Work at office
    Relocation package
    Night shift

    San Francisco Tensor Company

    San Francisco, CA
    4 days ago
  • $150k - $275k

     ...lease origination. We're building a better system to evaluate consumers consistently and fairly. We prevent...  .... Role overview Two Dots is looking for Software Engineers of varying experience levels (new grads to staff), to help build out our platform to serve more customers... 

    Two Dots

    San Francisco, CA
    3 days ago
  • $104.6k - $154.5k

    Member of Technical Staff: Product Engineer (0652) Job #88104 - BIDS At the University of California, Berkeley...  ...advancing interdisciplinary data science research, academic training, and software...  ...that require an in-depth evaluation of cutting edge data science and AI... 
    Full time
    Traineeship
    Work at office

    University of California

    Berkeley, CA
    2 days ago
  •  ...engagement, working directly with the engineer who leads our embedded...  ...and turn them into trained, evaluated, production-ready model...  ...: You can explain something technical you built from first principles...  ...autonomous vehicle, or defense research labs. What Success Looks... 
    Full time
    Internship
    Shift work

    Liquid Ai Inc

    San Francisco, CA
    1 day ago
  • $200k - $300k

    Member of Technical Staff - Agent Engineer About Phylo Phylo is an applied research lab building agentic intelligence to accelerate discovery for every biomedical scientist...  ...production experience in AI agents to build and evaluate systems that make our agents capable,... 
    Work at office

    Phylo

    South San Francisco, CA
    5 days ago
  • $150k - $250k

     ...from C to Safe Rust. Our team has published award-winning AI research and is backed by top-tier investors including Eric Schmidt,...  ...make agents work, from data processing, training, inference, evaluation, to other components. You work closely with research and product... 
    Work at office
    Flexible hours

    Asari AI

    San Francisco, CA
    8 days ago
  • About Us Radical Numerics is an AI research lab building general biological intelligence...  ...also lowers the barrier to creating engineered threats and AI‑generated bioweapons....  ...to defend. About the role As a Member of Technical Staff, ML Product Engineer, this role owns... 
    Local area

    Radical Numerics

    San Francisco, CA
    4 days ago
  • $285.55k

     ...METR We are a nonprofit research organization that...  ...We're Looking For The Evaluation Execution team at METR...  ...execution and software engineering skills. Research Execution...  ...and make sound technical decisions. You lead large...  ...Requirements Our technical team members are in our office in... 
    H1b
    Work at office
    Work from home
    Home office
    Relocation package
    3 days per week

    METR

    Berkeley, CA
    3 days ago
  •  ...hardware. This is a high-leverage engineering role at the center of the research loop, close to real robot...  .... Core Responsibilities Policy Evaluation: Build and maintain the pipelines...  ...professionals who combine world-class technical skills with creative vision, grounded... 
    Work from home
    Flexible hours

    Walden Robotics

    San Francisco, CA
    15 hours ago
  • Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build...  ...our understanding of model capabilities Build and refine evaluation systems and processes that create tight feedback loops between... 
    Work at office
    Visa sponsorship

    Visa Hunt

    San Francisco, CA
    5 days ago
  • $150k - $250k

     ...Product Hunt), Charlie Songhurst (Board Member, Meta), and Michael Jones (Former...  ...Nations, UChicago, and Oxford engineers and researchers. Our omnichannel agents are supporting...  ...’re looking for a (Human) Member of Technical Staff specializing in backend engineering.... 
    Full time
    Internship
    Worldwide

    Krew

    San Francisco, CA
    15 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff — Research Engineering, Evaluation. Be the first to apply!