Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff — Research Engineering, Evaluation

Causal Labs

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it. To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather. Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN. We look for research engineers who are excited to tackle unsolved problems. Progress is only as trustworthy as its measurement. As our model, data, and reasoning efforts multiply, every team needs to know, precisely and comparably, whether a change made the model better. Your mission is to build the central evaluation framework that the entire research organization runs on: the pipelines, the metrics, and the tools that turn results into shared understanding. Responsibilities Design and build a central, reusable evaluation framework that every model and every team runs through Implement evaluation pipelines, benchmark suites, and baselines that make model quality measurable and comparable across efforts Build the visualization and dashboard tools that turn raw results into shared, actionable understanding for the whole team Establish sound statistical methodology for evaluation, so teams can distinguish real improvements from noise Partner with research and domain teams to translate what "good" means in each domain into standardized, automated metrics What we\'re looking for We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains. Strong software engineering skills and experience building data or evaluation pipelines at scale Experience turning research or model outputs into metrics, benchmarks, and visualizations that teams rely on Solid grasp of probability and statistics, with the judgment to design evaluations that measure what they claim to Full-stack range: comfortable building both backend pipelines and the frontend tools people read results in Owns deliverables end-to-end, from collecting requirements to autonomously driving execution #J-18808-Ljbffr Causal Labs

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff — Research Engineering, Evaluation in San Francisco, CA vacancy
  • $175k - $300k

     ...lab developing simulation research and infrastructure to accelerate...  ...research in AI evaluation like FinanceBench , Lynx...  ...formerly AI researchers and engineers from companies like Meta AI...  ...Responsibilities As a Member of Technical Staff – Engineering at Patronus... 
    Suggested
    Full time
    Work at office

    Patronus AI, Inc.

    San Francisco, CA
    8 days ago
  • Backend Engineer We are looking for a Backend Engineer...  ...systems that ingest, evaluate, and serve agent behavior...  ...company direction and technical decisions High...  ...sponsorship As a founding member, you'll help define the...  ...NeoSigma is a product-driven research lab building the... 
    Suggested
    Visa sponsorship
    Flexible hours

    NeoSigma

    San Francisco, CA
    6 hours ago
  • $150k - $250k

     ...Product Hunt), Charlie Songhurst (Board Member, Meta), and Michael Jones (Former...  ...United Nations, UChicago, and Oxford engineers and researchers. Our omnichannel agents are supporting...  ...custom performance and quality evaluations for our agents Minimum Qualifications... 
    Suggested
    Full time
    Internship
    Worldwide

    Krew

    San Francisco, CA
    a month ago
  • Job Description - Member Of Technical Staff (Language Model Evaluations) Location: San Francisco (preferred), Sydney,...  ...benchmarking company. We support labs, engineers and enterprises to understand AI...  ..., working directly with their research teams; our commercial team owns... 
    Suggested

    Artificial Analysis

    San Francisco, CA
    1 day ago
  •  ...Perplexity is seeking experienced ML engineers to design, build, and...  ...user. Build the data and evaluation foundations that let these...  ...with usage. Help shape the technical direction of ranking,...  ...constantly learn outside of it. Research is essential to them and never... 
    Suggested
    Full time

    Perplexity®️

    San Francisco, CA
    more than 2 months ago
  •  ...companies, giving our team access to technical problems spanning frontier models, production...  ...hardware. About the role As a Member of Technical Staff, you will build the compiler...  ...and memory systems. This is compiler engineering at the boundary of ML systems and distributed... 

    Gimlet Labs

    San Francisco, CA
    1 day ago
  • $240k - $295k

     ...mechanism. The real product is a scalable risk engine, our Stand World Model . We stay when...  ...engine designed to manage agents and evaluations at scale. This includes coordinating...  ...Experience partnering with an applied‑science or research team and shipping their work into a... 
    Full time
    Contract work
    Temporary work
    H1b
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours

    Stand Insurance

    San Francisco, CA
    1 day ago
  • $300 per month

     ...team run by scientists and engineers from leading institutions across...  ..., tool integrations, and evaluation frameworks. Develop reusable...  ...field insights and internal research into product direction –...  ...Data Science, or a related technical field. Proficiency in Python... 
    Full time
    Work at office

    Edison Scientific Inc.

    San Francisco, CA
    a month ago
  • $104.6k - $154.5k

    Member of Technical Staff: Product Engineer (0652) Job #88104 - BIDS At the University of California, Berkeley...  ...advancing interdisciplinary data science research, academic training, and software...  ...that require an in-depth evaluation of cutting edge data science and AI... 
    Full time
    Traineeship
    Work at office

    University of California

    Berkeley, CA
    4 days ago
  • Member of Technical Staff - Agent Engineer About Phylo Phylo is an applied research lab building agentic intelligence to accelerate discovery for every biomedical scientist...  ...production experience in AI agents to build and evaluate systems that make our agents capable,... 
    Work at office

    Phylo, Inc.

    South San Francisco, CA
    3 days ago
  • $150k - $250k

     ...from C to Safe Rust. Our team has published award-winning AI research and is backed by top-tier investors including Eric Schmidt,...  ...make agents work, from data processing, training, inference, evaluation, to other components. You work closely with research and product... 
    Work at office
    Flexible hours

    Asari AI

    San Francisco, CA
    a month ago
  • $285.55k

     ...METR We are a nonprofit research organization that...  ...We're Looking For The Evaluation Execution team at METR...  ...execution and software engineering skills. Research Execution...  ...and make sound technical decisions. You lead large...  ...Requirements Our technical team members are in our office in... 
    H1b
    Work at office
    Work from home
    Home office
    Relocation package
    3 days per week

    METR

    Berkeley, CA
    16 hours ago
  • $328k - $402k

     ...METR We are a nonprofit research organization that develops...  ...internally and runs external evaluations.) Communicating results...  ...skills Software engineering. You're a strong engineer...  ...Hybrid Preferred: Our technical team members are in our office in Berkeley... 
    H1b
    Work at office
    Work from home
    Home office
    Relocation package
    Flexible hours
    3 days per week

    METR

    Berkeley, CA
    4 days ago
  • Member of Technical Staff: iOS Engineer (Ego) Location: San Francisco, CA (hybrid) Reports to: Founding team About The Role Ego AI is a YC-backed applied AI research lab building the behavioral infrastructure for AI companions and agents. We work at the intersection of... 

    ego AI (YC W24)

    San Francisco, CA
    3 days ago
  •  ...Product Hunt), Charlie Songhurst (Board Member, Meta), and Michael Jones (Former...  ...Nations, UChicago, and Oxford engineers and researchers. Our omnichannel agents are supporting...  ...’re looking for a (Human) Member of Technical Staff specializing in backend engineering.... 
    Full time
    Internship
    Worldwide

    Krew

    San Francisco, CA
    3 days ago
  •  ...the cutting edge, we blend frontier research with real-world execution. Alongside...  ...and SAIL About the Role As a Staff Frontend Engineer, you will own the frontend platform...  ...career, and you’re excited to set the technical direction for a brand-new platform. You... 
    Full time

    Cogent Security

    San Francisco, CA
    more than 2 months ago
  • $240k - $350k

     ...an ambitious team run by scientists and engineers from leading institutions across biology...  ...discovery. You will work on both cutting edge research and practical engineering, bridging...  ...with the capability to adapt to various technical challenges in the data, ML, and LLM... 
    Full time
    Work at office
    Flexible hours

    Edison Scientific Inc.

    San Francisco, CA
    a month ago
  • $200k - $275k

     ...Francisco, 5 days in office Own platform engineering, develop frontier long-horizon RL...  ...infrastructure to support customer usage at scale. Research and develop next-generation RL...  ...You should have Familiarity building evaluations, benchmarks, or RL for AI agents. Startup... 
    H1b
    Work at office
    Relocation
    Visa sponsorship

    Halluminate

    San Francisco, CA
    6 hours ago
  • $200k - $400k

    Infrastructure Engineer We are looking for an Infrastructure Engineer...  ...with Product Engineering, Research, and Security teams to build...  ...: Ability to write clear technical specs for both internal teams...  ...ensure a fair and thorough evaluation for all applicants, Simile observes... 
    Flexible hours

    Simile

    San Francisco, CA
    2 days ago
  •  ...Description Job Description Job Overview: Our client is seeking a highly skilled and motivated Member of Technical Staff to join our Platform Engineering team in our San Francisco office. As a member of this team, you will be responsible for developing and maintaining... 
    Permanent employment
    Full time
    Work at office

    Upcoresolutions

    San Francisco, CA
    11 days ago
  •  ...the future of recruiting with AI – and we need an exceptional engineer to join our founding team in our San Francisco hackerhouse. We...  ...fully agentic systems that automate complex workflows. It's technically challenging, fast-paced, and high-impact. Your Experience... 
    Full time

    Clera

    San Francisco, CA
    more than 2 months ago
  •  ...Member Of Technical Staff, Machine Learning Drug discovery is a prediction problem. Scientists design...  ...closely with chemists and software engineers to integrate models into our software...  ..., deep learning architectures, and evaluation approaches You are proficient in standard... 

    Inductive Bio

    San Francisco, CA
    16 hours ago
  • $227.5k - $401k

     ...Member of Technical Staff San Francisco This is Adyen Adyen provides...  ...Adyen, everything we do is engineered for ambition. We create an...  ...application of cutting-edge AI research within the financial...  ...Reasoning (DABStep), which evaluates AI agents on real-world data... 
    Work at office
    Immediate start
    Relocation
    Flexible hours

    Adyen

    San Francisco, CA
    3 days ago
  • $130k - $220k

     ...them hire. Title of Role: Member of Technical Staff (AI Benchmarking)...  ...most important independent evaluators of frontier AI systems....  ...widely used by enterprises, researchers, investors, and policymakers...  ...solutions Collaborate with engineers to improve benchmarking infrastructure... 
    Work at office
    Remote work
    Visa sponsorship
    Relocation package

    Recruiting from Scratch

    San Francisco, CA
    16 hours ago
  •  ...Member of Technical Staff @ Lotus AI Who we are Lotus AI is a groundbreaking...  ...includes ex-founders and engineers who have built and scaled...  ...high-quality training and evaluation datasets from clinical...  ...engineers, clinicians, and AI researchers to build something with... 

    Lotus Health AI, Inc

    San Francisco, CA
    1 day ago
  • $140k - $200k

     ...Member Of Technical Staff San Francisco Bay Area Shape The Future Of Ai...  ...breakthrough AI models at leading research labs and enterprises....  ...on during training and evaluation, the terminals, browsers,...  ...inside. This is a hands-on engineering role. You'll write... 
    Immediate start
    Flexible hours

    Labelbox

    San Francisco, CA
    4 days ago
  • $150k - $200k

     ...funded team, moving fast. The Role Our runtime team builds the engine. Our infrastructure team makes it scale. You decide what it...  ...maintainership with a reputation for good DX, developer advocacy or technical writing experience, experience building with AI agents or LLM... 
    Immediate start

    Runta

    San Francisco, CA
    3 days ago
  •  ...The role As a Member of Technical Staff at Sainapse, you will build the shared platform that turns...  ...what to build; Forward Deployed Engineers own scoped customer POCs, implementation...  ...and tool frameworks, permissions, evaluations, and deployment primitives. Build... 
    Full time
    Visa sponsorship

    Sainapse Inc

    San Francisco, CA
    4 days ago
  • Product Engineer Valthos Inc. Valthos is an applied biological intelligence company. We build and deploy software and biological AI...  ...early-stage company where product direction, customer needs, and technical constraints are still evolving. Respect for users operating... 
    Work at office

    Valthos

    San Francisco, CA
    4 days ago
  • $200k

     ...our form. We're hiring a member of technical staff to work closely with the...  ...shape both our products and research direction. Key Responsibilities: Backend engineering: Design and build scalable...  ...research, and create evaluations for agent performance and... 
    Immediate start

    Fulcrum

    San Francisco, CA
    16 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff — Research Engineering, Evaluation. Be the first to apply!