Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - Evaluations

Reflection

Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all . We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond. About The Role Conduct critical comparative analysis to advance our understanding of model capabilities Build and refine evaluation systems and processes that create tight feedback loops between data, evals, and model behavior Develop generalizable evaluation frameworks that capture what matters for reasoning, alignment, and usefulness Collaborate closely with pre‑training, post‑training, and applied teams to translate insights into model improvements Push the boundaries of what’s measurable, from synthetic evals to human feedback and real‑world interaction data About You Strong statistical analysis and experimental design skills to rigorously measure model improvements Familiarity with LLM evaluation methodologies: static benchmarks, human preference evals, and/or agentic tasks High agency and thrive in a fast‑paced startup environment; bias for impact over process Excited to work in a new frontier lab, defining how we measure and accelerate progress toward more capable models Collaborative, detail‑oriented, and motivated by building the feedback loops that make models truly improve What We Offer We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small, talent‑dense team. You will help define our future as a company, and help define the frontier of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top‑tier compensation: salary and equity structured to recognize and retain the best talent globally Health & wellness: comprehensive medical, dental, vision, life, and disability insurance Life & family: fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off‑sites and team celebrations #J-18808-Ljbffr Reflection

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - Evaluations in San Francisco, CA vacancy
  • $150k - $300k

     ...be working on advancing our ability to evaluate and serve models trained with our RL Lab...  ...systems into our RL training stack. Core Technical Responsibilities LLM Serving Multi‑tenant...  ...in open development and encourage team members to contribute to the broader AI community... 
    Suggested
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work

    Prime-Intellect

    San Francisco, CA
    2 days ago
  • $227.5k - $401k

     ...motivated individuals who tackle unique technical challenges at scale and solve them as...  ...financial technology sector. As a Member of Technical Staff, you will operate with a high degree...  ...Multi‑step Reasoning (DABStep), which evaluates AI agents on real‑world data analysis... 
    Suggested
    Work at office
    Immediate start
    Relocation
    Flexible hours

    Adyen

    San Francisco, CA
    2 days ago
  •  ...you won't just observe the cutting edge of AI, your work will define what cutting edge means. We're hiring Members of Technical Staff to design the evaluations that set the standard for how AI is measured, produce analysis that shapes how companies and the broader industry... 
    Suggested

    Artificial Analysis, Inc.

    San Francisco, CA
    1 day ago
  •  ...uses Shapes every single day, and everyone talks to users. Member of Technical Staff is the title we use for engineers who own hard problems...  ...React surfaces — feed, chat, profiles, and rooms Fine-tuning, evaluating, and routing across frontier models like Opus 4.7 and GPT... 
    Suggested

    Shapes

    San Francisco, CA
    3 days ago
  •  ...Member of Technical Staff, Product TL;DR: Listen teaches AI what people actually think and want. We're Sequoia-backed, raised $100M, and...  ...what McKinsey does for $1M per engagement. The bottleneck is evaluating those qualitative outputs. Once you have the eval, you can... 
    Suggested
    Flexible hours
    Shift work

    Listen Labs

    San Francisco, CA
    4 days ago
  •  ...Member Of Technical Staff We're looking for a member of technical staff to build and deploy production-grade AI systems. In this role, you...  ...powered systems into production environments Fine-tune, evaluate, and work with machine learning models in real-world applications... 

    ERAGON

    San Francisco, CA
    2 days ago
  •  ...Member Of Technical Staff @ Lotus AI Lotus AI is a groundbreaking primary care app that integrates your medical records, AI, and real doctors...  ...curation pipelines that produce high-quality training and evaluation datasets from clinical interactions. Voice and... 

    Lotus Health

    San Francisco, CA
    20 days ago
  •  ...improving models. This includes trajectory visualization, evaluation workflows, monitoring dashboards, and the core product interfaces...  ...core agent products. We’re building our team of founding Members of Technical Staff to design the frontier of continually learning systems.... 

    Trajectory

    San Francisco, CA
    2 days ago
  • $160k - $240k

    Full-time San Francisco · In person $160k - $240k + Equity Member of Technical Staff, Modeling About the Role You will build and evaluate the models that turn operational time-series into forecasts, ranked risk drivers, and auditable decisions. The work spans time-series... 
    Full time

    Reific

    San Francisco, CA
    2 days ago
  • $200k

     ...builds the internal platform that teams across Magic use to evaluate the performance of internal and external models. The team...  ...of many of the company's most important decisions. As a Member of Technical Staff on Evals, you will build both the platform and the evaluations... 
    Visa sponsorship
    Relocation package

    Magic

    San Francisco, CA
    4 days ago
  • About the Role As a Member of Technical Staff, Biosecurity at Radical Numerics, you will lead the design, evaluation, and deployment of biosecurity systems for biological foundation models. You will build evaluation frameworks, define safety architecture, and work with... 
    Local area

    Radical Numerics Inc.

    San Francisco, CA
    4 days ago
  •  ...great products. Join us on our mission and shape the future! Member of Technical Staff, Search Why this role? We are looking for talented...  ...datasets and optimize data pipelines for model training and evaluation. Work closely with the model serving team to ensure that... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    San Francisco, CA
    2 days ago
  • $185k - $255k

    Member of Technical Staff - Reinforcement Learning Optimized deploys AI agents into the most critical supply chains in the world: the operations...  ...and post-training: the reward models, training loops, and evaluations that turn raw model capability into reliable long-horizon... 

    Optimized, Inc.

    San Francisco, CA
    2 days ago
  • $300k

    Member of Technical Staff - RL Algorithms About V max V max is an applied research lab developing AI capable of open-ended learning. We are building...  ...and agentic settings. Establish empirical baselines and evaluation protocols for measuring sample efficiency, robustness,... 
    Work at office
    Local area
    Shift work

    Vmax

    San Francisco, CA
    4 days ago
  •  ...design and the responsibility to defend. About the Role As a Member of Technical Staff, Mechanistic Interpretability at Radical Numerics, you...  ...scientific insight into learning systems, improved model evaluations, and ultimately, mastery over the code of life. This role... 
    Local area

    Radical Numerics Inc.

    San Francisco, CA
    12 hours ago
  • As a Member of Technical Staff (MTS), you'll build production-grade systems that power continuous optimization loops for AI agents—from evaluation pipelines and data/trace infrastructure to APIs that deploy improved policies. This role is a blend of MLE + backend engineering... 

    VizopsAI

    San Francisco, CA
    3 days ago
  • Member of Technical Staff, ML Systems Mirendil Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration...  ...latency, throughput, cost) Developing data pipelines and evaluation tooling Deploying and maintaining reliable production... 

    Mirendil

    San Francisco, CA
    12 hours ago
  • $100k - $150k

    Founding Member of Technical Staff (Security) Location: San Francisco • Singapore • Hyderabad • London Engineering • Hybrid • Full-time We're...  ...work we've published in our blog. Create benchmarks to evaluate agent performance on real-world scenarios. Work closely with... 
    Full time
    For contractors
    Work at office

    Crane Venture Partners

    San Francisco, CA
    3 days ago
  •  ...knowledge and resources that strengthen the broader AI ecosystem. As a member of SII, you'll conduct original and impactful research on...  ...for security and privacy in AI-native products. Build security evaluation frameworks, benchmarks, and datasets to measure the... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    2 days ago
  •  ...useful agents, we need infrastructure that makes environment construction, experimentation, evaluation, and iteration feel like one seamless system. As a Member of Technical Staff, Infrastructure / DevOps, you will own the systems that make Plato's research and training... 

    Plato

    San Francisco, CA
    3 days ago
  • $130k - $200k

    Job Title Member of Technical Staff Salary $130k-200k+ + Equity Company Description SketchPro.ai is a venture-backed startup building the first...  ...3D geometry with architectural precision. Build robust evaluation harnesses and platform integrations to ensure agent outputs... 

    Jack & Jill

    San Francisco, CA
    1 day ago
  •  ...preference and judgment. That lets us evaluate models on what people actually care...  ...actually want. We’re a small, deeply technical team with people from Harvard, Berkeley...  ...Angel, BoxGroup and others. The Role Member of Technical Staff, Platform Engineer You’ll design,... 

    Arcada Labs Incorporated

    San Francisco, CA
    3 days ago
  • Member of Technical Staff - Applied Research Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress...  ...some of the earliest and most influential research in AI evaluation like FinanceBench , Lynx, SimpleSafetyTests ,... 

    Patronus AI, Inc.

    San Francisco, CA
    1 day ago
  •  ...both the power to design and the responsibility to defend. About the Role As a Member of Technical Staff, Post‑Training at Radical Numerics, you will develop the training and evaluation loops that shape biological world models after pretraining. You will work on the... 
    Local area

    Radical Numerics Inc.

    San Francisco, CA
    4 days ago
  • Job Description As a Member of Technical Staff (Research) at Trajectory, you will design and build the post‑training stack that lets our customers...  ...own end‑to‑end experiments across data, training, and evaluation: shaping telemetry into learnable signals, training and serving... 

    Trajectory

    San Francisco, CA
    1 day ago
  • The opportunity We are looking for a Member of Technical Staff with deep expertise in generative modelling to work at the interface between our...  ...in biology and understand the unique data challenges, evaluation paradigms and scientific workflows of biological modelling... 
    Flexible hours

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • $176k - $253k

    Senior Member of Technical Staff, AI Quality Harper is an AI-native commercial insurance company in San Francisco. We're not bolting AI onto insurance...  ..., voice, and submission packaging; every one needs to be evaluated, regression-tested, and monitored in production. You'll... 
    Permanent employment
    Work at office
    Relocation

    Harper Group

    San Francisco, CA
    2 days ago
  •  ...design and the responsibility to defend. About the Role As a Member of Technical Staff focused on statistical genetics, you will help us turn...  ...part data architect, part methods scientist, and part model evaluator. You will collaborate closely with AI engineers and... 
    Local area

    Radical Numerics Inc.

    San Francisco, CA
    12 hours ago
  •  ...benchmarks. This spans everything needed to evaluate LLMs at scale: Python libraries, a web...  ...code and architecture reviews for other members of the team Help establish engineering...  ...meets their needs Requirements Technical 2+ YOE: 2+ years of full-time experience... 
    Full time
    Work experience placement
    Relocation
    Relocation package
    Shift work

    PetsApp

    San Francisco, CA
    12 hours ago
  •  ...multiple levels for this role) Hands‑on experience with LLM evaluations and/or post‑training methods: How to design useful evals...  ...end‑to‑end What the job involves We are seeking a Member of Technical Staff, Evals & Post‑Training Product to help define how developers... 

    Fireworks AI

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - Evaluations. Be the first to apply!