Staff, Model Evaluations & Behavioral Metrics (Equity)
$200k - $400kSimile
Simile is seeking a Member of Technical Staff, Model Evaluations, to develop measurement systems that gauge the accuracy of simulations of human behavior. You will design evaluation metrics and collaborate with modeling teams to ensure models are effective. Ideal candidates possess strong statistical judgement, familiarity with LLMs, and the ability to automate evaluation workflows. The role offers a salary range of $200,000 – $400,000 USD along with equity and comprehensive benefits. #J-18808-Ljbffr Simile
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff, Model Evaluations & Behavioral Metrics (Equity) in San Francisco, CA vacancy
$245k - $310k
Product Manager, Model Behavior San Francisco, CA. About the Team The... ...methodologies, tools, and processes for evaluating, tuning, and iterating on... ...on clear, actionable metrics that accurately reflect... ...Compensation $245K - $310K • Offers Equity The base pay offered may...Employment EquityWork at officeRelocation package$136.44k - $265.11k
...data, and run AI agents and models directly in their workflows.... ...here.You’ll build the datasets, evaluations, and systems that help close... ...reliably distinguish strong model behavior.QUALIFICATIONS2+ years at the... ...benefits program including equity, health, dental, vision, 401(...Employment EquityWork at officeLocal areaMonday to FridayShift work- Job Description - Member of Technical Staff (Language Model Evaluations) Location: San Francisco (preferred), Sydney, Melbourne, Brisbane About Artificial... ..., and the strategy as we scale. Competitive compensation including equity 1 #J-18808-Ljbffr Artificial Analysis, Inc.Employment Equity
$98k - $140k
...behave through context engineering, designing evaluation systems, and analyzing data. This team... .... As part of that you'll shape Notion's model strategy and work directly with frontier... ...providing highly competitive cash compensation, equity, and benefits. The compensation offered...Employment EquityLive inLocal area- OpenAI is seeking a Product Manager for the Model Behavior team in San Francisco. In this role, you will define strategic priorities and guide... ...offers a hybrid work model with competitive compensation, equity options, and a comprehensive benefits package including medical...Employment Equity
- Artificial Analysis is seeking a Member of Technical Staff to design frontier evaluations for language models and publish results used by AI labs and enterprises... ...flexible to other major cities, this role offers equity and the opportunity to shape how industry measures...Employment EquityWorldwideFlexible hours
$163.64k - $336.9k
...is looking for a Sr. Staff Quantitative Product... ...contributing to metrics work, but guiding it... ...DS and Eng to build behavioral proxies or predictive models where they're needed... ...this work into how we evaluate and maintain the systems... ...also eligible for equity. Final salary is...Employment EquityWork at officeLocal areaRemote workRelocation package$180k - $320k
...doesn’t start with the model, it starts with the... ...improve model training, evaluation, and performance. You... ...datasets across targeted behaviors, domains, and edge... ...evaluation, including defining metrics and using empirical... ...offers also include equity in the form of...Employment EquityLocal area- ...training pipeline behind the models that power both Parallel’s search... ...training data, fine‑tune and evaluate these models rigorously, and... ..., retrieval, and agent behavior inform one another, and how to... ...Competitive salary Generous equity Visa sponsorships 401K plans...Employment EquityWork at officeVisa sponsorship
$305k
...Manager on Claude Code's model performance team, you... ...capabilities to define target behaviors and influence model... ...engineering, and evaluation methodology Are a systems... ...Currently, we expect all staff to be in one of our... ...and benefits, optional equity donation matching, generous...Employment EquityWork at officeVisa sponsorshipFlexible hours$204k - $259k
...Driver. The Simulator Evaluation team faces the... ...Engineer to build the metrics and systems that... ...or foundation models—provide a trustworthy... ...to a Senior Staff Software Engineering... ...based modeling and behavioral logic. Experience... ...annual bonus program, equity incentive plan,...Employment EquityFull timeRemote workWaymo
San Francisco, CA7 hours ago$175k - $215k
...hybrid role, you will report to a Senior Staff Test Engineer, Driving Behaviors. You will: Develop metrics and models to evaluate and enhance the performance, safety and... ...Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company...Employment EquityFull timeRemote workWaymo
San Francisco, CA7 hours ago- ...and out of the office. As a Staff Sensor Lead, Emerging Technologies... ...that unlock high-fidelity metrics, improve activity and gesture... ...motion sensor performance evaluation.Analyze sensor data to diagnose... ...offer:Competitive salary and equity packagesHealth, dental, vision...Employment EquityTemporary workWork at officeLocal areaRemote workFlexible hours
$218.5k - $288k
...Scientist specializing in Small Language Models and AI Training, you will lead research and... ...language models.Design, implement, and evaluate model training experiments to improve performance... ...00.00 to $288,000.00, plus a competitive equity package. Actual compensation is based on...Employment EquityWork at officeFlexible hours3 days per week$170k - $216k
...from large scale real-world data, to (2) develop models and model training at scale, to (3) analyze real-world behavior and develop systems for handling the... ...in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program...Employment EquityFull timeRemote workWaymo
San Francisco, CA7 hours ago$251k - $310k
...for the Waymo Driver’s behavior. We are the software... ...loss functions for ML models Quickly prototype ideas... ..., simulation, and evaluation Mentor engineers in... ...workflows and building metrics for ML models Proficiency... ...annual bonus program, equity incentive plan, and...Employment EquityFull timeRemote workWaymo
San Francisco, CA7 hours ago- ...We’re developing open weight models for individuals, agents, enterprises... .... That means defining the evaluation frameworks, building the... ...engineers on topics like model behavior, evaluation design, data... ...tier compensation: Salary and equity structured to recognize and retain...Employment EquityFull timeRelocation package
$150k - $250k
...build AI systems using Evaluation-Driven Development—an... ...improving, and trusting AI behavior in production.AI... ...design, agent logic, model selection, and release... ...pitfalls of overfitting to metrics that don’t reflect... ...eligible for meaningful equity, along with a...Employment EquityWork at office3 days per week$300k - $320k
...Program Manager to lead our AI model evaluation initiatives across multiple... ...to build new processes, align metrics with policy, and track... ...policy: Currently, we expect all staff to be in one of our offices at... ...consists of three elements: salary, equity, and benefits. We are...Employment EquityWork at officeHome officeVisa sponsorshipRelocation package- ...the frontier of AI to bring cutting-edge models into production. We're growing quickly and... ...reuse. Instrument deep observability (metrics, traces, logs) and build repeatable... ...Competitive compensation, including meaningful equity. ~100% coverage of medical, dental, and...Employment EquityFull timeFlexible hours
Baseten
San Francisco, CA7 hours ago $298k - $368k
...from large scale real-world data, to (2) develop models and model training at scale, to (3) analyze real-world behavior and develop systems for handling the... ...in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program...Employment EquityFull timeRemote workWaymo
San Francisco, CA7 hours ago- ...and a rapidly growing platform. You will define how frontier AI models are measured, design new benchmarks, run experiments, and publish... ...gold standards. We sponsor visas and relocation; compensation is competitive with meaningful equity. #J-18808-Ljbffr IntelligenceEmployment EquityRelocationVisa sponsorship
$196k - $230k
...define and scale how we evaluate Notion’s AI-powered... ...looks like not only for model output quality, but for... ..., and failure/recovery behaviors, then translate those insights... ..., and observable metrics.AI fluency and systems... ...competitive cash compensation, equity, and benefits. The...Employment EquityLocal areaShift work$172.43k - $230.95k
...:The Senior Software Engineer for the AI Model Lifecycle team will play a crucial role in... ...management: versioning, lineage, evaluation, and reproducible fine-tuning at scale.What... ...education, and abilities, as well as internal equity and alignment with market data.Crusoe is...Employment EquityTemporary work- ...office. We're looking for a Staff UX Researcher to join our Design... ...research across generative, evaluative, and strategic studies to... ...meaningful work translating behavioral or usage data into qualitative... ...work location, internal peer equity, and market conditions. These...Employment EquityWork at officeLocal areaRemote work
$164.7k - $339.08k
...for the ML platform that powers how Pinterest trains, evaluates, deploys, and measures content safety models at scale. You'll lead the development of ML Signal... ...for this position. The position is also eligible for equity. Final salary is based on a number of factors...Employment EquityWork at officeLocal areaRemote workRelocation package- Cincinnatus LLC is placing finance SMEs at a leading AI lab to critically evaluate AI model outputs for financial tasks. The role focuses on rigorous, rubric-based assessment of model performance and constructing finance-focused evaluation frameworks. Candidates should...Weekday work
$139.73k - $209.59k
# Staff Product SpecialistSan Francisco, California... ...governance workflows, model oversight, AI policy management... .... Establish success metrics that connect product... ...generative AI, LLMs, AI agents, evaluation frameworks, and... ...discretionary bonuses, equity, and/or commissions, as...Employment EquityWork experience placementWork at officeLocal areaWorldwideFlexible hours3 days per week1 day per week$168k - $227k
...seeking two exceptional Staff Customer Experience... ...employer and employee behaviors, pain points, and goals... ...VOC data, operational metrics, and journey insights into... ...augmented workflows Role model change management best... ...eligible for a cash bonus, equity rewards and benefits,...Employment EquityFixed term contract$220k - $320k
...( trains and hosts specialized language models for companies that need frontier-quality... ...everything end-to-end: distillation, training, evaluation, and planet-scale hosting. We are a... ...We offer competitive compensation, equity in a high-growth startup, and comprehensive...Employment EquityWork at officeInference
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff, Model Evaluations & Behavioral Metrics (Equity). Be the first to apply!
Related searches
- investment intern (private equity) San Francisco, CA
- equity research associate San Francisco, CA
- equity inclusion San Francisco, CA
- diversity equity San Francisco, CA
- diversity equity inclusion San Francisco, CA
- private equity associate San Francisco, CA
- private equity internship summer San Francisco, CA
- private equity intern San Francisco, CA
- equity fund manager San Francisco, CA
- hedge fund private equity tax manager San Francisco, CA