Staff, Model Evaluations & Behavioral Metrics (Equity)
$200k - $400kSimile
Simile is seeking a Member of Technical Staff, Model Evaluations, to develop measurement systems that gauge the accuracy of simulations of human behavior. You will design evaluation metrics and collaborate with modeling teams to ensure models are effective. Ideal candidates possess strong statistical judgement, familiarity with LLMs, and the ability to automate evaluation workflows. The role offers a salary range of $200,000 – $400,000 USD along with equity and comprehensive benefits. #J-18808-Ljbffr Simile
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff, Model Evaluations & Behavioral Metrics (Equity) in San Francisco, CA vacancy
$245k - $310k
Product Manager, Model Behavior San Francisco, CA. About the Team The... ...methodologies, tools, and processes for evaluating, tuning, and iterating on... ...on clear, actionable metrics that accurately reflect... ...Compensation $245K - $310K • Offers Equity The base pay offered may...Employment EquityWork at officeRelocation package$350k
...company and training our own models end-to-end. Our work spans areas... ...engineer to build the evaluation infrastructure that tells us... ...and tooling that measure model behavior across capabilities. Some example... ...500,000 USD and a meaningful equity grant, depending on...Employment Equity$238k - $302k
...simulation across 15+ U.S. states. The Large Model Evaluation team is at the nexus of Waymo’s AI... .... You will: Develop novel metrics and sampling techniques to measure the... ...’s discretionary annual bonus program, equity incentive plan, and generous Company benefits...Employment EquityFull timeRemote workWaymo
San Francisco, CA1 day ago$98k - $140k
...behave through context engineering, designing evaluation systems, and analyzing data. This team... .... As part of that you'll shape Notion's model strategy and work directly with frontier... ...providing highly competitive cash compensation, equity, and benefits. The compensation offered...Employment EquityLive inLocal area$281k - $356k
...ensure that we can continue to evaluate safety and service quality... ...you will report to a Senior Staff manager. You will: Develop... ...to get strong signal for metrics and models from our datasets Build automation... ...annual bonus program, equity incentive plan, and generous...Employment EquityFull timeWork experience placementRemote work- ...industry leaders. The Opportunity Language model evaluation is the sharpest question in AI: what can... ...uses. We’re hiring Members of Technical Staff to build the next generation of them.... ...scale. Competitive compensation including equity Interested in this role? #J-18808-Ljbffr...Employment Equity
- OpenAI is seeking a Product Manager for the Model Behavior team in San Francisco. In this role, you will define strategic priorities and guide... ...offers a hybrid work model with competitive compensation, equity options, and a comprehensive benefits package including medical...Employment Equity
- ...Intelligence is the open platform for evaluating how AI models perform in the real world.... ...to evaluate AI model behavior across reasoning, style,... ...dimensions Develop new metrics, methodologies, and evaluation... ...compensation and equity aligned to the markets where...Employment EquityPermanent employmentWork at office
$163.64k - $336.9k
...is looking for a Sr. Staff Quantitative Product... ...contributing to metrics work, but guiding it... ...DS and Eng to build behavioral proxies or predictive models where they're needed... ...this work into how we evaluate and maintain the systems... ...also eligible for equity. Final salary is...Employment EquityWork at officeLocal areaRemote workRelocation package$107k - $194k
...solutions and a broad range of equity, fixed income, and multi-... ...matter to you. Role Summary The Model Portfolio landscape is one of... ...adopt recommended solutions. Evaluates the strategic potential of... ...and apply highly complex key metrics in advising clients. Applies...Employment EquityFull timeContract workLocal areaRemote workWork from home1 day per week- ...training pipeline behind the models that power both Parallel’s search... ...training data, fine‑tune and evaluate these models rigorously, and... ..., retrieval, and agent behavior inform one another, and how to... ...Competitive salary Generous equity Visa sponsorships 401K plans...Employment EquityWork at officeVisa sponsorship
- ...team, you will use data to shape how AI behaves, work with partners in leading labs, and ensure user satisfaction through effective evaluation baselines. Competitive salary and benefits offered, with a focus on collaboration and quality improvement. #J-18808-Ljbffr Notion
$305k
...Manager on Claude Code's model performance team, you... ...capabilities to define target behaviors and influence model... ...engineering, and evaluation methodology Are a systems... ...Currently, we expect all staff to be in one of our... ...and benefits, optional equity donation matching, generous...Employment EquityWork at officeVisa sponsorshipFlexible hours- About the Role We're hiring software engineers for the Model Behavior team to help shape how Perplexity’s AI products behave: the style... ...working across teams or with external partners. Experience designing evaluations or benchmarks for AI systems. #J-18808-Ljbffr Doist
$175k - $215k
...hybrid role, you will report to a Senior Staff Test Engineer, Driving Behaviors. You will: Develop metrics and models to evaluate and enhance the performance, safety and... ...Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company...Employment EquityFull timeRemote workWaymo
San Francisco, CA1 day ago- ...and out of the office. As a Staff Sensor Lead, Emerging Technologies... ...that unlock high-fidelity metrics, improve activity and gesture... ...motion sensor performance evaluation.Analyze sensor data to diagnose... ...offer:Competitive salary and equity packagesHealth, dental, vision...Employment EquityTemporary workWork at officeLocal areaRemote workFlexible hours
$170k - $216k
...from large scale real-world data, to (2) develop models and model training at scale, to (3) analyze real-world behavior and develop systems for handling the... ...in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program...Employment EquityFull timeRemote workWaymo
San Francisco, CA1 day ago$218.5k - $288k
...Scientist specializing in Small Language Models and AI Training, you will lead research and... ...language models.Design, implement, and evaluate model training experiments to improve performance... ...00.00 to $288,000.00, plus a competitive equity package. Actual compensation is based on...Employment EquityWork at officeFlexible hours3 days per week$172.5k - $260.1k
...RoleSlack is seeking a Staff Business Intelligence Architect... ...performance, and evaluate business opportunities.... ...maintain trusted data models that support... ...and standardize business metrics to ensure consistent measurement... ...compensation, equity, and benefits. Salesforce...Employment EquityFull time- ...We’re developing open weight models for individuals, agents, enterprises... .... That means defining the evaluation frameworks, building the... ...engineers on topics like model behavior, evaluation design, data... ...tier compensation: Salary and equity structured to recognize and retain...Employment EquityFull timeRelocation package
$150k - $250k
...build AI systems using Evaluation-Driven Development—an... ...improving, and trusting AI behavior in production.AI... ...design, agent logic, model selection, and release... ...pitfalls of overfitting to metrics that don’t reflect... ...eligible for meaningful equity, along with a...Employment EquityWork at office3 days per week- ...the frontier of AI to bring cutting-edge models into production. We're growing quickly and... ...reuse. Instrument deep observability (metrics, traces, logs) and build repeatable... ...Competitive compensation, including meaningful equity. ~100% coverage of medical, dental, and...Employment EquityFull timeFlexible hours
Baseten
San Francisco, CA1 day ago $298k - $368k
...from large scale real-world data, to (2) develop models and model training at scale, to (3) analyze real-world behavior and develop systems for handling the... ...in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program...Employment EquityFull timeRemote workWaymo
San Francisco, CA1 day ago- ...and a rapidly growing platform. You will define how frontier AI models are measured, design new benchmarks, run experiments, and publish... ...gold standards. We sponsor visas and relocation; compensation is competitive with meaningful equity. #J-18808-Ljbffr IntelligenceEmployment EquityRelocationVisa sponsorship
$196k - $230k
...define and scale how we evaluate Notion’s AI-powered... ...looks like not only for model output quality, but for... ..., and failure/recovery behaviors, then translate those insights... ..., and observable metrics.AI fluency and systems... ...competitive cash compensation, equity, and benefits. The...Employment EquityLocal areaShift work- ...office. We're looking for a Staff UX Researcher to join our Design... ...research across generative, evaluative, and strategic studies to... ...meaningful work translating behavioral or usage data into qualitative... ...work location, internal peer equity, and market conditions. These...Employment EquityWork at officeLocal areaRemote work
$172.43k - $230.95k
...:The Senior Software Engineer for the AI Model Lifecycle team will play a crucial role in... ...management: versioning, lineage, evaluation, and reproducible fine-tuning at scale.What... ...education, and abilities, as well as internal equity and alignment with market data.Crusoe is...Employment EquityTemporary work$164.7k - $339.08k
...for the ML platform that powers how Pinterest trains, evaluates, deploys, and measures content safety models at scale. You'll lead the development of ML Signal... ...for this position. The position is also eligible for equity. Final salary is based on a number of factors...Employment EquityWork at officeLocal areaRemote workRelocation package$126k - $201k
...Engineer to support and scale efforts for our Behavior Planning Team. In this role, you will... ...software for the Aurora Driver Design metric suites and testing workflows for rapid... ...also be eligible for an annual bonus, equity compensation, and benefits. #LI-JL261...Employment EquityFull timeAurora Innovation
San Francisco, CA1 day ago$139.73k - $209.59k
...Challenge We’re looking for a Staff Product Specialist with... ...governance workflows, model oversight, AI policy... .... Establish success metrics that connect product investments... ...AI, LLMs, AI agents, evaluation frameworks, and... ...discretionary bonuses, equity, and/or commissions, as...Employment EquityWork experience placementWork at officeLocal areaWorldwideFlexible hours3 days per week1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff, Model Evaluations & Behavioral Metrics (Equity). Be the first to apply!
Related searches
- diversity equity inclusion San Francisco, CA
- private equity accountant San Francisco, CA
- equity bank San Francisco, CA
- diversity equity San Francisco, CA
- equity specialist San Francisco, CA
- equity sales San Francisco, CA
- equity portfolio manager San Francisco, CA
- hedge fund private equity tax manager San Francisco, CA
- director of equity and inclusion San Francisco, CA
- director private equity San Francisco, CA