Staff, Model Evaluations & Behavioral Metrics (Equity)
$200k - $400kSimile
Simile is seeking a Member of Technical Staff, Model Evaluations, to develop measurement systems that gauge the accuracy of simulations of human behavior. You will design evaluation metrics and collaborate with modeling teams to ensure models are effective. Ideal candidates possess strong statistical judgement, familiarity with LLMs, and the ability to automate evaluation workflows. The role offers a salary range of $200,000 – $400,000 USD along with equity and comprehensive benefits. #J-18808-Ljbffr Simile
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff, Model Evaluations & Behavioral Metrics (Equity) in San Francisco, CA vacancy
$245k - $310k
Product Manager, Model Behavior San Francisco, CA. About the Team The... ...methodologies, tools, and processes for evaluating, tuning, and iterating on... ...on clear, actionable metrics that accurately reflect... ...Compensation $245K - $310K • Offers Equity The base pay offered may...Employment EquityWork at officeRelocation package$180k - $270k
...defensible, and automated metrics that researchers and... ..., data pipelines, or evaluation harnesses that can run... ...at scale against live model checkpoints. Can... ...statistical results and model behaviors clearly to both... ...+ performance bonus + Equity. Comprehensive Benefits...Employment EquityFull timeWork at officeWorldwide$180k - $260k
...AI Compensation $180K - $260K • Offers Equity U.S. Benefits Full-time U.S. employees... ...listed above. Perplexity is looking for a Model Behavior Architect to help shape our answer... ...outputs through well-designed research and evaluation projects. These projects may be either...Employment EquityFull timeLocal area$281k - $356k
...ensure that we can continue to evaluate safety and service quality... ...you will report to a Senior Staff manager. You will: Develop... ...to get strong signal for metrics and models from our datasets Build automation... ...annual bonus program, equity incentive plan, and generous...Employment EquityFull timeWork experience placementRemote work$98k - $140k
...behave through context engineering, designing evaluation systems, and analyzing data. This team... .... As part of that you'll shape Notion's model strategy and work directly with frontier... ...providing highly competitive cash compensation, equity, and benefits. The compensation offered...Employment EquityLive inLocal area- OpenAI is seeking a Product Manager for the Model Behavior team in San Francisco. In this role, you will define strategic priorities and guide... ...offers a hybrid work model with competitive compensation, equity options, and a comprehensive benefits package including medical...Employment Equity
- Cartesia is looking for an Evaluations Lead to design frameworks that measure AI model interactions, focusing on understanding, naturalness, and adaptability in real-world settings. The role blends research, product, and infrastructure, requiring a candidate with a scientific...
$180k - $260k
A tech-focused investment firm in San Francisco is seeking a Model Behavior Architect to enhance their answer engine by collaborating with research, design, and engineering teams. Candidates should demonstrate a strong passion for AI, be familiar with Python, and possess...Full time- About the Role We’re looking for a Model Behavior Architect to help build the company’s AI products and evaluations. You’ll sit within our AI team and collaborate closely... ...Experience designing evaluations, benchmarks, or metrics for AI systems. Strong written and verbal...
- ...training pipeline behind the models that power both Parallel’s search... ...training data, fine‑tune and evaluate these models rigorously, and... ..., retrieval, and agent behavior inform one another, and how to... ...Competitive salary Generous equity Visa sponsorships 401K plans...Employment EquityWork at officeVisa sponsorship
- ...team, you will use data to shape how AI behaves, work with partners in leading labs, and ensure user satisfaction through effective evaluation baselines. Competitive salary and benefits offered, with a focus on collaboration and quality improvement. #J-18808-Ljbffr Notion
- ...of AI to bring cutting‑edge models into production. We’re growing... ...helping developers discover, evaluate, and select the right models... ...reliability: define success metrics, establish feedback loops, and... ...compensation, including meaningful equity. 100% coverage of medical,...Employment EquityFlexible hours
$204k - $259k
...Conduct applied foundation model research and development Design... ...experiments by training and evaluating large deep learning models Present... ...or PhD in deep learning in behavior and agent modeling or... ...discretionary annual bonus program, equity incentive plan, and generous...Employment EquityFull timeRemote work$315k
...Anthropic's production models undergo sophisticated post... ...model fine-tuning and evaluation Develop tools to... ...training pipelines and model behavior Help establish best... ...Currently, we expect all staff to be in one of our offices... ...and benefits, optional equity donation matching,...Employment EquityWork at officeVisa sponsorshipFlexible hours$240k - $300k
### Staff Economist#### San Francisco, California, United StatesStaff... ..., finance, and business behavior.You’ll partner with Content,... ...Experience analyzing markets and evaluating data from multiple sources to... ...on the position offered, equity and other forms of compensation...Employment EquityWork at officeRemote workWork from home3 days per weekBrex Inc.
San Francisco, CA4 days ago$301.75k - $355k
...This Role The Senior Director for the Model LifeCycle team will undertake a pivotal role... ...management: versioning, lineage, evaluation, and reproducible fine‑tuning at scale.... ...education, and abilities, as well as internal equity and alignment with market data. Crusoe...Employment EquityTemporary workCrusoe Energy Systems LLC
San Francisco, CA3 days ago- ...San Francisco is seeking an ML Eval Engineer to design evaluation benchmarks and improve model performance. This role involves working with unstructured... ...with the ML and engineering teams. You will develop metrics, conduct evaluations, and contribute to model enhancements...
- ...We’re developing open weight models for individuals, agents, enterprises... .... That means defining the evaluation frameworks, building the... ...engineers on topics like model behavior, evaluation design, data... ...tier compensation: Salary and equity structured to recognize and retain...Employment EquityFull timeRelocation package
$105.3k - $205.15k
...line determination, business model refinement, and changes to offering... ...right revenue model, price metric, price point, and packaging.... ...models that simulate customer behavior and project costs to complete... ...incentives in the form of a new hire equity award. State-Specific Notices...Employment EquityLocal areaWorldwide- Software Engineer (Model Evaluation & Benchmarking) About the Role We are hiring Engineers focused on AI Model Evaluation to build the systems... ...and detect regressions across versions. Develop evaluation metrics for realism, consistency, and performance. Integrate...
$250k
...conducting experiments to isolate the impact of various datasets on model behavior. Ideal candidates will have strong expertise in LLM training... ...position offers a total compensation of US$250K-$450K plus equity, making it an exciting opportunity in the AI field. #J-18808-...Employment Equity- About the Team The Personality & Model Behavior team, within OpenAI’s broader Personal AGI team conducts research on how to shape personalities... ...reward modeling, and reinforcement learning. Build robust evaluations and model training pipelines to facilitate our research....Full timeWork at officeRelocation package
$150k - $250k
...build AI systems using Evaluation‑Driven Development —an... ..., and trusting AI behavior in production. AI Evaluation... ...design, agent logic, model selection, and release... ...of overfitting to metrics that don’t reflect real... ...eligible for meaningful equity, along with a...Employment EquityWork at office3 days per week$230k - $284k
...Systems Engineering, Driving Behaviors. You Will Provide... ...analysis, and developing metrics to support system evaluation or improvement. Strong skills... ...leveraging machine learning models for system optimization or... ...annual bonus program, equity incentive plan, and generous...Employment Equity$220k - $320k
...net trains and hosts specialized language models for companies that need frontier‑quality... ...end‑to‑end: distillation, training, evaluation, and planet‑scale hosting. We are a well... ...Compensation We offer competitive compensation, equity in a high‑growth startup, and...Employment EquityWork at officeInference
San Francisco, CA5 days ago$140k - $190k
...alignment and verification of all behavioral system requirements at Waabi... ...and how to describe and evaluate them efficiently and effectively... ...with requirements and metrics for driving behavior evaluations... ...role, including discretionary equity incentive awards and discretionary...Employment EquityFull timeWork at officeWork from homeFlexible hours- ...seeking an Engineering Manager to lead the Model Library team. The role involves guiding a team through model discovery and evaluation, managing developer-facing products like... ...competitive compensation with meaningful equity and comprehensive health coverage, alongside...Employment EquityFlexible hours
$200k - $400k
...proving it is possible to model human behavior with high accuracy. Today,... ...As a Member of Technical Staff, Model Evaluations at Simile, you will build... ...simulation: Design evals, metrics, rubrics, datasets, dashboards... ...that include base salary, equity, and comprehensive...Employment EquityFlexible hours$196k - $230k
...define and scale how we evaluate Notion’s AI‑powered... ...looks like not only for model output quality, but for... ..., and failure/recovery behaviors, then translate those insights... ..., and observable metrics. AI fluency and systems... ...competitive cash compensation, equity, and benefits. The...Employment EquityLocal areaShift work$156k - $195k
...and outcomes. Define success metrics with your partners and measure... ...the impact of your work on host behavior, satisfaction, and business... ...patterns, and design standards. Model Turo’s design principles, collaborative... ...95,000 annually. Eligible for equity and benefits. Employer‑paid...Employment EquityFull timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff, Model Evaluations & Behavioral Metrics (Equity). Be the first to apply!
Related searches
- private equity internship summer San Francisco, CA
- entry level private equity San Francisco, CA
- equity research associate San Francisco, CA
- equity portfolio manager San Francisco, CA
- private equity associate San Francisco, CA
- investment intern (private equity) San Francisco, CA
- equity fund manager San Francisco, CA
- private equity San Francisco, CA
- private equity sales San Francisco, CA
- director of equity and inclusion San Francisco, CA