Research Intern: Simuser Framework & Evaluation
Kindredventures
Scorecard is seeking a Research Intern in San Francisco to own one research question end-to-end within simuser frameworks for AI agent simulations. You’ll design experiments, build prototypes, evaluate outcomes, and publish findings with a dedicated mentor. Internships run 10 to 16 weeks with flexible start dates; you’ll work with real data (human work transcripts), ship your prototypes into the framework, and contribute to public benchmarks or blog posts. #J-18808-Ljbffr Kindredventures
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Intern: Simuser Framework & Evaluation in San Francisco, CA vacancy
- ...Research Intern About Scorecard We're a small team within Scorecard, the simulation platform for AI... ...resulting in unrealistic users that corrupt evaluation results. To fix this, we’re building a simuser framework and orchestration layer. It allows defining high...InternshipHourly payWork at officeFlexible hours
Kindredventures
San Francisco, CA18 hours ago - ...Research Scientist Intern Mercor's mission is to organize human intelligence to power the AI economy... ...(RLVR), data generation, and model evaluation. You'll investigate how datasets,... ...datasets, rubrics, evaluators, and scoring frameworks for complex model capabilities....InternshipFull time
Mercor Inc
San Francisco, CA2 days ago $216k - $270k
Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays... ...with AI safety policy frameworks (e.g., NIST AI RMF, EU AI Act... ...treated in accordance with our internal policies and programs designed...SuggestedFull timeScale AI
San Francisco, CA2 days ago- ...and physical AI. Ask any AI researcher or roboticist: the core bottleneck... ...THE ROLE As a Research Intern you will work directly with... ..., encompassing high-stakes evaluation, large-scale benchmarking,... ...systems: orchestration frameworks, tool APIs, distributed execution...InternshipFlexible hours
Abundant Energy Inc.
San Francisco, CA2 days ago - ...Experiences and HCI & Visualization research groups, you and your mentor(... ...studies, heuristic evaluations, task analyses, structured interviews... ....Explore new prototyping frameworks and technologiesAuthor a... ...on the topic in international venuesStrong communication skills...InternshipFull timeWork at officeRemote workFlexible hours
Autodesk
San Francisco, CA6 days ago $130k - $200k
...adjusted to local cost of living. Apart Research is hiring a Research Scientist for... ...Evals to design, build, and publish novel evaluations of AI harmful manipulation that directly... ...Python and software engineering (eval frameworks like Inspect, LLM APIs); comfortable analyzing...Work at officeLocal areaRemote workHome officeFlexible hours$175k - $250k
...Research Engineer About Scorecard We’re a small, nimble team backed... ...This role is part of the "simuser research" pod within Scorecard... ...unrealistic users that corrupt evaluation results. To fix this, we’re building a simuser framework and orchestration layer. It...Work at officeKindredventures
San Francisco, CA2 days ago- About Phonic Phonic is a product and research lab focused on powering the most realistic... ...includes top-tier AI researchers, international olympiad medalists, and former... ...production Build the training pipelines, evaluation frameworks, and tooling that let us experiment and...InternshipWork at office
- ...infrastructure frontier AI labs build internally, made available to every... ...compute, environments, evaluations, secure sandboxes, high-... ...horizon tasks like autonomous research, and the full-stack platform... ...environment and evaluation frameworks. Work on model-based grading...Remote workVisa sponsorshipRelocation packageFlexible hours
Wwshemi
San Francisco, CA1 day ago - ...Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build... ..., stands it up, and makes it real. That means defining the evaluation frameworks, building the operational infrastructure for model safety,...Work at officeVisa sponsorship
Sierra Ventures
San Francisco, CA18 hours ago $58 - $70 per hour
Role Overview As a Research Intern in the Model Shaping team, you will work on one or more of... ...methods) Robust and reliable evaluation of foundation model capabilities The Model... ...fundamentals Experience with deep learning frameworks (PyTorch, JAX, etc.) Familiarity with...InternshipHourly payWork at office$85 per hour
...and foster collaborations with other research teams in Alphabet. AI Foundations... ..., hierarchical learning, and robust evaluation. Waymo interns partner with leaders in the industry... ...preferences Modern deep learning frameworks such as PyTorch and Jax We prefer...InternshipHourly payFull timeSummer internshipWaymo
San Francisco, CA3 days ago$320k - $405k
...growing group of committed researchers, engineers, policy experts,... ...externally and informing Anthropic's internal business and product... ...pipelines — to help Anthropic evaluate the downstream economic... ...learning new technical tools and frameworks Demonstrated ability to:...Work at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA4 days ago$64 - $68 per hour
...seeking an Applied Scientist intern to develop next-generation user... ...context and behavioral data, evaluate their fidelity against... ...prototype, establish an evaluation framework for measuring simulation... ...evaluation pipelines Prior research experience with LLM agents, generative...InternshipSummer workWork at officeLocal area3 days per weekLyft
San Francisco, CA18 hours ago$165.6k - $207k
...quality data and accelerate progress in GenAI research. We are looking for Research Scientists... ...(SFT, RLHF, reward modeling) and evaluation. This role is on the evaluation pod within... ...will be treated in accordance with our internal policies and programs designed to protect...Full timeScale AI
San Francisco, CA2 days ago- ...This is a REMOTE Volunteer position* The General Research Assistant / Intern (GRA/GRI) has a strong interest in the technological achievement... ...criteria WBE roadmapping: methodologies WBE ethical framework Responsibilities / Duties: Literature...InternshipWork at officeRemote work
Carboncopies Foundation for Substrate Independent Minds INC
San Francisco, CA4 days ago $2,500 per week
...Our Research Associate Interns are involved in diverse, challenging assignments within a stimulating, collegial work environment. As a Research... ...reverse engineer and/or replicate opponent's analysis for evaluation and criticism Create compelling graphics/tables/charts...InternshipFlexible hoursThe Brattle Group
San Francisco, CA4 days ago$53 - $62 per hour
...Technology Group (ATG) is Dolby's research division, focused on... ...technologies. As a Research Intern, you will define and lead a novel... ...Preferred experience with modern AI frameworks such as PyTorch or TensorFlow... ...AI. Training, fine-tuning, evaluation, or deployment of AI models...InternshipHourly payFull timeWork experience placementSummer workLocal areaWorldwideMonday to FridayFlexible hours$2,000 per month
...faster than anyone in the world. Job Summary We're hiring Research Interns to train on the physical labor dataset. You run a real... ...Responsibilities Run a research bet on Build data: train, evaluate, ablate, and write down what the data actually taught Work...InternshipWork at officeRelocation packageBuild AI
San Francisco, CA3 days ago- Key Talent Solutions seeks a Research Scientist - Post Training to advance how training data shapes LLM capabilities, generalisation and alignment. This hands-on role blends research, evaluation and collaboration with external partners. You will design SFT and RL experiments...
- Scale AI, Inc. seeks Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation. The role focuses on building benchmarks and diagnosing model failure modes in text and multimodal modalities within the GenAI...
$119.8k - $234.7k
...e.g., statistics predictive analytics, research) OR Master's Degree in Statistics, Econometrics... ...computing using R or Python, including frameworks such as Statsmodels, EconML, or... ...including formulating research questions and evaluating relevant literature. ~ Doctorate in...Ongoing contractLocal areaMicrosoft Corporation
San Francisco, CA2 days ago- Our Mission Reflection is a research lab making intelligence open and accessible for everyone... ...used to run our most sensitive model evaluations — including evaluations in CBRN (... ...involve. Familiarity with compliance frameworks relevant to sensitive data handling. We...Work at officeVisa sponsorship
$6,790 per month
...About the position You will conduct research as part of an interdisciplinary team of... ...model (ATS-EcoSIM). The code provides a framework for three-dimensional hydrologic modeling... ...background check. Any convictions will be evaluated to determine if they directly relate to...Full timeContract workRemote workLawrence Berkeley Lab
San Francisco, CA18 hours ago- Databricks is seeking a research team member to advance domain adaptation techniques using LLMs and AI systems. Responsibilities include... ...methods, designing new methods for custom domains, and evaluating various AI systems. Candidates should be PhD candidates in relevant...InternshipHourly pay
$180.6k - $225.75k
...quality data and accelerate progress in GenAI research. We are looking for Research Scientists... ...(SFT, RLHF, reward modeling) and evaluation. This role is on the evaluation pod within... ...will be treated in accordance with our internal policies and programs designed to protect...Full time- Together AI is seeking a research intern to advance speculative decoding, training and evaluating draft models at scale on dedicated GPU clusters in San Francisco. You will explore new drafters, verification schemes, and distillation recipes, testing ideas against real...Internship
$9.7k - $19k
...Center for AI Safety (CAIS) is a leading research and advocacy organization focused on... ...The Role As a research engineer intern here, you will work very closely with our... ...experiments. Are familiar with relevant frameworks and libraries (e.g., PyTorch). Communicate...InternshipFull timeSummer workLocal areaFlexible hoursCenter for AI Safety
San Francisco, CA2 days ago- Apart Research in San Francisco is seeking a Research Scientist for Manipulation Evals to design, build, and publish novel evaluations of AI harmful manipulation that inform EU AI Act enforcement. You will own the full pipeline and steer research directions with significant...Remote work
$146k - $280k
...experienced Applied Data Scientist to shape evaluation methodologies for autonomous driving... ...Design scalable production frameworks for autonomy evaluation, applying statistically... ...statistical modeling. Experience working with internal cross‑functional partners and...Full timeWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Intern: Simuser Framework & Evaluation. Be the first to apply!
Related searches
- historical research San Francisco, CA
- research pharmacist San Francisco, CA
- research assistantship San Francisco, CA
- research compliance officer San Francisco, CA
- neuroscience research San Francisco, CA
- research investigator San Francisco, CA
- research dietitian San Francisco, CA
- mental health research San Francisco, CA
- research and development San Francisco, CA
- health research San Francisco, CA