Staff Research Engineer RL, LLMs & Evaluation Systems
hillclimb
Hillclimb is building environments and evals to push frontier models toward real scientific progress. We seek a motivated researcher to turn ML research problems into scalable, automated evaluation environments.
You will design repeatable rewards and build systems that catch flaws before training. You will collaborate with a founding team of researchers, contribute to post-training analyses, and help shape the evaluation framework for frontier models.
#J-18808-LjbffrVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Research Engineer RL, LLMs & Evaluation Systems in San Francisco, CA vacancy
- ...Staff+ Research Engineer, RL Data Platform San Francisco, CA | New York City, NY... ...interpretable, and steerable AI systems. We want AI to be safe and... ...annotation, labelling, evaluation, or other human-in-the-loop... ...scale. Familiarity with how LLMs are trained and evaluated....SuggestedFull timeContract workFor contractorsFor subcontractorWork at officeVisa sponsorshipFlexible hours
Anthropic
San Francisco, CA4 days ago - ...Research Engineer Intern, Evaluations & BenchmarksLocation: San Francisco (Hybrid)TensorStax... ...building fully autonomous AI systems to manage and optimize... ...with a focus on benchmarking LLMs in mission-critical domains... ...Experience developing custom RL environments for AI...SuggestedInternship
TensorStax
San Francisco, CA5 days ago - ...Research EngineerOur mission is general causal intelligence; AI that... ...Model (LPM) because physical systems, unlike text or images, are... ...and CERN.We look for research engineers who are excited to tackle unsolved... ...is to build the central evaluation framework that the entire research...Suggested
Causal Labs
San Francisco, CA2 days ago - ...Learning EngineerYou'll bridge research and engineering—rapidly implementing,... ...ideas into high-performance systems, and will operate across the... ...scale experimental models (LLMs, RL agents, agentic systems) on... ...and pipelines for training, evaluation, and analysis.Implement...Suggested
ATG intelligence
San Francisco, CA2 days ago - ...interpretable, and steerable AI systems. We want AI to be... ...group of committed researchers, engineers, policy experts, and... .... About the RL teams Our Reinforcement... ...RL environments and evaluations for agentic RTL... ...Currently, we expect all staff to be in one of our offices...SuggestedWork at officeVisa sponsorshipFlexible hours
Anthropic Limited
San Francisco, CA3 days ago $290.4k - $363k
...reliable, production-grade systems that drive real... ...the RoleAs a Senior/Staff Machine Learning Engineer (MLE) on the General... ...system design to evaluation, deployment, and iteration... ...of modern LLMs, prompt-, context-,... ...problem spaces, balancing research-driven approaches with...Full timeScale AI
San Francisco, CA3 days ago$136.44k - $166.75k
...models better at science. LLMs know an extraordinary amount... ...You’ll build the datasets, evaluations, and systems that help close that gap. You... ...intersection of software engineering, biology, and frontier AI:... ..., scientists, and external research partners.Desire to work in...Work at officeLocal areaMonday to FridayShift workBenchling
San Francisco, CA2 days ago- ...interpretable, and steerable AI systems. We want AI to be... ...group of committed researchers, engineers, policy experts, and... ...to build the evaluations that tell us — and the... ...throughout production RL training runs Own... ...Currently, we expect all staff to be in one of our...Work at officeVisa sponsorshipFlexible hours
Anthropic Limited
San Francisco, CA1 day ago - ...Staff Research Engineer, Multi-Agent Scaling San Francisco, CA |... ...interpretable, and steerable AI systems. We want AI to be... ...the platform and evaluations Anthropic uses to run... ..., or inference and RL infrastructure Built... ...or harnesses for LLMs or agents Experience...Full timeWork at officeVisa sponsorshipFlexible hours
Anthropic
San Francisco, CA4 days ago $150k - $250k
...Founding ML / Research Engineer – RL Environments Location: San Francisco, California, USA... ...The company develops a platform that evaluates engineers through real-world engineering... ...learning (RL) environments and evaluation systems that turn complex engineering workflows...Local areaRelocationCGS
San Francisco, CA2 days ago- ...daily U.S. X-rays. Our research team brings experience... ...exceptional Research Engineer or Research Scientist to... ...how we curate data and evaluate frontier AI models for... ...imaging. You'll own the systems and methodologies that... ...frameworks for LLMs, VLMs, or other generative...
Health Data Innovations Inc
San Francisco, CA1 day ago $250k - $350k
...develop reliable AI systems for the world’s... ...combining rigorous evaluation with full-stack deployment... ...with applied ML research, design, and... ...About the RoleAs a Staff Machine Learning Research Engineer, you will operate across... ...online or offline RL — and validate them...Full timeScale AI
San Francisco, CA3 days ago$350k
...Staff Research Engineer, Discovery TeamSan Francisco, CAAbout AnthropicAnthropic's mission is to... ...reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...with language model training, evaluation, and inference, be comfortable triaging...Work at officeImmediate startVisa sponsorshipFlexible hoursanthropic
San Francisco, CA5 days ago$249.12k - $367.92k
...develop the foundational systems, models, and data... ...production serving, evaluation, and monitoring. As... ...across Plaid.As a Staff Machine Learning Engineer, you will lead the technical... ...that translate research into production... ...expertise in Transformers/LLMs/Foundation Models,...Work experience placementLocal areaImmediate startPlaid Financial
San Francisco, CA2 days ago- ...About the Team The RL and Reasoning team drives the core reasoning... ...of reinforcement learning research, building next-generation... ...About the Role As a Research Engineer/Research Scientist at OpenAI,... ...purpose agents, including the systems that power various models....Work at officeRelocation package
OpenAI
San Francisco, CA4 days ago - ...relocation assistance Research Engineer Greptile is an AI... ...some sample efficient RL, in order to increase... ...build the multi-agent systems, harnesses, models, and... ..., prototype and evaluate a multi-agent code review... ...latest research across LLMs, information retrieval...Work at officeRelocation package
Greptile
San Francisco, CA4 days ago - ...build general-purpose AI systems that run efficiently... ...We treat data as a research problem, not an infrastructure... ..., ships like an engineer: You build the pipelines... ...systems using LLMs, structured prompting,... ...what scales up Build evaluation sets you can trust, and...Weekend work
Liquid-Ai
San Francisco, CA1 day ago - ...Preference Model is building automated ML research engineering to advance RL environments and post-training for large language models. We seek machine... ...and shaping research directions. You will train and evaluate models on proprietary RL environments, architect...
Preference Model
San Francisco, CA1 day ago $174k - $252k
...Large Language Models (LLMs) or Information Retrieval... ...experience with software engineering in one or more... ...Reinforcement Learning (RL) algorithms, automated evaluation systems, or LLM reflection and reasoning... ...machine learning models or research innovations into large-...DeepMind Technologies Limited
San Francisco, CA5 days ago- ...Research Engineer, RL EngineeringSan Francisco, CA | New York City, NY | Seattle, WAAbout AnthropicAnthropic... ..., interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...policy: Currently, we expect all staff to be in one of our offices at least 25...Work at officeVisa sponsorshipFlexible hours
Anthropic
San Francisco, CA5 days ago $350k
...Research Engineer, Visual Knowledge WorkNew York City... ...and steerable AI systems. We want AI to be... ...the capabilities of LLMs. On the Vision team... ...training data and RL environments targeting... ...specifications, evaluating visual data and... ...Currently, we expect all staff to be in one of...Work at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA5 days ago$160k - $250k
...apply for the Founding Research Engineer role at Adam Join to... ...faster CAD edits Create RL environments to teach... ...push the boundaries of LLMs, especially in the... ...collection to model training, evaluation, and inference Have a... ...projects, or shipped systems) Operate with high...Full timeadam.ai
San Francisco, CA4 days ago$150k - $200k
...test their models. You'd be their first engineer in San Francisco, and from about month six... ...you'll own Designing and building RL tasks and environments that frontier models... ...RL environments, tasks, benchmarks or evaluation harnesses with your own hands. Only operating...Full timeWork at officeRnb Consultancy
San Francisco, CA2 days ago- ...Ambral is hiring to build a replayable enterprise history engine and deploy it in real workflows. You will work closely with the CTO to design production systems, process real enterprise data, and improve agent performance through reinforcement learning and context engineering...
Ambral (YC S25)
San Francisco, CA1 day ago - ...Research Engineer, Machine Learning (RL Velocity) Remote-Friendly (Travel-Required) | San Francisco, CA | New... ...– the infrastructure, tooling, and systems that let researchers iterate quickly... ...Location-based hybrid policy: Expect all staff to be in one of our offices at least...Work at officeRemote workVisa sponsorshipFlexible hours
Anthropic
San Francisco, CA4 days ago $300k - $405k
...and steerable AI systems. We want AI to be... ...group of committed researchers, engineers, policy experts,... ...learning (RL) research and development... ...experiments and evaluations, delivering your... ...curious about how LLMs could augment or... ...Currently, we expect all staff to be in one of...Work at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA1 day ago$175k - $250k
...Research Engineer About Scorecard We’re a small, nimble team... ...users that corrupt evaluation results. To fix this... ...TypeScript and have owned a system from design through... ...annotation pipelines. RL experience: building RL environments for LLMs, reward design, or...Work at officeKindredventures
San Francisco, CA4 days ago- ...Scion Technology Staffing is seeking a Founding Research Engineer for a pioneering AI startup in San Francisco, onsite at our client. You will drive RL research and post-training evaluations while owning core engineering projects from concept to deployment. You will work...
Scion Technology Staffing
San Francisco, CA3 days ago - ...Anthropic is hiring a Research Engineer for the Code RL team to advance silicon design with reinforcement learning-focused environments and evaluations. You will work on RTL generation, formal verification, and physical design optimization, collaborating across research...
Anthropic Limited
San Francisco, CA1 day ago - ...Research Scientist, Research Engineer, AI Systems EngineerThe Recursive Self-Improvement (RSI) team works across research... ...and feedback loops, designing evaluations, and training models to develop missing... ...agent harnesses, synthetic data, RL environments, and model training....
OpenAI
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Research Engineer RL, LLMs & Evaluation Systems. Be the first to apply!
Related searches
- staff engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- software engineer staff San Francisco, CA
- staff data engineer San Francisco, CA
- assistant engineer San Francisco, CA
- staff design engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- staff security engineer San Francisco, CA
- assistant electrical engineer San Francisco, CA
- technology administrator San Francisco, CA