Staff AI Research Engineer - Frontier Judgment & Evaluation
Crucibl Co.
Crucibl in San Francisco is building the next generation of enterprise AI. You will explore how frontier models reason in high-stakes decisions and design evaluation methods to test and ship robust solutions. Join a small, elite team that shapes product direction, collaborates with founders, and operates in a fast-growing, equity-driven environment. We value published research, practical impact, and high-ambiguity problem solving. #J-18808-Ljbffr Crucibl Co.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff AI Research Engineer - Frontier Judgment & Evaluation in San Francisco, CA vacancy
- Prime Intellect, Inc. is building an open frontier AI platform that unifies compute, environments, evaluations, and secure sandboxes for end-to-end frontier-scale training and deployment. The role focuses on taking open models from architecture experiments to full pretraining...SuggestedRemote job
- ...hiring a Member of Technical Staff to define how frontier coding agents are... ...You will partner with top researchers and engineers to develop benchmarks, verifier systems, evaluation methodologies, and data-quality... ...quality techniques for coding AI. Early team members...Suggested
- ...systems to enhance frontier AI capabilities.... ...world’s leading research accelerator for frontier... ...Our environments evaluate and improve AI... ...: Software engineering environments for... ...are looking for Staff Research Engineers... ...Strong scientific judgment around experimental...SuggestedContract workPart timeFor contractors
Turing
San Francisco, CA20 days ago $250k - $350k
...Francisco, Turing works with frontier AI labs to generate high... ..., and frontier research benchmarks that... ...capabilities in software engineering, enterprise knowledge... ...signals into better data, evaluations, and more capable... .... Scientific judgment: Sound judgment around...SuggestedTuring Enterprises, Inc.
San Francisco, CA1 day ago$136.44k - $265.11k
...rebuilding biotech for the AI era.When a... ...focused on making frontier AI models better... ...build the datasets, evaluations, and systems that... ...intersection of software engineering, biology, and... ...real scientific judgment, and building systems... ..., and external research partners.Desire to...SuggestedWork at officeLocal areaMonday to FridayShift workBenchling
San Francisco, CA1 day ago- ...superintelligence stack: the infrastructure frontier AI labs build internally, made... ...compute, environments, evaluations, secure sandboxes, high-... ...tasks like autonomous research, and the full-stack platform... ...Requirements Strong software engineering skills in Python and...Remote workVisa sponsorshipRelocation packageFlexible hours
Wwshemi
San Francisco, CA13 hours ago - ...Improvement (RSI) team works across research, engineering, product, and infrastructure to build AI systems that accelerate and... ...and feedback loops, designing evaluations, and training models to develop... ...Design evaluations for research judgment, hypothesis generation and...
OpenAI
San Francisco, CA2 days ago - Catapult is seeking a highly capable researcher/engineer to push the frontier and build end-to-end systems from idea to product. You will tackle agentic... ..., retrieval/knowledge-base work, data processing, evaluation, and experimentation while delivering robust, scalable...
$207k - $300k
Improve our adversarial evaluation (auto-red teaming)... ...Collaborate with safety engineering to develop new capabilities... ...based on adversarial research.Contribute to... ...journals.Passion for AI technology and all of... ...the next generation of frontier models and help defend...Google
San Francisco, CA5 days ago$174k - $252k
...Share Research Engineer, Frontier Safety Mitigations, DeepMind DeepMind Mountain View, CA, USA ~ Bachelor... ...) development, fine-tuning, or safety evaluation methodologies. Experience taking... ...model capabilities seriously as AI advances. Because of this, we believe...Google LLC
San Francisco, CA2 days ago- ...company Computer is seeking a senior software engineer to build and own frontier AI-powered agent capabilities. You will evaluate new model behaviours, design scalable agent... ...You will collaborate with PM, Data Science, Research to identify high-impact opportunities and...
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We... ...clarity of an alert, and the judgment built into an automated... ...machine learning researchers, engineers, and product managers... ...learning for creating frontier-level specialized models,...Permanent employmentFull timeTogether Computer Inc
San Francisco, CA13 hours ago$250k - $350k
...to develop reliable AI systems for the... ...combining rigorous evaluation with full-stack deployment... ...on pushing the frontier of what agentic applications... ...with applied ML research, design, and... ...About the RoleAs a Staff Machine Learning Research Engineer, you will operate across...Full timeScale AI
San Francisco, CA5 days ago- Obsidian is partnering with an AI research initiative to support a Frontier Code Agents project in San Francisco. You will evaluate frontier AI coding models by performing realistic data engineering tasks, reviewing ETL pipelines, data warehouses, and distributed systems...
- Distyl AI is hiring Research Engineers to bridge frontier AI research and production systems. You will design and implement agentic AI systems, prototype robust... ...in real customer environments. You will build evaluation frameworks, observe system behavior, and ensure deployment...Work at office
$300k
...Research Engineer, Agent Systems One of the most mission-driven organizations in AI is building the infrastructure that makes intelligent... ...Equity San Francisco · On-Site Frontier AI Lab · Confidential... ...and production Develop evaluation infrastructure that measures...Visa sponsorshipAionia Group
San Francisco, CA1 day ago- Obsidian is seeking a candid evaluator to assess the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train frontier AI labs. You will review repository-level tasks, reference patches, test harnesses, and grading integrity, and provide...
- Ephapsys seeks a Staff Research Engineer to advance the SDK and platform, focusing on production-grade AI systems, secure model deployment, and governance. You will work with the founder to translate AI research into hardened, scalable infrastructure. You will lead AI/...
- ...the teamThe Applied AI Engineering team is responsible for... ...faster than ever. As frontier models become more... ...technical guidance on how to evaluate, validate, and safely... ..., Engineering, Research, and Security to turn... ...evidence-first security judgment: you validate...Work at officeLocal areaRelocation packageFlexible hours
OpenAI
San Francisco, CA2 days ago $251k - $278k
...the TeamOpenAI’s Applied AI Engineering team helps organizations turn frontier AI capabilities into... ...combine deep technical judgment, hands-on engineering,... ...architecture through prototyping, evaluation, production launch, and... ...and OpenAI Product, Research, Engineering, Security,...Work at officeLocal areaRelocation packageFlexible hoursOpenAI
San Francisco, CA4 days ago- Google DeepMind is recruiting a Share Research Engineer for the Frontier Safety Mitigations team. The role focuses on building robust, end-to-end... .... You will work on de-risking model launches, creating evaluations, red-teaming, and deploying mitigations at scale. The position...
$50 per hour
...roadmaps, and mentor junior engineers to elevate the overall capability... ..., and setting rigorous evaluation standards that address accuracy... ...build a robust, collaborative AI engineering culture. Documentation... ...exposure to cutting‑edge research, mentorship from senior...Full timeContract workTemporary workWork experience placementCasual workFlexible hoursLockheed Martin
San Francisco, CA4 days ago- ...management, design, and engineering together with the... ...You are an exceptional AI-native software engineer... ...fundamentals with product judgment, systems thinking, and... ..., establish tests and evaluations, and review generated... ...A genuine interest in frontier AI and a consistent...Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
Accenture
San Francisco, CA3 days ago - Harrison Clarke is seeking a Machine Learning Engineer focused on safety for a frontier AI lab in the Bay Area. This role centers on making advanced AI... ...at the edge of current capabilities. You will work on evaluation, red-teaming, safety post-training, and guardrails,...
$302k - $335k
...the TeamThe Applied AI Engineering team is responsible for... ...customers turn frontier AI capabilities into... ...architecture, implementation, evaluation, and adoption,... ...with Sales, Product, Research, and Engineering to translate... ...humility, technical judgment, and a commitment to...Work at officeLocal areaRelocation packageFlexible hoursOpenAI
San Francisco, CA1 day ago- Scale Labs seeks a Research Scientist focused on Frontier Risk Evaluations to design evaluation measures, harnesses and datasets for measuring risks posed by frontier AI systems. You will build harnesses to test models, collaborate with government agencies to scope evaluations...
- Prime Intellect is building an open frontier AI platform that unifies training, evaluation, and deployment. You will own the transformation of research artifacts into open-source and product experiences, working with engineering and design to deliver researcher-facing...Remote job
- ...for customer-facing AI agents, working... ....Sierra’s Applied Research team advances the... ...externally provided frontier intelligence, balancing... ..., fine-tune, evaluate, and deploy models... ...speech.Excellent judgment in framing product... ...TypeOn-siteDepartmentEngineeringPlatform EngineeringFull timeFlexible hours
Sierra
San Francisco, CA3 days ago $300k - $400k
...prototypes — fast prototyping with AI tools and building AI-driven... ...Anthropic as an Applied AI Research Engineer to translate large language... ...education. Build demos, evaluations, and prototypes that... ...Location-based hybrid policy: staff are expected to be in one of...Work at officeVisa sponsorshipFlexible hoursvibehackers
San Francisco, CA1 day ago- ...is building the leading AI-native platform for... ...for a Senior Applied AI Engineer to design and build production... ...its behavior should be evaluated, where deterministic... ...are excited to apply frontier AI capabilities to difficult... ...iteration. ~ Strong judgment about where AI is...Full timeWork experience placementRelocation
Abby Care
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff AI Research Engineer - Frontier Judgment & Evaluation. Be the first to apply!
Related searches
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- staff engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior staff systems engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff data engineer San Francisco, CA