Frontier AI Risk Evaluation Scientist
Scale
Scale Labs seeks a Research Scientist focused on Frontier Risk Evaluations to design evaluation measures, harnesses and datasets for measuring risks posed by frontier AI systems. You will build harnesses to test models, collaborate with government agencies to scope evaluations, and publish methodologies for policymakers. Ideal candidates have 3+ years in ML research or product development, a track record in generative AI, and strong cross-functional communication skills to work with industry, #J-18808-Ljbffr Scale
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Frontier AI Risk Evaluation Scientist in New York, NY vacancy
$216k - $270k
Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs...RiskFull time- Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs...Risk
$400 per month
Obsidian is seeking contributors for a Frontier Code Agents project, focused on evaluating AI coding models in fraud and risk engineering. Candidates will use AI coding tools to handle complex tasks and provide technical assessments. The role requires 2+ years of experience...Risk- Scale AI, Inc. is looking for a Research Scientist focused on Frontier Risk Evaluations to develop evaluation measures and datasets for assessing AI risks. As a key team member, you will engage with government agencies and publish methodologies that influence AI safety...Risk
$192.5k - $373.8k
...makes us Roche. Advances in AI, data, and computational... ...Intelligence (AI) to assist our scientists in both pRED and gRED to deliver... .... The Opportunity Frontier Research is dedicated to foundational... ...reusable code, running evaluations, and organizing results. •...SuggestedFull timeWork experience placementLocal areaWorldwideRelocation package$170k - $215k
...Founding Scientist — AI Review of Biomedical Grants and Papers CoPAIR... ...building an AI system that evaluates scientific manuscripts and grant... ...we orchestrate ensembles of frontier models in specialized,... ...manuscripts for impact, rigor, and risk. Own the validation...RiskFull timeWork at officeRelocation packageCoPAIR LLC
New York, NYmore than 2 months ago- Scale Labs is seeking a Research Scientist focused on Agent Robustness to advance safe and aligned AI agents. You will contribute to evaluating risks, building testing harnesses, and prototyping... ...policy and industry practices in frontier AI. #J-18808-Ljbffr United States...Risk
$216k - $270k
Research Scientist, AI Controls and Monitoring Scale Labs, Research Scientist - AI Controls... ...Monitoring As the leading data and evaluation partner for frontier AI companies, Scale plays an... ...informed, scientific decisions about AI risks and capabilities. Our research tackles...RiskFull time$121k - $141k
...is hiring a Machine Learning Scientist to join the New A.I. Products... ...architectures.You will fine-tune and evaluate language models for custom use... ...deploy machine learning and AI research with robustness and... ..., with consideration of risks and trade-offsYou will adapt or...RiskWork experience placementWork at officeLocal areaRemote workFlexible hours$320k - $400k
As a Research Scientist on our team, you will partner with... ...on our track record of AI-powered solutions (e.g.... ...Research tackles high-risk, high-reward problems... ...RL training loops, and evaluation infrastructure needed to... ...that match or surpass frontier models at a fraction of...Risk$207k - $300k
...years of research experience in frontier AI safety or governance (e.g., in threat... ...dangerous capability/alignment evaluations). Preferred qualifications:... ...The Job We are hiring a research scientist to lead governance research and risk modeling work for the Frontier Safety...RiskShift work$300k - $325k
Senior Program Scientist, AI and Advanced Computing Institute Join to apply for the Senior Program... ...to mitigate and manage potential risks from advanced AI. Improve AI reliability... ...directions for engagement. Technical Evaluation and Program Development Provide technical...RiskLocal area- As a Research Scientist on our team, you will partner with... ...on our track record of AI-powered solutions (e.g.... ...Research tackles high-risk, high-reward problems... ...RL training loops, and evaluation infrastructure needed to... ...that match or surpass frontier models at a fraction of...Risk
$85k - $95k
...are The real world is the next frontier, and at Metropolis, we are... ...growth. In this role, you will evaluate deal structure, shape pricing... ...economic scenarios, surfacing risks and opportunities proactively... ...environment Experience leveraging AI tools to transform static...RiskTemporary workWork at officeLocal areaMetropolis
New York, NY8 days ago- Mercor seeks experienced AI Safety Red Teamers to identify vulnerabilities in frontier AI systems through adversarial testing. You will design... ...prompts, uncover model weaknesses, and evaluate AI behavior across complex, high-risk, and ambiguous topics. Responsibilities...Risk
$76k - $125.3k
...issues, provide advice and assistance managing risks across tax compliance and/or advisory... ...filings and other business analysisCompile and evaluate moderately complex data, computations,... ...trust in capital markets.Enabled by data, AI and advanced technology, EY teams help...RiskSummer holidayFlexible hours- Mercor is partnering with a venture-backed AI lab building frontier AI platforms and physics-based... ...they build. Are you a preclinical R&D scientist who has taken drug programs from the bench... ...selection, optimization, trade-offs, risk) Help define structure and quality standards...RiskPart time10 hours per weekFlexible hours
$40 per hour
AIToolboard in the United States is seeking a part-time Remote Chemistry Research Scientist for AI Evaluation to join our expanding AI research team. You will train AI models related to chemical data, test outputs, and provide rigorous evaluation to improve model accuracy...Remote jobHourly payPart timeFlexible hours$146.8k - $272.6k
...industry setting? TR Labs is the AI Research & Development arm of... ...Reuters. We are seeking scientists with a passion for solving problems... ...for Legal, Tax & Accounting, Risk, and News Media professionals.... ...environmentsOutstanding technical judgment and evaluation expertiseExcellent...RiskFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$76k - $125.3k
...issues, provide advice and assistance managing risks across tax compliance and/or advisory... ...and other business analysis Compile and evaluate moderately complex data, computations, documentation... ...in capital markets. Enabled by data, AI and advanced technology, EY teams help...RiskSummer holidayFlexible hours- SME Careers is seeking biologists to contribute to an AI training project that involves reviewing AI-generated responses and providing... ...hold a MS or PhD in a relevant field and have experience in evaluating complex biology content. Strong communication skills and proficient...Immediate start
$141.1k - $262.1k
...what makes us Roche.Advances in AI, data, and computational... ...Intelligence (AI) to assist our scientists in both pRED and gRED to... ...objectives, training signals, and evaluation criteria.Evaluation &... ...libraries.A passion for applying frontier AI to drug discovery.Relocation...Full timeWork experience placementLocal areaWorldwideRelocation package$180.6k - $225.75k
...with the industry's leading AI labs to provide high quality... ...We are looking for Research Scientists and Research Engineers with expertise... ..., RLHF, reward modeling) and evaluation. This role is on the... ...diagnostic methods that reveal where frontier models fail and why. You will...Full time$167.4k - $310.8k
...what makes us Roche.Advances in AI, data, and computational... ...Intelligence (AI) to assist our scientists in both pRED and gRED to... ...architectures, training strategies, and evaluation methodologies.Model... ...libraries.A passion for applying frontier AI to drug discovery....Full timeLocal areaWorldwideRelocation package$189.2k - $372.9k
...Engineers (FDE) don’t just build AI solutions, they help clients... ...026. Work you’ll do As a Lead Frontier GenAI FDE, you will serve as... ...quality, latency, cost, adoption, risk) and a phased plan from... ...quality and scalability.Define evaluation frameworks covering quality, hallucination...RiskLocal areaVisa sponsorship- ...driven revenue growth across Sales, Growth, Product, Engineering, and Risk categories. You will synthesize cross-functional inputs to... ...data science/consulting, strong SQL/Python/A/B testing, and a passion for AI tools. #J-18808-Ljbffr United States Digital Space LLCRisk
- argenx SE in the United States is seeking a Safety Scientist to lead ongoing safety surveillance of experimental and marketed products.... ...team to ensure timely safety deliverables, contribute to benefit‑risk assessments, and represent GPS Safety Science globally. The...Risk
$175k - $250k
...Quantitative Analyst, Market Risk at the VP level to join the Front... ...rigor with next-generation AI to transform how market risk is... ...business and regulatory deadlines.Evaluate emerging GenAI technologies... ...opportunity to work at the frontier of AI application in quantitative...RiskFull timeWork at officeRemote work- ...healthcare technology firm is seeking a Senior GenAI Scientist II to deliver innovative solutions that... ...quality. This role requires expertise in AI and machine learning, with responsibilities including model validation, risk management, and improvements in monitoring activities...RiskRemote job
- ...leading security-first enterprise AI company. We build cutting-... ...We’re training and deploying frontier models for enterprises who... ...Paris. Join us!Why this role?Evaluation is critical to making progress... ...progress.As a Senior Research Scientist, Model Evaluation, you will:...Full timeWork at officeLocal areaRemote workHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontier AI Risk Evaluation Scientist. Be the first to apply!
