Research Scientist, Frontier Risk Evaluations San Francisco, CA Apply

Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs has launched a new team focused on policy research to bridge the gap between AI research and global policymakers, enabling informed, scientific decisions about AI risks and capabilities. Our research tackles the hardest problems in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. This team collaborates broadly across industry, the public sector, and academia and regularly publishes our findings. We are actively seeking talented researchers to join us in shaping this vision. Job Responsibilities Design and build harnesses to test AI models and systems (including agents) for dangerous capabilities such as security vulnerability exploitation, CBRN uplift, and other high-risk activities. Work with government agencies or other labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems. Publish evaluation methodologies and write technical reports for policymakers. Qualifications Commitment to our mission of promoting safe, secure, and trustworthy AI deployments as frontier AI capabilities continue to advance. Practical experience conducting technical research collaboratively, building and instrumenting ML pipelines, writing evaluation harnesses, and turning research literature into working prototypes. A track record of published research in machine learning, particularly in generative AI. At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development. Strong written and verbal communication skills to operate in a cross‑functional team. Nice to Have Experience crafting evaluations and benchmarks, or a background in data science roles related to LLM technologies. Experience with red‑teaming or adversarial testing of AI systems. Familiarity with AI safety policy frameworks (e.g., NIST AI RMF, EU AI Act, Korea AI Basic Act). Equal Employment Opportunity We believe that everyone should be able to bring their whole selves to work, and we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, Veteran status, or any other protected characteristic. We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at View email address on click.appcast.io. We comply with the United States Department of Labor's Pay Transparency provision. We collect, retain and use personal data responsibly for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. Please see our privacy policy for additional information. #J-18808-Ljbffr