Frontier AI Risk Evaluations Scientist
Scale AI, Inc.
Scale AI, Inc. is looking for a Research Scientist focused on Frontier Risk Evaluations to develop evaluation measures and datasets for assessing AI risks. As a key team member, you will engage with government agencies and publish methodologies that influence AI safety policy. Candidates should have a strong track record in machine learning research and excellent collaboration skills. The position offers a competitive salary package, including benefits and equity opportunities. #J-18808-Ljbffr Scale AI, Inc.
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Frontier AI Risk Evaluations Scientist in New York, NY vacancy
- Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs...Risk
- ...Journalist and Content Strategist for AI Research | Local Historian,... ...a new client project at the frontier of Generative AI (GenAI).... ...expertise will help train and evaluate the next generation of Generative... ...and reliability, reducing the risk of misinformation, especially...RiskFreelanceLocal areaRemote workFlexible hours
$121k - $141k
Machine Learning Scientist, New AI Products and Platforms New York, NY The mission of The New York... ...‑Tower architectures. Fine‑tune and evaluate language models for custom use cases... ...robustness and reproducibility, considering risks and trade‑offs. Adapt or develop ML...RiskWork experience placementWork at officeRemote workFlexible hours$170k - $215k
...Founding Scientist — AI Review of Biomedical Grants and Papers CoPAIR... ...building an AI system that evaluates scientific manuscripts and grant... ...we orchestrate ensembles of frontier models in specialized,... ...manuscripts for impact, rigor, and risk. Own the validation...RiskPermanent employmentFull timeWork at officeRelocation package$300k - $325k
Senior Program Scientist, AI and Advanced Computing Institute Join to apply for the Senior Program... ...to mitigate and manage potential risks from advanced AI. Improve AI reliability... ...directions for engagement. Technical Evaluation and Program Development Provide technical...RiskLocal area- As a Research Scientist on our team, you will partner with... ...on our track record of AI-powered solutions (e.g.... ...Research tackles high-risk, high-reward problems... ...RL training loops, and evaluation infrastructure needed to... ...that match or surpass frontier models at a fraction of...Risk
$40 per hour
...DataAnnotation is seeking a Biotechnology R&D Scientist to train AI models. In this role, you will evaluate the outputs of AI chatbots and assess their logic to improve model quality. The ideal candidate should have a deep understanding of cell biology, genetics, biochemistry...Hourly payFor contractorsRemote workDataAnnotation
New York, NY3 days ago$85k - $95k
...Are The real world is the next frontier, and at Metropolis, we are... ...growth. In this role, you will evaluate deal structure, shape pricing... ...economic scenarios, surfacing risks and opportunities proactively... ...environment Experience leveraging AI tools to transform static...RiskTemporary workWork at officeLocal area$50 - $60 per hour
DataAnnotation is seeking a Risk Analyst to evaluate and improve AI Assistant models focused on finance. You will work independently, using your expertise to assess AI responses about financial principles. The role offers a flexible schedule, allowing you to choose projects...RiskRemote jobHourly payFlexible hours$50 - $60 per hour
A financial technology company based in New York is seeking a Credit Risk Officer to train AI models, evaluate their outputs, and enhance their performance. Applicants should possess expert financial reasoning and skills in financial analysis. This role offers flexibility...RiskRemote jobHourly pay$40 per hour
A leading AI training company is looking for a Research Scientist (Biology) to evaluate AI models. This role involves testing chatbots with complex biology questions and requires strong expertise in biology and related fields. Candidates must be fluent in English and detail...Hourly payContract workRemote workFlexible hoursDataAnnotation
New York, NY2 days ago$40 per hour
A technology firm specializing in AI is looking for a Research Scientist (Chemistry) to join their team. This role involves training AI models by evaluating chatbot outputs on complex chemistry questions. The candidate should possess a solid understanding of chemistry...Hourly payContract workRemote workDataAnnotation
New York, NY2 days ago$50 - $60 per hour
DataAnnotation is seeking a Risk Analyst to assist in training AI models, particularly for finance professionals. The role involves evaluating AI outputs, providing structured feedback, and solving problems to enhance AI accuracy. Applicants should have strong finance...RiskRemote jobHourly payFor contractorsWork from homeFlexible hours- Abridge is seeking a Research Scientist to evaluate the real-world impact of ambient AI on healthcare outcomes. This role involves designing empirical studies and collaborating with health systems to generate insights into care quality and patient experience. Applicants...Work at office
$40 per hour
A data annotation company seeks an R&D Biologist to enhance AI models by evaluating chatbot outputs related to complex biology queries. This remote position allows flexibility in project selection and scheduling, with hourly rates starting at $40+ USD. Ideal candidates...Hourly payRemote workDataAnnotation
New York, NY2 days ago- Obsidian is seeking PhD-level chemists to enhance the safety of advanced AI models. The role involves writing expert prompts and evaluating model responses on chemistry topics. Training will be provided for those without AI/ML experience. Ideal candidates will hold a PhD...Part timeFlexible hours
- Crossing Hurdles in Canada is seeking a Computational Physics Expert to contribute high-quality insights on AI evaluation projects. The candidate will analyze large-scale scientific data sets and collaborate with interdisciplinary teams to enhance AI capabilities in scientific...
$40 per hour
A cutting-edge AI training company in the United States is looking for a Microbiologist to evaluate and improve AI chatbot models. This role allows you to work remotely and choose projects on your own schedule, with compensation starting at $40 per hour plus bonuses for...Hourly payContract workRemote workDataAnnotation
New York, NY3 days ago- ...Biological Safety Research Scientist San Francisco, CA... ...mechanisms for our AI systems. As a Safeguards... ...opportunity to shape how frontier AI models handle dual-use... ...and execute capability evaluations ("evals") to assess the... ...to contribute to new risks and new mitigation strategies...RiskWork at officeVisa sponsorshipFlexible hoursShift work
anthropic
New York, NY9 hours ago $76k - $125.3k
...issues, provide advice and assistance managing risks across tax compliance and/or advisory... ...and other business analysis Compile and evaluate moderately complex data, computations, documentation... ...in capital markets. Enabled by data, AI and advanced technology, EY teams help...RiskSummer holidayFlexible hours$40 per hour
DataAnnotation is seeking a Clinical Researcher to assist in training AI models by measuring progress and evaluating outputs. The role allows candidates to work from home on their schedule, choosing projects that interest them. Applicants should have a strong background...Remote jobHourly payFor contractorsWork from home- DataAnnotation is seeking a Research Scientist (Chemistry) in the United States. The role involves training AI models by posing complex chemistry questions and evaluating their outputs. Applicants should possess a solid grounding in chemistry concepts and an ability to...Remote jobFor contractorsFlexible hours
- A leading data services company is seeking an Applied Mathematician to evaluate AI models by providing complex mathematical problems to chatbots and assessing their outputs for quality and performance. This role offers flexibility with fully remote work and allows you to...Remote jobHourly pay
$40 per hour
A growing technology company is seeking an R&D Biologist to join their team. This role involves training AI models by evaluating chatbot outputs on complex biology questions. Applicants should possess strong expertise in biology and related fields. You will work remotely...Remote jobHourly pay- SME Careers is seeking physicists for an AI training project where you will review AI-generated responses, evaluate reasoning quality, and provide expert feedback. This role allows you to contribute to future AI projects and enhance model accuracy through your expertise...
$146.8k - $272.6k
...industry setting? TR Labs is the AI Research & Development arm of... ...Reuters. We are seeking scientists with a passion for solving problems... ...for Legal, Tax & Accounting, Risk, and News Media professionals.... ...Outstanding technical judgment and evaluation expertise Excellent...RiskWork at officeLocal areaFlexible hours2 days per week3 days per weekThomson Reuters
New York, NY2 days ago$40 per hour
...A leading AI training company is seeking a Theoretical Physicist to evaluate and improve AI models by assessing their reasoning with complex physics questions. The ideal candidate will possess a strong understanding of various physics disciplines and will be responsible...Hourly payRemote workFlexible hoursDataAnnotation
New York, NY2 days ago- ...healthcare technology firm is seeking a Senior GenAI Scientist II to deliver innovative solutions that... ...quality. This role requires expertise in AI and machine learning, with responsibilities including model validation, risk management, and improvements in monitoring activities...RiskRemote job
- ...candidate for the position of STEM Computational Scientific Software & Evaluation Design in Astrophysics & Cosmology. This position is remote with... ...include designing computational problems, evaluating AI systems, and developing strategies for data recovery. Interested...Remote jobContract work
- Mercor is hiring for a STEM Computational Scientific Software & Evaluation Design position in Astrophysics & Cosmology. This role is remote... ...requires candidates to design computational problems and evaluate AI systems for research purposes. A graduate degree in a relevant...Remote jobPart time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontier AI Risk Evaluations Scientist. Be the first to apply!
