AI Safety Benchmark Lead & Evaluation Architect
ALICE
Alice is seeking a seasoned researcher-leader to helm AI safety benchmarks and evaluations. You will own the taxonomy, harness, and release cadence, coordinating researchers and freelancers while reporting to the CTO office. You will influence the public research agenda and shape quarterly plans with cross-functional leads. You will collaborate with top AI labs and universities, ensure rigorous evaluation standards, and mentor a growing team of researchers. #J-18808-Ljbffr Alice
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the AI Safety Benchmark Lead & Evaluation Architect in New York, NY vacancy
- ...high-quality academic assessment content for an AI research initiative. You will craft and verify rigorous... ...-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will work on...SuggestedRemote jobFlexible hours
- Rise Data Labs seeks a Media & Information AI Training Specialist to craft realistic media tasks and rubrics for... ..., editing, writing, or video production experience and comfort evaluating professional-grade work to benchmark AI performance. #J-18808-Ljbffr BAM VenturesSuggested
- micro1 is seeking a Member of Technical Staff, Law Research, to lead the development of evaluation frameworks for AI-enabled legal reasoning. You will design benchmarks and collaborate with researchers to shape enterprise AI workflows, focused on robust evaluation across...SuggestedRemote job
- ...high-quality academic assessment content for an AI research initiative. You will write and verify rigorous... ...-choice questions across core business domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...SuggestedRemote job
- ...speaking Subject Matter Expert to contribute to an AI benchmarking project for Bengali in the Indian region. You... ...realistic healthcare scenarios and develop evaluation rubrics to assess clinical reasoning and patient safety. This independent contractor role requires 5+...SuggestedFor contractors
- Weekday AI is seeking expert mathematicians to author and review high-quality academic assessment content... ...questions across core mathematics domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned...Remote jobWeekday work
- ...high-quality academic assessment content for an AI research initiative. You will write and review rigorous... ...philosophy MC questions across core domains, evaluate solution quality, and help establish gold-standard benchmarks for advancing AI capabilities. You will be...Remote job
- ...high-quality academic assessment content for an AI research initiative. You will write and verify rigorous... ...choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...Remote job
- ...high-quality academic assessment content for an AI research initiative. You will write and verify rigorous... ...-choice questions across core chemistry domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...Remote job
- ...high-quality academic assessment content for an AI research initiative. You will write and verify rigorous... ...choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...Remote job10 hours per week
- Remote AI Lead / Architect Accomplished Tech Visionary: Embark on an exciting journey into the realm... ...across multiple domains. You will evaluate emerging technologies, define architectural... .... Evaluate build-vs-buy decisions and benchmark AI tools/platforms. Evaluate emerging...Work at officeLocal areaRemote workFlexible hours
$350k - $375k
Vice President, AI Architect (Remote) page is loaded## Vice President, AI Architect (Remote... ...for performance, resilience, and scale. Benchmark model and serving options, investigate... ...ingestion and model adaptation through evaluation, deployment, and operational feedback....Remote jobWork experience placementWork at officeLocal area- ...building a foundational role in model evals and safety, embedding with research and... ...frontier model development. You’ll define evaluation frameworks, build operational infrastructure... ...sideways, helping Reflection shape open-weight AI responsibly. #J-18808-Ljbffr Jobleads-...
- ...Applied AI Architect (Data, Systems & Governance) | Brillio Architect the Foundations of Enterprise AI Brillio is looking for an Applied... ...vector databases, knowledge layers, and AI data pipelines Evaluate and select AI models based on use case, performance, cost,...Full time
Brillio
New York, NY4 days ago $222.5k - $261.9k
...impact?West Monroe is seeking a Senior Architect to lead the technical vision, architecture, and... ...portfolio of proprietary software assets, AI capabilities, and reusable platforms that... ...enterprise AI platforms and frameworks. Evaluate emerging technologies and establish...Local areaImmediate startFlexible hoursWest Monroe Partners
New York, NY3 days ago- ...A tech-focused research lab is seeking Property Manager Experts to design and evaluate property management challenges for training AI models. This remote role allows you to leverage your expertise in real estate operations while making a significant impact on AI solutions...Remote work
AfterQuery Experts
New York, NY2 days ago $230k
...Data & Digital Platforms, AI at Scale, Agile,... ...transforming strategies into leading-edge tech platforms, at... ...ll DoPrincipal AI Tech Architects at BCG Platinion are:... ...and agent orchestration.Evaluate emerging AI frameworks... ...calling, observability, safety, deployment strategies...Work at officeLocal areaThe Boston Consulting Group
New York, NY2 days ago$150k
...change. BCG delivers solutions through leading-edge management consulting along with... ...platforms, at scale.What You'll DoSenior AI Tech Architects at BCG Platinion are:Collaborative.... ...modules in IT implementation projects.Evaluating products, SW packages, and solutions,...Work at officeLocal areaThe Boston Consulting Group
New York, NY2 days ago$226k - $311k
Secure Every Identity, from AI to HumanIdentity is the key to unlocking... ...are looking for a Product Architect, AI to help define how Auth0 and Okta lead the market in agentic identity, secure... ...frameworks, orchestration tools, evaluation and observability platforms, and...Full timeLocal areaWorldwideFlexible hoursShift workEarly shiftOkta
New York, NY1 day ago$215k - $275k
...engineering, analytics, automation, and AI-native delivery to build... ...enterprise scale. As an AI/ML Architect, you’ll design and deliver... ...orchestration, agentic workflows, evaluation, deployment, monitoring,... ...decision-support use cases.* Lead enterprise adoption of production...Temporary workLocal areaSlalom
New York, NY4 days ago$187.6k - $220.7k
Are you ready to make an impact?Agentic AI Architect-Google Cloud West Monroe is seeking an experienced... .... This highly client-facing role will lead the strategy, architecture, and... ...for clients, exercising sound judgment in evaluating outputs. Apply AI technologies (e.g.,...Local areaImmediate startFlexible hoursWest Monroe Partners
New York, NY17 hours ago$152k - $241.5k
...models are foundational to American AI leadership and cybersecurity, and... ...scientific scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling that helps find... ...meaning it as the program grows. Your benchmarks will define what progress means...Full timeRemote workNvidia
New York, NY1 day ago$258.8k - $304.2k
...to make an impact?Applied AI Engineer/Architect West Monroe is seeking an Applied... ...AI Engineer/Architect to lead the design and delivery of... ..., workflow orchestration, evaluation frameworks, observability,... ...evaluation methodologies using benchmark datasets, regression...Local areaImmediate startFlexible hoursWest Monroe Partners
New York, NY1 day ago- ...global leader in data analytics, AI, and knowledge services,... ...integration layers, and missing evaluation infrastructure. We close that... ...Team Leadership & Reusable IP: Lead 30+ engineers/data scientists... ...fit. Not a Pure Data or Cloud Architect: Warehouse/pipeline design and...Worldwide
Straive
New York, NY4 days ago $270k - $330k
...cybersecurity SaaS company, focused on shaping AI strategy and designing large-scale... ..., production‑grade systems. Evaluate and define AI governance, safety, and compliance frameworks... ...intelligence domains. Experience leading technical strategy and influencing across...Work at officeClera
New York, NY3 days ago$125k - $150k
...Role: AI Lead Architect – RAG & Python Location: NYC, NY/Charlotte, NC We are At Synechron, we believe in the power of digital... ...candidate will also establish AI governance, security, monitoring, evaluation, and LLMOps practices. Additional Information* The...Full timeTemporary workFlexible hoursSynechron
New York, NY4 days ago$190k
...Transformation, Data & Digital Platforms, AI at Scale, Cybersecurity and... ...transforming strategies into leading-edge tech platforms, at scale.What You'll DoLead AI Tech Architects - AI Platforms at BCG... ...modularity, and operational complexity.Evaluate emerging Ai frameworks and...Work at officeLocal areaThe Boston Consulting Group
New York, NY4 days ago$99k - $252.45k
...Description & SummaryThe OpportunityAs an AI Architect Manager, you will design and implement... ...delivery of solutions. As a Manager, you will lead teams and manage client accounts,... ...business performance- Conducting research and evaluating new technologies to drive innovation and...Full timeH1bPwC
New York, NY3 days ago$134k - $348.5k
...LevelDirectorJob Description & SummaryThe OpportunityAs an AI Architect Director, you will lead the design and implementation of innovative technology... ...and cloud deployment- Establishing AI design patterns, evaluates platforms and tools, and guides technical teams to...Full timeH1bPwC
New York, NY17 hours ago- ...join our team.KPMG is currently seeking an AI Architect to join our Audit Technology Alliance organization.Responsibilities:Lead the architectural design and technical strategy... ...engineering standards and advanced AI evaluation frameworks like LangSmith, taking ownership...H1bLocal area
KPMG
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Safety Benchmark Lead & Evaluation Architect. Be the first to apply!
Related searches