Director, Research - AI Evals
$258k - $348kFigma
Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us!The Figma Research team is hiring an Director, Research - AI Evals to own how we measure the quality of Figma's AI-powered experiences. As Figma ships more AI capabilities across our products, the question "is this really good?" has never mattered more — and answering it rigorously is what this role exists to do. You'll define what "good" means for our AI features, build the frameworks and quality bars to measure it, and turn that into trusted signal that product teams rely on to decide what to ship.The ideal candidate brings deep, hands-on experience evaluating AI/LLM-powered products — blending human evaluation with automated, model-based approaches — along with the product instinct and communication skills to make evaluation genuinely useful. Partnering with Product, Design, Engineering, and Data Science, you'll sit upstream of nearly every AI shipping decision at Figma and directly shape the quality of features used by millions of people.This is a full time role that can be held from one of our US hubs or remotely in the United States.What you'll do at Figma:Own AI evaluation methods and operations for Figma's AI-powered experiences — define quality dimensions, design how we measure them, and turn results into decision-ready signalBuild and maintain evaluation frameworks, rubrics, golden datasets, and quality bars, combining human evaluation with automated/model-based approaches (e.g., LLM-as-judge) where appropriatePartner with engineering to stand up repeatable, reproducible evaluation pipelines and regression testing, so evaluation is a routine part of how AI features are built and shippedProduce clear readouts and dashboards that let stakeholders confidently make go/no-go and prioritization decisionsSocialize a shared definition of quality so evaluation standards are adopted across teams rather than re-invented — and advocate for evaluation as a strategic partner in the product processManage a small team to execute our AI evals in partnership with contractors, internal staff, and/or LLMsWe'd love to hear from you if you have:10+ years of experience in product, research, applied research, or a closely related field, including 2+ years of management experienceDirect, hands-on experience owning the evaluation of AI/LLM-powered productsExpertise designing and running AI evaluation — human evaluation programs, rubric and benchmark/golden-dataset construction, inter-rater reliability — and sound judgment about when and how to apply automated/model-based approaches (e.g., LLM-as-judge), including their limitationsStrength across both qualitative and quantitative methods, comfort with data and metrics, and the ability to reason about model behaviorDemonstrated success in identifying the riskiest assumptions behind an ambiguous quality question, prioritizing them, and designing right-sized evaluation to build confidenceA proven track record of gaining buy-in from executive and cross-disciplinary stakeholders — transcending methodology to articulate a larger user story and the "so what" to inspire actionWhile it's not required, it's an added plus if you also have:Experience building or co-building automated evaluation pipelines and regression testing in partnership with engineering, or familiarity with eval tooling (e.g., Braintrust, LangSmith, DeepEval, or equivalents)Experience standing up a new function, practice, or discipline from scratch2+ years in product design, user-centric product management, data science, product development, and/or front-end engineeringA familiarity and depth of experience using Figma's productsAt Figma, one of our values is Grow as you go. We believe in hiring smart, curious people who are excited to learn and develop their skills. If you’re excited about this role but your past experience doesn’t align perfectly with the points outlined in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.Pay Transparency DisclosureJob level and actual compensation will be decided based on factors including, but not limited to, individual qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), market demands, and specific work location. Figma offers equity to employees, as well as a competitive package of additional benefits, including health, dental, and vision coverage; retirement benefits with company contributions; parental leave and reproductive or family planning support; mental health and wellness benefits; and paid time off. Figma provides paid sick leave, holidays, and other leave benefits in compliance with applicable federal, state, and local laws, including the requirements of the Washington Minimum Wage Act and related regulations. Exempt employees are eligible for employer‑provided paid flexible PTO in addition to flexible paid sick leave. PTO is subject to manager approval. Additional benefits may include company recharge days, cell phone and home internet reimbursements, and a number of lifestyle spending accounts. Figma also offers sales incentive compensation for most sales roles and an annual bonus plan for eligible non-sales roles. All compensation and benefits are subject to applicable plan terms and may be modified by Figma at any time, consistent with applicable law.Annual Base Salary Range:$258,000—$348,000 USDAt Figma we celebrate and support our differences. We know employing a team rich in diverse thoughts, experiences, and opinions allows our employees, our product and our community to flourish. Figma is an equal opportunity workplace - we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity/expression, veteran status, or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.We will work to ensure individuals with disabilities are provided reasonable accommodation to apply for a role, participate in the interview process, perform essential job functions, and receive other benefits and privileges of employment. If you require accommodation, please reach out to View email address on click.appcast.io. These modifications enable an individual with a disability to have an equal opportunity not only to get a job, but successfully perform their job tasks to the same extent as people without disabilities. Examples of accommodations include but are not limited to: Holding interviews in an accessible locationEnabling closed captioning on video conferencingEnsuring all written communication be compatible with screen readersChanging the mode or format of interviews To ensure the integrity of our hiring process and facilitate a more personal connection, we require all candidates keep their cameras on during video interviews. Additionally, if hired you will be required to attend in person onboarding.By applying for this job, the candidate acknowledges and agrees that any personal data contained in their application or supporting materials will be processed in accordance with Figma's Candidate Privacy Notice.
- International Rescue Committee (IRC) seeks a Director of Research to lead the Airbel Impact Lab’s strategic research efforts across multiple sectors. You will guide ambitious research agendas, build teams, and advance evidence-based solutions in humanitarian contexts....Suggested
$255k - $275k
...Autism and Neuroscience (A&N), is seeking an experienced Director or Senior Director of Research Software Engineering (RSE) to lead the design,... ...part of the Informatics leadership team, they shape how AI is incorporated into A&N’s research software and the broader...SuggestedFull timeLocal area$365k
...Technical Program Manager, Research Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users... ...ll move across research areas like compute, evals, RL environments, and emerging research initiatives...SuggestedWork at officeFlexible hoursShift work$140k - $230k
DescriptionThe Mount Sinai Tisch Cancer Center (TCC) is seeking a Director for Research Administration who will also hold the role of Associate Director for Administration for the P30 Cancer Center Support Grant. The TCC at Mount Sinai is a National Cancer Institute (NCI...SuggestedContract workTemporary workTraineeshipWork at officeLocal area- A tech-driven research company in New York is seeking a Sales Director for Research & Insights to drive growth. This senior role involves managing the full sales cycle with Market Research teams in enterprise organizations. The ideal candidate will have over 5 years of...Suggested
$204.25k - $285k
...or more of the firm’s portfolios. As a Principal Quantitative Research / Quant Developer within the derivatives platform team in Asset... ...aggregation, and hedging analytics Architects and governs agentic AI-enabled engineering workflows (using enterprise-authorized tools...Full time$195k - $400k
...About Agentio Agentio builds AI-native infrastructure for creator advertising. Our platform... ...decisions. We're looking for a Research Engineer to advance that work through applied... ...Turn campaign data into training signals, evals, and learning loops while tackling problems...Full timeWork at officeLocal areaFlexible hours$350k
...create reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...is a quickly growing group of committed researchers, engineers, policy experts, and business... ...horizon and vision-heavy tasks, building evals, designing rewards, and scaling data. This...Full timeWork at officeVisa sponsorshipFlexible hours$124k - $335k
...Java and Python programming languages - Production experience with Microsoft Azure cloud services - Production experience with ADLC and AI coding tools Travel RequirementsUp to 40%Job Posting End DateThe salary range for this position is: $124,000 - $335,000. Actual...Full timeH1b$315k
We are looking for Research Engineers to build “gold standard” evaluations for catastrophic risks, in order to understand what AI Safety Level (ASL) to assign to models. Research leads on... ...national security, and experiment with new evals, in order to measure how risky AI...Currently hiringWork at officeImmediate startHome officeVisa sponsorshipRelocation package$140k - $170k
...reliability. Guided by our vision to help researchers rapidly move from the lab to life-... ...makes everything possible.The Innovation and AI Manager plays a key role in bringing AI strategy... ...advantage.This position reports to the Director of Data, Innovation & AI and is part of...Full timeRemote workWork from homeFlexible hours$250k - $325k
..., 08/31/2026 - 04:43 EPAM's new Frontier AI business unit partners directly with leading... ...AI organizations, translating their research and post-training objectives into technically... ..., and training data. The Senior Director, Frontier AI Research is EPAM's first dedicated...Remote jobTemporary workH1bFlexible hours- JPMorganChase AI Research is a global team of research scientists, engineers and product managers that develops novel AI capabilities and... ...risk management, effectively and responsibly. As an Executive Director / Research Director in AI Research, you will work on...Work at officeShift work
$148.1k - $282.1k
The OpportunityThe Research and AI team builds foundational generative AI models and applications for Adobe products, enabling customers to ideate, build, and scale content in new ways.The role of Principal PM involves defining and advancing foundational generative capabilities...Full timeTemporary workLocal areaWorldwide$99k - $266k
...The OpportunityAs part of the Software Engineering team, you will lead one or more delivery teams to design, build, and run innovative AI- and data-intensive tax platforms. As a Manager, you will provide technical and people leadership, guiding architecture and...Full timeH1b- Scorpion Therapeutics seeks a Senior Technical Product Manager (AI Research & Development) to drive product strategy for our AI-enabled research platforms. Remote within the United States with hybrid options in Vancouver, WA and New York City, NY. You will gather requirements...Remote job
$124k - $155k
About the TeamAI Research Lab is one of DoorDash’s frontier innovation hubs, focused on building the foundation for an AI-native future across our three core audiences: consumers, merchants, and dashers. As AI capabilities accelerate, the AI Research Lab operates at the...Hourly payWork at officeLocal areaRemote workFlexible hours$124k - $335k
...ApplicableSpecialismData, Analytics & AIManagement LevelSenior ManagerJob Description & SummaryThe Opportunity As a Tax Innovation - AI Engineer, you will lead the integration and deployment of artificial intelligence technologies within our Tax practice, enhancing performance...Full timeH1b- Medidata, headquartered in New York, is seeking a Senior Director of AI & Data Science to shape the future of AI in clinical development.... ...Data teams, and ensure scalable, secure AI systems that accelerate clinical research and patient outcomes. #J-18808-Ljbffr PowerToFly
- ...impact by delivering high-quality products that transform the way we do business within Markets.As a Product Manager - Sales Applied AI & Insights, Vice President - in Digital Sales, you will play a key role in leveraging emerging technologies such as GenAI to create unique...Work at office
$177k - $260k
...decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter from content you can... .... Our universe of public and private content includes equity research, company filings, event transcripts, expert calls, news, trade journals...Local areaShift work- Latham & Watkins is seeking a Research Services Manager - Operations, AI Platforms to lead evaluation, testing, and implementation of AI-powered research services. You will develop testing protocols, coordinate pilots, collect feedback, and advise on adoption strategies...Work at office
$207k - $300k
...engineering solutions, and run rigorous experiments to address emerging research priorities within the Responsibility portfolio.Work with Research Scientists to advance the state of the art in Responsible AI.Act as a technical anchor for the team, establishing best practices...$174k - $252k
...training recipes.Integrate novel ML and agentic techniques into research prototypes.Build evaluation pipelines, benchmarks, and leaderboards... ...community by partnering with universities and publishing papers.AI’s cyberattack capability is increasing rapidly and it is...$197.3k - $313.7k
...CategorySoftware EngineeringJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together.... ...where your engineering skills directly enable world-class research and products used by millions?At Salesforce, we are driving the...Full time$101.6k - $188.7k
...customers? Then come and apply your skills and passion for technology at Thomson Reuters Labs.We are seeking a Research Engineer who will bring expertise in AI and ML and is interested in building data-driven capabilities that transform the way legal, accounting, and...Full timeWork at officeLocal areaRemote workFlexible hours$200k - $300k
...minds in the field.We are seeking highly motivated and skilled Research Engineers who will work very closely with our Algo Developer (Quant... ...you are we’d love to get to know you.Please be advised: Use of AI tools during interviews or assessments is strictly prohibited,...Temporary workWork at officeLocal areaImmediate start$167k - $235k
...requirements documentation, user testing, training, and licensure management Knowledge of LegalTech product categories and emerging AI tools Strong collaboration and interpersonal skills, with the ability to work effectively with colleagues across teams Good...Full timeWork at office- ...Tessera Labs Research Engineer Tessera Labs is a new category of enterprise software: an AI platform that changes how the world's largest companies run. Every large enterprise carries the same weight — decades of accumulated process, data, and code that no longer match...
$250k - $350k
...empowered to build an exceptional career.Position Summary:The Director of Research & Intelligence provides strategic leadership and operational... ...priority of this role is leading the Firm's strategic adoption of AI-powered research and intelligence tools in collaboration with...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Director, Research - AI Evals. Be the first to apply!
- research coordinator remote New York, NY
- director of research New York, NY
- research finance manager New York, NY
- senior research manager New York, NY
- research coordinator New York, NY
- director institutional research New York, NY
- research data coordinator New York, NY
- clinical research manager New York, NY
- research supervisor New York, NY
- research data manager New York, NY

