Lead, Legal AI Benchmarking & Evaluation
Newcode.ai
Newcode.ai in New York is seeking a highly analytical professional with a strong statistical background to join our Head of Evaluations. In this role, you will design, implement, and scale the testing frameworks used to evaluate our platform, ensuring our AI products meet the highest standards of legal reasoning, factual accuracy, and regulatory compliance while maintaining a near-zero hallucination rate. You will design benchmarks for contract drafting, information extraction, legal research, #J-18808-Ljbffr Newcode.ai
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead, Legal AI Benchmarking & Evaluation in New York, NY vacancy
- Who are we? At Newcode.ai, we're transforming how law firms and legal professionals harness AI for real-world impact... ...to join our Head of Evaluations. In this role, you will design, implement... ...Key Responsibilities Design Legal Benchmarks for: Contract Drafting, Information...LegalContract workShift work
$150k - $250k
We are seeking an experienced AI/LLM Product Engineer to design... ...domains, and strategies Define evaluation frameworks to measure and... ...behavior, real-time conditions, and benchmark data Incorporate multiple... ...Commuter Benefits Program ARAG Legal Services Employee Assistance...LegalFull timeWork at officeImmediate startFlexible hours- Obsidian seeks legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify... ...across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI...LegalRemote job
$119.56k - $182.18k
...the forefront of piloting cutting-edge AI technology that is already impacting... ...seeking a highly motivated and skilled Legal AI Solutions Lead to join our Innovation and AI Department... ...business professional teams directly.Evaluates AI use cases and makes recommendations...LegalRemote workWeekend workAfternoon shift$116k - $154k
...best fits them.What You'll Do:Lead strategic sourcing for enterprise... ...a documented, collaborative evaluation process, with action plans... ...with Procurement Operations, Legal, Security, IT, and Office Operations... ...Specifically around adopting AI to build repeatable workflows...LegalWork at office- ...machine learning, and generative AI in a highly regulated... ...requests.As an AI/ML Governance Lead - Vice President within the Commercial... ...partner closely with risk, legal, compliance, and technology... ...changing AI landscapeResearch, evaluate, and stay current on new AI tools...Legal
- Generative AI is making machine learning model development faster... ...AI ML Governance & Automation Lead in Consumer & Community... ...science, engineering, product, legal, risk, controls, compliance, and... ...advanced analytical reasoning to evaluate program performance, identify...Legal
$165k - $220k
...MAIA is our next leap in AI, an always-available... ...closely with engineering to evaluate feasibility, shape... ..., and release quality. Lead day-to-day execution of... ...and reliability. Build benchmark sets, red-team scenarios... ...Work with IT, security, legal, and business...LegalWork at office3 days per week$130.97k - $183.68k
...Apply NowGet to Know the Opportunity:The Lead AI Product Manager is a senior individual... ...language models (LLMs), agentic systems, AI evaluation methodologies, and regulated product... ...across business, technology, compliance, legal, and risk functions, the Lead AI Product...LegalFull timePart timeWork experience placementLocal areaWork from homeFlexible hours$141.2k - $278.3k
Position Summary Google AI Lead Architect/AI & Engineering:Join our AI & Engineering... ..., security, and cost.Design, fine-tune, evaluate, and govern LLM solutions with Gemini on... ...Please see for a detailed description of the legal structure of Deloitte LLP and its...LegalLocal areaVisa sponsorshipFlexible hours- ...attorneys, leadership, clients, and tech teams to identify, evaluate, and implement tools that improve how legal work gets done. This is not a traditional attorney... ...; you will pilot, test, and integrate new tools and AI solutions, translating needs into practical...Legal
- ...Development Manager to open doors with potential partners, lead exploratory discussions, and evaluate opportunities. You will lead cross-functional teams... ...and collaborate with Product, Engineering, Legal and Sales on AI initiatives that support Google's advertising business...Legal
- ...member to enhance its product partner ecosystem. You will identify, evaluate, and scale ecosystem partnerships while managing partner... ...skills. The position offers competitive compensation and a chance to shape a category-defining legal AI platform. #J-18808-Ljbffr HarveyLegal
- ...firm that is making significant investment in legal AI and innovation, and they're looking to hire an AI & Innovation Lead to help shape the next phase of their AI... ...deliver tailored solutions. Leading AI pilots, evaluating emerging technologies, and driving firmwide adoption...LegalRemote work3 days per week
- ...entertainment company and the leader in AI music. We are backed by leading investors including Bond Capital,... ...functions (Growth, People, Legal, Finance, and beyond) to find opportunities... ...confidently. Partner with Leverage team to evaluate, vet, and roll out tools and...LegalFull timeWork at officeLocal area
- ...emails , and pull in Finance, Legal, Security, and IT just to get... ...and Accel to change that. Our AI-native platform connects every... ...entity. As Omnea's AI Solutions Lead, you own deployment of the... ...clear, specific instructions and evaluate what comes back Client-facing...LegalContract workWork at officeShift workDay shift
$60 per hour
A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience in US law. Candidates must have strong written English skills and a stable...LegalPermanent employmentPart timeFreelanceFlexible hours$185k - $200k
...strategies. Ascot offers clients leading financial security while... ...working confidently alongside AI‑enabled tools, applying sound... ...Serve as the primary liaison with Legal, Compliance, and Risk on AI... ...templates, and self‑service guidance Evaluate governance maturity of AI...LegalTemporary workWork at officeFlexible hours- ...Having raised over $20M from leading VCs and trusted by more than 7... ...business dissolution process — from legal and tax to operational and... ...way. Our buyers span the top AI labs, RL environment providers... ...environment builders, data and evaluation vendors, labeling firms, and...LegalLocal areaImmediate startRemote workFlexible hours
$60 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered... ..., our investors include Benchmark , General Catalyst ,... ...in real retail practice. Evaluate AI model outputs against structured... ...skills. Compensation & Legal ~ W-2 employment with...LegalContract workSummer workRemote workWeekday workMercor
New York, NY8 days ago$151.6k - $205k
...the ASV team. It is Amazon's AI-powered content-to-commerce second... ...streaming. As the lead UX Designer for Shop-the-Show,... ...innovations through data-driven evaluation and A/B testing.Basic qualifications... ...operations, product development, legal, etc.- Experience defining...LegalFlexible hours$50 - $190 per hour
...creative and technical talent with leading AI research labs. Headquartered... ..., our investors include Benchmark , General Catalyst ,... ...Role Responsibilities Evaluate AI systems on complex personal... ...projects. Compensation & Legal Hourly contractor . Experts...LegalHourly payContract workFor contractorsSummer workRemote workTrial periodMercor
New York, NY10 days ago$180k - $235k
AI Enablement Lead, External Relations Location New York Business Area Marketing and Public Relations Ref # 10052528 Description... ...connector to firmwide AI, engineering, product, operations, legal, and compliance partners.Help colleagues navigate access,...LegalTemporary workFor contractorsWork experience placementWork at officeShift work$176.72k - $265.08k
AI Transformation Group Manager The AI Transformation... ...responsible for leading and transforming the technology... ...and resilience of the legal‑entity, counterparty,... ...; own performance evaluation and management, talent... ...analytical tools, and benchmarks and to use them to drive...LegalImmediate startShift work$147.6k - $274.2k
Lead Applied Scientist, Search & Information RetrievalAbout the RoleThis... ...optimization for complex legal, tax, and accounting content.... ...retrieval, ranking, relevance evaluation, and production deployment.You... ...on search, retrieval, and AI strategyMentor applied scientists...LegalFull timeLocal areaFlexible hours- ...Schools is seeking an experienced Leader, AI Product Management to drive the adoption... ...every workflow, from classroom content to legal contracts to college counseling, into an... ...— from requirements gathering and vendor evaluation through implementation, testing, and rollout...LegalWork at officeVisa sponsorship
$225k - $250k
...within this exciting and growing industry.Job DescriptionSUMMARYThe Lead, AI Governance and Portfolio Management will lead the operational... ...meet enterprise standards for risk, compliance, security, legal, privacy, and architecture. The role serves as the central point...LegalFull timeTemporary workWork experience placementFlexible hours- ...JPMorganChase AI Research is a global team of research scientists... ...a Vice President / Research Lead in AI Research, you will work... ...stage innovation and rigorous evaluation to production-scale delivery in... ...design and creation of meaningful benchmarks and metrics for evaluation....Work at officeShift work
- Franklin Fitch is assisting a leading US law firm expanding its AI & Innovation team by hiring two Legal AI Solutions Leads. You’ll sit between legal, AI and IT, collaborating with attorneys to turn problems into practical AI solutions. Responsibilities include mapping...Legal
- ...everything across a business—until generative AI. Today, AI is the number one driver of... ...you can help clients shift to the New using leading-edge technologies on some of the coolest... ...employer, or (c) consistent with the Company's legal duty to furnish information.California...LegalFull timeWork experience placementLive inWork at officeLocal areaShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead, Legal AI Benchmarking & Evaluation. Be the first to apply!
Related searches
- legal full time New York, NY
- legal operations specialist New York, NY
- medical legal New York, NY
- asistente legal New York, NY
- legal correspondent New York, NY
- legal billing New York, NY
- remote legal internship New York, NY
- remote legal writer New York, NY
- legal compliance officer New York, NY
- legal writer New York, NY