Australian In-House Counsel for Legal AI Evaluation
$100 - $120 per hourSaidGig
Evaluate AI-generated answers to practical Australian legal questions, applying your in-house legal judgment to help assess quality, accuracy, and usefulness. Role Overview
In this remote, hourly engagement, you will review responses from two AI language model platforms and assess their performance on Australian law questions.
Key Responsibilities- Run an identical set of prompts through two AI language model platforms.
- Compare the resulting answers side by side.
- Score each response using a standardized rubric provided for the engagement.
- Provide concise written feedback for every evaluation.
- At least 5 years of experience practising as in-house legal counsel in Australia.
- Strong knowledge of Australian law, particularly commercial and contract matters.
- Excellent attention to detail and precise written English.
- Ability to work independently, follow a rubric, and meet deadlines.
- Remote role based in Australia.
- Hourly engagement with an initial commitment of approximately 10 hours.
- All work is subject to a confidentiality agreement.
$100 to $120 per hour.
Vacancy posted 16 days ago
Similar jobs that could be interesting for youBased on the Australian In-House Counsel for Legal AI Evaluation in Remote vacancy
$100 - $120 per hour
...Evaluate and improve AI responses to real Australian law questions by applying your litigation and disputes expertise. You... ...Responsibilities Run the same legal prompts through two AI language-model... ...Candidates currently working in-house are eligible only if they moved in...HouseLegalHourly payRemote workSaidGig
Remote5 days ago- ...Apply your Australian litigation and procedural law expertise to evaluate and improve how AI systems respond to real legal questions. You will test comparable prompts across two AI platforms... ...more years preferred. Current in-house lawyers are eligible only if they moved...HouseLegalHourly payRemote work
SaidGig
Australia5 days ago $170 per hour
...Role Overview Evaluate AI-generated legal analyses related to civil legal services and access-to-justice... ...factual and legal scenarios in housing, family, consumer, foreclosure, and debt... ...Qualifications: prior service as Pro Bono Counsel or Pro Bono Partner, experience...HouseLegalHourly payRemote workSaidGig
United Statesa month ago- ...Role Overview Evaluate how effectively AI systems respond to practical questions of German law. You will apply your in-house legal expertise to compare responses from two AI platforms, assess... ...of experience as in-house legal counsel practicing in Germany. ~ Strong knowledge...HouseLegalHourly payContract workRemote work
SaidGig
Germany16 days ago - ...French commercial and contract law expertise to evaluate how AI systems respond to practical legal questions. You will independently compare legal outputs... ...At least 5 years of experience as in-house legal counsel practicing in France. Strong knowledge of French...HouseLegalHourly payContract workRemote work
SaidGig
Remote16 days ago $100 - $120 per hour
...Role Overview Evaluate how legal AI systems answer real questions of Australian law by running standardized prompts, comparing outputs, and scoring responses... ...Qualifications Minimum 5 years experience as in-house legal counsel practising in Australia. Strong command of...HouseLegalRemote jobHourly payContract workSaidGig
Australia4 days ago$150 - $160 per hour
...Act as an expert reviewer assessing how AI systems answer real questions of French... ...concise written feedback for every evaluation. Key Responsibilities Run the same... ...Qualifications At least 5 years experience as in-house legal counsel practising in France Strong command...HouseLegalRemote jobHourly payContract workSaidGig
Remote4 days ago$170 per hour
...Role Overview Evaluate AI-generated legal analyses that address civil legal services and access-to-justice... .... Evaluate scenarios across housing, family, consumer, foreclosure, and debt... ...Experience serving as Pro Bono Counsel or Pro Bono Partner. Experience coordinating...HouseLegalHourly payRemote workSaidGig
United States4 days ago$150 - $160 per hour
...Role Overview Evaluate how two large language model platforms answer... ...for experienced in-house counsel with strong commercial and contract... ...predefined set of prompts on two AI language model platforms,... ...years experience as in-house legal counsel practising in the United...HouseLegalRemote jobHourly payContract workSaidGig
Remote4 days ago$216k - $324k
...building products rooted in AI, automation, and... ...entrepreneurial Senior Counsel, Product (AI) to support... ...leader at the company. Our legal team is practical and... ...at least 3+ years in-house, preferably at a global... ...may be used to screen or evaluate applications for this...HouseLegalFull timeWork at officeRemote workFlexible hoursShift work$165k - $195k
...People and Places, General Counsel, Risk, Internal Audit,... ...team, providing legal counsel on complex global... ...artificial intelligence (AI) governance. This role... ...a large law firm or in-house within a global financial... ...should be contacted to evaluate the accommodation...HouseLegalFull timeContract workWork at officeRemote workWork from homeWorldwide- YO IT Consulting is seeking a seasoned in-house transactional attorney for a part-time, remote role shaping how legal AI models are trained, evaluated, and applied in real-world work. The role emphasizes drafting, reviewing, negotiating, and redlining technology contracts...HouseLegalRemote jobContract workPart time
- Overview The Senior Counsel - Contract Intelligence and AI Integration will lead the implementation... ...management across the Legal Department. This attorney... ...by the Legal Department Evaluate every contract submitted... ...legal research tools Prior in‑house experience preferred,...HouseLegalContract workWork at officeRemote work
€140 - €150 per hour
...Apply your Spanish corporate and commercial law expertise to evaluate AI-generated legal answers. In this remote, hourly role, you will compare... ...transactional practice, with 3 or more years preferred. Current in-house lawyers are eligible only if they moved in-house within the...HouseLegalHourly payRemote workSaidGig
Remote6 days ago$90 - $100 per hour
...author realistic corporate law evaluation tasks used to test AI systems in high-stakes... ...transaction tooling, such as legal research platforms, virtual... ...or serving as general counsel at a major law firm, investment... ...including top law firms and in house roles at large public...HouseLegalHourly payContract workRemote workSaidGig
United States9 days ago$150 per hour
...Role Overview Evaluate AI-generated legal reasoning in civil justice matters, using your public interest and civil litigation experience to identify... ...real-world usefulness. Evaluate scenarios involving housing, family law, consumer protection, debt collection, and...HouseLegalHourly payRemote workSaidGig
United Statesa month ago$90 - $100 per hour
...Design and author complex regulatory law evaluation tasks for AI systems used in regulatory compliance... ...that reflect senior regulatory counsel judgment. Key Responsibilities Construct... .... The two tracks emphasize different legal frameworks, US Administrative...LegalHourly payFixed term contractRemote workSaidGig
United States14 days ago$90 - $150 per hour
...experience to improve how advanced AI systems interpret contract... ...risk, and support real-world legal work. Role Overview This remote... ...role focuses on training and evaluating AI through contract drafting,... .... At least 3 years of in-house experience in technology transactions...HouseLegalHourly payContract workPart timeFor contractorsRemote workSaidGig
United States24 days ago$90 - $100 per hour
...Overview Design and author realistic evaluation tasks for AI systems used in civil rights, environmental... ..., environmental law and regulation, housing and consumer protection, immigration... .... Develop scenarios that involve legal research platforms, case management systems...HouseLegalHourly payWork at officeRemote workSaidGig
United States14 days ago$220k - $260k
...Future NeighborsThe Counsel team is a close-... ...and consistency in legal advice and counsel... ...we operate in an AI-first environment... ...manner, including evaluating and advising on risks... ...a law firm or in-house counsel role J.D.... ...DSA, Canadian law, Australian lawLitigation...HouseLegalWork at officeLocal areaWork from homeFlexible hours- ...Evaluate how AI systems respond to practical questions of German law by comparing legal analyses from two AI platforms and applying a consistent expert-review standard. Key Responsibilities... .... Candidates currently working in-house are eligible only if they moved in-house...HouseLegalHourly payRemote work
SaidGig
Remote5 days ago $214.2k - $315k
About the TeamDoorDash's Legal Team has built a reputation within... ...our collaborative approach to counseling, always with a bias for action... ...Platform, and Labs. You will support AI Data Services and Dasher Tasks... ...prior experience at an in-house legal department. You are...HouseLegalHourly payFor contractorsWork at officeLocal areaImmediate startRemote workFlexible hours- ...Evaluate and compare AI-generated answers to practical UK law questions, applying your litigation expertise... ...to help assess answer quality and legal accuracy. Role Overview You will test... ...more years is preferred. Current in-house lawyers are eligible only if they moved...HouseLegalHourly payFor contractorsRemote work
SaidGig
United Kingdom5 days ago $90 - $100 per hour
...Role Overview Design evaluation tasks and realistic practice materials for AI systems that will operate... ...that reflect senior IP counsel judgment, and produces rubrics... ...reasoning from generic legal recall. Key... ...at a major IP firm or in-house IP department, with examples...HouseLegalHourly payWork at officeRemote workSaidGig
United States14 days ago$110 - $150 per hour
...Shape rigorous AI evaluation work for legal matters involving the regulatory complexity, transaction scale, and risk standards of Fortune 50... ...Responsibilities Create enterprise legal scenarios spanning in-house counsel, regulatory, transactional, and litigation matters....HouseLegalHourly payRemote workSaidGig
United States14 days ago$171.12k - $213.9k
...Artificial Intelligence (AI) to help make our... ...as Twilio's next Senior Counsel, Commercial. About... ...the growing commercial legal team to support the Go-... ...their perspectives. Evaluate and prioritize which matters... ...as Registered In-House Counsel ~6+ years of...HouseLegalContract workLocal areaRemote workWorldwideTwilio
San Francisco, CA5 days ago- A legal recruitment firm is looking for a Senior Legal Counsel to join a growing global AI infrastructure company. This role offers the chance to influence executive decisions... ...experience in both private practice and in-house worlds would be ideal. This remote-first position...HouseLegalPrivate practiceRemote work
W&P Partners Recruitment
New York, NY4 days ago $180k - $325k
...powering the future of physical AI. Founded in 2017 and now... ...role Reporting to the General Counsel, the Senior Counsel, Privacy &... ...governance efforts and serve as a key legal partner to Product,... ...+ years of law firm and/or in-house experience, with substantial privacy...HouseLegalFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workWorldwideDay shiftApplied PC
Sunnyvale, CA4 days ago- ...Legal Counsel SymphonyAI Financial Services is a leading provider of advanced AI-driven solutions for financial crime and compliance management... ..., and collaborations. Evaluate and address legal risks associated... ...PQE at a law firm or in-house. Required: experience...HouseLegalContract workWork at officeRemote work
SymphonyAI
United States1 day ago - ...Systems builds the world's largest AI chip, 56 times larger than... ....As Director, Data Center Counsel at Cerebras, you will support... ...throughout their lifecycle, provide legal advice on all matters relating... ...of leading law firm and in-house experience preferred.The compensation...HouseLegalWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Australian In-House Counsel for Legal AI Evaluation. Be the first to apply!
