In-House Counsel for AI Legal Evaluation [Remote]
$100 - $120 per hourSaidGig
Australia
- Remote job
Role Overview
Evaluate how legal AI systems answer real questions of Australian law by running standardized prompts, comparing outputs, and scoring responses against a provided rubric. This role focuses on quality assessment and concise written feedback to help benchmark two large language model platforms.
Key Responsibilities- Run the same set of prompts through two AI (LLM) platforms for each assignment.
- Compare the outputs from both platforms side by side, noting differences in substance, clarity, and applicability to Australian law.
- Score each response using a standardized rubric supplied by the project team.
- Provide concise written feedback for every evaluation, explaining scores and highlighting notable errors or strengths.
- Minimum 5 years experience as in-house legal counsel practising in Australia.
- Strong command of Australian law, with particular expertise in commercial and contract matters.
- Excellent attention to detail and precise written English.
- Able to work independently to a rubric and meet deadlines consistently.
- Location: Australia, remote.
- Engagement type: hourly work.
- Initial commitment of approximately 10 hours, with a strong potential for additional assignments thereafter.
- All work is subject to a confidentiality agreement, you must sign an NDA before participating.
- Rate: 100 - 120 hourly.
- You must be an in-house legal counsel with the required 5+ years practising in Australia.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the In-House Counsel for AI Legal Evaluation [Remote] in Australia vacancy
- ...Google Workspace across multiple domains and legal entities, MDM and endpoint security for a... ...job. Tier-1 support here is handled by AI agents, onboarding is about 90% automated... ...— we lean toward building small things in-house when an LLM and an afternoon can replace a...HouseLegalRemote jobFull timeContract workLive in
- ...We are Datadog's in-house product experts. The Technical Solutions team enables Datadog's... ...regardless of criminal histories, consistent with legal requirements. Here are our Candidate... ...status of applications. Privacy and AI Guidelines: Any information you submit...HouseLegalWork at officeImmediate startWorldwide3 days per week
- ...Brisbane (Australia) Key Responsibilities Provide strategic legal advice on infrastructure and renewable energy projects,... ...-scale projects. Liaise with internal stakeholders, external counsel, government authorities, and financial institutions. Support...LegalFull time
- ...identity and SSO on Okta , Google Workspace across multiple domains and legal entities, MDM and endpoint security for a global laptop fleet,... .... This is not a helpdesk job. Tier-1 support here is handled by AI agents, onboarding is about 90% automated end to end (HRIS record...LegalFull timeRemote work
Magic Eden
Australia1 day ago - ...manage aspects of regulatory compliance and financial crime prevention. This role is critical in ensuring the organisation meets its legal and regulatory obligations, with a particular focus on anti-money laundering (AML), counter-terrorist financing (CTF), and broader...LegalLocal areaFlexible hours
- ...including wholesale/sophisticated investor classification, KYC, and legal documentation, working closely with OKX's Compliance and Legal... ...-taker fee models, and how HFTs/proprietary trading groups evaluate exchange venues Familiarity with API- or FIX-based trading relationships...LegalFull time
- ...strategic projects while developing and supporting team members Work cross-functionally with Operations, Marketing, Compliance, Legal, Product, Engineering, Risk, Business Development, and Customer Support teams to ensure products are commercially effective, operationally...LegalFull timeLocal area
- ...ensuring alignment with company objectives and legal requirements Collaborate with internal... .... Conduct risk assessments to evaluate the impact of contractual terms on the organization... ...organization. Collaborate with legal counsel when necessary to finalize agreements....LegalContract workFor subcontractorSecond jobLocal areaImmediate start
- ...will drive strategic initiatives and operational excellence across OKX Australia. Working cross-functionally with Product, Compliance, Legal, Risk, Business Development and Global Operations teams, this role identifies opportunities to improve business performance, remove...LegalFull time
- ...data to provide deep direct marketing expertise across channels, evaluating campaign results and adapting the approach to optimize... ...client needs. • Partner closely with product, operations, risk, legal, compliance, technology and required delivery teams to deliver...LegalFull timeFor contractorsFixed term contractWork at officeLocal areaWorldwideShift work
$500 per month
...time observability grids, and enterprise AI data pipelines for the world’s most sophisticated... ...regional business units, corporate Legal structures, and global People cells to... ...programs—including comprehensive performance evaluation cycles, structured compensation processes...LegalFull timeWork at officeLocal areaImmediate startRemote workWork from homeHome officeFlexible hoursShift workClickhouse
Australiaa month ago- ...communication skills, and a compassionate approach Flexible availability & a long-term commitment to Hearth Essential criteria: The legal right to work in Australia A valid driver's license and a registered vehicle NDIS Worker Screening Check Two professional...LegalImmediate startFlexible hoursShift work
- ...cross-functional partners in engineering, design, web, copywriting, legal, and sales What You'll Do Build, lead, and develop a high-... .... Oversee execution across the full marketing mix: web, SEO, AI optimization, email, paid media, press, social, content, events,...LegalFull time
$100k
...Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms...Remote jobPermanent employment- ...expanding our partner integrations. You’ll lead the commercial process leveraging the various internal teams including technology, legal and operations as required. As the process transitions to delivery, you’ll bring the appropriate level of oversight to ensure key milestones...LegalFull timeOverseasFlexible hours
Mx51
Australia20 days ago - ...with Australian Work rights. Who we are At DOF what we do is as important as the way we do business – our operations are safe, legal and ethical, everywhere we do business. The DOF team treat each other and our surroundings with RESPECT, INTEGRITY and strive for...LegalRemote jobCasual workWork at office
- ...lead for Australia, with strong understanding of local consumer behavior, media landscape, and cultural nuances Partner with PR, legal, and compliance teams to ensure messaging is accurate, responsible, and regulator-ready Manage local agencies and creative partners...LegalFull timeTemporary workLocal areaWork from home
- ...and development. Collaborate efficiently across multiple domains, including but not limited to Operations, Product, Engineering, Legal and Customer Success, and with Lifecycle team internal stakeholders to effectively execute and enhance existing integrations, processes...LegalFull timeContract workWork experience placementLocal areaImmediate startRemote workWorldwide
Remote
Australia13 days ago - ...short notice where suitable. Who we are At DOF what we do is as important as the way we do business – our operations are safe, legal and ethical, everywhere we do business. The DOF team treat each other and our surroundings with RESPECT, INTEGRITY and strive for...LegalRemote jobTemporary workCasual workFlexible hours
- ...challenges, identify opportunities and shape commercially sound solutions. Partner with internal teams across Product, Services, Legal, Finance, Customer Delivery, Marketing and other functions to bring the best of Mastercard to our clients. Lead post-implementation...LegalFull timeWorldwide
- ...people management capabilities — you develop and hold a high bar for your team ~ Excellent stakeholder management across engineering, legal, compliance, finance, and senior leadership Life @[ Crypto.com ]( Empowered to think big. Try new opportunities while working...LegalFull timeRemote workFree visa
- ...design, testing, and debugging Ansible playbook authorship and complex task automation RPM design, build, publishing, and in-house repository management CI/CD pipelines, Git version control, branching and merging best practices Strong system and network troubleshooting...House
$100k - $150k
...traders, retail brokers, and portfolio managers. Onboarding Management: Drive the end-to-end onboarding process, coordinating with Legal, Compliance, and Operations to ensure a seamless "time-to-trade" for new clients across all core product lines and RWA verticals....LegalFull timeRemote workFree visa$60 per hour
...minute telehealth consultations with an expected baseline throughput of 4 to 6 patients per hour. Digital Recordkeeping & Medico-Legal Control: Review, maintain, and publish uncompromised patient health charts and electronic clinical histories in accordance with strict...LegalHourly payContract workFor contractorsRemote workFlexible hoursShift workAfternoon shiftAlternaleaf
Australiaa month ago- ...disciplinary processes Act as the escalation point for complex ER cases, ensuring outcomes are compliant, consistent, and minimise legal risk Maintain up-to-date knowledge of applicable legislation including the Fair Work Act, Work Health & Safety laws, and case law...LegalRemote jobImmediate startFlexible hours
$130k
...holiday (between Boxing Day and New Year's Day). Outstanding career growth opportunities and world-class training through our in-house Training Alliance and registered training organization CPA Clinical salaries are up to $130,000 equivalent package depending on...HouseFull timePart timeRelocation package- ...trade schools, industry bodies, and community groups - they will excel at both attending external events and creating memorable in house event experiences that showcase Tesla as a premium employer of choice in the Aftersales sector. Working closely with Aftersales Leadership...HousePermanent employmentFull timeContract workApprenticeshipNight shift
- ...offering expertise in property management, investment management, development, and construction services in institutional-quality rental housing. Headquartered in Charleston, South Carolina, Greystar manages and operates over $350 billion of real estate in more than 260...HouseLocal areaImmediate startRotating shift
$500 per month
...milestones. Empowerment and Growth: access to a $500 learning and development budget to put towards your professional growth, in-house workshops & Lunch & Learns; and Our annual Summer Camp offsite Office Benefits: Weekly catered breakfast, monthly team lunch...HouseSummer workWork at officeLocal areaRemote workDay shift- ...offering expertise in property management, investment management, development, and construction services in institutional-quality rental housing. Headquartered in Charleston, South Carolina, Greystar manages and operates over $300 billion of real estate in more than 265...HousePermanent employmentLocal areaImmediate startWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to In-House Counsel for AI Legal Evaluation [Remote]. Be the first to apply!
