GenAI Evaluation Analyst (Legal Technology) - Contract

Key Responsibilities

Evaluate generative AI tools used in legal workflows (e.g., document drafting, summarization, legal research, issue spotting)
Document outputs, limitations, risks (e.g., hallucinations, bias, inaccuracies), and usability observations
Compare AI-generated results against provided reference materials or guidance
Maintain clear, consistent evaluation documentation and testing logs
Escalate anomalies, quality issues, or risk concerns to project leads
Collaborate with legal, innovation, and technology stakeholders as tools evolve

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:


Required Skills & Experience

Strong written communication and documentation skills
High attention to detail and consistency
Comfort working with new or evolving tools
Ability to follow testing instructions and frameworks
General familiarity with professional or enterprise software tools
Analytical mindset and sound judgment


Nice to Have Skills & Experience

Exposure to legal, risk, compliance, or regulated environments
Prior experience evaluating AI tools, LLM outputs, or automation tools


Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.