Product & AI Quality Intern, Technical Projects Group

Hillspire, LLC, is an integrated family office management company that serves the business and philanthropic activities of Eric and Wendy Schmidt and their family and supports more than 700 employees worldwide. Hillspire provides legal, finance, accounting, facilities and real estate, human resources, and information technology services to the organization. Eric and Wendy Schmidt have created a number of philanthropic organizations and initiatives that work toward a healthy, resilient, secure world for all. These philanthropic organizations include: The Schmidt Family Foundation works to restore a balanced relationship between people and planet. It has two grant-making and investment programs: The 11th Hour Project, which works to create a world with fresh air, clean water and healthy food for all people; and Schmidt Marine Technology Partners, which supports scientists, engineers and entrepreneurs in developing technologies that restore ocean health. Schmidt Ocean Institute is a virtual institute that operates the research vessel Falkor (too). The ship and its assets are available at no cost to scientists worldwide working to explore, discover and understand the ocean. Schmidt Ocean catalyzes ocean exploration and research and educates and engages the public to inform the wise stewardship of the planet. Schmidt Sciences works to deepen human understanding of the natural world and develop solutions to global issues with science and technology. The core focus areas of the organization include: AI and advanced computing, astrophysics and space, biosciences, climate and cross-science programs. 11th Hour Racing works with the sailing community and maritime industry to advance solutions and practices that protect and restore the health of the ocean. Agog is a groundbreaking initiative at the intersection of technology, communications and social impact. The organization helps creators and nonprofit leaders harness the power of extended reality (XR) technologies to spur positive social transformation, opening new avenues for empathy, understanding and activism. The Schmidt Initiative for Long Covid advances clinical care for Long Covid patients globally. The organization works to raise the level of Long Covid care and understanding around the world by connecting specialists and primary care providers to support patients and share knowledge virtually, in real time. Remain is a charitable organization that supports the economic, social and environmental vitality of Nantucket. The Team The Office of Eric Schmidt aims to support Eric Schmidt in his personal and professional endeavors, advance the mission of his philanthropic and for-profit entities, and drive forward his initiatives. The Office of Eric Schmidt encompasses: 1) a personal administrative and research team (EST), 2) a political team (OneOne), 3) a technology team (Technical Projects Group), 4) an event management team for Eric’s personal and professional events (Community), and 5) his personal communications team. The Role We are looking for a detail-oriented Product Quality & AI Evaluation Specialist to help us build the future of civic tech. In this role, you will be the bridge between our cutting-edge AI features and the real-world impact they have on organizers. You won't just be checking boxes; you’ll be developing a deep intuition for how LLMs behave, ensuring our models provide accurate, helpful, and reliable support to our users. This is a hybrid role that blends AI evaluation, systematic QA, and user research support. You’ll spend your time rigorously testing our product, building automated test suites to catch regressions, and working closely with our engineering team to prioritize and squash bugs. Beyond the technical side, you’ll help us stay grounded in user needs by coordinating research sessions and synthesizing feedback from the field. \n Key Responsibilities LLM Evaluation: Review and score outputs from our AI features, helping us understand where the model gets it right and where it falls short. You'll develop a real intuition for what "good" looks like in AI-assisted civic tech. Automated Testing: Contribute to building out our automated LLM test suite, including writing and maintaining test cases that help us catch regressions as the product evolves. QA: Systematically test product features, document bugs with clear reproduction steps, and help us maintain a high bar for what ships. Bug Triage: Help review incoming bug reports, identify patterns, and prioritize issues alongside the engineering team. User Research Support: Help coordinate and set up user interviews with organizers, including scheduling, note-taking, and synthesizing what we hear. Other duties and projects as assigned. Knowledge, Skills, and Abilities Ability to proactively lead, design, and create research projects, workflows, and initiatives. Demonstrated excellence in advanced research and analytical skills, including primary and secondary source research, writing, and editing. Project management skills, including capabilities to drive efforts independently and ensure effective implementation. Ability to coordinate efforts across multiple stakeholders, partners, and teams. Ability to work under pressure and across multiple work-streams to meet timelines. Exceptional analytical mind with the ability to solve complex, multifaceted problems, synthesize arguments, and generate new ideas. Strong teamwork skills and a record of impact in high-intensity, team-based environments. Commitment to the highest standards of ethics and confidentiality. Excellent written and verbal communication skills, with reasonable ability to use common software tools for word processing, presentation, and spreadsheets. Curiosity and optimism in the face of uncertainty. Requirements Maintain the highest level of ethics, integrity, and discretion for confidentiality. Be based at the Schmidt offices in New York City and be able to travel within the U.S. as needed. \n $32 - $39 an hour \n This is a non-exempt position. Hillspire, LLC is an equal opportunity employer and we strive to create an atmosphere where diversity of identity, experience, and background are welcomed, valued, and supported. We believe that diversity brings about greater results on all levels and we aim to use our resources to generate greater impact through our work. Candidates who contribute to this diversity are strongly encouraged to apply.