Staff AI Evaluation Scientist
Visa Hunt
Reflection Research Lab in San Francisco is seeking a candidate to conduct critical comparative analysis to advance our understanding of model capabilities. You will build and refine evaluation systems that create tight feedback loops between data, evals, and model behavior, and develop generalizable frameworks for reasoning, alignment, and usefulness. Join a fast-moving startup to translate insights into model improvements, collaborate with pre-training, post-training, and applied teams, and #J-18808-Ljbffr Visa Hunt
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff AI Evaluation Scientist in Brooklyn, NY vacancy
- OpenTrain AI is seeking a Film and Television AI Evaluation Expert to craft challenging prompts and evaluate AI responses for accuracy and nuance. You will focus on film, television, streaming, and entertainment history while identifying knowledge gaps and helping build...SuggestedRemote jobPart timeFor contractors
- Uncover is building a central evaluation framework to measure model quality across teams. You will design reusable pipelines, benchmarks, and baselines, and build visualization tools to turn results into actionable insights for stakeholders. The role demands strong software...Suggested
$129k - $152k
About the Role: At Fetch, we’re building AI and automation systems that make our work smarter, faster, and more scalable. The... ...perform with quality, reliability, and measurable impact. As a Staff AI Evaluation Lead, you’ll own automation and evaluation programs across AI...SuggestedFull timeRemote work- ...Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour... ..., and other content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality...SuggestedHourly payFor contractorsRemote workFlexible hours
CNTXT AI
Brooklyn, NY2 days ago $35 - $42 per hour
...per weekbased on project availability Help Shape the Future of AI in Finance, Audit & Risk Volga Partners is seeking experienced... ...and legal professionals to join our growing network ofon-call AI Evaluation Specialistssupporting the development, training, and evaluation...SuggestedHourly payExtra incomePermanent employmentContract workTemporary workRemote workFlexible hours- Trajectory Labs, PBC is seeking a senior individual-contributor to own the evaluation pipeline for our prompt injection red-teaming line. You will review evals, design new tasks, and build agent tooling that scales your judgment, while working closely with founders and...Remote work
$143.62k - $229.79k
Job Description Serve as the senior AI/ML scientist to identify, research, and develop transformational predictive, prescriptive, and Generative... ...that can adapt and evolve over time. Design, implement, and evaluate artificial intelligence (AI) systems that can be used in...- Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products. You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and...
$55 - $65 per hour
OpenTrain AI is recruiting experienced pediatric inpatient nurses to evaluate AI systems used in clinical settings. You will assess AI-generated clinical outputs against nursing flowsheet documentation and current standards. The work requires an active U.S. RN license outside...Hourly payPart timeRemote work- Scale AI, Inc. is seeking Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) to optimize data curation and evaluation for improved LLM capabilities in text and multimodal modalities. You will develop novel methods...
$16.5 per hour
...Job TitleFloor Staff Team MemberJob DescriptionFloor staff team members are classified based on individual theatre needs, and/or employee... ..., gather relevant data and note possible causes of problems. Evaluate relevant information, recognize alternatives and reach...Hourly payFull timePart timeWork at officeLocal areaRegal Entertainment
Forest Hills, NY5 days ago$50k
...by understanding client operations and legal challenges. Risk Evaluation and Mitigation Identify, evaluate, and mitigate legal risks associated... ...related departments. Mentor junior attorneys and legal support staff, offering guidance and direction to elevate team performance....Remote workLiberty Mutual Group
Brooklyn, NY2 days ago$235k - $350k
...we’ve redefined modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems, processing... ...models; designing and tuning the harnesses; and developing the evaluation and verification methodologies that give us rigor around if the...Work experience placementWork at officeLocal area$16.5 per hour
...Job Category : Floor Staff - Theatre Requisition Number : TEMPL039052 Part-Time On-site Locations Showing 1 location Green Hills Stadium... ..., gather relevant data and note possible causes of problems. Evaluate relevant information, recognize alternatives and reach...Hourly payFull timePart timeWork at officeLocal areaAll shiftsWeekend workRegal Entertainment
Brooklyn, NY5 days ago$44.02k - $58.68k
...health, and mission alignment. Develop and execute ministry plans, evaluating and modifying as needed. Mobilize students and faculty to... ...Partner with local, area, regional, and national InterVarsity staff and volunteers to maintain biblical standards of excellence and...Full timePart timeWork at officeLocal areaFlexible hours- ...reviews and approves requests for proposals, evaluations and contractor selection Understands the... .../Years of Experience E&C Project Manager Staff: Required: Bachelor’s Degree and minimum... ...fertility and adoption support Advanced AI tools and resources to help level up and...For contractorsWork at officeFlexible hoursShift work
$220k - $292k
...of systems is powered by Lattice OS, an AI-powered operating system that turns thousands... ...THE JOB We are seeking an AI Research Scientist to serve as a founding ML expert on our team... ...-based operational orders. Shape Data & Evaluation Strategies: Define and execute data...Full timeWork experience placement- ...Prepare boring logs, field reports, geologic maps, cross-sections, and technical documentation. Assist geotechnical engineers in evaluating subsurface conditions and developing recommendations for foundations, pavements, retaining walls, earthwork, and slope stability....Temporary workFor contractorsFor subcontractorInternshipWork at officeFlexible hours
Willmer Engineering
Brooklyn, NY1 day ago - ...you will play a vital role in safeguarding water resources and evaluating mining proposals. This position gives you the chance to analyze... ...surveys and coordinate findings with engineering and inspection staff Impact Analysis: Assess geologic and hydrologic data to...Full timePart timeWork at officeRemote workWork from homeMonday to Friday3 days per week
Commonwealth of Pennsylvania
Brooklyn, NY1 day ago - ...remote team members and proficiency in remote work settings.Risk Evaluation and Case Resolution Facilitation: Identify, evaluate, and... ...enhancing efficiency, effectiveness, and best practices within Staff Legal and Global Legal & Compliance organizations.Ethical Compliance...Local areaRemote workFlexible hours
- ...Mississippi, Tennessee, and Alabama. About the Role We’re looking for a Staff Attorney that will work within the Risk Management team to... ...efficiencies to improve processes. Prudent Accurately evaluates legal risks and anticipates potential challenges. Ensures contracts...Contract work
Rngd Llc
Brooklyn, NY2 days ago $83k - $125k
...seeks a dynamic, skilled, mission-driven applicant for a full-time Staff Attorney position. The Staff Attorney will work under the... ...volunteers Present selected potential cases to the ACLU Legal Panel for evaluation Review and investigate selected requests for legal assistance...Full timeWork at officeAfternoon shift2 days per weekan attorney with the ACLU
Brooklyn, NY5 days ago$170k - $220k
...$220,000.00What’s the role?We’re hiring a Staff Design Program Manager to own the operational... ...inventory, unlocking growth through AI-assisted insights, and reducing friction across... ...and capacity.Build the operating model: Evaluate how the Seller Experience design org currently...Full timeContract workWork at officeLocal areaVisa sponsorshipShift work$82.6k - $162.8k
Position Summary We are seeking an AI Governance and Privacy Consultant who can operationalize responsible AI in real systems... ..., implement controls-as-code patterns, and stand up measurable evaluation and monitoring workflows.As a Senior Consultant, you will help...Local areaVisa sponsorship$64.45k - $69.45k
...family stability, and promoting community economic development. Our staff of seventeen consists of attorneys, case managers, and other... ...those related to landlord-tenant law. Track metrics to evaluate and improve recruitment and retention efforts and legal program...Full timeTemporary workPrivate practiceRemote workFlexible hoursAfternoon shiftManagement Information Exchange
Brooklyn, NY3 days ago- ...GWC seeks a dedicated staff attorney for its Legal Clinic to provide labor and employment legal assistance to garment workers, including... ...stronger enforcement. Responsibilities include intake, case evaluation, direct representation at Berman hearings, collaboration with...
Sacbar
Brooklyn, NY3 days ago $73k - $104k
# Staff AttorneyFully Remote • Remote - Modesto, CA 95354## OverviewSalary Range$73,000.00 - $104,000.00 SalaryPosition TypeFull TimeCategoryLegal##... ...of record clearing and other post-conviction laws.•Implement evaluation of Project services in collaboration with other Project staff.•...Full timeTemporary workWork experience placementLocal areaImmediate startRemote workCalifornia Rural Legal Assistance, Inc.
Brooklyn, NY3 days ago$75k - $115k
...Position Staff Attorney Who we are Mediacom Communications Corporation is the 5th largest... ...legal research, knowledge management, and AI-assisted legal technology tools to improve... ...research and drafting applications. Ability to evaluate, validate, and exercise independent legal...Contract workLocal areaFlexible hoursKinsley Power Systems
Brooklyn, NY3 days ago- ...transforms how the business operates. We build AI-first, agent-driven products that change... ..., retrieval-augmented generation (RAG), evaluation frameworks, and traditional machine... ...and operational processes.• Mentor data scientists, AI engineers, and analysts on agentic...Full timeTemporary workRemote work
$75k - $90k
...skills training, conducting regular check-ins and performance evaluations, reviewing work product, and providing consistent and effective... ...legal work and support in the professional development of junior staff. Support with data management and grant reporting systems,...Temporary workWork at officeRemote work2 days per weekNew Jersey Consortium for Immigrant Children
Jersey City, NJ1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff AI Evaluation Scientist. Be the first to apply!
