Remote LLM Evaluation Analyst (Contract)
Crossing Hurdles
New York, NY
- Remote job
Crossing Hurdles is seeking a Business Analyst for remote, short-term work to evaluate chatbot responses and support AI quality improvements. You will perform structured evaluations, analyze outputs, and provide clear, data-driven assessments to guide enhancements. The candidate should hold a Bachelor's degree in a related field, demonstrate strong analytical and communication skills, and be proficient with Excel, SQL, Power BI, and Tableau, including process mapping and documentation. #J-18808-Ljbffr Crossing Hurdles
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote LLM Evaluation Analyst (Contract) in New York, NY vacancy
- Cypress HCM is seeking an LLM Evaluation Specialist for a part-time, contract role in the San Francisco area. You will run evaluation passes on AI-generated charts, headlines, captions, and chats, using a defined rubric to assess accuracy and clarity. You’ll log findings...Contract workRemote jobPart time
- Alignerr Corp. seeks a Health Informatics Analyst (AI Training) to evaluate AI-generated healthcare content, clinical workflows, and EHR outputs... ...AI systems reason about health data. The role is a remote, hourly contract offering 10-40 hours per week, with flexible...Contract workRemote jobHourly pay10 hours per weekFlexible hours
- ...enterprise-grade platforms. With rigorous evaluation data, tomorrow’s AI can democratize... ...live and breathe model evaluation, LLM safety, prompt robustness, data... ...and PTO do not apply. Employment type: Contract Workplace type: Remote Seniority level: Mid-Senior Level Originally...Contract workRemote workHourly payFor contractors
- Next Move Healthcare is seeking an experienced Clinical Product Research Analyst. This fully remote, six‑month contract role focuses on evaluating medical supplies, equipment, and patient care products across manufacturers to determine clinical appropriateness and optimal...Contract workRemote job
$84k - $167k
...Join a global Contract Resource Organization (CRO) where innovation meets purpose. At... ...Make an Impact as a Senior Business Analyst, AI Evaluation & Value Realization at Worldwide... .... Where You'll Work This is a remote role open to candidates based in the US...Contract workRemote workHourly payFull timeWorldwide$59.86 per hour
...Hybrid San Francisco, CA 94107 (Open to Remote) Duration: 11/16/2026 - 12/18/2026... ...Team: Incubator - VizWhiz Job Details LLM Evaluation Specialist Location: Hybrid San Francisco... ...approximately 15 hours per week over a multi-week contract. Duties Perform recurring evaluation...Contract workRemote workPart time- Crewlia is seeking an AI Data Analyst for a remote hourly contract in the United States and Canada. You will assess AI-generated data and content, applying... ...flexible hours and clear project guidelines. You will evaluate outputs against source materials, documenting rationales...Contract workRemote jobHourly payFlexible hours
- TURING ENTERPRISES, INC. is seeking a detailed QA Analyst to evaluate and compare responses from multiple chatbots. You will review outputs... ...and provide final assessments for each task. This freelance, remote role spans a defined number of evaluation tasks over a 16-week...Contract workRemote jobFreelance
$30 per hour
Evaluate and compare chatbot responses against defined criteria. Analyze outputs and conduct structured... ...evaluation processes. Position: Business Analyst Type: Short-term contractor Compensation: Up to $30/hour Location: Remote Commitment: 10-40 hrs/week Role...Remote jobTemporary workFor contractors$56.08k
...for a curious, hard-working analyst eager to show how data informs... ...collaboration, the Data and Evaluation Analyst supports PCOA in reporting... ..., Tucson, AZ 85716); some remote work may be available.... ...funding allocation workbooks, contract budget builds, and budget-to-...Contract workRemote workFull timeTemporary workPart timeFor subcontractorWork at officeLocal areaImmediate startMonday to FridayShift workWeekend workAfternoon shift- ...Health Informatics Analyst (AI Training) We’re looking for Health... ...to help train and evaluate cutting‑edge AI systems. Your... ...healthcare information. This is a remote, flexible contract role designed for... ...tools or large language model (LLM) evaluation Why Join Us Work...Contract workRemote workHourly payOngoing contractFreelanceFlexible hours
Alignerr
Atlanta, GA4 days ago - ...Telework Eligible No Major Duties As a Program Evaluator you will be responsible for the following duties (If selected at the... ...Support (TFS) National Security/Emergency Preparedness (NS/EP) contract portfolio, overseeing contractor performance and key surveillance...Contract workRemote workFull timeTemporary workFor contractors
Defense Logistics Agency
Arlington, VA4 days ago $55 per hour
...responses for accuracy and quality. This remote, asynchronous role offers up to $55 per... ...Hourly · $55/hr $55/hr Compensation Contract, part-time Engagement Remote Location... ...United States The work You will help evaluate large language models, or AI systems that...Contract workRemote workHourly payPart timeFor contractorsFlexible hours$100 per hour
...feedback on data to improve LLM performance, helping... ...expert project consultant on a contract basis. Location: U.S... ..., project-based expert evaluation work Work Type: Remote Project Summary: This... ...Director, Manager, or Analyst Pricing Operations Lead...Contract workRemote workHourly payFull timePart timeLinkedIn
United States9 hours ago- ...automation, issue triaging, and evaluating test coverage and quality... ...codebases locally to assess LLM performance in bug-fixing scenarios... ...: Work in a fully remote environment. Opportunity... .../paid leave) Duration of contract : 3 months; [expected start...Contract workRemote workFor contractorsFreelance
- ...Analyze GitHub issues and evaluate LLM performance on software tasks. Job Title: Senior Software... ...With Turing: Work in a fully remote environment. Opportunity to work on... ...(no medical/paid leave) Duration of contract : 3 month; [expected start date is next...Contract workRemote workPart timeFor contractorsFreelance
Turing
San Francisco, CAa month ago - ...leading AI company is seeking an entry-level analyst to fine-tune large language models. This... ...while working independently in a fully remote environment. Candidates should possess... ...cutting-edge AI projects and the potential for contract extension based on performance. #J-18808-...Contract workRemote job
- ...research, and work with the LLM (Large Language Models)... ...AI to be a better analyst. This is your chance to... ...work independently in a remote setting. Commitment :... ...hours per week for the contract duration overlapping US... ...day) America/Los_Angeles Evaluation Process (approximately...Contract workRemote jobFor contractorsFreelance
$50 - $100 per hour
...engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set... ...able to work independently and meet deadlines in a remote setting. Preferred Qualifications Prior LLM research or evaluation projects. Experience...Contract workRemote workHourly payFor contractorsRemoExperts
San Francisco, CAa month ago- ...Data quality and QA analysts review datasets and task outputs for... ...data review or similar work. Remote, US-based; no pay or hours stated... ...instructions and complex evaluation rubrics Preferred: basic spreadsheet... .... Where: Remote, US-based. Contract work for micro1, a company...Contract workRemote work
$85 per hour
...Category: Enterprise Workflow & Tool Use · Pay: $85 / hr · Location: Remote — US-eligible · Contractor Data Analyst (AI Evaluation) is a remote review track for evaluating AI outputs across data analyst specialist operations workflows. Reviewers grade workflow correctness...Contract workRemote workHourly payFor contractorsWork experience placement10 hours per weekAuraOne
San Jose, CAa month ago- Job Summary Management Analyst —AI Cross-Functional Team... ...Services (FERSS) contract. This role supports ISRM... ...large language models (LLM) tools, and the ability... ...(40 hours/week), 100% remote position. Primary Responsibilities... .... Help identify and evaluate opportunities to use AI...Contract workRemote workFull timeWork at office
- ...contribute to an AI training and evaluation project focused on the... ...on experience as a Data Analyst, Business Analyst, BI... ...using modern LLM tools such as ChatGPT, Claude... ...at . Location Thailand Remote status Fully Remote Employment type Contract Contact Bato Medojevic Senior...Contract workRemote workWork experience placementFreelanceWorldwideFlexible hours
$50 per hour
.... Position: German Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated German text across various use cases such as translation...Contract workRemote workFull timeSummer work- ...security threats. Incident Response Analyst (AI Training) We're partnering with leading... ...Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10–40 hours/week What You... ..., alerts, and incident cases to evaluate AI-generated responses Assess impact,...Contract workRemote workHourly payOngoing contractFreelanceFlexible hours
Alignerr Corp.
Denver, CO2 days ago - ...need of an MDM Data Quality Analyst for a 12+ months contract. Job details are below.... ...Quality Analyst Location Remote - occasional travel to Illinois... ...consistent processes and evaluating data quality with the... ...automation, AI/ML, GenAI, or LLM-assisted engineering for...Contract workRemote work
- ...Health Informatics Analyst (AI Training) About The Role Your expertise in... ...— on your own schedule, entirely remote. Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10–4... .../week What You'll Do Analyze and evaluate AI-generated healthcare content,...Contract workRemote workHourly payOngoing contractFreelanceFlexible hours
Alignerr
New York, NY2 days ago $57.2k - $108.8k
...defense. What You Will Do Support the Contracts Team, by executing multiple small- to... ...include support for the following: Evaluate requests for proposal/solicitations for... ...role is designated as on-site, hybrid or remote. The salary range for this role is 57...Contract workRemote workFull timeTemporary workWork experience placementInternshipWork at officeFlexible hoursRTX
Tucson, AZ3 days ago- ...Health Informatics Analyst (AI Training) About The Role We're looking for Health... ...reasons about healthcare. This is a fully remote, flexible contract role — work on your schedule, on your... ...relevant to AI training tasks Evaluate AI-generated clinical and operational...Contract workRemote workHourly payOngoing contractFreelanceFlexible hours
Alignerr
Chicago, IL4 days ago - ...Health Informatics Analyst (AI Training) About The Role At Alignerr, we partner with the world... .... Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10-40 hours/week What You'll Do Analyze and evaluate AI-generated healthcare content, data interpretations...Contract workRemote workHourly payOngoing contractFreelanceFlexible hours
Alignerr
Cincinnati, OH3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote LLM Evaluation Analyst (Contract). Be the first to apply!
Related searches
- hybrid analyst New York, NY
- review analyst New York, NY
- remote analyst New York, NY
- senior infrastructure analyst New York, NY
- incident response analyst New York, NY
- military analyst New York, NY
- behavior analyst bcba New York, NY
- student analyst New York, NY
- senior trade analyst New York, NY
- medicare analyst New York, NY