Business Analyst - AI Evaluator
Virtual Vocations Inc
Detail-oriented and analytical, the full-time Business Analyst - AI Evaluator will support a project evaluating chatbot responses by gathering business requirements, analyzing outputs, and providing assessments in a fully remote environment. Key Responsibilities Gather, analyze, and document business requirements for chatbot evaluations Collaborate with stakeholders to translate business needs into functional specifications Create reports and documentation while tracking project progress and key performance indicators Required Qualifications Bachelor's degree in Business Administration, Finance, Computer Science, or a related field 2-3+ years of experience as a Business Analyst or in a similar role Proficiency in Excel, SQL, Power BI, Tableau, or similar tools Experience with requirement-gathering and process-mapping techniques Knowledge of Agile or Scrum methodologies is an advantage Virtual Vocations Inc
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Business Analyst - AI Evaluator in New York, NY vacancy
$120k - $160k
Hudson River Trading (HRT) is seeking a Business Operations Analyst to help manage the operational... ...to know you.Please be advised: Use of AI tools by an applicant during interviews... ...agreed upon. We employ various methods to evaluate the authenticity of candidate responses...SuggestedContract workWork at officeLocal areaImmediate startHudson River Trading
New York, NY3 days ago- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...SuggestedContract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY3 days ago $100k - $125k
...About the role: We're hiring the first Analyst on our newly formed Operations team,... ...functional workflow management to the data and AI systems that support company-wide... ...scope and ownership growing quickly with the business. Conduct ad hoc research on industry developments...SuggestedInternshipLocal areaFlexible hoursShift workDigital Asset
New York, NY2 days ago- Archangel Health AI is seeking Clinical AI Evaluators to review AI-generated clinical outputs, benchmark diagnostic reasoning, and refine responses to real-world medical queries. You will perform clinical accuracy auditing, RLHF ranking, error and harm identification,...SuggestedRemote workFlexible hoursShift work
$18 per hour
rws is seeking AI Linguistic Evaluators to assess Marathi performance of an AI application for a short collaboration. This freelance role offers flexible hours with a total of about 10-15 hours (roughly 5 hours daily) and a rate of 18 USD per hour. Candidates should be...SuggestedRemote jobHourly payDaily paidFreelanceImmediate startFlexible hours- Anyone AI is seeking multilingual coding experts to evaluate AI-generated responses. This part-time remote contract lasts up to 3 months and supports frontier AI model improvement. What you'll do: Review AI-generated customer service and technical content for clarity, correctness...Remote jobContract workPart timeFor contractors
$18 per hour
Description Interact with an AI assistant in Bengali. Translate English prompts into Bengali and use them to test the AI application. Evaluate AI-generated responses according to project guidelines. Assess linguistic accuracy, naturalness, localization quality, and...Hourly payTemporary workFreelanceImmediate startRemote workFlexible hours- Anyone AI Inc. is seeking multilingual coding experts to evaluate AI-generated responses on a part-time remote contract lasting up to 3 months. This opportunity supports frontier AI model improvement by providing precise feedback and evaluations. You will review AI-generated...Remote jobContract workPart time
$18 per hour
We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Bengali for a short collaboration. Job Type... ...and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications,...FreelanceImmediate startRemote workFlexible hours- Cincinnatus LLC is recruiting a senior character animator to help shape evaluation standards for an AI-driven performance transfer model. The role focuses on facial animation, performance capture, and translating complex visuals into precise data captions, with part-time...Part time
$60 per hour
Prolific is seeking Chemistry Experts and Chemical Engineers to join our Expert Network to train and evaluate AI models using real-world chemical knowledge. A quick 10- to 15-minute test will assess your skills; successful candidates join Prolific as participants and are...Remote jobHourly payWork from homeFlexible hours- Alignerr is seeking a Social Media Content Evaluator (AI Training) to review AI-generated posts, captions, and comments. You will help ensure content feels natural, engaging, and appropriate for real audiences. This is a fully remote, hourly contract role with 10-40 hours...Remote jobHourly payContract work10 hours per week
- Turing is seeking a remote contractor to evaluate AI-generated answers for relevance, accuracy, and proper use of context. The project runs for up to 16 weeks with a 20-hour weekly target and potential up to 40 hours based on project needs, including four hours of overlap...Remote jobFor contractors
- Edison Scientific is seeking expert scientists in biology or related fields to help generate evaluation and training datasets for AI-based scientific tasks. The role is part-time, on a per-deliverable basis, with flexible hours and a global reach beyond the U.S. Ideal candidates...Part timeFlexible hours
- AI Trainer Jobs seeks a remote independent contractor to review AI outputs for fintech operations evaluation. You will assess workflow adherence, tone, and escalation logic, assigning severity tags and documenting next steps for model training. The role requires experience...Remote jobHourly payFor contractorsFlexible hours
$40 per hour
Prolific is recruiting Materials Science Specialists to join its Expert Network and contribute real-world expertise to train and evaluate cutting-edge AI models. If selected, you’ll be invited to join Prolific as a participant and paid to train and evaluate powerful AI...Remote jobHourly pay- OpenTrain AI, Inc. is seeking a remote contractor to evaluate language-model responses in social scenarios and provide structured feedback that helps improve AI behavior. The work involves careful review, evidence-based decisions, and consistent use of project guidelines...Remote jobFor contractors
- Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Remote jobWork at office
- ...experienced Nurse Practitioners and advanced practice nursing professionals to join a remote project in the United States. You will evaluate AI-driven clinical content and provide expert feedback to improve accuracy and reliability of patient care materials....Remote job
$30 per hour
...Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems... ...stakeholders. Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical...Remote jobHourly payContract work$20 - $26 per hour
Prolific seeks fluent Marathi speakers to act as evaluators, listening to AI-generated audio and comparing text and voice snippets to assess naturalness and cultural accuracy. You will provide feedback on pronunciation, intonation, and context, tagging data for model improvement...Hourly payRemote workFlexible hours$30 per hour
RWS Group is seeking a web-savvy evaluator to refine search results by reviewing text, audio, images and videos, helping to improve AI data used by major search engines. This flexible, part-time, remote role requires English and Italian proficiency, and residence in Switzerland...Remote jobPart timeFreelanceFlexible hours- RWS - TrainAI is seeking a Tamil-language AI Linguistic Evaluator for a remote freelance collaboration. The role involves interacting with an AI assistant in Tamil, translating prompts, and assessing the quality and localization of AI responses to ensure accuracy and cultural...Remote jobFreelanceImmediate startFlexible hours
- RWS Group is seeking a Telugu language specialist to interact with an AI assistant in Telugu and translate English prompts into Telugu for AI interactions. You will evaluate AI-generated responses, assess linguistic quality and cultural appropriateness, and provide structured...Remote jobFreelanceImmediate start
$24 per hour
Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language's emotional and cultural nuances. Responsibilities include assessing audio clips, reviewing tones for cultural relevancy, and ensuring quality control...Remote jobFlexible hours- Mercor seeks experienced brand designers to define grading criteria for real-world brand deliverables and to score AI-generated versus human work with detailed written justifications. You will apply evidence-based judgment, ensure reproducibility, and iteratively incorporate...
$18 per hour
...Flexible schedule, approximately 10-15 total hours Rate: $18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural relevance Qualifications: Native-level fluency...Remote jobHourly payTemporary workFreelanceFlexible hours- Mercor is seeking experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Hindi and English. Responsibilities...
$50 per hour
Prolific in the United States is seeking HR and Talent professionals to join our Expert Network. You will help train and evaluate AI models using real HR expertise and may be invited to join Prolific as a paid participant after a quick test. Tasks pay up to $50 per hour...Remote jobHourly pay- Mercor seeks a contract evaluator for general business strategy to assess AI-generated artifacts against domain-specific rubrics. You will work remotely, evaluate quality, and provide structured written feedback to help improve AI model performance. You will collaborate...Remote jobContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Analyst - AI Evaluator. Be the first to apply!
Related searches
- order management analyst New York, NY
- junior IT service management analyst New York, NY
- lead business analyst New York, NY
- bank of america business analyst New York, NY
- entry level business analyst New York, NY
- workforce management analyst New York, NY
- sharepoint business analyst New York, NY
- business analyst part time New York, NY
- remote business analyst New York, NY
- business strategy analyst New York, NY