Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Business Analyst - AI Evaluator / AI Trainer (US ONLY)

Braintrust

About Turing:

Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview

We are looking for a detail-oriented Business Analyst to support a project involving the evaluation of multiple chatbot responses. The role will require analyzing business requirements, comparing chatbot outputs, conducting structured evaluations, and providing final assessments based on defined criteria.

Key Responsibilities:

  • Gather, analyze, and document business requirements.
  • Collaborate with stakeholders to understand business needs and objectives.
  • Translate business requirements into clear functional specifications.
  • Analyze workflows, processes, and data to identify gaps and improvement areas.
  • Create reports, dashboards, process maps, and other documentation.
  • Support project planning, testing, implementation, and user acceptance testing.
  • Coordinate with technical and cross-functional teams to ensure successful delivery.
  • Track project progress, risks, dependencies, and key performance indicators.
  • Present insights and recommendations to stakeholders.

Required Qualifications and Skills:

  • Bachelor’s degree in Business Administration, Finance, Computer Science, or a related field.
  • 3+ years of experience as a Business Analyst or in a similar role.
  • Strong analytical, problem-solving, and communication skills.
  • Proficiency in Excel, SQL, Power BI, Tableau, or similar tools.
  • Experience with requirement-gathering and process-mapping techniques.
  • Ability to work with cross-functional teams and manage multiple priorities.
  • Strong attention to detail and documentation skills.
  • Knowledge of Agile or Scrum methodologies is an advantage.

Perks of Freelancing With Turing:

  • Work at the forefront of AI applications in accounting and finance.
  • Fully remote and flexible work environment.
  • Opportunity to collaborate on high-impact projects with global reach.

Offer Details:

  1. This is a project-based role involving a defined number of evaluation tasks.
  2. Each task will involve comparing multiple chatbots and providing a final assessment.
  3. Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
  4. Duration: 16 weeks.

Interview Process:

  1. Complete an interest check form (10 minutes)
  2. General aptitude test (60 minutes)

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Business Analyst - AI Evaluator / AI Trainer (US ONLY) in New York, NY vacancy
  • About the Opportunity A leading AI research organization is seeking advanced LLM power...  ...personal life tasks. This project focuses on evaluating how well AI systems handle personalized,...  ...Looking For Strong candidates will have: US-based only Strong MCP experience and plug... 
    Suggested
    Trial period

    Mercor

    New York, NY
    2 days ago
  • $60 per hour

     ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is...  ...legal consultants, attorneys with an experience in US law open to part-time, non-permanent projects.... 
    Suggested
    Permanent employment
    Temporary work
    Part time
    Freelance
    10 hours per week

    Mind Rift

    New York, NY
    3 days ago
  • $70 per hour

    About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Details Position:... 
    Suggested
    Contract work
    Summer work
    Immediate start
    Remote work

    mercor

    New York, NY
    2 days ago
  • $50 per hour

    Mercor is seeking experienced scientists/engineers fluent in German to train and evaluate AI agents on realistic professional tasks. You will build workspaces and files, write prompts, and create grading rubrics based on real stem work as it's done in Germany. The role... 
    Suggested
    Remote job
    Hourly pay

    Mercor

    New York, NY
    3 days ago
  • $11 - $30.65 per hour

    Meridial is seeking contractors to evaluate advanced agentic audio models by simulating realistic customer service interactions across multiple domains. You will contribute to developing diverse datasets and assess model performance using various metrics. The role requires... 
    Suggested
    Remote job
    Hourly pay
    For contractors

    Meridial

    New York, NY
    3 days ago
  • $40 per hour

    A leading company in AI training solutions is seeking a Content Developer specialized in Physics. The role involves enhancing AI models by providing and evaluating complex physics problems. Ideal candidates hold advanced degrees in physics or related fields, ensuring high... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    2 days ago
  • $20 - $80 per hour

    Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses...  ...and analyze complex material in areas including business, finance, marketing, healthcare, and legal topics.... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    New York, NY
    1 day ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning... 
    Contract work
    Summer work
    Remote work

    mercor

    New York, NY
    2 days ago
  •  ...Expert for a six-week remote contract. The role demands deep knowledge of materials science and the ability to craft prompts to test AI models. Responsibilities include sourcing data from papers and open sources, building grading criteria, and calibrating tasks against... 
    Remote job
    Contract work

    Mercor Inc

    New York, NY
    2 days ago
  • Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The role involves reviewing datasets for accuracy, providing feedback to annotators, and validating AI model outputs to ensure high production quality. Candidates... 
    Remote job
    Full time

    Feitong Buke

    New York, NY
    3 days ago
  • $60 per hour

    A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience in US law. Candidates must have strong written English skills and a... 
    Permanent employment
    Part time
    Freelance
    Flexible hours

    Mindrift

    New York, NY
    4 days ago
  • $50 - $190 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...0+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows,...  ...correctly. Qualifications Must-Have US-based only. Strong MCP experience and... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work
    Trial period

    Mercor

    New York, NY
    16 days ago
  • $160k - $210k

    BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured Products Location New York Business Area Product Ref # 10053894 Description & Requirements Bloomberg’s Evaluated Pricing Service, BVAL, provides transparent and accurate... 
    Price work
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  • $18 per hour

    Prolific is seeking AI Trainers/Study Participants from diverse backgrounds in the United States to contribute to academic and applied research studies. After a quick screening, you may join and get paid per study, with compensation up to $18/hr and studies that can require... 
    Remote job

    Prolific

    New York, NY
    1 day ago
  •  ...to the Head of Commodities Risk Analytics and Risk Advisory. The US FTR, Gas and Power Risk, Quantitative Researcher will partner...  ...risk, and physical commodity models to help grow the Commodities business.Responsibilities IncludeFormulate and implement models for risk... 

    Balyasny Asset Management

    New York, NY
    3 days ago
  • $20 per hour

    Prolific is seeking a Sales Professional to join our Expert Network for AI model training and evaluation. You will be paid to contribute real sales and business development expertise via paid tasks, with a quick screening test if selected. All work is remote and ad hoc... 
    Remote job
    Hourly pay
    Freelance

    Prolific

    New York, NY
    5 days ago
  • $130 per hour

    Turing is seeking US-based dermatologists to review AI-generated dermatology content for accuracy and safety. You will analyze medical images and case...  ..., requiring 20 hours per week and overlap with Pacific business hours. Compensation is $130 per hour for the project duration... 
    Hourly pay
    Contract work
    Part time

    Braintrust

    New York, NY
    3 days ago
  • $4,325 - $5,750 per week

    # Quantitative Researcher – 2026 PhD Intern (US)Citadel SecuritiesInternshipQuant ResearcherPosted March 18, 2025Job DescriptionAt Citadel Securities, a leading global market maker, our team of quantitative researchers models the markets and brings trading strategies to... 
    Internship

    Quant Blueprint LLC

    New York, NY
    2 days ago
  • $20.3 per hour

     ...Hourly rate: $20.30 Language: English (US) Estimated volume: 8 - 10 hours Start date...  ...qualified raters to support a project focused on evaluating personalized search and location...  ...hour We may use artificial intelligence (AI) tools to support parts of the hiring process... 
    Hourly pay
    Contract work
    Freelance
    Immediate start

    Welocalize

    New York, NY
    4 days ago
  • $20.3 per hour

    Welo Data is seeking a Maps Visual Design Relevance Evaluator (US) to assess the aesthetic quality, readability, and overall polish of digital map designs, ensuring geographic accuracy and content relevance for user-facing features. This freelance, remote role pays US$2... 
    Remote job
    Hourly pay
    Freelance

    Welo Data

    New York, NY
    3 days ago
  • Welo Data seeks a Maps Visual Design Relevance Evaluator to assess the aesthetic quality, readability and polish of digital map designs for English (US) users. This freelance, remote role pays hourly and focuses on ensuring contextual relevance and helpful recommendations... 
    Remote job
    Hourly pay
    Freelance

    Welo Data

    New York, NY
    2 days ago
  • Welocalize is seeking a Maps Visual Design Relevance Evaluator - English (US) to assess the aesthetic quality, readability, and polish of digital map designs while verifying geospatial accuracy and content relevance. You will review personalized location recommendations... 
    Remote job
    Freelance

    Welocalize

    New York, NY
    3 days ago
  • Welo Data is seeking a Maps Visual Design Relevance Evaluator (US). This freelance role focuses on evaluating the aesthetic quality and readability of digital map designs, with emphasis on spatial accuracy and content relevance. You will work remotely in English (US) across... 
    Remote job
    Freelance

    Welo Data

    New York, NY
    1 day ago
  •  ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess...  ...to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform... 
    Contract work
    Worldwide
    Flexible hours

    CXG

    New York, NY
    2 days ago
  • $197.3k - $225.1k

     ...Manager, Data Scientist - US Card (Upmarket Acquisitions) Data is at the center...  ...engineers, product managers, credit and business analysts, to deliver the solutions from ideation...  ...development, from design through training, evaluation, validation, and implementation Flex... 
    Full time
    Part time
    Local area
    Flexible hours

    Capital One Group

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    Senior Manager, Data Scientist - US CardData is at the center of...  ...on the customer management business, and builds top tier machine...  ...Upmarket business, engineers, analysts, data science/quants,...  ...from design through training, evaluation, validation, and implementation... 
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    New York, NY
    1 day ago
  • # AI TraineriMerit Technologyvia RemoteOKUS, UK, Canada, Australia + 35 other countriesUSD...  ...s application page## Key detailsLocation: US, UK, Canada, Australia + 35 other...  ...identifying objects, actions and events.* Evaluate video quality, relevance and accuracy against... 
    For contractors
    Remote work

    Userc Dehradun

    New York, NY
    5 days ago
  • $125k - $135k

     ...intersection of data, technology, and business strategy? Are you the person...  ...'ve recently launched in the US with offices in NYC and Los...  ...in data, analytics, and AI consulting — dedicated to transforming...  ...business consultants, data analysts, data scientists, data... 
    Full time
    Worldwide

    Artefact

    New York, NY
    5 days ago
  • $37.5 per hour

     ...create a golden data set for AI generated ad copy for various...  ...role you will be responsible for evaluating advertising copy generated by...  ...Services Were a leading provider of business and technology services. We...  ...and Asia, who partner with us for our scale, full-stack capabilities... 
    Contract work
    Temporary work
    Remote work

    TEKsystems

    New York, NY
    2 days ago
  • $29.75 - $44.5 per hour

     ...job-related knowledge, geographic location, and other specific business and organizational needs. As a candidate, you are encouraged to...  ...accommodations to complete the application process, please email TD Bank US Workplace Accommodations Program at ****@*****.***. Include... 
    Work at office
    Local area
    Work from home
    Flexible hours

    TD Bank, N.A.

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Business Analyst - AI Evaluator / AI Trainer (US ONLY). Be the first to apply!