Business Analyst - AI Evaluator / AI Trainer (US ONLY)
Braintrust
About Turing:
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview
We are looking for a detail-oriented Business Analyst to support a project involving the evaluation of multiple chatbot responses. The role will require analyzing business requirements, comparing chatbot outputs, conducting structured evaluations, and providing final assessments based on defined criteria.
Key Responsibilities:
- Gather, analyze, and document business requirements.
- Collaborate with stakeholders to understand business needs and objectives.
- Translate business requirements into clear functional specifications.
- Analyze workflows, processes, and data to identify gaps and improvement areas.
- Create reports, dashboards, process maps, and other documentation.
- Support project planning, testing, implementation, and user acceptance testing.
- Coordinate with technical and cross-functional teams to ensure successful delivery.
- Track project progress, risks, dependencies, and key performance indicators.
- Present insights and recommendations to stakeholders.
Required Qualifications and Skills:
- Bachelor’s degree in Business Administration, Finance, Computer Science, or a related field.
- 3+ years of experience as a Business Analyst or in a similar role.
- Strong analytical, problem-solving, and communication skills.
- Proficiency in Excel, SQL, Power BI, Tableau, or similar tools.
- Experience with requirement-gathering and process-mapping techniques.
- Ability to work with cross-functional teams and manage multiple priorities.
- Strong attention to detail and documentation skills.
- Knowledge of Agile or Scrum methodologies is an advantage.
Perks of Freelancing With Turing:
- Work at the forefront of AI applications in accounting and finance.
- Fully remote and flexible work environment.
- Opportunity to collaborate on high-impact projects with global reach.
Offer Details:
- This is a project-based role involving a defined number of evaluation tasks.
- Each task will involve comparing multiple chatbots and providing a final assessment.
- Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
- Duration: 16 weeks.
Interview Process:
- Complete an interest check form (10 minutes)
- General aptitude test (60 minutes)
- About the Opportunity A leading AI research organization is seeking advanced LLM power... ...personal life tasks. This project focuses on evaluating how well AI systems handle personalized,... ...Looking For Strong candidates will have: US-based only Strong MCP experience and plug...SuggestedTrial period
$60 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...legal consultants, attorneys with an experience in US law open to part-time, non-permanent projects....SuggestedPermanent employmentTemporary workPart timeFreelance10 hours per week$70 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Details Position:...SuggestedContract workSummer workImmediate startRemote work$50 per hour
Mercor is seeking experienced scientists/engineers fluent in German to train and evaluate AI agents on realistic professional tasks. You will build workspaces and files, write prompts, and create grading rubrics based on real stem work as it's done in Germany. The role...SuggestedRemote jobHourly pay$11 - $30.65 per hour
Meridial is seeking contractors to evaluate advanced agentic audio models by simulating realistic customer service interactions across multiple domains. You will contribute to developing diverse datasets and assess model performance using various metrics. The role requires...SuggestedRemote jobHourly payFor contractors$40 per hour
A leading company in AI training solutions is seeking a Content Developer specialized in Physics. The role involves enhancing AI models by providing and evaluating complex physics problems. Ideal candidates hold advanced degrees in physics or related fields, ensuring high...Remote jobHourly pay$20 - $80 per hour
Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses... ...and analyze complex material in areas including business, finance, marketing, healthcare, and legal topics....Hourly payContract workFor contractorsRemote work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning...Contract workSummer workRemote work- ...Expert for a six-week remote contract. The role demands deep knowledge of materials science and the ability to craft prompts to test AI models. Responsibilities include sourcing data from papers and open sources, building grading criteria, and calibrating tasks against...Remote jobContract work
- Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The role involves reviewing datasets for accuracy, providing feedback to annotators, and validating AI model outputs to ensure high production quality. Candidates...Remote jobFull time
$60 per hour
A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience in US law. Candidates must have strong written English skills and a...Permanent employmentPart timeFreelanceFlexible hours$50 - $190 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...0+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows,... ...correctly. Qualifications Must-Have US-based only. Strong MCP experience and...Hourly payContract workFor contractorsSummer workRemote workTrial period$160k - $210k
BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured Products Location New York Business Area Product Ref # 10053894 Description & Requirements Bloomberg’s Evaluated Pricing Service, BVAL, provides transparent and accurate...Price workTemporary workFor contractorsWork experience placement$18 per hour
Prolific is seeking AI Trainers/Study Participants from diverse backgrounds in the United States to contribute to academic and applied research studies. After a quick screening, you may join and get paid per study, with compensation up to $18/hr and studies that can require...Remote job- ...to the Head of Commodities Risk Analytics and Risk Advisory. The US FTR, Gas and Power Risk, Quantitative Researcher will partner... ...risk, and physical commodity models to help grow the Commodities business.Responsibilities IncludeFormulate and implement models for risk...
$20 per hour
Prolific is seeking a Sales Professional to join our Expert Network for AI model training and evaluation. You will be paid to contribute real sales and business development expertise via paid tasks, with a quick screening test if selected. All work is remote and ad hoc...Remote jobHourly payFreelance$130 per hour
Turing is seeking US-based dermatologists to review AI-generated dermatology content for accuracy and safety. You will analyze medical images and case... ..., requiring 20 hours per week and overlap with Pacific business hours. Compensation is $130 per hour for the project duration...Hourly payContract workPart time$4,325 - $5,750 per week
# Quantitative Researcher – 2026 PhD Intern (US)Citadel SecuritiesInternshipQuant ResearcherPosted March 18, 2025Job DescriptionAt Citadel Securities, a leading global market maker, our team of quantitative researchers models the markets and brings trading strategies to...Internship$20.3 per hour
...Hourly rate: $20.30 Language: English (US) Estimated volume: 8 - 10 hours Start date... ...qualified raters to support a project focused on evaluating personalized search and location... ...hour We may use artificial intelligence (AI) tools to support parts of the hiring process...Hourly payContract workFreelanceImmediate start$20.3 per hour
Welo Data is seeking a Maps Visual Design Relevance Evaluator (US) to assess the aesthetic quality, readability, and overall polish of digital map designs, ensuring geographic accuracy and content relevance for user-facing features. This freelance, remote role pays US$2...Remote jobHourly payFreelance- Welo Data seeks a Maps Visual Design Relevance Evaluator to assess the aesthetic quality, readability and polish of digital map designs for English (US) users. This freelance, remote role pays hourly and focuses on ensuring contextual relevance and helpful recommendations...Remote jobHourly payFreelance
- Welocalize is seeking a Maps Visual Design Relevance Evaluator - English (US) to assess the aesthetic quality, readability, and polish of digital map designs while verifying geospatial accuracy and content relevance. You will review personalized location recommendations...Remote jobFreelance
- Welo Data is seeking a Maps Visual Design Relevance Evaluator (US). This freelance role focuses on evaluating the aesthetic quality and readability of digital map designs, with emphasis on spatial accuracy and content relevance. You will work remotely in English (US) across...Remote jobFreelance
- ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform...Contract workWorldwideFlexible hours
$197.3k - $225.1k
...Manager, Data Scientist - US Card (Upmarket Acquisitions) Data is at the center... ...engineers, product managers, credit and business analysts, to deliver the solutions from ideation... ...development, from design through training, evaluation, validation, and implementation Flex...Full timePart timeLocal areaFlexible hours$229.9k - $262.4k
Senior Manager, Data Scientist - US CardData is at the center of... ...on the customer management business, and builds top tier machine... ...Upmarket business, engineers, analysts, data science/quants,... ...from design through training, evaluation, validation, and implementation...Full timePart timeLocal areaFlexible hours- # AI TraineriMerit Technologyvia RemoteOKUS, UK, Canada, Australia + 35 other countriesUSD... ...s application page## Key detailsLocation: US, UK, Canada, Australia + 35 other... ...identifying objects, actions and events.* Evaluate video quality, relevance and accuracy against...For contractorsRemote work
$125k - $135k
...intersection of data, technology, and business strategy? Are you the person... ...'ve recently launched in the US with offices in NYC and Los... ...in data, analytics, and AI consulting — dedicated to transforming... ...business consultants, data analysts, data scientists, data...Full timeWorldwide$37.5 per hour
...create a golden data set for AI generated ad copy for various... ...role you will be responsible for evaluating advertising copy generated by... ...Services Were a leading provider of business and technology services. We... ...and Asia, who partner with us for our scale, full-stack capabilities...Contract workTemporary workRemote work$29.75 - $44.5 per hour
...job-related knowledge, geographic location, and other specific business and organizational needs. As a candidate, you are encouraged to... ...accommodations to complete the application process, please email TD Bank US Workplace Accommodations Program at ****@*****.***. Include...Work at officeLocal areaWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Analyst - AI Evaluator / AI Trainer (US ONLY). Be the first to apply!
- revenue growth management analyst New York, NY
- configuration management analyst New York, NY
- entry level management analyst New York, NY
- medicaid business analyst New York, NY
- pega business analyst New York, NY
- student business analyst New York, NY
- records management analyst New York, NY
- oracle business analyst New York, NY
- senior data management analyst New York, NY
- analytics business analyst New York, NY



