Business Data AI Evaluation Analyst
$50 - $80 per hourOpenTrain AI, Inc.
The work You will help evaluate how well AI handles real-world business analysis tasks. The work combines data privacy review, analytical quality checks, and clear scoring standards for AI performance. Review business datasets for personally identifiable information and flag sensitive content using appropriate privacy practices. Assess AI responses to business and data analysis scenarios, then provide feedback to improve accuracy and precision. Validate, reconcile, and verify analytical outputs using quality assurance methods. Create objective evaluation frameworks and grading criteria for analytical AI performance. Find inconsistencies and help improve datasets, evaluation guidance, and best practices for AI-driven analytics. What it pays and takes This is a part-time contractor role performed remotely from the United States. The role is marked entry level, and the requirements below describe the experience and education needed for the work. Pay: $50 to $80 per hour. Location: Open to candidates in the United States. Schedule: Part-time. Language: Fluency in English. Experience: At least three years as a business analyst or data analyst working with large business datasets. Skills: Data validation, reconciliation, quality assurance, analytical-output verification, and handling personally identifiable information or other sensitive material. Education: A bachelor's degree in business, analytics, statistics, information systems, or a related field, or equivalent professional experience. Helpful: SQL, Excel, business intelligence or data visualization tools, an advanced degree or professional certification in business analysis or data analytics, or experience with AI, data labeling, or model evaluation. About AI training work AI training is the human work behind systems that learn from examples, including reviewing model answers and checking data quality. People with business and analytical experience help set reliable standards for judging whether AI outputs are accurate and useful. #J-18808-Ljbffr
- ...one of the world’s fastest-growing AI companies accelerating the... ...are looking for a detail-oriented Business Analyst to support a project involving the evaluation of multiple chatbot responses. The... ...Analyze workflows, processes, and data to identify gaps and improvement...DataFreelanceRemote workFlexible hoursWeekday work
$150 per hour
...central bank expertise to create forecasting and research data that helps evaluate and improve AI models performing real-world macroeconomic analysis.... ...defined point in time, documenting the judgment a strong analyst would have made without hindsight. Key...DataHourly payLocal areaRemote work$145k - $160k
...just advisors we’re doers. We use AI tools to accelerate workflows and... ...The Role: We are seeking a Senior Business Analyst to work on client-facing data and AI platform delivery. The role... ...predictive and agentic capabilities: evaluation criteria, ground truth sets,...Data- ...Vulnerability Patch Management Analyst for their Midtown... ...severity, business impact, and established... ...Analyze security event data, SIEM alerts, and other... ...Governance & Compliance Evaluate vulnerability and patch... ...Power BI, scripting, and AI-enabled automation to streamline...DataContract workWork at office3 days per week
$130k - $180k
...Company Overview: Business Integration Partners (BIP) is Europe’s fastest growing digital... ...Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance,... ...ROI and implementation feasibility. • Evaluate modellable and non-modellable risk factors...DataTemporary workRemote workWorldwide$136.5k - $165k
...our people.We’re helping businesses get off the ground by... ...solve HR issues. We’re data-driven and never stop iterating... ...or enhancementsHelp evaluate new technologies,... ...standard audit reportsLead AI transformation... ...Senior Business Systems Analyst, how results are achieved...DataCasual workWork at officeLocal area- ...Role Title: Data Analyst (AI Evaluation) Role Type: Contractor Location: Remote, US-based. micro1 is engaging Data Analysts to contribute their knowledge and expertise to a customer’s data quality project. In this role, you’ll apply your expertise to help train next-generation...DataFor contractorsRemote work
$105.4k - $175.4k
...market while addressing evolving business, technology, cybersecurity,... ...closely with client personnel to evaluate and enhance information... ...platforms, ERP environments, data privacy requirements, and industry... ...capital markets.Enabled by data, AI and advanced technology, EY...DataImmediate start$97.9k - $179.5k
...expect to work with client personnel to analyze, evaluate, and enhance information systems facilitating the business internal control process, and will assist... ...while building trust in capital markets.Enabled by data, AI and advanced technology, EY teams help clients shape...DataContract workSummer holidayFlexible hours$120k - $160k
...River Trading (HRT) is seeking a Business Operations Analyst to help manage the operational backbone of our Data Strategy team.This role... ...you.Please be advised: Use of AI tools by an applicant during... ...We employ various methods to evaluate the authenticity of candidate...DataContract workWork at officeLocal areaImmediate start- ...Mercor is partnering with a leading AI lab to train frontier models on insurance reasoning data. We are hiring Multiline Property & Casualty Underwriters to design... ...risk-selection and underwriting scenarios, evaluate model outputs against underwriting standards, and...Data
- Senior Business Analyst - Data Sharing Contracts Ascension Technologies is seeking a detail‑oriented and... ...central to our efforts in leveraging AI and language learning models to surface... ...support contract visibility and compliance Evaluate feedback and suggest enhancements to...DataContract workRemote work
- ...Vulnerability Management Analyst (AI Training) About the Role... ...workflows to help train and evaluate cutting-edge AI models. This... ...severity, exploitability, and business impact using industry-standard... ...realistic security-reasoning data used to train and benchmark AI...DataHourly payOngoing contractContract workFreelanceRemote workFlexible hours
- ...our community. Join us in using data, bold thinking, and a... ...identify and mitigate riskUse AI tools fluently and stay current... ...this role’s team or the related business lines. We utilize a hybrid work... ...will use this information to evaluate your application for employment...DataFull timeWork at officeLocal areaRemote workRelocationFlexible hours
$132.26k - $155.6k
...best. Helping the customers and businesses we serve to make better and... ...visa sponsorship.The Market Risk Data Analytics Specialist will... ...or similar tools, and emerging AI-enabled capabilities.The successful... ...senior management reporting.Evaluate opportunities to apply AI,...DataFull timeWork experience placementLocal area3 days per week$30 - $80 per hour
...Role Overview Apply your business intelligence and analytics expertise... ...to help train next-generation AI systems through high-quality,... ...interactive dashboards and data visualizations using Power BI,... ...Databricks, or comparable tools. Evaluate and troubleshoot calculation...DataHourly payContract workRemote work$150k - $200k
...serving clients in major centers of business, finance, technology, and... ...Overview The Compliance & Data Science Consultant supports the... ...design, implementation, and evaluation of client compliance programs.... ...roadmaps.Continue to develop AI-driven workflows to derive efficiency...Data- eDataBae is seeking English-speaking professionals located in the United States to support an AI evaluation initiative focused on small business use cases. You will create realistic business prompts, interact with AI tools, and provide structured feedback to improve AI...
- ...hedge in New York is looking to appoint a AI Business Analyst. The Operations team is responsible... ...execute against. Conduct in-depth data analysis across asset classes, products... ..., applying prompt design, testing, and evaluation to improve output quality and reliability...DataInterim roleCasual work
- ...chatbot responses against business requirements and... ...assessments that help improve AI applications used in... ...workflows, processes, and data. Create reports,... ...involving a defined number of evaluation tasks. The listing does... ...years as a Business Analyst or in a similar role....DataFreelanceRemote workWorldwideWeekday work
$98k - $122k
...our people.We’re helping businesses get off the ground by... ...solve HR issues. We’re data-driven and never stop iterating... ...forward-thinking about AI and automation, but... ...Performance Insights Analyst, how results are... ...or similar AI models to evaluate unstructured data (e.g....DataCasual workWork at officeLocal area$125.4k - $200.6k
...Lead - Ai Governance Risk SpecialistThe Lead - AI Governance Risk Specialist... ...oversight with emphasis on the evaluation of AI use cases, AI-enabled tools, data considerations, third-party... ...effectiveness. The role partners across business, technology, cybersecurity, legal,...DataFull timeTemporary workWork at officeImmediate startRemote workWork visaFlexible hours- Turing, an AI company, is seeking a meticulous Quality Analyst for a 16-week contract to evaluate and compare chatbot responses. You will review outputs against guidelines, identify... ...cases when needed. This role focuses on data-quality and AI tool usage throughout the...DataRemote jobContract work
- AI Trainer Jobs is seeking a detail-oriented evaluator to score prompt-response pairs from large language models. You will use structured rubrics to rate factual... ...subtle failure modes, and contribute to fine-tuning data. Sessions are asynchronous with calibration meetings...Data
- ...and to-be process maps, data-flow diagrams, user... ...with acceptance criteria, business rules, data dictionaries... ...), de-duplication, AI-assisted relevance screening... ...lifecycle governance: evaluation datasets, change... ...3 years in a business analyst, systems analyst or product...DataLocal area
$115k - $150k
...leader in digital assets and data center infrastructure, delivering... ...infrastructure to power AI and high-performance computing... ...Asia. To learn more about our businesses and products, visit What We Value... ...planning and execution. Evaluate and manage risks across pre-construction...DataContract workFor contractorsLocal area$175k - $225k
...The Opportunity We’ve built out a best-in-class data asset and AI tools about businesses in the US. We are continually expanding our data coverage... ...source of truth data. You’ll also be responsible for evaluating the data quality of new partners’ data and owning the...Data- Mercor is partnering with a leading AI lab to train frontier models on high-quality insurance reasoning data. We're hiring Multiline Property & Casualty Underwriters to... ...risk-selection and underwriting scenarios, evaluate model outputs against established underwriting...Data
$50k - $60k
...relationships are everything in business and in life. Founded by two... ...the Role We are seeking an Analyst to join our Data Team and conduct research... ...emerging technologies like AI. Proficiency in conducting... ...Connect we focus on evaluation based on key competencies needed...DataWork at officeLocal areaFlexible hours$126k - $201.6k
Business Systems Analyst - AI Automation As Avalara scales its AI-first enterprise systems, workflows, and... ...rigor Using structured analysis and data to reduce ambiguity, automation... ...define measurable AI-driven outcomes, evaluation criteria, and business impact Apply AI...DataContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Data AI Evaluation Analyst. Be the first to apply!
- revenue growth management analyst New York, NY
- configuration management analyst New York, NY
- entry level management analyst New York, NY
- medicaid business analyst New York, NY
- pega business analyst New York, NY
- student business analyst New York, NY
- records management analyst New York, NY
- oracle business analyst New York, NY
- senior data management analyst New York, NY
- analytics business analyst New York, NY






