Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Business Data AI Evaluation Analyst

$50 - $80 per hour

OpenTrain AI, Inc.

The work You will help evaluate how well AI handles real-world business analysis tasks. The work combines data privacy review, analytical quality checks, and clear scoring standards for AI performance. Review business datasets for personally identifiable information and flag sensitive content using appropriate privacy practices. Assess AI responses to business and data analysis scenarios, then provide feedback to improve accuracy and precision. Validate, reconcile, and verify analytical outputs using quality assurance methods. Create objective evaluation frameworks and grading criteria for analytical AI performance. Find inconsistencies and help improve datasets, evaluation guidance, and best practices for AI-driven analytics. What it pays and takes This is a part-time contractor role performed remotely from the United States. The role is marked entry level, and the requirements below describe the experience and education needed for the work. Pay: $50 to $80 per hour. Location: Open to candidates in the United States. Schedule: Part-time. Language: Fluency in English. Experience: At least three years as a business analyst or data analyst working with large business datasets. Skills: Data validation, reconciliation, quality assurance, analytical-output verification, and handling personally identifiable information or other sensitive material. Education: A bachelor's degree in business, analytics, statistics, information systems, or a related field, or equivalent professional experience. Helpful: SQL, Excel, business intelligence or data visualization tools, an advanced degree or professional certification in business analysis or data analytics, or experience with AI, data labeling, or model evaluation. About AI training work AI training is the human work behind systems that learn from examples, including reviewing model answers and checking data quality. People with business and analytical experience help set reliable standards for judging whether AI outputs are accurate and useful. #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Business Data AI Evaluation Analyst in New York, NY vacancy
  •  ...one of the world’s fastest-growing AI companies accelerating the...  ...are looking for a detail-oriented Business Analyst to support a project involving the evaluation of multiple chatbot responses. The...  ...Analyze workflows, processes, and data to identify gaps and improvement... 
    Data
    Freelance
    Remote work
    Flexible hours
    Weekday work

    Braintrust

    New York, NY
    2 days ago
  • $150 per hour

     ...central bank expertise to create forecasting and research data that helps evaluate and improve AI models performing real-world macroeconomic analysis....  ...defined point in time, documenting the judgment a strong analyst would have made without hindsight. Key... 
    Data
    Hourly pay
    Local area
    Remote work

    SaidGig

    New York, NY
    2 days ago
  • $145k - $160k

     ...just advisors we’re doers. We use AI tools to accelerate workflows and...  ...The Role: We are seeking a Senior Business Analyst to work on client-facing data and AI platform delivery. The role...  ...predictive and agentic capabilities: evaluation criteria, ground truth sets,... 
    Data

    Sol Consulting

    New York, NY
    1 day ago
  •  ...Vulnerability Patch Management Analyst for their Midtown...  ...severity, business impact, and established...  ...Analyze security event data, SIEM alerts, and other...  ...Governance & Compliance Evaluate vulnerability and patch...  ...Power BI, scripting, and AI-enabled automation to streamline... 
    Data
    Contract work
    Work at office
    3 days per week

    Nesco Resource

    New York, NY
    2 days ago
  • $130k - $180k

     ...Company Overview: Business Integration Partners (BIP) is Europe’s fastest growing digital...  ...Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance,...  ...ROI and implementation feasibility. • Evaluate modellable and non-modellable risk factors... 
    Data
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    2 days ago
  • $136.5k - $165k

     ...our people.We’re helping businesses get off the ground by...  ...solve HR issues. We’re data-driven and never stop iterating...  ...or enhancementsHelp evaluate new technologies,...  ...standard audit reportsLead AI transformation...  ...Senior Business Systems Analyst, how results are achieved... 
    Data
    Casual work
    Work at office
    Local area

    Justworks

    New York, NY
    7 days ago
  •  ...Role Title: Data Analyst (AI Evaluation) Role Type: Contractor Location: Remote, US-based. micro1 is engaging Data Analysts to contribute their knowledge and expertise to a customer’s data quality project. In this role, you’ll apply your expertise to help train next-generation... 
    Data
    For contractors
    Remote work

    micro1

    New York, NY
    4 days ago
  • $105.4k - $175.4k

     ...market while addressing evolving business, technology, cybersecurity,...  ...closely with client personnel to evaluate and enhance information...  ...platforms, ERP environments, data privacy requirements, and industry...  ...capital markets.Enabled by data, AI and advanced technology, EY... 
    Data
    Immediate start

    EY (Ernst & Young)

    New York, NY
    8 days ago
  • $97.9k - $179.5k

     ...expect to work with client personnel to analyze, evaluate, and enhance information systems facilitating the business internal control process, and will assist...  ...while building trust in capital markets.Enabled by data, AI and advanced technology, EY teams help clients shape... 
    Data
    Contract work
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    5 days ago
  • $120k - $160k

     ...River Trading (HRT) is seeking a Business Operations Analyst to help manage the operational backbone of our Data Strategy team.This role...  ...you.Please be advised: Use of AI tools by an applicant during...  ...We employ various methods to evaluate the authenticity of candidate... 
    Data
    Contract work
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    6 days ago
  •  ...Mercor is partnering with a leading AI lab to train frontier models on insurance reasoning data. We are hiring Multiline Property & Casualty Underwriters to design...  ...risk-selection and underwriting scenarios, evaluate model outputs against underwriting standards, and... 
    Data

    Mercor Inc

    New York, NY
    1 day ago
  • Senior Business Analyst - Data Sharing Contracts Ascension Technologies is seeking a detail‑oriented and...  ...central to our efforts in leveraging AI and language learning models to surface...  ...support contract visibility and compliance Evaluate feedback and suggest enhancements to... 
    Data
    Contract work
    Remote work

    Medasource

    New York, NY
    2 days ago
  •  ...Vulnerability Management Analyst (AI Training) About the Role...  ...workflows to help train and evaluate cutting-edge AI models. This...  ...severity, exploitability, and business impact using industry-standard...  ...realistic security-reasoning data used to train and benchmark AI... 
    Data
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    2 days ago
  •  ...our community. Join us in using data, bold thinking, and a...  ...identify and mitigate riskUse AI tools fluently and stay current...  ...this role’s team or the related business lines. We utilize a hybrid work...  ...will use this information to evaluate your application for employment... 
    Data
    Full time
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    New York, NY
    8 days ago
  • $132.26k - $155.6k

     ...best. Helping the customers and businesses we serve to make better and...  ...visa sponsorship.The Market Risk Data Analytics Specialist will...  ...or similar tools, and emerging AI-enabled capabilities.The successful...  ...senior management reporting.Evaluate opportunities to apply AI,... 
    Data
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    New York, NY
    7 days ago
  • $30 - $80 per hour

     ...Role Overview Apply your business intelligence and analytics expertise...  ...to help train next-generation AI systems through high-quality,...  ...interactive dashboards and data visualizations using Power BI,...  ...Databricks, or comparable tools. Evaluate and troubleshoot calculation... 
    Data
    Hourly pay
    Contract work
    Remote work

    SaidGig

    New York, NY
    2 days ago
  • $150k - $200k

     ...serving clients in major centers of business, finance, technology, and...  ...Overview The Compliance & Data Science Consultant supports the...  ...design, implementation, and evaluation of client compliance programs....  ...roadmaps.Continue to develop AI-driven workflows to derive efficiency... 
    Data

    Ropes & Gray

    New York, NY
    6 days ago
  • eDataBae is seeking English-speaking professionals located in the United States to support an AI evaluation initiative focused on small business use cases. You will create realistic business prompts, interact with AI tools, and provide structured feedback to improve AI... 

    eDataBae

    New York, NY
    22 hours ago
  •  ...hedge in New York is looking to appoint a AI Business Analyst. The Operations team is responsible...  ...execute against. Conduct in-depth data analysis across asset classes, products...  ..., applying prompt design, testing, and evaluation to improve output quality and reliability... 
    Data
    Interim role
    Casual work
    New York, NY
    24 days ago
  •  ...chatbot responses against business requirements and...  ...assessments that help improve AI applications used in...  ...workflows, processes, and data. Create reports,...  ...involving a defined number of evaluation tasks. The listing does...  ...years as a Business Analyst or in a similar role.... 
    Data
    Freelance
    Remote work
    Worldwide
    Weekday work

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • $98k - $122k

     ...our people.We’re helping businesses get off the ground by...  ...solve HR issues. We’re data-driven and never stop iterating...  ...forward-thinking about AI and automation, but...  ...Performance Insights Analyst, how results are...  ...or similar AI models to evaluate unstructured data (e.g.... 
    Data
    Casual work
    Work at office
    Local area

    Justworks

    New York, NY
    3 days ago
  • $125.4k - $200.6k

     ...Lead - Ai Governance Risk SpecialistThe Lead - AI Governance Risk Specialist...  ...oversight with emphasis on the evaluation of AI use cases, AI-enabled tools, data considerations, third-party...  ...effectiveness. The role partners across business, technology, cybersecurity, legal,... 
    Data
    Full time
    Temporary work
    Work at office
    Immediate start
    Remote work
    Work visa
    Flexible hours

    Bread Financial Holdings

    New York, NY
    4 days ago
  • Turing, an AI company, is seeking a meticulous Quality Analyst for a 16-week contract to evaluate and compare chatbot responses. You will review outputs against guidelines, identify...  ...cases when needed. This role focuses on data-quality and AI tool usage throughout the... 
    Data
    Remote job
    Contract work

    Benture

    New York, NY
    1 day ago
  • AI Trainer Jobs is seeking a detail-oriented evaluator to score prompt-response pairs from large language models. You will use structured rubrics to rate factual...  ...subtle failure modes, and contribute to fine-tuning data. Sessions are asynchronous with calibration meetings... 
    Data

    Claru

    New York, NY
    1 day ago
  •  ...and to-be process maps, data-flow diagrams, user...  ...with acceptance criteria, business rules, data dictionaries...  ...), de-duplication, AI-assisted relevance screening...  ...lifecycle governance: evaluation datasets, change...  ...3 years in a business analyst, systems analyst or product... 
    Data
    Local area

    Eversana

    New York, NY
    22 hours ago
  • $115k - $150k

     ...leader in digital assets and data center infrastructure, delivering...  ...infrastructure to power AI and high-performance computing...  ...Asia. To learn more about our businesses and products, visit What We Value...  ...planning and execution. Evaluate and manage risks across pre-construction... 
    Data
    Contract work
    For contractors
    Local area

    Galaxy Digital

    New York, NY
    22 hours ago
  • $175k - $225k

     ...The Opportunity We’ve built out a best-in-class data asset and AI tools about businesses in the US. We are continually expanding our data coverage...  ...source of truth data. You’ll also be responsible for evaluating the data quality of new partners’ data and owning the... 
    Data

    Enigma Technologies, Inc.

    New York, NY
    3 days ago
  • Mercor is partnering with a leading AI lab to train frontier models on high-quality insurance reasoning data. We're hiring Multiline Property & Casualty Underwriters to...  ...risk-selection and underwriting scenarios, evaluate model outputs against established underwriting... 
    Data

    Mercor

    New York, NY
    22 hours ago
  • $50k - $60k

     ...relationships are everything in business and in life. Founded by two...  ...the Role We are seeking an Analyst to join our Data Team and conduct research...  ...emerging technologies like AI. Proficiency in conducting...  ...Connect we focus on evaluation based on key competencies needed... 
    Data
    Work at office
    Local area
    Flexible hours

    Leadership Connect, Inc.

    New York, NY
    22 hours ago
  • $126k - $201.6k

    Business Systems Analyst - AI Automation As Avalara scales its AI-first enterprise systems, workflows, and...  ...rigor Using structured analysis and data to reduce ambiguity, automation...  ...define measurable AI-driven outcomes, evaluation criteria, and business impact Apply AI... 
    Data
    Contract work

    Bitovi

    New York, NY
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Business Data AI Evaluation Analyst. Be the first to apply!