Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Media & Information AI Training Specialist — Task Creation & Model Evaluation

BAM Ventures

About Rise Data Labs Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including journalism, editorial, and video/film production. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data. Job Overview As a Media & Information AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for journalism, editorial, and video/film production work. This role goes beyond traditional annotation and labeling — you'll author realistic, economically valuable media tasks and rubrics based on your own professional experience, then grade AI-generated deliverables against them. What You'll Do Create realistic work scenarios based on your own professional experience — e.g., drafting or editing an article, fact-checking and sourcing, writing a script or shot list, reviewing a rough cut or storyboard Supply the kinds of reference materials you'd normally work from (source documents, style guides, scripts, production notes) Write detailed rubrics specifying exactly what a correct, publication‑ready or production‑ready deliverable requires — accurate sourcing, correct style/format, sound editorial or production judgment Grade AI-generated deliverables (often written pieces, scripts, or production documents) against your rubric Join calibration sessions with other experts to ensure consistent scoring across the benchmark Preferred Qualifications Prior hands‑on experience as a Journalist, Editor, Writer, Producer, Director, or Video Editor Comfort reviewing detailed written or production work product against professional standards Prior experience with AI model training, evaluation, or benchmark development is a plus What We Offer At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in media, journalism, and video production. #J-18808-Ljbffr BAM Ventures

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Media & Information AI Training Specialist — Task Creation & Model Evaluation in New York, NY vacancy
  • AuraOne is seeking an Evaluation Harness Model Evaluation Specialist to work remotely as an independent contractor. You will review evaluation harness model outputs, label issues, and provide structured feedback to retrain the model using AuraOne's quality rubric. Strong... 
    Suggested
    Remote job
    For contractors

    AuraOne

    New York, NY
    3 days ago
  • Job Overview As an AI Model Training Specialist with a focus on Bash coding, you will play a crucial role in enhancing the performance of AI models...  .... Utilize Bash scripting to automate data processing tasks and improve efficiency. Provide domain expertise to enhance... 
    Suggested
    Hourly pay
    Flexible hours

    BAM VENTURES LLC

    New York, NY
    1 day ago
  • A leading AI research initiative is seeking skilled Inkscape users for flexible...  ...-based work. The role involves evaluating AI-generated content and providing feedback on visual tasks using your experience in vector design, logo creation, and graphic design. Ideal... 
    Suggested
    Remote work
    Flexible hours

    Handshake

    New York, NY
    4 days ago
  • $92.86 per hour

     ...Our client, a leading organization in the media and information industry, is seeking a Generative AI Training and Support Specialist to join their team. As a Generative AI Training and Support Specialist, you will be part of the Learning and Development department supporting... 
    Suggested
    Weekly pay
    Temporary work
    Work experience placement
    Flexible hours
    3 days per week

    Experis/Manpower Group

    New York, NY
    22 hours ago
  • $80 per hour

     ...the future of AI. What We Do The...  ...platform connects specialists with AI...  ...and structured evaluation scenarios for LLM...  ...human-performed tasks and define gold...  ...From creating training prompts to refining model responses, you'...  ...Processing (NLP), Information Systems or other... 
    Suggested
    Part time
    Freelance
    Remote work
    Flexible hours

    Mindrift

    New York, NY
    22 hours ago
  • $80 per hour

     ...Mindrift connects specialists with project-based AI opportunities for leading...  ...focused on testing, evaluating, and improving AI...  ...refine realistic coding tasks based on provided...  ..., requirements and information sources Write comprehensive...  ...understand what the model struggles with vs.... 
    Permanent employment
    Temporary work

    Mindrift

    New York, NY
    1 day ago
  • $60 - $90 per hour

     ...technical talent with leading AI research labs....  ...Machine Learning Engineer — Model Evaluation & Experimentation...  ...Design tasks by turning real ML research...  ...implementing changes, running training experiments, and analyzing...  ...process and platform information, please check: For... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $20 per hour

     ...seasoned Personal Trainers and Fitness Instructors to join its Expert Network. You’ll help train and evaluate AI models by applying exercise and wellness expertise, with tasks delivered remotely on a freelance basis. A quick 10-15 minute test may be required to assess... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Prolific

    New York, NY
    13 hours ago
  • $30 per hour

     ...seeking fluent Cantonese speakers to join their Expert Network. Participants will help train and evaluate AI models using their legal expertise, with pay rates up to $30/hr for tasks that require one hour of uninterrupted work. Successful candidates will have advanced Cantonese... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • $50 - $190 per hour

     ...technical talent with leading AI research labs....  ...Role Responsibilities Evaluate AI systems on complex personal...  ...complex personal-life tasks using Google Drive ,...  ...to improve AI model performance . Judge...  ...interview process and platform information, please check: For... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work
    Trial period

    Mercor

    New York, NY
    7 days ago
  • $203k - $338.3k

     ...Manager - Model Validation...  ...advanced data, AI, and...  ...path to value creation. Work you’ll...  ...Technology, Media, and Telecom...  ...-based evaluation).Develop models...  ...with specialists across Deloitte...  ...prioritize multiple tasks in a fast-...  ...model training experience Information for... 

    Deloitte

    New York, NY
    4 days ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...  ...interview process and platform information, please check: For any help... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $118.98k - $195.47k

     ...our team as a Finance Model & AI Solutions Lead.The...  ...automatically create and evaluate multiple planning...  ...solutionsConduct training sessions and create...  ...reduce manual planning tasks by 30%+Creation of AI solutions that...  ...and filtering of information provided by applicants... 
    Full time
    H1b
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours
    3 days per week

    Guardian Life Insurance

    New York, NY
    22 hours ago
  •  ...Subject‑Matter Expert to join a leading AI lab's GenAI team in New York. This W-2 role involves evaluating insurance tasks and guiding model development for high‑quality underwriting...  ...and collaborate with other SMEs to ensure accurate training data. #J-18808-Ljbffr Mercor
    Weekday work

    Mercor

    New York, NY
    3 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (Vision model customization, VLM) Overview At Capital One...  ...leveraging AI. From informing customers about unusual charges...  ...including foundation model training, large language model...  ...search, guardrails, model evaluation, experimentation, governance... 
    Full time
    Part time
    Local area

    Capital One Financial Corp

    New York, NY
    2 days ago
  • $180k - $225k

     ...integrate and optimize models for production and...  ...relevant education or training. Scale employees in eligible...  ...a fair and thorough evaluation of all applicants....  ...is to develop reliable AI systems for the world'...  ...poster for additional information.We comply with the United... 
    Full time

    Scale AI

    New York, NY
    22 hours ago
  •  ...professionals for a unique remote opportunity to evaluate and enhance AI systems in financial contexts....  ...and deep knowledge of financial modeling, forecasting, and variance analysis. This...  ...challenge AI models with complex financial tasks and requires strong communication... 
    Remote job
    For contractors

    YO IT Consulting

    New York, NY
    1 day ago
  • Jack & Jill is recruiting a Finance & Consulting Expert (AI Training) to train and evaluate AI models on complex financial and strategic tasks. Remote, global engagement with competitive hourly pay and flexible schedule. You will craft expert prompts, review financial materials... 
    Remote job
    Hourly pay
    Flexible hours

    Jack & Jill

    New York, NY
    3 days ago
  • $400 per month

     ...Mercor is partnering with a leading AI research lab to support a Frontier...  ...Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments...  ...evaluate complex data engineering tasks. Review model-generated... 

    Mercor

    New York, NY
    2 days ago
  •  ...is seeking a Generalist who can operate in English and Punjabi. This contract, remote position focuses on evaluating AI outputs and supporting model evaluation tasks. You will conduct fact-checking, assess reasoning, clarity, tone and completeness, and provide actionable... 
    Remote job
    Contract work

    United States Digital Space LLC

    New York, NY
    3 days ago
  • Cincinnatus LLC is hiring for a Marketing SME to support GenAI model evaluation and brand/growth tasks. The role centers on applying rigorous marketing judgment to AI training data and guiding cross-functional teams to improve model outputs. Ideal candidates have extensive... 

    Obsidian

    New York, NY
    2 days ago
  • $80 per hour

     ...and technical talent with leading AI research labs. Headquartered in...  ...coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving...  ...interview process and platform information, please check: For any help... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    9 days ago
  •  ...a project to assess advanced agentic audio models, benchmarking them against leading systems...  ...technical support, contributing to diverse evaluation datasets. Responsibilities include evaluating performance with metrics on task completion, naturalness, audio comprehension... 
    Remote job
    Contract work

    name

    New York, NY
    2 days ago
  • Dorado is seeking Speech AI Evaluation Specialists to support AI content improvement. This freelance, part-time role is based remotely from Malaysia...  ...native Vietnamese speakers with strong English skills (B2-C2) and some exposure to AI/data tasks. #J-18808-Ljbffr Dorado
    Remote job
    Part time
    Freelance
    Immediate start
    10 hours per week

    Dorado

    New York, NY
    4 days ago
  •  ...tech company in Canada is seeking individuals for a role focused on evaluating AI-generated responses. The responsibilities include assessing reasoning quality, providing structured feedback for model improvements, and ensuring outputs are accurate and human-aligned. Candidates... 
    Full time
    Contract work
    Part time
    Flexible hours

    Crossing Hurdles

    New York, NY
    22 hours ago
  • In-House Fit Model (Women's Size 8 / Medium)About the RoleWe are...  ...key contributor to the product creation process, you will work...  ...merchandising, and sales teams to help evaluate garment fit, comfort, and...  ...of confidential product information.This is an excellent opportunity... 
    Full time

    Career Development Partners

    New York, NY
    3 days ago
  •  ...users to support AI research...  ...editing, content creation, or social media video production to evaluate AI-generated content...  ...video tasks and editing workflows...  ...Multimedia Specialist You should...  ...earning Work Model and Project Details...  ...for more information on what types... 
    Hourly pay
    Full time
    Contract work
    For contractors
    Freelance
    Remote work
    Flexible hours

    Handshake

    New York, NY
    4 days ago
  • $125k - $150k

     ...and Live Nation Media & Sponsorship....  ...For additional information, visit WHO ARE...  ...THE JOB The Lead AI Solutions...  ...stakeholder + builder model, partnering...  ...majority of their tasks and will act as...  ...lightweight evaluation frameworks to measure...  ...programs & trainings OTHERS:... 
    Local area
    Worldwide
    Flexible hours

    Live Nation Entertainment

    New York, NY
    2 days ago
  • $60 - $85 per hour

     ...Remote | Licensed Chemical Engineer & AI Evaluation Specialist - $60-$85/hour We are sharing a...  ...procedures, calculations, and technical training materials Collaborate...  ...application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment... 
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work
    10 hours per week
    Flexible hours

    24-MAG LLC

    New York, NY
    a month ago
  •  ...seeking experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-...  ...quality standards, and perform labeling and comparison tasks while working in Arabic and English. This project runs up... 
    Flexible hours

    Mercor

    New York, NY
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Media & Information AI Training Specialist — Task Creation & Model Evaluation. Be the first to apply!