AI Multimedia Generation Product Evaluator [Remote]
SGS Consulting
Remote
- Remote job
Job Responsibilities:
- Set up Halo tasks and run model inference
- Enqueue new queues to Halo
- Audit annotations from vendors
- Build necessary tooling for managing evaluation datasets
- Collaborate with model development teams to conduct offline evaluations and automate pipelines
- Facilitate, set up queues, manage image radio data, and audit results
- Ensure consistency and accuracy in measurements, involving programming and auditing tasks
- Collaborate with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement. Main tasks include facilitating, setting up queues, managing image radio data, and auditing results.
Skills:
- 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
- Experience in SQL and handling large data tables
- Experience in the image and video domain
- Ability to adapt to new code
- General know-how
- Flexibility in working hours
- Nice-to-Have Skills:
- Experience as a GenAI user in the image and video domain
- Basic shell script knowledge
- 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
- Experience in SQL and handling large data tables
- Experience in the image and video domain
- Experience as a GenAI user in the image and video domain
- Basic shell script knowledge
Education/Experience:
- Bachelor’s preferred, not required
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the AI Multimedia Generation Product Evaluator [Remote] in Remote vacancy
$50 per hour
Prolific is looking for Product Designers and UX Specialists to join their Expert Network. In this role, you'll help train AI models using your design expertise, and you may earn up to $50 per hour . You will evaluate AI-generated designs, ensure they meet accessibility...SuggestedRemote jobHourly payFlexible hours$50 per hour
Prolific is seeking Product Designers and UX Specialists to join our Expert Network to help train AI models using real design expertise. This role involves evaluating AI-generated designs, auditing accessibility, and validating UX principles. The successful candidate will...SuggestedRemote jobWork from homeFlexible hours$50 per hour
Prolific is seeking Product Designers and UX Specialists to train and evaluate AI models. Candidates should have a degree in HCI or related fields and experience... ...products. Responsibilities include assessing AI-generated designs and ensuring they meet usability and accessibility...SuggestedRemote jobHourly payFlexible hours$80 - $120 per hour
...In this role, you will leverage your expertise in product management to evaluate AI-generated work products, including documents, spreadsheets, and slide decks. Your primary responsibility will be to assess these outputs for accuracy, rigor, and domain quality, ensuring...SuggestedRemote jobHourly payWork at office$80 - $120 per hour
...Role Overview As an Evaluator specializing in Product launch and experiment readiness, you will play a crucial role in reviewing and assessing AI-generated work products, including documents, spreadsheets, and slide decks. Your expertise will ensure that these outputs...SuggestedRemote jobHourly payWork at office- YO IT Consulting is seeking a Remote Italian Data Trainer to improve the safety and reliability of AI systems. The role involves evaluating AI-generated content, assessing reasoning quality, and providing expert feedback. Candidates should have a Bachelor's degree in a...Remote jobFor contractors
- Alignerr is seeking a Population Health Informaticist (AI Training) to evaluate and improve AI-generated content related to population health. You will assess the accuracy of AI outputs and provide structured feedback to help enhance understanding of health challenges....Remote job
- Turing is seeking graduate students or professionals for a remote role in evaluating AI-generated research reports. Responsibilities include reading, annotating, and scoring reports on a 1-5 scale, alongside providing written justifications. Candidates must possess strong...Remote job
$24 per hour
Prolific Academic Ltd is seeking AI Trainers with advanced Telugu fluency for a remote role focused on assessing AI audio outputs.... ...Responsibilities include audio localization and sentiment analysis of AI-generated content. Researchers may pay up to $24/hr, and candidates should...Remote job- YO IT Consulting is looking for a Visual Evaluation Specialist to work remotely, where you will apply your expertise to help train next-generation AI systems. Your role involves evaluating visual content for quality and usefulness, providing detailed feedback, and collaborating...Remote job
- YO IT Consulting is seeking a Generalist Expert to evaluate AI-generated responses and provide structured feedback. This remote role is ideal for sharp, analytical thinkers who can contribute to impactful AI research projects. Required qualifications include a Bachelor'...Remote jobFor contractors
- YO IT Consulting is seeking an Italian Data Trainer for a remote, hourly-paid contractor role. The candidate will evaluate AI-generated content, providing structured feedback to enhance safety, reliability, and reasoning quality. Key responsibilities include reviewing AI...Remote jobHourly payFor contractors
- YO IT Consulting is seeking a Generalist Expert to evaluate AI-generated responses and provide structured written feedback remotely. This role is ideal for analytical thinkers who want to impact AI research projects. Candidates should have a Bachelor's degree from a top...Remote jobFor contractors
- YO IT Consulting is seeking a Generalist Expert to evaluate AI-generated responses and provide structured feedback. This remote position is perfect for those with strong analytical skills and a Bachelor's degree from a top-100 university. Key responsibilities involve contributing...Remote jobFor contractors
- YO IT Consulting is seeking a Visual Evaluation Specialist to remotely evaluate and annotate visual content for next-generation AI training. You will provide detailed feedback to improve AI model accuracy through high-quality assessments. Ideal candidates have experience...Remote job
- Job Title: Visual Evaluation Specialist Job Type: Contractor Location: Remote Job Summary... ...your expertise to help train next-generation AI systems. Your work will shape how models... ...desired: design, architecture, UX/UI, product design, photography, videography, visual...Remote jobFor contractors
- YO IT Consulting is seeking a Generalist Expert to evaluate AI-generated responses and provide structured feedback. Candidates will have the opportunity to contribute to high-impact AI research projects from a remote location. The ideal candidate will possess strong analytical...Remote jobFor contractors
- ...Staffing & Recruiting Firm is seeking a licensed Real Estate Agent or Broker who is passionate about AI and language quality. This remote role involves reviewing AI-generated conversations to ensure accuracy and natural dialogue between home buyers and agents. The ideal...Remote job
- Alignerr is seeking an AI Language Expert for Portuguese to evaluate AI systems built for language learning and tutoring. This role allows you to work remotely... ...expert, you will provide valuable feedback on AI-generated content and contribute to enhancing AI tutoring...Remote jobFreelanceWorldwideFlexible hours
- YO IT Consulting is looking for a remote Italian Data Trainer to enhance AI systems' safety and reasoning quality. Responsibilities include evaluating AI-generated content, conducting safety evaluations, and providing expert feedback. Candidates should possess a Bachelor...Remote jobFlexible hours
$1,750 - $2,150 per month
Mercor is looking for a Cybersecurity Expert to evaluate AI-generated security outputs and develop cybersecurity workflows. The role is remote and offers compensation of $1,750-$2,150 per completed task, with a potential transition to hourly pay based on performance. Qualified...Remote jobHourly payContract work- Turing is seeking a freelance evaluator to assess AI chatbot responses for small business scenarios. Candidates should have a strong understanding... ...on conducting evaluations and providing feedback on AI-generated responses, ensuring they meet user goals effectively. #J-1...Remote jobFreelanceFlexible hours
$100 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...: $100/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to enhance reasoning and rigor in model outputs. Provide...Contract workSummer workRemote work$100 per hour
Mercor is seeking a Generalist Expert for a remote contract position. The role involves evaluating AI-generated responses, providing structured feedback to enhance training data quality, and collaborating with AI research teams. Candidates must have a Bachelor's degree...Remote jobContract work- Mercor is seeking a Telecommunications Expert to connect elite creative and technical talent with leading AI research labs. The role involves reviewing AI-generated outputs related to network architecture and providing structured feedback on telecom standards. The ideal...Remote job
- YO IT Consulting is seeking a Visual Evaluation Specialist to evaluate and annotate visual content, supporting next-generation AI training. The candidate should have proven experience in visual evaluation, exceptional written communication skills, and strong analytical...Remote jobFor contractorsFlexible hours
- ...Trainer for a remote, hourly-paid contractor role. The position focuses on improving the safety and reasoning quality of AI systems by evaluating AI-generated content and providing expert feedback. Ideal candidates must possess native-level Italian proficiency and a minimum...Remote jobHourly payFor contractors
- YO IT Consulting is seeking a Visual Evaluation Specialist to evaluate visual content and provide critical feedback for AI training. This role requires proven experience in... ...photography, or visual arts. Join us to shape next-generation AI systems with your expertise and insights...Remote job
- ...seeking a Generalist who is a native Marathi speaker to work remotely. This role involves conducting fact-checking and generating evaluation data to enhance AI model performance. A bachelor's degree and significant experience with large language models are essential. Strong...Remote jobContract work
- YO IT Consulting is seeking an Italian Data Trainer for a remote position focused on evaluating AI-generated content. The role involves ensuring safety and quality in AI systems through detailed analysis and structured feedback. Candidates should possess a bachelor's degree...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Multimedia Generation Product Evaluator [Remote]. Be the first to apply!
Related searches