Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Human Evaluator, Studio (Contract)

$23.2 per hour

Roblox

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences – all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Role Overview We are searching for a self‑motivated individual who is passionate about Roblox and thrives in detail. You will be responsible for classifying content based on a specific set of guidelines to help us improve Roblox systems. As a Human Evaluator you will have the opportunity to provide us direct feedback on the performance of various products across the company, but primarily for features within the studio and creator store. You will: Classify content based on a set of instructions; Content classification includes the review and classification of text, image, video, scripts, and audio Track and document insights and trends related to annotation projects Test out new features within studio and provide detailed feedback Become an expert in a variety of topics to enable more accurate evaluations Dedicate between 25-29 hours per week with a work schedule from Monday to Friday You have: At least 1+ years of experience developing on Roblox or other creation platforms. Solid knowledge of the technical aspects of Roblox Studio. Proficiency with Lua Strong verbal and written communication skills Demonstrated patience for repetitive tasks and attention to detail Effective time management skills In-depth understanding of Roblox and the Roblox community. Fluency in a second language, such as: Japanese, Korean, Chinese, Portuguese, Spanish, French, German, Italian Prior experience with content moderation or data annotation. A deep passion for gaming trends and the Roblox community ecosystem. Please note Benefits below only apply to full time employees in the US. This role is fully remote For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job‑related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual hourly rate could fall outside of this expected range. This pay range is subject to change and may be modified in the future. Please note that not all benefits on this page are applicable to this hourly position. Hourly Pay Range

$23.20 — $23.20 USD

Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted). Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process. #J-18808-Ljbffr Roblox

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Human Evaluator, Studio (Contract) in New York, NY vacancy
  •  ...Description $2,000 Sign on Bonus! Job Title: Evaluator Location: Connection Center - Columbia,...  ...promotes well‑being, values you as a human being, and encourages your health and...  ...research, analysis, grant procurement, contract administration, and similar endeavors.... 
    Contract work
    Full time
    Relocation package

    Dormont Manufacturing Co

    New York, NY
    5 days ago
  • $15 - $20 per hour

     .... Position: Generalist - English & Malayalam Type: Contract Compensation: $15–$20/hour Location: Remote Role...  ...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    7 days ago
  • $40 per hour

     ...related problems. As part of this flexible remote role, you will evaluate the performance and correctness of AI outputs while ensuring...  ...medical degree and be fluent in English. This is an independent contract position with hourly pay starting at $40, plus bonuses for high... 
    Contract work
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    18 hours ago
  • $80 - $120 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position Details Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor Inc

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should... 
    Contract work
    Hourly pay
    Work at office
    Remote work

    Mercor Inc

    New York, NY
    1 day ago
  • $400k

     ...work with industry leaders across all segments of the business. Contract End Date: December 31st, 2026 Why This Role Matters The role...  ...assigned What You Will Bring To The Team Bachelor’s degree in Human Resources, Business or Communications preferred or equivalent... 
    Contract work
    Permanent employment
    Full time
    Temporary work
    Fixed term contract
    Work experience placement
    Internship
    Work at office
    Local area

    Christie's

    New York, NY
    3 days ago
  • A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content...  ...to require about 30 hours a week for 1 month, with pay and the potential for future contract extensions. #J-18808-Ljbffr Turing Inc
    Contract work
    Remote job
    For contractors
    Freelance
    Flexible hours

    Turing Inc

    New York, NY
    4 days ago
  • $35 per hour

     ...seeking a Remote Consumer Expert to create domain-relevant prompts, evaluate AI responses, and draft expert-level benchmarks. The ideal...  ...consumer-focused domains and excellent analytical skills. This contract position requires a commitment of 10-40 hours per week and is suitable... 
    Contract work
    Remote job
    10 hours per week

    Crossing Hurdles

    New York, NY
    3 days ago
  • A talent marketplace is seeking soccer experts to evaluate live soccer games. The role involves assessing AI-generated commentary, scoring...  ...skills, and be comfortable with online tools. This contract position aims to refine AI's soccer insights through expert evaluations... 
    Contract work

    Mercor

    New York, NY
    3 days ago
  •  ...assess AI-generated responses in Assamese and English. You will evaluate the strengths and areas for improvement in AI replies, contributing to the development of optimal response strategies. This contract position requires a Bachelor's degree and native fluency in Assamese... 
    Contract work

    Obsidian

    New York, NY
    4 days ago
  • Mercor is seeking a Public-sector procurement / RFI response Evaluator to evaluate AI-generated artifacts and provide structured feedback. Candidates should have 5+ years of experience in public-sector procurement and be highly proficient with Microsoft Office and Google... 
    Contract work
    Remote job
    Work at office
    Flexible hours

    Mercor

    New York, NY
    1 day ago
  • $30 per hour

    Type: Hourly contract Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows,... 
    Contract work
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    3 days ago
  • $15 - $20 per hour

    Mercor is looking for a Generalist to evaluate AI model responses while working remotely. Candidates must be native Malayalam speakers...  ...quality evaluation data to enhance AI performance. The position is contract-based with compensation ranging from $15 to $20 an hour. Ideal... 
    Contract work
    Remote job

    Mercor

    New York, NY
    5 days ago
  • $30 - $150 per hour

    A tech-driven company is seeking a Mercor Generalist to evaluate AI-generated outputs for accuracy and provide feedback on performance. The role requires strong English fluency, critical thinking skills, and attention to detail. This position is remote, with an expected... 
    Contract work
    Remote job
    Hourly pay
    Part time
    10 hours per week

    Crossing Hurdles

    New York, NY
    3 days ago
  • $80 - $120 per hour

    Mercor is seeking a Legal / Compliance Evaluator to work remotely. The role involves evaluating AI-generated artifacts and providing structured...  ...in Microsoft Office and Google Workspace. The position offers a contract with compensation of $80-$120/hour. #J-18808-Ljbffr Mercor
    Contract work
    Remote job
    Work at office

    Mercor

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...is looking for a User/customer research and feedback synthesis Evaluator to assess AI-generated artifacts based on specific quality...  ...Microsoft Office and Google Workspace. This will be a remote contract position offering compensation of $80-$120/hour. Successful candidates... 
    Contract work
    Remote job
    Work at office

    Mercor

    New York, NY
    4 days ago
  • $80 - $120 per hour

    Mercor is seeking a contract position specializing in Special Education / IEP evaluation. The role involves evaluating AI-generated artifacts and providing structured feedback for improvement. Candidates should have over 5 years of relevant experience and professional... 
    Contract work
    Remote job
    Hourly pay
    Work at office

    Mercor

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...looking for a Brand / creative direction / marketing collateral Evaluator to assess AI-generated work for quality. The ideal candidate...  ...be proficient in Microsoft Office and Google Workspace. This contract position allows for remote work, offering compensation between... 
    Contract work
    Remote job
    Work at office

    Mercor

    New York, NY
    5 days ago
  • $80 - $120 per hour

    Mercor is seeking a Public-sector procurement / RFI response Evaluator for a contract position offering flexible hours and compensation ranging from $80-$120 per hour. The evaluator will assess AI-generated artifacts using domain-specific quality rubrics. Responsibilities... 
    Contract work
    Remote job
    Hourly pay
    Work at office
    Flexible hours

    Mercor

    New York, NY
    4 days ago
  • DataAnnotation is seeking a Customer Service Representative to help train AI models by evaluating their progress and improving their quality. In this flexible role, you can choose projects and work from home. The ideal candidate should be fluent in English, detail-oriented... 
    Contract work
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $500 per day

     ...certified Speech Language Pathologists (SLPs) to conduct CSE (school-age) Speech and Language Evaluations in person. Job Type: Flexible Schedule Job Types: Full-time, Part-time, Contract Pay: From $500.00 per day Schedule: Choose your own hours Work Location: On the road... 
    Contract work
    Full time
    Part time
    Work at office
    Work from home
    Flexible hours

    AngelCare ABA Therapy

    New York, NY
    4 days ago
  • $50 - $60 per hour

     ...Responsibilities Give AI chatbots diverse and complex problems and evaluate their outputs Evaluate the quality produced by AI models for...  ...Only applicants in United States will be considered for this role. This is an independent contract position. #finance #J-18808-Ljbffr
    Contract work
    Hourly pay
    Full time
    Part time
    Work experience placement
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  •  ...and an entrepreneurial drive fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Finance and Accountancy Location: Remote (USA) Job Type: Contract Key Responsibilities Review and Validate AI Responses: Evaluators will work via our online... 
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    3 days ago
  •  ...investments and an entrepreneurial drive fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract Key Responsibilities Review and Validate AI Responses: Evaluator will work via our online platform... 
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    3 days ago
  • $95k - $120k

     ...New York, New York, United States Position Title: Senior Human Resources Generalist About Total Deployment Solutions Total Deployment...  ...in HRIS systems. Track assignment timelines and upcoming contract completions. Generate HR reports related to hiring activity, visa... 
    Contract work
    Full time
    Temporary work
    For contractors
    H1b
    Relocation

    Total Deployment Solutions

    New York, NY
    1 hour ago
  • $82.95k - $124.35k

    ## Human Resources GeneralistApplylocations: Upton, NYtime type: Full timeposted on: Posted...  ...workplace investigations, critically evaluate facts and findings, and prepare comprehensive...  ...employment laws and Department of Energy contract requirements.* Collaborate with Talent... 
    Contract work
    For contractors
    Work at office
    Local area

    Brookhaven LAB

    New York, NY
    4 days ago
  •  ...company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years... 
    Contract work
    Remote job
    Flexible hours

    Handshake

    New York, NY
    2 days ago
  • $50 per hour

    Mercor is looking for a Dutch Audio Generalist Evaluator Expert to transcribe audio and video with precision in both Dutch and English...  ...conduct model testing for audio contexts. This remote position is contract-based for a duration of 3 to 6 months with compensation of $50... 
    Contract work
    Remote job

    Mercor

    New York, NY
    1 day ago
  • Mercor is seeking a User/customer research and feedback synthesis Evaluator to evaluate AI-generated artifacts and provide structured feedback. This remote contract position requires 5+ years of experience and proficiency in Microsoft Office and Google Workspace. Key responsibilities... 
    Contract work
    Remote job
    Work at office

    Mercor

    New York, NY
    4 days ago
  • Welo Data is seeking a detail-oriented Data Labeling Associate to evaluate AI outputs and improve system behaviors in real-world scenarios. The ideal candidate will have native French proficiency and a university degree. This full-time role, based in New York City, involves... 
    Full time

    University of Delaware

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Human Evaluator, Studio (Contract). Be the first to apply!