Human Evaluator, Studio (Contract)
$23.2 per hourRoblox
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences – all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Role Overview We are searching for a self‑motivated individual who is passionate about Roblox and thrives in detail. You will be responsible for classifying content based on a specific set of guidelines to help us improve Roblox systems. As a Human Evaluator you will have the opportunity to provide us direct feedback on the performance of various products across the company, but primarily for features within the studio and creator store. You will: Classify content based on a set of instructions; Content classification includes the review and classification of text, image, video, scripts, and audio Track and document insights and trends related to annotation projects Test out new features within studio and provide detailed feedback Become an expert in a variety of topics to enable more accurate evaluations Dedicate between 25-29 hours per week with a work schedule from Monday to Friday You have: At least 1+ years of experience developing on Roblox or other creation platforms. Solid knowledge of the technical aspects of Roblox Studio. Proficiency with Lua Strong verbal and written communication skills Demonstrated patience for repetitive tasks and attention to detail Effective time management skills In-depth understanding of Roblox and the Roblox community. Fluency in a second language, such as: Japanese, Korean, Chinese, Portuguese, Spanish, French, German, Italian Prior experience with content moderation or data annotation. A deep passion for gaming trends and the Roblox community ecosystem. Please note Benefits below only apply to full time employees in the US. This role is fully remote For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job‑related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual hourly rate could fall outside of this expected range. This pay range is subject to change and may be modified in the future. Please note that not all benefits on this page are applicable to this hourly position. Hourly Pay Range
$23.20 — $23.20 USD
Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted). Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process. #J-18808-Ljbffr Roblox$20 per hour
..., and Jack Dorsey. Position Generalist - English & Urdu Type Contract Compensation $15-$20/hour Location Remote Role Responsibilities... ...public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement...Contract workRemote jobPart timeSummer work- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Contract workTemporary workImmediate startRemote work
- ...A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content... ...is expected to require about 30 hours a week for 1 month, with pay and the potential for future contract extensions. #J-18808-Ljbffr...Contract workFor contractorsFreelanceRemote workFlexible hours
- Prointegrate World It Consulting is seeking a Tamil bilingual expert for a remote contract role. You will listen to Tamil audio, assess nativeness and fluency, and evaluate pronunciation and linguistic authenticity according to established guidelines. Responsibilities...Contract workRemote jobFor contractors
- A talent marketplace is seeking soccer experts to evaluate live soccer games. The role involves assessing AI-generated commentary, scoring... ...skills, and be comfortable with online tools. This contract position aims to refine AI's soccer insights through expert evaluations...Contract work
- G2i Inc. is seeking a Senior AI Interaction Evaluator to assess how coding agents reason and respond. You won't write production code;... ...define what great looks like for AI-assisted development. This contract runs 10-20 hours per week with start ASAP. #J-18808-Ljbffr G2...Contract workImmediate start10 hours per week
- ...Expert specializing in Urdu to join our distributed team. This remote, contract role runs up to 6 months, with an expected commitment of 20+ hours per week and an immediate start. You will evaluate AI-generated music and lyrics, compare against published works, and provide...Contract workRemote jobImmediate start
- Mercor is seeking an experienced IT management professional to evaluate AI-generated IT management content and workflows. You will direct information systems efforts, coordinate technical teams, and oversee enterprise technology operations in a short-term engagement. Responsibilities...Contract workTemporary workImmediate start
- About the Role We’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll be making judgment calls on whether outputs actually make sense, stay consistent, and reflect real-world...Contract workTemporary workFreelanceImmediate startRemote work
- ...company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years...Contract workRemote workFlexible hours
- ...investments and an entrepreneurial drive fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract Key Responsibilities Review and Validate AI Responses: Evaluator will work via our online platform...Contract workRemote workWorldwide
- ...and an entrepreneurial drive fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Finance and Accountancy Location: Remote (USA) Job Type: Contract Key Responsibilities Review and Validate AI Responses: Evaluators will work via our online...Contract workRemote workWorldwide
$30 per hour
Type: Hourly contract Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows,...Contract workRemote jobHourly pay- About the Role We’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are coherent, consistent, and aligned with real-world expectations in Turkish...Contract workTemporary workFreelanceImmediate startRemote work
$20.3 per hour
Contract type: Freelance Hourly rate: $20.30 Language: English (US) Estimated volume: 8 - 10 hours Start date: The project runs on... ...looking for qualified raters to support a project focused on evaluating personalized search and location recommendations. This role involves...Contract workHourly payFreelanceImmediate start- FAWE seeks to recruit a Multimedia Communications Assistant on a one-year fixed-term contract to support the establishment and day-to-day operation of FAWE Studio. Working within the Communications Unit, the successful candidate will support podcast production, multimedia...Contract workFixed term contract
- ...Network is seeking clinicians to conduct remote clinical interviews and cognitive assessments for research studies globally. Roles are contract-based and remote, with training and regular supervision provided to maintain high-quality data collection. Qualified candidates...Contract workRemote job
$75 per hour
Position: Sociology Teachers, Postsecondary Type: Hourly contract Compensation: $45-$75/hour Location: Remote Commitment: 10-40 hours/week... ...through AI training initiatives for postsecondary education. Evaluate and review AI-generated coursework, assignments, and simulated...Contract workRemote jobHourly pay$95k - $120k
...precision, and long-term partnership. Overview The Sr. Human Resources Generalist for TDS is responsible for supporting the... ...records in HRIS systems. Track assignment timelines and upcoming contract completions. Generate HR reports related to hiring activity,...Contract workFull timeTemporary workFor contractorsH1bRelocation- ...a select group of experienced healthcare professionals to help evaluate and improve how AI systems understand and reason about healthcare... ...and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record...Contract workPart timeRemote work10 hours per weekFlexible hours
- Welo Data is seeking a detail-oriented Data Labeling Associate to evaluate AI outputs and improve system behaviors in real-world scenarios. The ideal candidate will have native French proficiency and a university degree. This full-time role, based in New York City, involves...Full time
- Mercor is hiring Legal Experts to evaluate AI-generated responses for employment and labor law scenarios. This fully remote, hourly contract offers flexible 6-15 hours per week. You will assess accuracy, provide feedback to improve model behavior and participate in calibration...Contract workRemote jobHourly payFlexible hours
- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI... ...in Portuguese and English. Start date is immediate and the contract runs up to 6 months, with ~20 hours per week and flexible commitment...Contract workImmediate startFlexible hours
- Human Resources Operations Specialist - Contract New York, NY | Onsite | 45-50 hours per week A leading global investment firm is seeking a Human Resources Operations Specialist to join its New York-based Human Resources team. This is an excellent opportunity for an early...Contract workFor contractorsWork at officeFlexible hoursShift work
$35 - $40 per hour
A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing...Contract workRemote jobFlexible hours- ...Jersey . Position: Independent Fee Appraiser (1099) Locations: New York & New Jersey (multiple counties available) Type: Contract / Split Fee What We’re Looking For Active Certified Residential or Licensed Residential Appraiser credential in NY and/or...Contract workFor contractorsLocal areaRemote workFlexible hours
- ...~6,000 employees, in all areas of the day-to-day operations of human resources, including but not limited to: recruitment, employee... ...their workforce solutions. Our recruiting and HR services include contract and direct hire staffing, Payrolling/EOR, Independent...Contract workPermanent employmentFor contractors
- Remote | Capsure | Contract, Part-Time | Competitive Hourly Rate About... ...AI Fund is a $370M+ venture studio that builds companies... ...A subset of cases require a human expert with direct DOL and IRA... ...applicable wage determinations. Evaluate apprenticeship ratio calculations...Contract workHourly payPart timeFor contractorsApprenticeshipRemote work10 hours per weekFlexible hours
- ...is looking for an experienced, adaptable Contract Recruiter to own full-cycle recruitment... ...supporting a growing, globally distributed studio, and this role is critical to keeping... ...data accurate and current in our ATS. Evaluate and recommend improvements to our recruiting...Contract workPermanent employmentFull timeFor contractorsFixed term contractFreelanceRemote workFlexible hours
$75 per hour
...Medical Coder AI Content Evaluator (Remote) This role focuses on applying medical coding and healthcare operations expertise to assess... ...healthcare technology. Job Type & Location This is a Contract position based out of New York, NY. Pay and Benefits The...Contract workRemote jobTemporary workWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Human Evaluator, Studio (Contract). Be the first to apply!
- quality evaluator New York, NY
- clinical evaluator New York, NY
- work from home web search evaluator New York, NY
- evaluator New York, NY
- program evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- work from home social media evaluator New York, NY
- studio artist New York, NY


