Human Evaluator, Studio (Contract)
$23.2 per hourRoblox
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences – all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Role Overview We are searching for a self‑motivated individual who is passionate about Roblox and thrives in detail. You will be responsible for classifying content based on a specific set of guidelines to help us improve Roblox systems. As a Human Evaluator you will have the opportunity to provide us direct feedback on the performance of various products across the company, but primarily for features within the studio and creator store. You will: Classify content based on a set of instructions; Content classification includes the review and classification of text, image, video, scripts, and audio Track and document insights and trends related to annotation projects Test out new features within studio and provide detailed feedback Become an expert in a variety of topics to enable more accurate evaluations Dedicate between 25-29 hours per week with a work schedule from Monday to Friday You have: At least 1+ years of experience developing on Roblox or other creation platforms. Solid knowledge of the technical aspects of Roblox Studio. Proficiency with Lua Strong verbal and written communication skills Demonstrated patience for repetitive tasks and attention to detail Effective time management skills In-depth understanding of Roblox and the Roblox community. Fluency in a second language, such as: Japanese, Korean, Chinese, Portuguese, Spanish, French, German, Italian Prior experience with content moderation or data annotation. A deep passion for gaming trends and the Roblox community ecosystem. Please note Benefits below only apply to full time employees in the US. This role is fully remote For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job‑related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual hourly rate could fall outside of this expected range. This pay range is subject to change and may be modified in the future. Please note that not all benefits on this page are applicable to this hourly position. Hourly Pay Range
$23.20 — $23.20 USD
Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted). Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process. #J-18808-Ljbffr Roblox$15 - $20 per hour
.... Position: Generalist - English & Malayalam Type: Contract Compensation: $15–$20/hour Location: Remote Role... ...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement...Contract workSummer workRemote work$68.23k - $86.99k
Provider Network Evaluator II-Targeted (Full-time Remote, North Carolina based) Posted on... ...data, clinical documentation, provider contracts, policies, and procedures, conduct provider... ...& Experience Master’s degree in human services/social sciences, from an accredited...Contract workRemote jobFull timeTemporary workWork at officeHome officeTrial periodFlexible hours- ...Overview Freelance Luxury Brand Evaluator - NYC Metro (Brooklyn & Long Island) Turn your passion for luxury into a career opportunity... ...customer of premium and luxury brands Not currently under contract with any retail brands, to ensure impartiality Punctual,...Contract workFull timeFreelanceFlexible hours
- ...seeking a Generalist who is a native Marathi speaker to work remotely. This role involves conducting fact-checking and generating evaluation data to enhance AI model performance. A bachelor's degree and significant experience with large language models are essential....Contract workRemote job
- A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content... ...to require about 30 hours a week for 1 month, with pay and the potential for future contract extensions. #J-18808-Ljbffr TuringContract workRemote jobFor contractorsFreelanceFlexible hours
$30 per hour
Type: Hourly contract Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows,...Contract workRemote jobHourly pay- ...abilities. The role requires conducting fact-checks and generating quality evaluation data. Success comes from identifying inaccuracies and producing clear feedback that enhances response quality. This contract role is critical in refining AI conversational behavior. #J-18808-...Contract work
$30 - $150 per hour
A tech-driven company is seeking a Mercor Generalist to evaluate AI-generated outputs for accuracy and provide feedback on performance. The role requires strong English fluency, critical thinking skills, and attention to detail. This position is remote, with an expected...Contract workRemote jobHourly payPart time10 hours per week- About the Role We’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are coherent, consistent, and aligned with real-world expectations in Turkish...Contract workTemporary workFreelanceImmediate startRemote work
- Role: Spanish Language Evaluator About the Role We’re looking for contract, remote Spanish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll be making judgment calls on whether outputs actually make sense, stay...Contract workTemporary workImmediate startRemote work
- A remote-first technology company is seeking Mathematics PhDs for flexible, hourly contract work in AI research. You will use your expertise to evaluate AI-generated content and create domain-relevant questions, all while enjoying the flexibility of working from anywhere...Contract workRemote jobHourly payFlexible hours
- MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Contract workRemote jobTemporary workImmediate start
- A talent marketplace is seeking soccer experts to evaluate live soccer games. The role involves assessing AI-generated commentary, scoring... ...skills, and be comfortable with online tools. This contract position aims to refine AI's soccer insights through expert evaluations...Contract work
$100 per hour
Mercor is seeking a Generalist Expert for a remote contract position. The role involves evaluating AI-generated responses, providing structured feedback to enhance training data quality, and collaborating with AI research teams. Candidates must have a Bachelor's degree...Contract workRemote job$11 - $31 per hour
...for a freelance AI Trainer project. This role involves creating evaluation scenarios for audio models, ensuring they meet customer... ...hour, determined by experience and expertise. This is a remote contract role suitable for mid-senior level professionals. #J-18808-Ljbffr...Contract workRemote jobHourly payFreelanceFlexible hours$500 per day
...certified Speech Language Pathologists (SLPs) to conduct CSE (school‑age) Speech and Language Evaluations in person. Positions are available as Full‑time, Part‑time, or Contract with a flexible schedule. Pay starts at $500.00 per day. Job Location On the road across all...Contract workFull timePart timeWork at officeFlexible hours- ...investments and an entrepreneurial drive fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract Key Responsibilities Review and Validate AI Responses: Evaluator will work via our online platform...Contract workRemote workWorldwide
$700 per day
...Speech Language Pathologists (SLPs), to conduct CSE (school-age) Speech and Language Evaluations in person. Job Type: Flexible Schedule Company Description: We are a NYCDOE contracted agency providing Speech and Language Evaluations to school-age children in all 5...Contract workFull timePart timeWork at officeLocal areaWork from homeFlexible hours$22 - $70 per hour
Crossing Hurdles is seeking a contractor for a role focused on evaluating AI-generated content. The position involves critiquing... ...analytical skills, and have a keen eye for detail. This is a remote contract role, requiring 10-40 hours of commitment weekly, with compensation...Contract workRemote jobHourly payFor contractors$95k - $120k
...New York, New York, United StatesPosition Title: Senior Human Resources GeneralistAbout Total Deployment SolutionsTotal Deployment... ...records in HRIS systems.Track assignment timelines and upcoming contract completions.Generate HR reports related to hiring activity, visa...Contract workTemporary workFor contractorsH1bRelocation- ...Jersey . Position: Independent Fee Appraiser (1099) Locations: New York & New Jersey (multiple counties available) Type: Contract / Split Fee What We’re Looking For Active Certified Residential or Licensed Residential Appraiser credential in NY and/or...Contract workFor contractorsLocal areaRemote workFlexible hours
- ...company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years...Contract workRemote jobFlexible hours
- ...tech company is seeking Machine Learning PhDs to engage in flexible, project-based contract work focusing on AI research. Candidates will utilize their machine learning expertise to evaluate and review AI-generated content, shaping better AI understanding. Ideal...Contract workRemote jobFlexible hours
$75 per hour
Position: Sociology Teachers, Postsecondary Type: Hourly contract Compensation: $45-$75/hour Location: Remote Commitment: 10-40 hours/week... ...through AI training initiatives for postsecondary education. Evaluate and review AI-generated coursework, assignments, and simulated...Contract workRemote jobHourly pay$40 per hour
...related problems. As part of this flexible remote role, you will evaluate the performance and correctness of AI outputs while ensuring... ...medical degree and be fluent in English. This is an independent contract position with hourly pay starting at $40, plus bonuses for high...Contract workRemote jobHourly payFlexible hours$20 per hour
...focuses on developing prompts, writing high-quality responses, and evaluating AI performance. Candidates should preferably hold a bachelor's... ...writing, research, and communication skills. This independent contract role offers the flexibility to choose projects and work on a...Contract workRemote jobHourly pay- ...Responsibilities include ensuring grammatical accuracy and cultural appropriateness in multilingual outputs. Compensation ranges from $6 to $65 per hour based on experience. This is a freelance contract position with no company-sponsored benefits. #J-18808-Ljbffr Invisible AgencyContract workRemote jobHourly payFreelance
$35 - $40 per hour
A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing...Contract workRemote jobFlexible hours$40 per hour
...company in the United States is seeking a Software Engineer to evaluate and improve AI chatbots. The role offers flexibility to choose... ...Ideal for detail-oriented individuals looking for independent contract work. Only applicants from the United States will be considered...Contract workRemote jobHourly pay- ...next-gen AI tools for finance professionals. This independent contract role allows for flexible remote work arrangements. Candidates... ...holding or pursuing a Master’s or PhD. Responsibilities include evaluating AI outputs and assisting with complex financial scenarios....Contract workRemote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Human Evaluator, Studio (Contract). Be the first to apply!
- quality evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- evaluator New York, NY
- social media evaluator New York, NY
- studio artist New York, NY
- amazon studios New York, NY
- dance studio New York, NY


