AI Model Evaluator & Data Quality Analyst
Welocalize
Welocalize is seeking a Data Quality Associate based in San Francisco for a full-time position. This role involves evaluating AI outputs and providing detailed feedback, with applicants needing native-level language proficiency and a university degree. Successful candidates will have strong critical thinking and communication skills, be naturally curious about AI, and demonstrate a commitment to quality standards. Benefits include paid vacation, medical insurance, and gourmet food. #J-18808-Ljbffr
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the AI Model Evaluator & Data Quality Analyst in San Francisco, CA vacancy
$50 - $75 per hour
A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in...SuggestedHourly payContract work$400 per month
...support a Frontier Code Agents project. Candidates will evaluate and improve AI coding models through structured assessments, focusing on mobile engineering... ...for complex tasks and reviewing generated code for quality and performance. Each accepted task earns $400, with...Suggested$38 per hour
...Between Human Judgment and AI Excellence Are you an... ...a high bar for data integrity? Welo Data is seeking Data Quality Analysts for Project Perseus . This... ...cutting-edge Arabic AI models is not only accurate but... ...compliance, or policy-driven evaluation in a GenAI context....SuggestedHourly payFull timeWork at officeShift workWelo Data
San Francisco, CA2 days ago$38 per hour
...Overview Welo Data is looking for experienced, detail... ...join our team as Data Quality Analysts. This role sits at the... ...with both people and AI systems — auditing... ...cases in both human and model outputs Participate in... ...or human-in-the-loop evaluation environments Prior experience...SuggestedFull timeContract workRemote workVisa sponsorshipWelocalize
San Francisco, CA2 days ago- Welo Data is seeking a Data Quality Analyst to join our team onsite in the United States. This role sits at the center of execution and quality — auditing outputs, guiding DLAs and Team Leads, and ensuring work is completed correctly. You will audit outputs, provide actionable...Suggested
- Welo Data is seeking experienced Data Quality Analysts to join our on-site team in multiple U.S. locations. The role bridges DLAs and Team Leads, auditing outputs... ...data quality processes while collaborating with AI systems. A bachelor’s degree and 2-4 years of experience...
- ...accurately labeling machine learning textual data to refine AI models. This will primarily involve... ...in order to drive efficiency and high quality. Complete assignments by deadlines while... ...3-4 months of data annotation or LLM evaluation experience (Textual data annotation...
- Welocalize is seeking a Data Quality Analyst to join their team in San Francisco. This onsite role involves auditing the work of Data Labeling Associates and providing feedback to ensure quality and execution meet standards. The ideal candidate will have a university degree...
- Welocalize is seeking a full-time Data Quality Analyst in San Francisco, California. This onsite role focuses on ensuring data quality by bridging teams and auditing outputs, emphasizing attention to detail and critical thinking. Candidates must have native-level English...Full time
- Welocalize is seeking a Data Quality Analyst based in San Francisco, California. This full-time role focuses on ensuring quality across Data Labeling... ...candidate will have a bachelor's degree and relevant experience in data quality or AI workflows. #J-18808-Ljbffr WelocalizeFull timeContract work
$85 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms...Contract workSummer workRemote work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile application code for correctness, quality, maintainability, and performance....Contract workSummer workRemote work- The Association of Asian American Investment Managers is seeking an Operations Analyst based in San Francisco, California. This role is crucial in managing the investment and custodial operations, including tasks such as reconciliation and trade settlement. The ideal candidate...
$144k - $187k
...s quantitative risk and factor model research. The team develops the... ...governance, and deliver production-quality outputs at scale. Your Key... ...infrastructure that integrates AI to accelerate model development... ...with research, engineering, and data teams Presenting complex systems...Flexible hoursMSCI
San Francisco, CA1 day ago- Mercor is seeking a Data analysis / quantitative readouts Evaluator to assess AI-generated outputs rigorously. This contract position emphasizes providing structured feedback to elevate AI quality metrics. The ideal candidate will possess expertise in data analysis with...Remote jobContract work
- ...seeking a Hindi Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research... ...and benchmark advanced language models. This is a short-term, structured... ...instructions. - Produce high-quality written outputs in Hindi, with...Temporary workPart time10 hours per week
Mercor
San Francisco, CA14 days ago - ...enhance its quantitative risk and factor model research infrastructure. The role... ...fields, strong skills in Python, and experience with AI tools. They will collaborate with various teams to ensure seamless delivery of production-quality outputs. #J-18808-Ljbffr Msci-
$144k - $187k
...Governance team in San Francisco, California. This role involves designing and building research infrastructure that integrates AI, developing tools for model development, and maintaining automated validation and governance for models. A M.S. or Ph.D. in a quantitative field...$95k - $166k
As a Data Science Analyst reporting to the VP - Client Success Management, you'll play... ...scalable analytical frameworks to evaluate diverse datasets across customer,... ...data into unified customer insight models. Build, deploy, and maintain AI/ML models to identify patterns in...Temporary workWork at officeHome officeFlexible hours3 days per week$109k
...looking for a Growth Product Analyst to partner with our Growth Product... ...-term retention. You'll turn data into the decisions that shape... ...Help the team establish high-quality eventing to allow the tracking... ...or Airflow. Familiarity with AI coding tools (such as Claude Code...Full timeWork at officeLocal areaRemote workNight shift- Welocalize is seeking a Data Quality Associate to evaluate AI model outputs and provide structured feedback. This is a full-time, onsite role located in San Francisco. The ideal candidate possesses a Bachelor's degree and has 1-2 years of professional writing experience...Full time
- Reporting to the Regulatory and Quality Reporting Manager. The analyst's primary responsibilities include: data collection, metric validation, performance and health outcome... ...experience / training Epic Clarity Data Model and/or Epic Radar and/or Epic Reporting Workbench...
- ...located in San Francisco, is looking for an analyst to extract and structure intelligence from... ...closely with reporters to create valuable data products. Candidates should have 1-3 years... ...in Excel, SQL, and familiarity with AI tools. Competitive salary and benefits included...Work at office
- We’re hiring a Staff Product Analyst for a hyper-growth, Series E AI company valued at $3B+. This is an opportunity... ...strategy and growth by leveraging data to drive decisions, optimize user... ...segmentation. Experience with ELT data modeling and BI tools like Looker, Omni, or...Full time
$85k - $110k
Listen Labs is hiring for a client-facing insights role to help customers leverage their AI-powered research platform. You'll work closely with product, research, and marketing leaders to translate insights into actionable decisions. The role requires 2+ years of market...Flexible hours$80 - $120 per hour
Mercor, headquartered in San Francisco, is looking for a Cybersecurity / IT GRC Evaluator. This role involves evaluating AI-generated artifacts, providing feedback, and ensuring accuracy in documents. The position is remote with compensation ranging from $80 to $120 per...Remote jobHourly payContract workWork at office$80 - $120 per hour
Mercor is seeking a Customer Success / Support Operations Evaluator to work on evaluating AI-generated artifacts against quality rubrics. The role requires 5+ years of experience in customer success and fluency in English. Responsibilities include identifying errors in...Remote jobContract workWork at office$80 - $120 per hour
Mercor is seeking a People ops / recruiting Evaluator to review and improve AI-generated content. This remote position... ...and fluency in English. You'll assess quality against specified standards and provide feedback to enhance AI model accuracy. The ideal candidate is...Remote jobHourly payWork at office$80 - $120 per hour
Mercor is seeking a User/customer research and feedback synthesis Evaluator based in San Francisco, California, to evaluate AI-generated artifacts and provide structured feedback. The ideal candidate will have over 5 years of relevant experience and a high proficiency...Remote jobHourly payContract workWork at office$80 - $120 per hour
Mercor is hiring a Legal / compliance Evaluator to evaluate AI-generated artifacts and provide structured feedback. The role demands 5+ years of experience in Legal / compliance and fluency in English. The position involves independent work improving AI performance. Compensation...Remote jobContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Model Evaluator & Data Quality Analyst. Be the first to apply!
Related searches
- work from home web search evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- oracle data analyst San Francisco, CA
- information risk analyst San Francisco, CA
- data solutions analyst San Francisco, CA
- financial data analyst San Francisco, CA
- entry level data analyst no experience San Francisco, CA
- talent data analyst San Francisco, CA