AI Model Evaluator & Data Quality Analyst
Welocalize
Welocalize is seeking a Data Quality Associate based in San Francisco for a full-time position. This role involves evaluating AI outputs and providing detailed feedback, with applicants needing native-level language proficiency and a university degree. Successful candidates will have strong critical thinking and communication skills, be naturally curious about AI, and demonstrate a commitment to quality standards. Benefits include paid vacation, medical insurance, and gourmet food. #J-18808-Ljbffr Welocalize
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Model Evaluator & Data Quality Analyst in San Francisco, CA vacancy
$50 - $75 per hour
A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in...SuggestedHourly payContract work$38 per hour
...Description Overview Welo Data is looking for... ...join our team as Data Quality Analysts. This role sits at the... ...with both people and AI systems — auditing outputs... ...in both human and model outputs Participate... ...or human-in-the-loop evaluation environments ~ Prior...SuggestedFull timeContract workRemote workVisa sponsorship$38 per hour
...Between Human Judgment and AI Excellence Are you... ...a high bar for data integrity? Welo Data is seeking Data Quality Analysts for Project Perseus... ...cutting-edge Arabic AI models is not only accurate but... ...compliance, or policy-driven evaluation in a GenAI context....SuggestedHourly payFull timeWork at officeShift work$38 per hour
...Job Description Welo Data is looking for experienced... ...join our team as Data Quality Analysts. This role sits at the... ...with both people and AI systems — auditing... ...cases in both human and model outputs Participate... ...or human-in-the-loop evaluation environments ~ Prior...SuggestedFull timeContract workRemote workVisa sponsorship$38 per hour
...Job Description What if your language expertise could help improve the speech and voice AI systems used by millions of people worldwide? WHAT YOU’LL DO • Execute Data labelling and annotation tasks across speech and voice datasets. • Work with audio and language...SuggestedHourly payFull timeLocal areaWorldwideVisa sponsorship- AKQA is seeking a Config Analyst to help transform raw product data into configurator-ready formats for a prominent... ...role involves data collection, quality assurance testing, and ensuring market... ...position follows a hybrid work model requiring some in-office presence....Work at office
- ...seeking a meticulous Configuration Analyst located in San Francisco,... ...transforming complex product data into accurate configurator-ready... ...datasets, conduct thorough quality assurance, and adapt data for... ...high standards. A hybrid work model is offered, promoting connections...
- The Association of Asian American Investment Managers is seeking an Operations Analyst based in San Francisco, California. This role is crucial in managing the investment and custodial operations, including tasks such as reconciliation and trade settlement. The ideal candidate...
$85 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms...Contract workSummer workRemote work$144k - $187k
...s quantitative risk and factor model research. The team develops the... ...governance, and deliver production-quality outputs at scale. Your Key... ...infrastructure that integrates AI to accelerate model development... ...research, engineering, and data teams Presenting complex systems...Flexible hoursMSCI
San Francisco, CA3 days ago- Mercor is seeking a Data analysis / quantitative readouts Evaluator to assess AI-generated outputs rigorously. This contract position emphasizes providing structured feedback to elevate AI quality metrics. The ideal candidate will possess expertise in data analysis with...Remote jobContract work
$50 per hour
...Product Data Analyst Trident consulting is hiring for a Product Data Analyst role. The position... ...and improve map data coverage and quality Build dashboards, KPIs, and analytical... ...communication Experience with Mode, Hex, or AI data tools is a plus GIS/Mapping...Contract workTrident Consulting
San Francisco, CA5 days ago$144k - $187k
...Governance team in San Francisco, California. This role involves designing and building research infrastructure that integrates AI, developing tools for model development, and maintaining automated validation and governance for models. A M.S. or Ph.D. in a quantitative field...$95k - $166k
## Data Science Analyst - Customer & Product IntelligenceApplylocations: San Francisco-... ...scalable analytical frameworks to evaluate diverse datasets across customer,... ...into unified customer insight models.* Build, deploy, and maintain AI/ML models to identify patterns in...Temporary workWork at officeHome officeFlexible hours3 days per week- Welocalize is seeking a Data Quality Associate to evaluate AI model outputs and provide structured feedback. This is a full-time, onsite role located in San Francisco. The ideal candidate possesses a Bachelor's degree and has 1-2 years of professional writing experience...Full time
- ...multimodal foundation models that can comprehend videos... ..., and prominent AI visionaries and founders... ...vital member of our ML Data Team - which leads the... ...preparation and model evaluation. This role comes with high... ...partnership, annotation, and quality evaluation work as...Work at officeWorldwideFlexible hours
- ...Francisco is seeking an experienced data operations professional for... ...-language data preparation, model evaluation, and requires strong skills... ...should have over 5 years in AI data operations, the ability... ...commitment to ensuring high-quality data. The position includes benefits...Flexible hours
$80 - $120 per hour
Mercor, located in San Francisco, is seeking a General finance / accounting Evaluator to evaluate AI-generated artifacts. This role involves providing structured feedback, ensuring quality, and collaborating with research teams. Candidates should have 5+ years of experience...Remote jobHourly payWork at office$80 - $120 per hour
Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of experience...Remote jobHourly payContract workWork at office- Mercor is seeking an experienced Education / school Evaluator to evaluate AI-generated artifacts and provide structured... ...independent work to meet deadlines and maintain high quality standards. Join us to improve AI model outputs with your expertise! #J-18808-Ljbffr MercorRemote jobContract workWork at office
- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...Remote jobHourly payWork at office
$80 - $120 per hour
Mercor, based in San Francisco, is seeking a People ops / Recruiting Evaluator to analyze AI-generated artifacts and enhance output quality. This remote position requires 5+ years in people ops/recruiting and high proficiency in Microsoft Office and Google Workspace, particularly...Remote jobContract workWork at office$80 - $120 per hour
...regulatory response with financial-services AI. The ideal candidate should have over 5 years... ...to $120 per hour. Candidates will be responsible for evaluating AI-generated outputs and providing structured feedback to enhance AI model performance. #J-18808-Ljbffr MercorRemote jobHourly pay$80 - $120 per hour
Mercor is seeking a Clinical / biomedical / pharma Evaluator to evaluate AI-generated artifacts against quality rubrics. The role requires at least 5 years of experience in the field and fluency in English. Successful candidates will work remotely and provide structured...Remote jobHourly payContract work- Obsidian is hiring expert Evaluators in Public health communications for a remote position. The role involves reviewing and assessing AI-generated work products for accuracy and domain quality. Candidates must have 5+ years of experience, native or professional fluency...Remote jobHourly payWork at office
$80 - $120 per hour
...seeking a Healthcare / Clinical Evaluator to connect elite creative and technical talent with leading AI research labs. This fully... ...AI-generated artifacts against quality standards, identifying errors,... ...providing feedback to enhance AI model performance. The ideal...Remote jobHourly payWork at office$80 - $120 per hour
...based in San Francisco, is seeking a Cybersecurity / IT GRC Evaluator to evaluate AI-generated artifacts and provide structured feedback.... ...and Google Workspace. Responsibilities include assessing the quality of AI outputs and applying subject-matter expertise in Cybersecurity...Remote jobHourly payWork at office- ...located in San Francisco, is looking for an analyst to extract and structure intelligence from... ...closely with reporters to create valuable data products. Candidates should have 1-3 years... ...in Excel, SQL, and familiarity with AI tools. Competitive salary and benefits included...Work at office
$80 - $120 per hour
...San Francisco, is looking for a Humanities / arts / culture Evaluator to assess AI-generated artifacts and provide feedback. The role requires... ...proficient in Microsoft Office and Google Workspace to effectively evaluate and enhance AI model outputs. #J-18808-Ljbffr MercorRemote jobHourly payContract workWork at office- ...a Generalist fluent in English and Assamese to work remotely. You will be responsible for fact-checking, generating evaluation data, and assessing model responses for clarity and completeness. The ideal candidate holds a Bachelor's degree, has significant experience with...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Model Evaluator & Data Quality Analyst. Be the first to apply!
Related searches
- quality evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- senior data management analyst San Francisco, CA
- data center analyst San Francisco, CA
- talent data analyst San Francisco, CA
- senior information security analyst San Francisco, CA
- manufacturing data analyst San Francisco, CA
- data warehouse analyst San Francisco, CA