AI Model Evaluator & Data Quality Analyst
Welocalize
Welocalize is seeking a Data Quality Associate based in San Francisco for a full-time position. This role involves evaluating AI outputs and providing detailed feedback, with applicants needing native-level language proficiency and a university degree. Successful candidates will have strong critical thinking and communication skills, be naturally curious about AI, and demonstrate a commitment to quality standards. Benefits include paid vacation, medical insurance, and gourmet food. #J-18808-Ljbffr Welocalize
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Model Evaluator & Data Quality Analyst in San Francisco, CA vacancy
$25 - $40 per hour
...Cartesia Our mission is to architect AI that learns from and interacts with the... ...like humans do. We're pioneering the model architectures that will make this possible... ...We are a research lab looking for a Data Quality Operations Analyst to ensure our internal and vendor...SuggestedPermanent employmentFull timeContract workFor contractorsWork at officeVisa sponsorshipFlexible hours- A research lab specializing in AI is seeking a Data Quality Operations Analyst to ensure datasets meet high standards. You will audit vendor and internal data deliveries, provide actionable feedback, and maintain quality guidelines. The ideal candidate has strong attention...SuggestedFor contractors
$38 per hour
...Data Quality Analyst Welo Data is looking for experienced, detail-oriented... ...closely with both people and AI systems — auditing outputs,... ...edge cases in both human and model outputs Participate in... ...workflows or human-in-the-loop evaluation environments ~ Prior...SuggestedFull timeContract workRemote workVisa sponsorshipWelocalize
San Francisco, CA4 days ago$38 per hour
...Data Quality Analyst Welo Data is looking for experienced, detail-oriented... ...closely with both people and AI systems — auditing outputs,... ...edge cases in both human and model outputs Participate in... ...workflows or human-in-the-loop evaluation environments ~ Prior...SuggestedFull timeContract workRemote workVisa sponsorshipWelocalize
San Francisco, CA4 days ago- ...Machine Learning Model Specialist The ideal candidate will have a foundational understanding of machine learning, data annotation, quality assurance, and natural language processing. They will... ...and command-line interfaces. Evaluate the performance of trained models...SuggestedFull time
Welocalize
San Francisco, CA3 days ago $38 per hour
...Between Human Judgment and AI Excellence Are you... ...a high bar for data integrity? Welo Data is seeking Data Quality Analysts for Project Perseus... ...cutting-edge Arabic AI models is not only accurate but... ...compliance, or policy-driven evaluation in a GenAI context....Hourly payFull timeWork at officeShift work- ...Data Quality Analyst We are seeking three Data Quality Analysts for multi-year engagements with a foremost Healthcare IT Group. The Data Quality Analysts will be responsible for the modelling and testing of data extracted by MS SQL queries from ETL and databases processes...Work experience placement
Samprasoft
Oakland, CA5 days ago $144k - $187k
...s quantitative risk and factor model research. The team develops the... ...governance, and deliver production-quality outputs at scale. Your Key... ...infrastructure that integrates AI to accelerate model development... ...research, engineering, and data teams Presenting complex systems...Flexible hoursMSCI
San Francisco, CA3 days ago- ...Product Data Analyst Trident consulting is hiring for a Product Data Analyst role. The position... ...and improve map data coverage and quality Build dashboards, KPIs, and analytical... ...communication Experience with Mode, Hex, or AI data tools is a plus GIS/Mapping...Contract work
Trident Consulting
San Francisco, CA5 days ago - ...Reporting to the Regulatory and Quality Reporting Manager. The analyst's primary responsibilities include: data collection, metric validation, performance and health outcome... ...experience / training Epic Clarity Data Model and/or Epic Radar and/or Epic Reporting Workbench...
University of California , San Francisco
San Francisco, CA3 days ago $144k - $187k
...Governance team in San Francisco, California. This role involves designing and building research infrastructure that integrates AI, developing tools for model development, and maintaining automated validation and governance for models. A M.S. or Ph.D. in a quantitative field...- ...multimodal foundation models that have the ability to... ...Ventures, and prominent AI visionaries and... ...vital member of our ML Data Team - which leads the... ...preparation and model evaluation. This role comes with high... ...partnership, annotation, and quality evaluation work as possible...Work at officeWorldwideFlexible hours
Twelve Labs, Inc
San Francisco, CA2 days ago $60 - $80 per hour
...Mercor, headquartered in San Francisco, is seeking a STEM PhD to enhance AI model training through innovative problem-solving. This contract role entails independent work, a commitment of 15–20 hours per week, and offers a competitive pay between $60 and $80 per hour....Hourly payContract workRemote workMercor Inc
San Francisco, CA3 days ago- Welocalize is seeking a Data Quality Associate to evaluate AI model outputs and provide structured feedback. This is a full-time, onsite role located in San Francisco. The ideal candidate possesses a Bachelor's degree and has 1-2 years of professional writing experience...Full time
- Welo Data is seeking Data Labeling Associates in California to evaluate AI outputs and ensure cultural context and safety in Arabic datasets. This role requires professional-level proficiency in Portuguese (Brazil), a bachelor's degree, and at least 2 years of experience...
$100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses to enhance reasoning and rigor in model outputs. Provide structured written... ...feedback to improve training data quality and downstream performance. Develop...Contract workSummer workRemote work- ...located in San Francisco, is looking for an analyst to extract and structure intelligence from... ...closely with reporters to create valuable data products. Candidates should have 1-3 years... ...in Excel, SQL, and familiarity with AI tools. Competitive salary and benefits included...Work at office
- Welo Data is seeking Data Labeling Associates for Project Perseus in San... ...at least two years in generative AI safety. This role emphasizes evaluating Arabic nuances and AI outputs, ensuring quality and safety in machine learning models. The position offers full-time employment...Full time
$24 per hour
Prolific Academic Ltd is seeking AI Trainers with advanced Telugu fluency for a remote role focused on assessing AI audio outputs.... ...candidates should have high emotional intelligence and access to high-quality audio equipment. This position offers a unique opportunity to...Remote job- ...Francisco is seeking an experienced data operations professional for... ...-language data preparation, model evaluation, and requires strong skills... ...should have over 5 years in AI data operations, the ability... ...commitment to ensuring high-quality data. The position includes benefits...Flexible hours
$70 - $150 per hour
Mercor is seeking a Superstar Reviewer to evaluate the accuracy of AI-generated content and provide structured feedback. The ideal candidate will have over 5 years of experience in content review, strong analytical skills, and the ability to work independently. Responsibilities...Remote jobFlexible hours- ...Introducing Moonlake, AI for creating world simulations. Modeling & architecture Build and iterate on 2D/3D/image/video/audio diffusion architectures... ...Large-scale diffusion training Improve sample quality vs. compute trade-offs: better objectives,...
Embedding VC
San Francisco, CA2 days ago - YO IT Consulting seeks a Visual Evaluation Specialist to evaluate and annotate visual content, supporting AI training through high-quality input. Candidates should have proven experience in visual content evaluation and strong analytical skills. The role requires at least...Remote job
- YO IT Consulting is seeking a Visual Evaluation Specialist to evaluate visual content and provide critical feedback for AI training. This role requires proven experience in visual content evaluation with exceptional communication skills in English. The position is remote...Remote job
- Featherless AI in San Francisco is seeking a Business Development Representative who will handle outbound opportunities and customer relationships while engaging with technical audiences. This role blends sales with connecting AI startups and enterprises. You will work...
- ...Member of Technical Staff, Model EfficiencyWho are we?Our mission is to scale intelligence... ...developers and enterprises who are building AI systems to power magical experiences like... ..., higher throughput, and consistent quality across diverse workloads.As an engineer on...Full timeWork at officeRemote workFlexible hours
Cohere
San Francisco, CA2 days ago $30 - $33 per hour
Nelson-Connects- is seeking an Inventory Data Specialist in Emeryville, California. This role supports data quality across inventory and procurement systems, ensuring accurate product information and resolving data issues. The ideal candidate holds a Bachelor's degree...Hourly pay$100 per hour
Mercor is seeking a Generalist Expert to work remotely, evaluating AI-generated responses and providing structured feedback to enhance model performance. Candidates must have a Bachelor's degree from a top-100 globally ranked university and possess strong analytical and...Remote jobContract work- Job Title: Visual Evaluation Specialist Job Type: Contractor Location... ...help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior... ...ability to make objective, data-driven decisions....Remote jobFor contractors
- ...A leading AI research accelerator based in San Francisco is seeking a medical expert in internal... ...opportunity involves utilizing your medical expertise to evaluate and enhance AI-driven diagnostic capabilities, ensuring high-quality patient care and safety. Ideal candidates will...For contractorsRemote workFlexible hours
Turing
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Model Evaluator & Data Quality Analyst. Be the first to apply!
Related searches
- work from home web search evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- virtual data analyst San Francisco, CA
- data solutions analyst San Francisco, CA
- remote data analyst San Francisco, CA
- senior financial data analyst San Francisco, CA
- temporary data analyst San Francisco, CA
- data analyst excel San Francisco, CA