Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Quality & Annotation Lead

$100k - $140k

Nimble Robotics

Nimble is an AI robotics company building the autonomous supply chain to power fast, efficient and economical commerce. We’re training robot AGI to power a proprietary generalist supply chain superhumanoid, the first robot in the world capable of performing thousands of tasks across the supply chain. We’ve raised over $220M at over $1B valuation and formed a strategic alliance with FedEx to build a national network of autonomous warehouses capable of generating many billions in annual revenue. We are a hardcore and obsessed team of the world’s best engineers and operators. If you are obsessed with your craft, enjoy a high-intensity and fast moving high impact environment, are super high agency in getting hard things done and want to be part of building the world’s most legendary robotics company at the most pivotal moment in history, we want to work with you. We are on a mission to empower and inspire mankind to accomplish legendary feats by inventing robots that liberate us from the menial. We will accomplish this by training robot AGI to invent and build the Autonomous Supply Chain – everything from the inside of factories and warehouses to your front door – powered by generalist superhumanoids. Our founding team comes from the AI labs at Stanford and Carnegie Mellon and our board of directors include famed robotics and AI legends including Fei-Fei Li (Chief Scientist of AI at Google and Director of Stanford’s AI Lab), Marc Raibert (founder of Boston Dynamics), and Sebastian Thrun (founder of GoogleX, Waymo; Stanford Professor and considered the father of autonomous vehicles). At Nimble, we are committed to building legendary products, a legendary team, and a legendary legacy. Join us and become part of an ambitious, humble, and resourceful culture where your work will leave a lasting impact on the future of robotics and commerce. Nimble's Core Values: Be relentlessly resourceful - Challenge conventions and overcome obstacles. Be legendary - Be the very best and do work that inspires. Be humble - Prioritize growth, learning, and doing whatever is needed to further the mission. Be dependable - Take ownership and deliver with high agency. The Role Nimble Brain turns real-world operational data into the training sets, evaluations, and feedback loops that make our robots smarter every day. The fuel for that engine is human demonstration data — skilled operators across our sites performing and recording the tasks our superhumanoids learn from — and the quality of every episode we collect sets the ceiling on every model we train. We’re looking for a Manager, Data Quality & Annotation to become the first dedicated owner of that quality bar. Own the rubric, not just run it: you’ll write the acceptance criteria that define what a "good" episode is for every task family, build the audit workflows that enforce them as we scale from ~15 to 100+ operators across four sites this year, and stand up the annotation engine — including a remote annotation team turning around episode review overnight — that keeps labeled, trusted data flowing to research on schedule. This is a hands‑on, metrics‑driven, build‑from‑scratch role. You’ll be based at our San Francisco HQ and spend heavy time at our collection sites, especially during operator ramps. Success looks like an episode acceptance rate that holds steady while the operator base grows 10x — with rubrics, audits, and dashboards that run like clockwork instead of heroics. Responsibilities Own episode acceptance criteria for every task family — translate research and engineering data needs into operational, auditable standards, and version them as model training needs evolve. Take over the annotation and episode‑review queue in your first weeks, then build the team and workflows that scale it far beyond yourself. Stand up and manage a remote annotation team (likely Philippines‑based; direct hires or vendor/BPO) with an overnight turnaround SLA — episodes collected today are reviewed and scored before the next shift starts. Design and run a sampling‑based QA audit program with explicit coverage targets, including inter‑rater reliability checks that keep annotators and auditors calibrated. Run the operator quality feedback loop: operator‑level quality scorecards delivered to site supervisors within 24 hours. You own the standard and the signal; supervisors own the coaching and people decisions. Instrument your function: define the quality metrics (episode acceptance rate, audit coverage, feedback latency, operator quality distribution, annotation throughput) and build the operational dashboards your team runs on, partnering with our analytics function, which independently owns org‑wide reporting. Own the certification bar for new operator onboarding — no one collects production data without meeting it — while site teams run the day‑to‑day training reps. Drive a standing weekly loop with research and engineering on failure modes, task‑spec drift, and what "good" needs to mean next. Qualifications 3+ years in data operations, annotation/labeling operations, or data collection QA for ML systems — robotics, autonomy, or teleoperation data strongly preferred. A track record of building quality standards from scratch — rubrics, SOPs, QC workflows — not just executing against existing ones. Be ready to walk us through one you built. Experience managing annotation or review teams, including remote/offshore or vendor/BPO teams, and driving their performance against SLAs. Experience delivering direct, frequent quality feedback to operators or annotators — including the hard conversations when someone isn’t meeting the bar. Data fluency: able to build and own your own reporting and pressure‑test the numbers — SQL, BI tools, or AI‑assisted, we don’t care how — rather than waiting on someone else. Meticulous judgment on edge cases, paired with the pragmatism to ship a v1 rubric this week instead of a perfect one next quarter. High agency and comfort with ambiguity in a fast‑paced, high‑growth environment — the org will triple around you this year. Able to work in person out of our San Francisco HQ, with regular time at our collection sites. Alignment with Nimble’s values: relentlessly resourceful, humble, dependable, and committed to legendary impact. Additional Requirements Familiarity with imitation learning / robot learning data — what makes a demonstration usable for model training. Experience scaling annotation or rater teams: pods, shift leads, inter‑rater reliability programs. Experience selecting and managing offshore annotation vendors, or standing up direct offshore teams (EOR, timezone‑shifted workflows). Compensation The pay range for this position at the start of employment is expected to be between $100,000 and $140,000/year . Your exact offer may vary depending on multiple individualized factors, including job‑related knowledge, skills, and experience. In addition to cash compensation, this position will also receive generous equity for this position. Culture: We embrace challenges and strive to make the impossible possible each day. We’re not in this to do what’s easy or to be mediocre. We want to create something legendary and leave our mark on the world. We’re ambitious, we’re gritty, we’re humble and we’re relentlessly resourceful in pursuit of our goals. If this sounds like you then you might be a great fit! Nimble Robotics, Inc. is an equal opportunity employer. We make all employment decisions based solely on merit. We provide equal employment opportunity to all applicants and employees without discrimination on the basis of race, color, religion, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, sexual orientation, age, military or veteran status, or any other characteristic protected by applicable state, federal or local laws. Nimble's Benefits Unlimited Flexible Time Off Enjoy the time you need to travel, rejuvenate, and connect with friends and family. Health Insurance Nimble provides medical, dental, and vision insurance through several premier plans and options to support you and your family. Enjoy paid bonding time following a birth. Take the stress out of commuting with access to fully paid parking spots. Referral Bonus Get a cash bonus for any friend or colleagues that you refer to us that we end up hiring. 401k Contribute towards a 401k for retirement planning. Equity Be an owner in Nimble through our equity program #J-18808-Ljbffr Nimble Robotics

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Quality & Annotation Lead in San Francisco, CA vacancy
  •  ...s most scalable API to human intelligence. We deliver high-quality data annotation, preference feedback, and model evaluation at internet speed...  ...active annotators across 192 countries. The world's leading AI labs use Rapidata to generate RLHF training data, run model... 
    Quality
    Full time
    Contract work
    Work at office

    Rapidata AG

    San Francisco, CA
    2 days ago
  •  ...experiences. We're funded by leading investors at Index Ventures and...  ...contact for all questions, quality decisions, and language-specific...  .... This is not a standard annotation engagement. You will own your...  ...annotation quality, auditing data, monitoring product performance... 
    Quality
    Contract work
    For contractors
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours

    Cartesia

    San Francisco, CA
    4 days ago
  •  ...San Francisco is seeking a Senior Technical Program Manager to lead data collection and annotation initiatives. The role involves collaborating with research teams, managing resources, and ensuring high-quality data delivery. The ideal candidate has a Bachelor's degree in... 
    Quality
    Flexible hours

    SESAME

    San Francisco, CA
    2 days ago
  •  ...false positives, and compliance teams that focus on decisions, not data entry. Banks and fintechs across the U.S., Canada, Europe, and...  ...: mapping workflows, refining alerts, improving output quality & accuracy, and building transparency into every decision. You’ll... 
    Quality
    Temporary work
    Work at office
    Relocation package

    Sphinx

    San Francisco, CA
    5 days ago
  •  ...mobile sites. The role requires expertise with People Who Use Drugs, motivational interviewing, trauma-informed care, and data entry. You will ensure quality services, develop systems, and liaise with partners, with occasional evening/weekend #J-18808-Ljbffr SAN-Francisco-... 
    Quality
    Afternoon shift

    SAN-Francisco-Aids-Foundatio

    San Francisco, CA
    2 days ago
  • $29 per hour

     ...Front Office Team Lead Make a Difference. Grow in Your Career. Thrive with Us. At...  ...environment allows our providers to deliver quality patient care. This role is full-time (4...  ...Microsoft Office, multiline phones, and accurate data entry. ~ Strong communication and... 
    Quality
    Hourly pay
    Full time
    Work at office

    Mindpath Health

    San Francisco, CA
    2 days ago
  • $25 - $26 per hour

     ...CoordinatorPurposeThe Expanded Learning Program (EXLP) Lead Program Instructor delivers high-quality expanded learning experiences that support the...  ...Lead Program Instructors support daily site operations, data entry, organization, supplies, routines, and implementation... 
    Quality
    Hourly pay
    Flexible hours

    Bay Area Community Resources

    San Francisco, CA
    2 days ago
  • $27.7 - $33 per hour

     ...phlebotomy license. Phlebotomist II Site Lead - Daly City, CA, Monday to Friday, 7:30 AM...  ...health decisions. The PSR II – Site Lead draws quality blood samples from patients and prepares...  .... Responsible for completing all data entry requirements accurately including data... 
    Quality
    Full time
    Part time
    Work experience placement
    Work at office
    Monday to Friday
    Flexible hours
    Shift work

    Quest Diagnostics

    Daly City, CA
    1 day ago
  • $80 - $120 per hour

    ML Encoder Lead - Contract - Bay Area Ready to shape how AI understands customers by creating...  ...-learning models from complex behavioural data? Proclinical is seeking an ML Encoder Lead...  ...practices and ability to assess embedding quality. Ability to communicate technical findings... 
    Quality
    Hourly pay
    Contract work

    Proclinical Group

    San Francisco, CA
    2 days ago
  •  ...DescriptionAt least 2 years of experience with Information Technology and Test Delivery in which at least 2 years of experience in Test Data ManagementAt least 2 years of experience in FACET application or Healthcare IT systemsExcellent understanding of the Healthcare... 
    Quality
    Permanent employment
    Full time
    H1b

    Sonsoft

    San Francisco, CA
    2 days ago
  • $27.7 - $33 per hour

     ...CA, WA, NV). Phlebotomist II Site Lead - Daly City, CA, Monday to Friday, 7:30 AM...  ...health decisions. The PSR II-Site Leaddraws quality blood samples from patients and prepares...  ...services. Responsible for completing all data entry requirements accurately including... 
    Quality
    Full time
    Part time
    Work experience placement
    Work at office
    Monday to Friday
    Flexible hours
    Shift work

    Quest Diagnostics Incorporated

    Daly City, CA
    3 days ago
  • Cartesia seeks a native-level Hindi language lead to own end-to-end language resources for voice AI. You’ll manage annotation quality, audit data, monitor product performance, and execute linguistics-driven projects with deep attention to detail. You will coordinate with... 
    Quality
    For contractors
    Work at office

    Cartesia, Inc.

    San Francisco, CA
    1 day ago
  • ThoughtSpot is a Data & AI platform that helps companies turn data into Enterprise advantage. We are Gartner...  ...daily workflow to increase productivity and quality.Hands-on experience to leverage AI tools (industry-leading LLMs) to increase productivity, automate routine... 
    Quality
    Work at office
    Local area
    3 days per week

    ThoughtSpot

    San Francisco, CA
    3 days ago
  • $116.2k - $229.1k

     ...and operational requirementsDriving high-quality functional documentation and disciplined delivery...  ...functional, technical, integration, data conversion, and testing workstreams to ensure...  ...professional relationshipsAbility to lead projects or workstreamsAbility to manage and... 
    Quality
    Local area

    Deloitte

    San Francisco, CA
    2 days ago
  • $204k - $260k

     ...addresses.About the roleWe are looking for a Compensation Programs Lead to own and drive our core compensation programs end-to-end. This...  ...surface issues, and continuously raise the bar on comp programs quality and program deliveryCompensation Launches & Operational... 
    Quality
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    4 days ago
  • $104.96k - $131.2k

     ...made the experience easy.As an Analytics Lead, you'll partner directly with cross-functional...  ...insights and recommendations to drive quality business decisions with customer-facing impact...  ...the analytical integrity of safety data at Lyft. Set the definitions, inclusion criteria... 
    Quality
    Hourly pay
    Local area
    Remote work

    Lyft

    San Francisco, CA
    18 hours ago
  •  ...barriers for the upper respiratory tract. The role will generate high-quality theses to guide our approach to grant and equity investments as...  ...with thinking through high-value experiments, technical data scrutiny, and triaging a wide funnel of ideas into the highest quality... 
    Quality
    Work experience placement

    Stripe

    San Francisco, CA
    3 days ago
  • $202k - $280k

     ...skilled and experienced Credit Risk Practice Lead to lead our onshore consulting and...  ...strong knowledge of the lending business, data and domain across the customer lifecycle,...  ...as a domain expert to clients, drive high-quality project delivery, and be responsible for hiring... 
    Quality
    Work at office

    EXL Service

    San Francisco, CA
    4 days ago
  • $210k - $240k

     ...time for their life’s work.About the Role:We are seeking a Tax Lead to join our global Tax and Treasury team. In this pivotal role,...  ...manage ambiguity, review complex technical work, and deliver high-quality outcomes in fast-paced environments.Public company experience, including... 
    Quality
    Local area

    Notion Labs

    San Francisco, CA
    4 days ago
  • $148k - $185k

     ...the RoleVercel is seeking a Startup Program Lead to build, lead, and scale our global...  ...program operates, scales, and delivers a high-quality experience for early stage founders. They...  ...Marketing, Media, Sales, Product, and Engineering.Data-driven mindset with experience defining... 
    Quality
    Work from home
    Worldwide
    Flexible hours

    Vercel

    San Francisco, CA
    4 days ago
  • $150k - $190k

     ...:We are seeking a Sr. Research Manager to lead and execute the Analytics, Research, and Mapping...  ...the analytical deliverables that underpin data-driven decision-making. This dual mandate...  ...ultimate accountability for accuracy and quality of all deliverables.What your day-to-day... 
    Quality
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    Jones Lang LaSalle

    San Francisco, CA
    5 days ago
  •  ...impact.HDR is searching for an Industrial Wastewater (IWW) Program Lead - Oil, Gas, and Chemicals Practice.Candidates for the IWW Lead...  ...and marketing managers on business class efforts Committed to quality, improvement and HDR values An attitude and commitment to being... 
    Quality
    For contractors

    HDR

    San Francisco, CA
    5 days ago
  • $240k - $275k

     ...the neighborhood at nextdoor.com. Meet Your Future NeighborsAs a Lead Designer on Nextdoor's Consumer Product team, you'll help shape...  ...designers toward their next level, and holds the line when speed and quality trade off, while still shipping hands-on work themselves.Deeply... 
    Quality
    Work at office
    Local area
    Work from home

    Nextdoor

    San Francisco, CA
    3 days ago
  • $190k - $225k

     ...Finance, People Ops, and Legal to automate processes, maintain data integrity, and support company growth.Ensure full payroll compliance...  ..., taxes, and equity, while managing third-party vendors for quality and accuracy.Analyze payroll data and maintain documentation, using... 
    Quality
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    3 days ago
  •  ...signals, identity linkages, and behavioral data are dramatically underleveraged tools in...  ...doing right now.As the Fraud Intelligence Lead, you will build and run a small, high-leverage...  ...& People LeadershipSet the casework quality bar: define what rigorous investigation, triage... 
    Quality
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Plaid Financial

    San Francisco, CA
    4 days ago
  • $142k - $214k

     ...looking for an experienced, high-judgment, Lead, Immigration to help scale Snap’s U.S....  ...S. immigration program to improve program quality and drive efficiency Quickly adjust Snap immigration...  ...of gathering, cleansing and analyzing data to support program strategies.If you have... 
    Quality
    Permanent employment
    Full time
    H1b
    Live in
    Work at office
    Local area
    Work visa

    Snap

    San Francisco, CA
    4 days ago
  •  ...California seeks a Nurse Practitioner or Physician Assistant to lead patient care across multiple sites. You will conduct psychiatric...  ...treatment plans, and participate in admissions, care coordination, and quality assurance activities. The role offers leadership... 
    Quality

    Rogers Behavioral Health

    San Francisco, CA
    4 days ago
  • $252k - $362k

    Scale AI is seeking a highly skilled and motivated Tech Lead for our ARC (Architecture, Reliability, & Compute) team supporting our...  ...world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading... 
    Quality
    Full time
    Work at office
    3 days per week

    Scale AI

    San Francisco, CA
    5 days ago
  • $197.5k - $271.5k

     ...At Faire, we're using the power of tech, data, and machine learning to connect this thriving...  ...looking for a Strategy & Analytics Senior Lead to drive better decisions, faster, as we...  ..., retailer demand, unit economics, and quality. You'll partner closely with Product, Engineering... 
    Quality
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    5 days ago
  • $155.7k - $186k

     ...should feel clear, distinctive, and true to our brand.As Brand Voice Lead, Systems, you’ll help make that happen.This is not a traditional...  ..., and ideas with clarity and conviction.Write and refine high-quality copy across a wide range of formats, including product launches,... 
    Quality
    Work at office
    Local area
    Work from home
    Flexible hours
    3 days per week

    Intercom

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Quality & Annotation Lead. Be the first to apply!