Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead, Multimodal AI Evaluation & Data Ops

TwelveLabs

TwelveLabs is seeking a key member for its ML Data Team in San Francisco. This role involves designing evaluation frameworks, managing data operations, and collaborating cross-functionally. Ideal candidates should have over 5 years of experience in AI data operations, proficiency in Python and a strong ability to analyze complex data. The position offers comprehensive health benefits, flexible PTO, and an inclusive work culture focused on innovation in AI. #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead, Multimodal AI Evaluation & Data Ops in San Francisco, CA vacancy
  •  ...Twelve Labs in San Francisco is seeking a vital ML Data Team member to lead video-language data preparation and model evaluation. You will define dataset needs, automate...  ...collaborate cross-functionally with engineering and AI model teams. Ideal candidates have over 5 years... 
    Data
    Flexible hours

    Twelve-Labs

    San Francisco, CA
    1 day ago
  • Simple AI in San Francisco is seeking a GTM Ops hire to build the operating system for their go-to-market strategy. You'll collaborate directly with the...  ...their sales and marketing processes through automation and data management. The ideal candidate has strong analytical... 
    Data

    Simple AI

    San Francisco, CA
    2 days ago
  • $175k - $300k

     ...the knowledge and tools to make AI work for their unique needs and...  ...weights models with their own data, algorithms, and for their own...  ...hiring a GTM Strategy & Operations lead to build the commercial engine...  ...and fluent in how developers evaluate and adopt tools. What You’ll Do... 
    Data
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    22 hours ago
  •  ...About the Role ML Ops Engineer — Agentic AI Lab (Founding Team) — Location: San Francisco Bay Area —...  ...pipelines that power our agents and AI data fabric. You’ll work across compute orchestration...  ..., lineage, reproducibility, and evaluation capture Create and manage evaluation... 
    Data
    Full time

    Fabrion

    San Francisco, CA
    5 days ago
  •  ...platform that deploys multimodal Superhumans for revenue...  ...product knowledge. They can lead unlimited, simultaneous...  ...We’re looking for an AI Research Lead to define...  ...high‑fidelity data from thousands of real...  ...applied research team. Evaluate new model architectures... 
    Data
    Full time
    Live in
    Relocation
    Visa sponsorship

    1mind

    San Francisco, CA
    1 day ago
  • $252k - $335k

    The Strategic Operations Lead at OpenAI in San Francisco will oversee operations within the...  ...risk and safety signals related to new AI deployments. We seek a highly strategic individual...  ...technical background, especially in data management and AI tools, is essential.... 
    Data

    OpenAI

    San Francisco, CA
    4 days ago
  • $92k - $115k

     ...Lead, CS AI Content Flex is a growth-stage, NYC headquartered FinTech...  ...ensure AI can retrieve data, trigger actions, or route conversations...  ...Product, Engineering, and Ops. Experience in high-growth...  ...with chatbot authoring, AI evaluation, or support QA.... 
    Data
    Full time
    Local area
    Relocation package
    Flexible hours
    2 days per week
    3 days per week

    FLEX Inc

    San Francisco, CA
    2 days ago
  •  ...recruiting marketplace is seeking a Business Operations Lead in San Francisco to drive data analytics and operational excellence. You will analyze marketplace...  ..., and enforce critical processes using advanced SQL and AI tools. The ideal candidate has 2-6 years of related... 
    Data

    Paraform

    San Francisco, CA
    3 days ago
  • $110k - $135k

    A leading advertising technology firm is seeking its first Revenue Operations hire to establish the operational backbone of its revenue organization. This high-impact role combines GTM strategy and data analytics while providing hands-on sales support. The ideal candidate... 
    Data

    Tatari

    San Francisco, CA
    2 days ago
  • $151.2k - $189k

    A leading AI technology company in San Francisco is seeking a Strategic Projects Lead (SPL) to drive initiatives that generate significant...  ...pipelines and requires a strong technical background in data analytics and software engineering. Ideal candidates should possess... 
    Data

    Scale AI

    San Francisco, CA
    3 days ago
  •  ...Francisco is seeking a dedicated member for our ML Data Team to lead video data preparation and evaluation. This role includes defining dataset needs, automating...  ...should have over 5 years of experience in AI data operations, proficiency in Python, and strong communication... 
    Data
    Flexible hours

    Twelve-Labs

    San Francisco, CA
    1 day ago
  • About Archetype AI Archetype AI is developing the world's first AI...  ...the physical world, a real‑time multimodal LLM for real life, transforming real‑world data into valuable insights and knowledge...  ...AI is seeking a hands‑on Evaluation Lead to build and assess model performance... 
    Data

    SupportFinity™

    San Francisco, CA
    4 days ago
  •  ...Role We are seeking a Senior Lead of Creative Ops to drive operational excellence...  ...project planning to scaling AI-powered efficiency tools to...  ...for Client Approved assets. Evaluate, evolve and socialize AI tools...  ...and budget oversight. Strong data fluency — able to track KPIs,... 
    Data
    Contract work
    Local area
    Shift work

    Hinge Health, Inc.

    San Francisco, CA
    4 days ago
  • $150k - $170k

     ...About Us Individually, our AI and Superhumans are best...  ...for an Innovation Lead, Office of the CEO to work...  ...are applying AI Evaluate third-party tools, platforms...  ..., consulting, product ops, automation, or similar...  ...Science, Information Systems, Data Science, Business... 
    Data
    Work at office

    Crescendo Inc

    San Francisco, CA
    6 days ago
  •  ...San Francisco is seeking an experienced data operations professional to join their ML...  ...The role involves designing robust model evaluation frameworks, managing project timelines, and...  ...candidates have over 5 years of experience in AI data operations and proficiency in Python... 
    Data
    Flexible hours

    TwelveLabs

    San Francisco, CA
    3 days ago
  • $124k - $186k

     ...Role, Why Now GTM Data Strategy & Operations stood...  ...deliberately agentic AI-first : a multi-agent pipeline...  ...account, contact, and lead signals remain...  ...scratch, but you run them, evaluate their output with GTM data...  ...Operations Maintain ops-only staging fields;... 
    Data
    For contractors
    Work experience placement

    Klaviyo

    San Francisco, CA
    3 days ago
  • $180.8k - $226k

     ...Lead Technical Program Manager, Trust & Safety San Francisco...  ...of GenAI and human-AI collaboration. The Gen AI Ops Trust and Safety team is focused...  ...into fraud analytics and data-driven strategy to protect...  ...dashboards, and define offline evaluation frameworks (e.g., false... 
    Data
    Full time
    Shift work

    Scale AI

    San Francisco, CA
    6 days ago
  • $200k - $400k

     ...building the next-generation data platform to train AI video models. Troveo offers...  ...datasets to deploying, evaluating, and training models in production...  ...– Develop and fine‑tune multimodal models (e.g., CLIP variants...  .... ~ Proficiency in ML ops tools (e.g., MLflow, Weights... 
    Data
    Work experience placement

    Troveo AI

    San Francisco, CA
    1 day ago
  •  ...organization in San Francisco is seeking a Research & Evaluation Senior Lead to lead research efforts and manage impact...  ...requires over 8 years of experience in data analysis leadership, with strong skills in survey design and using AI tools for analysis. Responsibilities... 
    Data
    Remote work
    Flexible hours

    aiEDU

    San Francisco, CA
    7 days ago
  •  ...content engineering platform built for the AI era. In a world where discovery is...  ...York and Montevideo. As our founding Biz Ops Lead, you'll build the operational and analytical...  ...capacity scenarios from scratch, and turn data into clear recommendations ~ Automation-... 
    Data
    Flexible hours
    Shift work

    AirOps

    San Francisco, CA
    6 days ago
  • $125k - $135k

     ...The AI Education Project (aiEDU) is a non-profit devoted to making sure that all...  ...other systems.About the RoleThe Research & Evaluation Senior Lead role is responsible for leading the...  ...measure our impact and managing our impact data and organizational dashboards. We have... 
    Data
    Temporary work
    Local area
    Immediate start
    Home office
    Flexible hours

    aiEDU

    San Francisco, CA
    2 days ago
  • $180k - $250k

     ...things they had to do. Powerful AI will be the biggest lever for...  ...power, design and build data centers, and operate them - with...  ...About the Role As our IT SOX Lead, you will own the design,...  ...CSF, or ISO 27001 Experience evaluating and documenting controls in complex... 
    Data
    Local area

    FluidStack

    San Francisco, CA
    6 days ago
  •  ...retention and growth strategies. You will partner with the VP of Global Customer Success to design impactful systems and tools using AI and data analysis, directly influencing company outcomes. The ideal candidate has extensive experience in Revenue Strategy at a B2B SaaS... 
    Data

    Mixpanel

    San Francisco, CA
    2 days ago
  •  ...About Ando Ando is building AI-native workforce...  ...a Principal AI / ML Systems Lead to serve as Ando's senior AI...  ...uncertainty Set standards for model evaluation, accuracy, and learning velocity...  ...or applied ML ~ Production data systems and software engineering... 
    Data
    Hourly pay
    Contract work
    Shift work

    Ando Technologies, Inc

    San Francisco, CA
    6 days ago
  • $170k - $240k

     ...About Zip Zip is the AI platform for enterprise procurement — built...  ...an industry leader in AI. You lead by doing — prototyping...  ...and other platform capabilities. Evaluate and prototype new tooling to address...  ..., understand MCP, reason about data flows, and vibe‑code working prototypes... 
    Data
    Work at office
    Home office
    Flexible hours
    Weekend work

    ZipHQ, Inc.

    San Francisco, CA
    2 days ago
  • $91 - $96 per hour

    Crystal Equation Corporation is hiring a Senior Regulatory Ops Manager in San Francisco, CA. The role involves collaborating with Legal...  ...and Operations to ensure regulatory compliance while leveraging data and technology to improve processes. Candidates should have over... 
    Data
    Hourly pay

    Crystal Equation Corporation

    San Francisco, CA
    22 hours ago
  • $164.7k - $266k

     ...management, Docusign unleashes business-critical data that is trapped inside of documents....  ...What you'll do We are seeking a Lead AI Architect to turn enterprise data, metadata...  ...with enterprise technology strategy Evaluate emerging AI, semantic, graph, and retrieval... 
    Data
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    5 days ago
  • $100k - $130k

    SamaCare in San Francisco is seeking a Growth Ops & Insights Manager to bridge customer data and operational initiatives. You will design and implement analytical frameworks, drive engagement, and coordinate with various teams. The role requires 3-6 years of experience... 
    Data
    Remote job
    Flexible hours

    SamaCare

    San Francisco, CA
    2 days ago
  • A leading financial technology company in San Francisco is looking for a Senior Marketing Operations...  ...manage automation, optimize marketing data infrastructure, and collaborate with cross...  ...tools, and a passion for leveraging AI in marketing processes. This role offers a... 
    Data
    Remote work
    Flexible hours

    Brex Inc.

    San Francisco, CA
    3 days ago
  •  ...Learning Engineer who will develop systems for multimodal perception and contribute to robotics evaluation. In this hands-on role, you'll impact how data is collected, validated, and evaluated to shape frontier labs and leading robotics companies’ training methods. The... 
    Data

    Human Archive

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead, Multimodal AI Evaluation & Data Ops. Be the first to apply!