Lead, Multimodal AI Evaluation & Data Ops
TwelveLabs
TwelveLabs is seeking a key member for its ML Data Team in San Francisco. This role involves designing evaluation frameworks, managing data operations, and collaborating cross-functionally. Ideal candidates should have over 5 years of experience in AI data operations, proficiency in Python and a strong ability to analyze complex data. The position offers comprehensive health benefits, flexible PTO, and an inclusive work culture focused on innovation in AI. #J-18808-Ljbffr
- ...Twelve Labs in San Francisco is seeking a vital ML Data Team member to lead video-language data preparation and model evaluation. You will define dataset needs, automate... ...collaborate cross-functionally with engineering and AI model teams. Ideal candidates have over 5 years...DataFlexible hours
- Simple AI in San Francisco is seeking a GTM Ops hire to build the operating system for their go-to-market strategy. You'll collaborate directly with the... ...their sales and marketing processes through automation and data management. The ideal candidate has strong analytical...Data
$175k - $300k
...the knowledge and tools to make AI work for their unique needs and... ...weights models with their own data, algorithms, and for their own... ...hiring a GTM Strategy & Operations lead to build the commercial engine... ...and fluent in how developers evaluate and adopt tools. What You’ll Do...DataVisa sponsorshipWork visaRelocation package- ...About the Role ML Ops Engineer — Agentic AI Lab (Founding Team) — Location: San Francisco Bay Area —... ...pipelines that power our agents and AI data fabric. You’ll work across compute orchestration... ..., lineage, reproducibility, and evaluation capture Create and manage evaluation...DataFull time
- ...platform that deploys multimodal Superhumans for revenue... ...product knowledge. They can lead unlimited, simultaneous... ...We’re looking for an AI Research Lead to define... ...high‑fidelity data from thousands of real... ...applied research team. Evaluate new model architectures...DataFull timeLive inRelocationVisa sponsorship
$252k - $335k
The Strategic Operations Lead at OpenAI in San Francisco will oversee operations within the... ...risk and safety signals related to new AI deployments. We seek a highly strategic individual... ...technical background, especially in data management and AI tools, is essential....Data$92k - $115k
...Lead, CS AI Content Flex is a growth-stage, NYC headquartered FinTech... ...ensure AI can retrieve data, trigger actions, or route conversations... ...Product, Engineering, and Ops. Experience in high-growth... ...with chatbot authoring, AI evaluation, or support QA....DataFull timeLocal areaRelocation packageFlexible hours2 days per week3 days per week- ...recruiting marketplace is seeking a Business Operations Lead in San Francisco to drive data analytics and operational excellence. You will analyze marketplace... ..., and enforce critical processes using advanced SQL and AI tools. The ideal candidate has 2-6 years of related...Data
$110k - $135k
A leading advertising technology firm is seeking its first Revenue Operations hire to establish the operational backbone of its revenue organization. This high-impact role combines GTM strategy and data analytics while providing hands-on sales support. The ideal candidate...Data$151.2k - $189k
A leading AI technology company in San Francisco is seeking a Strategic Projects Lead (SPL) to drive initiatives that generate significant... ...pipelines and requires a strong technical background in data analytics and software engineering. Ideal candidates should possess...Data- ...Francisco is seeking a dedicated member for our ML Data Team to lead video data preparation and evaluation. This role includes defining dataset needs, automating... ...should have over 5 years of experience in AI data operations, proficiency in Python, and strong communication...DataFlexible hours
- About Archetype AI Archetype AI is developing the world's first AI... ...the physical world, a real‑time multimodal LLM for real life, transforming real‑world data into valuable insights and knowledge... ...AI is seeking a hands‑on Evaluation Lead to build and assess model performance...Data
- ...Role We are seeking a Senior Lead of Creative Ops to drive operational excellence... ...project planning to scaling AI-powered efficiency tools to... ...for Client Approved assets. Evaluate, evolve and socialize AI tools... ...and budget oversight. Strong data fluency — able to track KPIs,...DataContract workLocal areaShift work
$150k - $170k
...About Us Individually, our AI and Superhumans are best... ...for an Innovation Lead, Office of the CEO to work... ...are applying AI Evaluate third-party tools, platforms... ..., consulting, product ops, automation, or similar... ...Science, Information Systems, Data Science, Business...DataWork at office- ...San Francisco is seeking an experienced data operations professional to join their ML... ...The role involves designing robust model evaluation frameworks, managing project timelines, and... ...candidates have over 5 years of experience in AI data operations and proficiency in Python...DataFlexible hours
$124k - $186k
...Role, Why Now GTM Data Strategy & Operations stood... ...deliberately agentic AI-first : a multi-agent pipeline... ...account, contact, and lead signals remain... ...scratch, but you run them, evaluate their output with GTM data... ...Operations Maintain ops-only staging fields;...DataFor contractorsWork experience placement$180.8k - $226k
...Lead Technical Program Manager, Trust & Safety San Francisco... ...of GenAI and human-AI collaboration. The Gen AI Ops Trust and Safety team is focused... ...into fraud analytics and data-driven strategy to protect... ...dashboards, and define offline evaluation frameworks (e.g., false...DataFull timeShift work$200k - $400k
...building the next-generation data platform to train AI video models. Troveo offers... ...datasets to deploying, evaluating, and training models in production... ...– Develop and fine‑tune multimodal models (e.g., CLIP variants... .... ~ Proficiency in ML ops tools (e.g., MLflow, Weights...DataWork experience placement- ...organization in San Francisco is seeking a Research & Evaluation Senior Lead to lead research efforts and manage impact... ...requires over 8 years of experience in data analysis leadership, with strong skills in survey design and using AI tools for analysis. Responsibilities...DataRemote workFlexible hours
- ...content engineering platform built for the AI era. In a world where discovery is... ...York and Montevideo. As our founding Biz Ops Lead, you'll build the operational and analytical... ...capacity scenarios from scratch, and turn data into clear recommendations ~ Automation-...DataFlexible hoursShift work
$125k - $135k
...The AI Education Project (aiEDU) is a non-profit devoted to making sure that all... ...other systems.About the RoleThe Research & Evaluation Senior Lead role is responsible for leading the... ...measure our impact and managing our impact data and organizational dashboards. We have...DataTemporary workLocal areaImmediate startHome officeFlexible hours$180k - $250k
...things they had to do. Powerful AI will be the biggest lever for... ...power, design and build data centers, and operate them - with... ...About the Role As our IT SOX Lead, you will own the design,... ...CSF, or ISO 27001 Experience evaluating and documenting controls in complex...DataLocal area- ...retention and growth strategies. You will partner with the VP of Global Customer Success to design impactful systems and tools using AI and data analysis, directly influencing company outcomes. The ideal candidate has extensive experience in Revenue Strategy at a B2B SaaS...Data
- ...About Ando Ando is building AI-native workforce... ...a Principal AI / ML Systems Lead to serve as Ando's senior AI... ...uncertainty Set standards for model evaluation, accuracy, and learning velocity... ...or applied ML ~ Production data systems and software engineering...DataHourly payContract workShift work
$170k - $240k
...About Zip Zip is the AI platform for enterprise procurement — built... ...an industry leader in AI. You lead by doing — prototyping... ...and other platform capabilities. Evaluate and prototype new tooling to address... ..., understand MCP, reason about data flows, and vibe‑code working prototypes...DataWork at officeHome officeFlexible hoursWeekend work$91 - $96 per hour
Crystal Equation Corporation is hiring a Senior Regulatory Ops Manager in San Francisco, CA. The role involves collaborating with Legal... ...and Operations to ensure regulatory compliance while leveraging data and technology to improve processes. Candidates should have over...DataHourly pay$164.7k - $266k
...management, Docusign unleashes business-critical data that is trapped inside of documents.... ...What you'll do We are seeking a Lead AI Architect to turn enterprise data, metadata... ...with enterprise technology strategy Evaluate emerging AI, semantic, graph, and retrieval...DataContract workWork at officeLocal areaRemote work2 days per week$100k - $130k
SamaCare in San Francisco is seeking a Growth Ops & Insights Manager to bridge customer data and operational initiatives. You will design and implement analytical frameworks, drive engagement, and coordinate with various teams. The role requires 3-6 years of experience...DataRemote jobFlexible hours- A leading financial technology company in San Francisco is looking for a Senior Marketing Operations... ...manage automation, optimize marketing data infrastructure, and collaborate with cross... ...tools, and a passion for leveraging AI in marketing processes. This role offers a...DataRemote workFlexible hours
- ...Learning Engineer who will develop systems for multimodal perception and contribute to robotics evaluation. In this hands-on role, you'll impact how data is collected, validated, and evaluated to shape frontier labs and leading robotics companies’ training methods. The...Data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead, Multimodal AI Evaluation & Data Ops. Be the first to apply!
- data officer San Francisco, CA
- data network cabling San Francisco, CA
- data auditor San Francisco, CA
- test data management San Francisco, CA
- data mining San Francisco, CA
- minimum data set coordinator San Francisco, CA
- data capturer San Francisco, CA
- data tech San Francisco, CA
- sap data migration San Francisco, CA
- provider data management San Francisco, CA

