Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Multimodal ML Evaluation Engineer

Gravity Engineering Services Pvt Ltd.

Gravity Engineering Services Pvt Ltd. seeks a skilled professional to design and maintain end-to-end evaluation pipelines for multimodal generative and vision-based models in San Francisco. The ideal candidate will develop automated benchmarking suites and collaborate with various teams to define metrics and data requirements. The role requires strong programming skills in Python and hands-on experience with machine learning model evaluation. Proficiency in CI/CD practices and excellent communication skills are essential. #J-18808-Ljbffr Gravity Engineering Services Pvt Ltd.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Multimodal ML Evaluation Engineer in San Francisco, CA vacancy
  •  ...with safety, privacy, and real-world responsibility in mind. Our ML team comes from a culture of academic research driven to...  ...privacy for the sake of ML advancement. Responsibilities Own LLM evaluation processes and methods with a focus on generating benchmarks representative... 
    Suggested
    Local area
    Shift work

    Capitolis

    San Francisco, CA
    2 days ago
  • Arcada Labs Incorporated is seeking an ML Research Engineer in San Francisco to lead evaluations of AI models based on human preferences. You will design experiments and analysis pipelines to enhance our understanding of AI capabilities and contribute to user-facing tools... 
    Suggested

    Arcada Labs Incorporated

    San Francisco, CA
    1 day ago
  • $213k - $263k

     ...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge:...  ...are seeking visionary machine learning engineers and researchers to architect the...  ...define and measure the realism of our multimodal world models. Your work will define the... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  • Anthropic is seeking a dedicated individual to build evaluation infrastructure that enhances trust in AI systems. You'll work on constructing real-world data sets and analyzing agent performance to inform risk management. The ideal candidate will have strong proficiency... 
    Suggested

    Anthropic

    San Francisco, CA
    2 days ago
  • Human Computer Lab in San Francisco is looking for a machine learning engineer to develop intelligent robotic systems. The candidate will work on multimodal models integrating computer vision, audio processing, and behavior. Key qualifications include 3+ years in machine... 
    Suggested

    Human Computer Lab

    San Francisco, CA
    2 days ago
  • Luma in San Francisco is seeking a Research Engineer to design and scale the infrastructure for evaluating multimodal AI models. You will build pipelines and metrics, ensuring...  ...'s or PhD in a technical field and 5+ years in ML evaluation. This role involves collaboration... 

    Luma

    San Francisco, CA
    2 days ago
  •  ...closely with researchers and model engineers to translate ideas into...  ...role at the intersection of ML, software engineering, and scalable...  ..., modalities, and evaluation metrics. What We Hope You’ll...  ...tuning). Background in robotics, multimodal models, or large‑scale foundation... 
    Full time

    Monograph

    San Francisco, CA
    1 day ago
  • $213k - $263k

    Waymo in San Francisco is looking for a Machine Learning Engineer to pioneer evaluation systems for its autonomous simulation technology. The role...  ...innovative evaluation approaches to assess realism in multimodal world models. The ideal candidate will have at least five... 

    Waymo

    San Francisco, CA
    2 days ago
  •  ...don’t believe culture can be engineered - but when it falls into place...  ...We’re looking for an ML engineer to design, train, and...  ...scale training to closed-loop evaluation in simulation and deployment...  ...backbone, action decoder, and multimodal fusion pipeline Build and optimize... 
    Local area

    Humble Robotics

    San Francisco, CA
    2 days ago
  • About the Role Scale’s ML platform (RLXF) team builds our internal...  ...and automatic training and evaluation of LLM's, as well as...  ...ML systems Strong software engineering skills, proficient in frameworks...  ...use , reasoning , agents , and multimodal , etc. #J-18808-Ljbffr Gravity... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    2 days ago
  • $200.8k - $251k

    Overview Scale's ML platform (RLXF) team builds our internal...  ...fast and automatic training and evaluation of LLMs, as well as...  ...ML systems Strong software engineering skills, proficient in frameworks...  ...use, reasoning, agents, and multimodal, etc. Compensation packages... 
    Full time
    For contractors
    Shift work

    Scale AI

    San Francisco, CA
    2 days ago
  •  ...discovers how work actually gets done; from multimodal signals including video, documents,...  ...Opportunity We are seeking a Principal ML Engineer to be the technical anchor of the...  ...components; agent harnesses, knowledge graphs, evaluation frameworks; that let delivery teams... 
    Full time
    Work experience placement
    Work at office

    Wells Fargo & Company

    San Francisco, CA
    1 hour ago
  •  ...constraints. You will work across data curation, training recipes, and evaluation to ship integrated models. The role emphasizes experimental...  ...with pretraining/post-training teams, and advancing multimodal capabilities. A strong Python background and advanced degree are... 

    Bold Capital Partners

    San Francisco, CA
    4 days ago
  • ML Engineer - AI-Powered Automation & Workflow Intelligence Location: Bay Area, CA (On-site...  ..., including experimentation, training, evaluation, and monitoring. Develop innovative...  ...involving large language models (LLMs), multimodal architectures (text, image, graph), and... 
    Full time

    Blue-Signal-Search

    San Francisco, CA
    2 days ago
  •  ...THE ROLE You’ll build and maintain the ML systems and pipelines that our research...  ...data pipelines, training infrastructure, evaluation tooling, deployment, observability. The...  ...results we trust.” This is a senior ML engineering role. You’ll own systems end-to-end. You... 

    MakerMaker

    San Francisco, CA
    4 days ago
  • Check out 1962 new Machine Learning Engineer opportunities posted on AI Chopping Block Design...  .... Develop and optimize end-to-end ML pipelines encompassing data collection, labeling...  ...latency. Machine Learning Enginer, Core Evaluations The responsibilities include designing... 
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    2 days ago
  •  ...Design, build, and deploy production‑grade ML systems with end‑to‑end ownership of the...  ...years of professional experience in ML engineering. Strong programming skills in Python (...  ...data pipelines for model training and evaluation. Familiarity with FastAPI, OpenAI APIs,... 
    Full time

    Catalyst Labs, LLC

    San Francisco, CA
    1 day ago
  •  ...small, fast-growing team of engineers in San Francisco powering Fortune...  ...-language models Build evaluation, data curation, and active learning...  ...3+ years in applied ML or research, or strong open source...  ...or JAX, and modern vision or multimodal architectures Solid engineering... 
    Work at office
    Visa sponsorship
    Relocation package

    Trypulse

    San Francisco, CA
    2 days ago
  •  ...need someone who can push the boundaries of what our ML systems can do. We're hiring a Founding ML Engineer to own the research and engineering behind our core...  ..., not just called APIs You know how to build and evaluate retrieval systems, classifiers, and embedding... 

    Crustdata (YC F24)

    San Francisco, CA
    2 days ago
  •  ...Physics | 5 Days Onsite Machine Learning Engineer Location: Onsite in San Francisco...  ...About the Role UniversalAGI is hiring an ML Engineer to help ship ML outcomes by owning...  ...pipelines to support model training and evaluation. Run training and fine-tuning workflows... 
    Work at office
    Flexible hours
    1 day per week

    UniversalAGI

    San Francisco, CA
    3 days ago
  • Syndesus, Inc. is looking for a founding engineer in San Francisco, CA or New York City, NY to shape their AI backbone. You'll process vast...  ...experience, with strong Python skills and an understanding of ML ops. Benefits include competitive salary and equity, full health... 

    Syndesus, Inc.

    San Francisco, CA
    2 days ago
  •  ...architectures and training algorithms through data curation, evaluation, and deployment. You'll join a focused, hands‑on group that works...  ...experience in some of the following: Building or optimizing multimodal training or data pipelines. Experience with distributed... 

    Bold Capital Partners

    San Francisco, CA
    4 days ago
  •  ...workstreams across data pipelines, evaluation systems, and customer...  ...evaluation systems that measure multimodal performance across internal...  ...building and shipping production ML systems beyond model training...  ...shared codebases with high engineering standards Nice‑to‑have:... 
    Shift work

    Liquid AI

    San Francisco, CA
    4 days ago
  • $161.93k - $247k

    Senior Machine Learning Engineer Join to apply for the Senior Machine...  .../machine learning (AI/ML) systems in a cloud environment...  ...needs. Continuously monitor, evaluate, and optimize DL model training...  ...datasets. Experience managing multimodal datasets, such as... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Freenome

    Brisbane, CA
    2 days ago
  •  ...menu of meal types and preparation configurations. As a Senior ML Engineer, Manipulation, you will own the learning systems that enable...  ...effector types (suction, parallel jaw, multi-finger) Implement and evaluate modern policy architectures (diffusion policies, transformer-... 
    Flexible hours

    Chef Robotics

    San Francisco, CA
    2 days ago
  • Senior Machine Learning Engineer Location: SF or Waterloo, with ability to travel Start...  ...systems Shaping benchmark design and model evaluation frameworks Building agentic AI...  ...Nations. What do we do? We’re building multimodal foundation models for the natural world... 
    Work experience placement
    Remote work
    Flexible hours

    Coastal Carbon

    San Francisco, CA
    5 days ago
  • NomadicML, based in San Francisco, seeks a Machine Learning Engineer to advance motion understanding with vision‑language models and production‑grade ML pipelines. You will train, evaluate, and deploy multi‑modal systems that reason about complex video events and interactions... 

    Nomadic AI

    San Francisco, CA
    3 days ago
  • $204k - $259k

     ...from a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently...  ...integrating new, diverse, and multimodal data streams (e.g., visual data from different...  ...existing models. Develop and rigorously evaluate metrics and methodologies for measuring... 

    Waymo

    San Francisco, CA
    2 days ago
  •  ...scale. About The Role We are looking for a visionary Senior ML Engineer who will bridge the gap between high-level architecture and hands...  ...models, embeddings; building clustering models; utilizing evaluation frameworks to quantify performance Proficiency in agent... 
    Shift work

    Palm Venture Studios

    San Francisco, CA
    2 days ago
  • $181.4k - $235.8k

     ...Inc. is seeking a Senior Machine Learning Engineer with 10+ years of experience to design,...  ...enterprise. This role is focused on end-to-end ML system ownership, including data...  ...lifecycle management, including training, evaluation, deployment, monitoring, and retraining Experience... 
    Minimum wage

    Gap Inc.

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Multimodal ML Evaluation Engineer. Be the first to apply!