Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Member of Technical Staff - Data & Evaluation

Rhoda AI

At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation world models that control our robots. Our robots are designed to be generalists capable of operating in complex, real-world environments and handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $400M and are investing aggressively in model research, infrastructure, hardware development, and manufacturing scale-up to make generalist robotics a reality. We're looking for Research Scientists and Research Engineers to build the data and evaluation foundations for our video action model. This team owns web-scale video data curation, annotation pipelines, and evaluation methodology — directly determining the quality of the video pretraining distribution and how clearly we can measure model progress. We hire across levels — from MTS-Staff What You’ll Do Design and implement scalable curation pipelines for web-scale video pretraining data: ingestion, deduplication, quality filtering, and content classification across internet-scale video corpora Develop video-specific annotation frameworks and quality filters — motion quality, scene diversity, action content, temporal coherence — to improve pretraining signal Build evaluation frameworks and benchmarks to measure causal video model capabilities: prediction quality, temporal coherence, long-horizon rollout fidelity, and downstream robot task performance Research and implement data selection, mixing, and weighting strategies that improve video generation quality and transfer to robotic control Deploy and scale vision-language models (VLMs) and video understanding models for automated annotation, filtering, and content scoring at web scale Collaborate closely with pre-training and post-training teams to ensure data quality and evaluation methodology drive research decisions Track model capability trends across training runs, catching regressions and surfacing improvements early What We’re Looking For Strong understanding of data-centric ML and how web video data quality affects large generative model performance Experience building large-scale video data pipelines: ingestion, filtering, deduplication, and quality scoring Familiarity with video-specific data characteristics: temporal structure, motion quality, scene diversity, and action content Solid ML fundamentals with hands-on experience training or evaluating large generative models Ability to design evaluations for video generation models that are diagnostic, reproducible, and actionable Staff-level candidates are expected to define technical direction and drive research strategy independently; senior/MTS candidates execute complex projects with strong fundamentals and growing scope Nice to Have (But Not Required) PhD or strong research background in ML, computer vision, or a related field Experience with large-scale web video dataset curation (e.g., WebVid, HowTo100M, Ego4D, or similar) Familiarity with video generation quality metrics (FVD, perceptual quality, motion consistency) Experience running VLM or CLIP-style inference at scale for automated video filtering and annotation Prior work on evaluation methodology for video generation or world models Understanding of how web video data properties connect to downstream robotic action prediction Publication record at NeurIPS, ICML, ICLR, CVPR, or related venues Why This Role The video curation and evaluation rigor you build directly determines pretraining quality and research iteration speed for the entire team Build the benchmark infrastructure that gives the team an honest signal of model progress toward real robot performance High leverage: improvements to data quality compound across every training run Work at the intersection of large-scale systems and generative model research with visibility across all model development #J-18808-Ljbffr Rhoda AI

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Research Member of Technical Staff - Data & Evaluation in Palo Alto, CA vacancy
  • About the Role As a Member of Technical Staff [Research] at NeoCognition , you’ll be part of the core team advancing the frontier of...  ...post-training (instruction tuning, RL, reasoning) Data pipeline design and model evaluation Proficiency in Python and familiarity with... 
    Data

    NeoCognition Inc.

    Palo Alto, CA
    3 days ago
  • $280k - $350k

     ...client is a Palo Alto AI research lab building the...  ...co-founder of a major data platform. Their research...  ...prototypes, shaping both the technical roadmap and the...  ...roadmap as one of the first members of the team. What we’...  ..., post‑training, or evaluations, backed by... 
    Data
    Internship
    Relocation
    Visa sponsorship
    Relocation package

    Raydar

    Palo Alto, CA
    1 day ago
  • $148.5k - $223.9k

    Senior Member of Technical Staff - AI ResearchSkip to main content#Senior Member of Technical Staff - AI Research page is loaded## Senior Member of Technical...  ...reliably.** *Critically evaluate code (Human or AI-...  ...engineering fundamentals (data structures, algorithms,... 
    Data
    Work at office

    Salesforce, Inc.

    Palo Alto, CA
    4 days ago
  • $180k - $230k

     ...Job Description Job Description Member of Technical Staff, Finance Research 1 opening $6 - $8/hr...  ...with a focus on building rigorous evaluation frameworks that measure, benchmark,...  ...evaluation methodologies, synthetic data generation, or model alignment techniques... 
    Data
    Full time
    Local area
    Remote work

    ESRhealthcare and EXEC STAFF RECRUITERS

    Palo Alto, CA
    12 days ago
  • $148.5k - $223.9k

     ...context for designing, constraining, and standardizing AI systems. Critically evaluate code (human or AI-generated) for correctness, quality, security, and performance. Strong fundamentals in data structures, algorithms, and system design; experience building production-... 
    Data

    Salesforce

    Palo Alto, CA
    1 day ago
  • $148.5k - $223.9k

     ...of Salesforce. Salesforce AI Research is looking for a Machine Learning...  ...customers. With your strong technical competence, strategic...  ...help our recruiters assess and evaluate candidates’ resumes and qualifications...  ...how we use your personal data and your rights, including... 
    Data

    salesforce.com, inc.

    Palo Alto, CA
    3 days ago
  • $200k - $300k

     ...Hybrid Department AI Perplexity is seeking top-tier AI Research Scientists and Engineers to advance our AI products and capabilities...  ...models Infrastructure & Implementation Own full-stack data, training, and evaluation pipelines required for model development Build robust... 
    Data
    Full time

    Pantera Capital

    Palo Alto, CA
    4 days ago
  •  ...possible by our cutting edge research and end-to-end system design....  ...reality. We're looking for a Staff / Principal ML Training...  ...evolve parallelism strategies: data / tensor / pipeline / sharding...  ...long-horizon sequences, rollout/evaluation cadence, multimodal and... 
    Data

    Rhoda AI

    Mountain View, CA
    3 days ago
  •  ...possible by our cutting edge research and end‑to‑end system...  ...on web‑scale video data, then adapt them to...  ...levels — from senior to staff — and welcome both...  ...prediction Build systematic evaluations to measure video...  ...are expected to define technical direction and drive research... 
    Data

    Rhoda AI

    Palo Alto, CA
    17 hours ago
  •  ...possible by our cutting edge research and end-to-end system...  ...on internet-scale data and fine-tuning it on...  ...— from senior to staff. What You'll Do Design...  ...robot actions Build evaluation frameworks for post-trained...  ...expected to define technical direction and drive research... 
    Data
    Shift work

    Rhoda AI

    Mountain View, CA
    4 days ago
  • About the Role As a Member of Technical Staff [Platform] at NeoCognition , you’ll...  ...everything we do — from research experiments to product deployments...  ...to ensure that our data, model, and product workflows...  ...management, model experimentation, evaluation, and deployment in both... 
    Data

    NeoCognition Inc.

    Palo Alto, CA
    3 days ago
  •  ...radiology datasets. About the Role As a Member of Technical Staff focused on model training, you will be...  ...role owns how models are trained: how data flows into training, how training jobs...  ..., and scalable. Partner with evaluation engineers to ensure training improvements... 
    Data

    Cognita Imaging Inc.

    Palo Alto, CA
    3 days ago
  •  ...deterministic model behavior. Role As a Member of Technical Staff, Machine Learning, you will build...  ...large‑scale ML behaves outside of research settings. This role is for...  ...and improve ML components across data, training, evaluation, and inference. Fine‑tune and adapt... 
    Data
    Immediate start

    A1

    Palo Alto, CA
    1 day ago
  •  ...paradigms. Born out of Stanford Research, our team blends AI with...  ...You'll Do As a Founding Member of the Technical Staff (Applied AI) at Architect,...  ...: scaffolding, tool use, evaluation harnesses, and the domain-...  ...— curating high-quality data, defining evaluation criteria... 
    Data

    Architect

    Palo Alto, CA
    1 day ago
  • Member of Technical Staff Physical AI (Robotics / World Models) Palo Alto, CA About Orbifold...  ...model companies through rigorous evaluation and curated, real-world data. We work directly with leading robotics and world model research teams on the field's hardest problem... 
    Data
    Shift work

    Bonfirevc

    Palo Alto, CA
    1 day ago
  • $180k

     ...engineers in multimodal mid‑training data. Tech Stack Python JAX and...  ...Develop robust and diverse evaluation for mid‑training checkpoints....  ...interview”) during which a member of our team will ask some...  ...process, which consists of four technical interviews: Coding... 
    Data
    Temporary work
    Relocation

    Pantera Capital

    Palo Alto, CA
    17 hours ago
  • $180k

    Member of Technical Staff - Imagine Safety ABOUT xAI xAI’s mission is to create...  ...safeguards, detection systems, and evaluation frameworks that prevent...  ...in collaboration with researchers, product, and policy teams....  ...model outputs, and training data to continuously improve safety... 
    Data
    Temporary work
    Worldwide

    Maxxd see Tesla

    Palo Alto, CA
    4 days ago
  • $180k

    Member of Technical Staff - Multimodal Understanding About xAI xAI’s mission is...  ...text—spanning the full stack: data curation/acquisition,...  ...alignment, infrastructure/scaling, evaluation, tooling/demos, and end‑to‑...  ...‑art performance. Build research tooling, user‑friendly... 
    Data
    Temporary work

    xAI

    Palo Alto, CA
    4 days ago
  •  ...possible by our cutting edge research and end-to-end system design....  ...a reality. We're looking for Data Infrastructure MLEs to scale the...  ...across levels — from senior to staff. What You'll Do Architect, build...  ...are expected to define technical direction and own architectural... 
    Data
    Immediate start

    Rhoda AI

    Palo Alto, CA
    1 day ago
  •  ...real-world radiology datasets. About the Role As a Member of Technical Staff focused on ML Evaluation, you will be responsible for understanding how well...  ...to collaborate closely with ML engineers and researchers to translate evaluation findings into action. Clear... 

    Cognita Imaging Inc.

    Palo Alto, CA
    3 days ago
  •  ...hardware paradigms. Born out of Stanford Research, our team blends AI with Silicon...  ...Intel. What You'll Do As a Founding Member of the Technical Staff at Architect, you'll be at the...  ...pipelines for model fine-tuning and evaluation, ensuring that theoretical performance... 

    Architect Labs

    Palo Alto, CA
    3 days ago
  • $180k

    Member of Technical Staff - RL Infrastructure About xAI xAI’s mission is to create AI systems...  ...engineers to create robust data pipelines, comprehensive evaluations for benchmarking LLMs, and...  ...to increase the productivity of researchers and engineers. Typical problems... 
    Data
    Temporary work

    xAI

    Palo Alto, CA
    1 day ago
  •  ...handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $400M and are...  ...help researchers move faster Collaborate with training systems, data infrastructure, and research teams to support their platform needs... 
    Data

    Rhoda AI

    Mountain View, CA
    4 days ago
  •  ...handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $400M and are...  ...for collecting, curating, and scaling high-quality robot learning data. This role sits at the intersection of robotics, data collection... 
    Data

    Rhoda AI

    Mountain View, CA
    17 hours ago
  •  ...radiology datasets. About the Role As a Member of Technical Staff in Software Engineering, you will...  ...volumes of structured and unstructured data, including imaging metadata and model...  ...Collaborate closely with ML training, evaluation, and infrastructure teams to integrate... 
    Data

    Cognita Imaging Inc.

    Palo Alto, CA
    4 days ago
  • $220k - $300k

     ...We are looking for a Principal Member of Technical Staff to join our engineering organization as a cross...  ..., async processing pipelines, and data infrastructure. Drive technical strategy...  ...Contributions to open-source security tooling or research. Endor Labs is an Equal Opportunity... 
    Data

    Endor Labs

    Palo Alto, CA
    2 days ago
  •  ...share knowledge with their teammates. About the Role We are seeking a highly skilled Member of Technical Staff to join our team in managing and enhancing reliability across a multi-data center environment. This role focuses on automating processes, building and... 
    Data

    Pantera Capital

    Palo Alto, CA
    2 days ago
  • $180k

     ...with their teammates. About the Team The Data Platform team at X builds and operates the...  ...(“phone interview”) during which a member of our team will ask some basic questions...  ...enter the main process, which consists of 2 technical interviews and 1 project deep‑dive interview... 
    Data
    Temporary work
    Work at office
    Work from home

    Pantera Capital

    Palo Alto, CA
    2 days ago
  • $180k

     ...with their teammates. About the Team The Data Platform team at X builds and operates the...  ...(“phone interview”) during which a member of our team will ask some basic questions...  ...enter the main process, which consists of 2 technical interviews and 1 project deep-dive interview... 
    Data
    Temporary work
    H1b
    Work at office
    Work from home
    Work visa

    Xai

    Palo Alto, CA
    2 days ago
  •  ...largest real‑world radiology datasets. About the Role As a Member of Technical Staff in Data Engineering, you will own the systems and workflows that...  ...data into high‑quality datasets used to train, evaluate, and improve production AI models. Your Impact Build and... 
    Data

    Cognita Imaging Inc.

    Palo Alto, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Member of Technical Staff - Data & Evaluation. Be the first to apply!