Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff, Vision / Language Engineer

Full-time

xdof

About XDOF

Frontier labs are racing to build general-purpose robots, and the bottleneck isn't compute. It's data. At XDOF, we're building the foundation behind the foundation models: the data collection systems, annotation pipelines, exabyte-scale data infrastructure, and software toolchain that enable our partners to push the field forward.

We're hiring a Research Engineer / Scientist to help lead technical efforts at the intersection of vision-language models and robot learning. You will build systems that turn raw egocentric and teleoperation video into high-signal training data for VLA models, and increasingly, contribute to the models themselves.

Beyond pipelines, you will drive research into what makes robot data useful : discovering new metadata (contact events, affordance labels, implicit reward signals, dynamics priors from video) that unlock capabilities current approaches miss. You'll explore how structured annotations can improve cross-embodiment transfer, automatic curriculum generation, and world models that predict what actually matters for manipulation. The data layer isn't downstream of the research. It is the research.

What You'll Do

  • Design and implement vision-language pipelines for egocentric and teleoperation video: structured captioning, temporal grounding, action-conditioned scene understanding, and semantic annotation at scale

  • Develop and evaluate representations that bridge visual perception, language, and low-level robot action — spanning VLAs, video prediction, and world models

  • Build and improve data curation systems that assess quality, diversity, and coverage of large-scale robot demonstration datasets

  • Work hands-on with bimanual and high-DoF manipulation data, including real teleoperation footage and sim-generated rollouts

  • Collaborate directly with partner labs to define data requirements and close the loop between data quality and downstream policy performance

  • Stay current on the research frontier (VLAs, video foundation models, flow matching, DiT architectures, egocentric pretraining) and translate insights into production systems

Required:

  • MS or PhD in Computer Science, Robotics, Machine Learning, or a related field from a top-tier program

  • 3–7 years of research or applied research experience (industry or academic) in one or more of: vision-language models, video understanding, robot learning, or generative modeling

  • Deep fluency in PyTorch; working knowledge of large-scale training infrastructure (distributed training, mixed precision, large batch workflows)

  • Published work or demonstrable impact in VLMs/VLAs, video representation learning, imitation learning, or a closely related area

  • Strong engineering fundamentals — you can design clean systems, not just run experiments

Benefits

  • Competitive compensation and equity

  • Comprehensive health and wellness benefits

  • Flexible work arrangements

  • Collaborative and fast-paced work environment

  • Opportunity to shape the future of robotics and AI alongside an ambitious, values-driven team

Level: Mid Level to Senior Research Scientist (L4–L5 equivalent) Location: San Mateo

Note: Junior candidates will still be considered

If you’re excited to help build the infrastructure powering tomorrow’s intelligent machines, we’d love to hear from you!

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff, Vision / Language Engineer in San Mateo, CA vacancy
  •  ...just shipped Fireworks Nexus: a drop-in platform that lets engineering organizations route their AI workloads off expensive...  ...We're looking for a product-minded engineer to join as a Member of Technical Staff, Nexus , and own the surfaces that make this real: the intelligent... 
    Suggested
    Full time

    Fireworks AI

    San Mateo, CA
    8 days ago
  •  ...enterprise AI. The Role:  We're looking for a Software Engineer focused on Performance Optimization to help push the...  ...performance of our most demanding workloads, including large language models (LLMs), vision-language models (VLMs), and next-generation video models.... 
    Suggested
    Full time

    fireworks

    San Mateo, CA
    4 days ago
  • $200k - $350k

     ...quality. We are the AI researchers and engineers behind such breakthrough AI technologies...  ...with deep expertise in post-training large language models through reinforcement learning....  ...time off (PTO) ~ Health, dental, and vision insurance ~401k match ~ Catered meals... 
    Suggested
    Full time
    Immediate start
    Flexible hours

    Inception Labs

    San Mateo, CA
    8 days ago
  •  ...Research Engineer At XDOF, we’re at an inflection point. Frontier labs are racing to build general-purpose robots, and high-quality...  ...constraints matter have experience with perception, computer vision, or robotics systems have optimized model inference for deployment... 
    Suggested
    Full time

    xdof

    San Mateo, CA
    4 days ago
  •  ...We hire new grads into teams across Engineering, and we match you to a team based on your...  ...Computer Science, Engineering, or a related technical field, completed within the last 6...  ...Go, Rust, TypeScript, or a comparable language Fluency with AI coding harnesses and... 
    Suggested
    Full time
    Summer work
    Internship

    Fireworks AI

    San Mateo, CA
    8 days ago
  •  ...data. We’re looking for a Robotics Data Engineer to be the person who knows whether our data...  ...taxonomy so the team has a common language for data issues working closely with...  ...data visualization tools or dashboards for technical teams have worked on data versioning,... 
    Full time

    xdof

    San Mateo, CA
    4 days ago
  •  ...enterprise AI. The Role: As a Software Engineer on our AI Infrastructure team, you will...  ...Participate in code reviews, technical discussions, and continuous integration...  ...programming skills in Python, Go, or a similar language ~ Proven experience in ML infrastructure... 
    Full time

    Fireworks AI

    San Mateo, CA
    8 days ago
  •  ...data warehouse, and model evaluation platform – to help our partners drive the field forward. We’re hiring generalist software engineers who can work across our robotics platform. Your work could touch anything from our low-level data collection systems, our simulation... 
    Full time

    xdof

    San Mateo, CA
    4 days ago
  • $180k - $230k

     ...Job Description Job Description Member of Technical Staff, ML Systems Company: Confidential —...  ...models. Today's stack was built for language models; the client is rebuilding it for...  ...Role The client is hiring ML systems engineers to own speed and efficiency across... 
    Full time
    H1b
    Work at office
    Visa sponsorship

    TensorScale

    Menlo Park, CA
    3 days ago
  • $500 per month

     ...GC AI is hiring a Staff Product Manager to own...  ...will work directly with Engineering, Sales, and R&D Attorneys...  ...actually adopted. Technically deep. You can walk an...  ...distributed company with team members across North America,...  ...Medical, Dental & Vision — Comprehensive... 
    Remote job
    Permanent employment
    Full time
    Currently hiring
    Work at office
    Immediate start
    Home office
    Relocation package
    Shift work

    gc-ai

    San Mateo, CA
    4 days ago
  •  ...enterprise AI. The Role: As a Member of Technical Staff on the Research team, you’ll push the...  ...optimization techniques Collaborate with engineering teams to transition research...  ...coding in C/C++, Python, or other similar languages Preferred Qualifications: PhD... 
    Remote job
    Full time
    Work experience placement
    Internship

    fireworks

    San Mateo, CA
    4 days ago
  •  ...truth generation Research and apply vision-based pose estimation methods (markerless...  ...sensor dropouts Collaborate with ML engineers and data infrastructure teams to ensure...  ...Direct involvement in the most critical technical challenge in embodied intelligence: producing... 
    Remote job
    Full time

    xdof

    San Mateo, CA
    4 days ago
  •  ...building the future of enterprise AI. We are seeking a Member of Technical Staff, Evals & Post-Training Product to help define how...  ...Minimum Requirements Experience: 1–7 years of software engineering or data science experience (We are hiring at multiple levels... 
    Remote job
    Full time

    fireworks

    San Mateo, CA
    4 days ago
  •  ...run on real fleets at real scale. As a Member of Technical Staff on the Systems Infrastructure team,...  ...You'll be paired with a senior engineer as a mentor and given a real problem...  ...skills in C/C++, Rust, Go, or a similar language, plus working proficiency in Python... 
    Remote job
    Full time
    Internship
    Local area
    Flexible hours

    fireworks

    San Mateo, CA
    4 days ago
  •  ...making and intelligent risk management. We’re looking for a Member of Technical Staff (Machine Learning) to build the models, signals, and...  ...Benefits We offer excellent medical, dental, and vision coverage, alongside a strong benefits package that includes... 
    Remote job
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    poesis

    Menlo Park, CA
    4 days ago
  •  ...construction and trading decisions. As a Member of Technical Staff, you'll build the systems that...  ...signals through trading. Solve complex engineering challenges around reliability,...  ...offer excellent medical, dental, and vision coverage, alongside a strong benefits... 
    Remote job
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    poesis

    Menlo Park, CA
    4 days ago
  •  ...The Role We are looking for a Member of Technical Staff, Data Platform to design and maintain...  ...will ensure that domain-specific data engineers can build the pipelines our business...  ...Proficiency in Python (or a similar language) for building data tooling and automation... 
    Remote job
    Full time

    fireworks

    San Mateo, CA
    4 days ago
  •  ...for an experienced software engineer to help lead our agentic efforts...  ...in investing and shape the technical direction of our agent platform...  ...medical, dental, and vision coverage, alongside a strong...  ...at Poesis As an early team member, you’ll help shape not just the... 
    Remote job
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    poesis

    Menlo Park, CA
    4 days ago
  •  ...AI. THE ROLE We are seeking a Member of Technical Staff, Data to build business-critical data...  ...business teams and with our data platform engineers to design thoughtful data models,...  ...Proficiency in Python or similar languages. Experience with Google BigQuery.... 
    Remote job
    Full time
    Work at office

    fireworks

    San Mateo, CA
    4 days ago
  •  ...keeping all of it auditable while the platform grows fast. As Member of Technical Staff, Cloud & Infrastructure Security, you own the cloud,...  ...posture and to make secure-by-default the easy path for every engineer here. Key Responsibilities: Design and build... 
    Remote job
    Full time

    fireworks

    San Mateo, CA
    4 days ago
  •  ...for a Full Stack Software Engineering to architect, build, and scale...  ...) and shape our end-to-end technical architecture. This role...  ...thousands of developers and product vision. You will be directly...  ...working with modern backend languages (e.g., Node.js, Python, Go).... 
    Remote job
    Full time

    fireworks

    San Mateo, CA
    4 days ago
  • $180k - $300k

     ...DatologyAI Research Engineer As a Research Engineer, you will play a crucial...  .... You will work closely with other members of the technical staff to develop and improve state-of-the...  ...pipelines that operate over massive language, vision, and multimodal datasets, and make... 
    Work at office
    Work from home
    Relocation package

    Datology

    San Mateo, CA
    2 days ago
  •  ...Job Description Job Description Member of Technical Staff - Biological Engineering, ML, or Lab System About the role Acelegen combines biology, AI...  ...automation, instrument integration, AI agents, computer vision, or multimodal systems. Familiarity with wet-lab... 

    Acelegen

    Menlo Park, CA
    6 days ago
  •  ...team brings together researchers and engineers across AI and biology, commercializing...  ...excellence. What you’ll do as a Member of Technical Staff – Product Engineering at Phylo:...  ...discovery ~ Full medical, dental, and vision coverage, including free therapy sessions... 
    Full time
    Work at office

    phylo

    South San Francisco, CA
    4 days ago
  •  ...We’re looking for an exceptional Member of Technical Staff (Quantitative Finance) to work alongside...  ...our CEO, Chief Scientist, and AI and engineering teams on the quantitative systems behind...  ...offer excellent medical, dental, and vision coverage, alongside a strong benefits... 
    Remote job
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    poesis

    Menlo Park, CA
    4 days ago
  •  ...team brings together researchers and engineers across AI and biology,...  ...the rest. What you’ll do as a Member of Technical Staff - Forward Deployed Scientist at Phylo...  ...genomic foundation models, protein language models, or vision models for pathology/imaging. Depth... 
    Full time
    Work at office

    phylo

    South San Francisco, CA
    4 days ago
  •  ...Description We are seeking a talented Humanoid Engineer to join our team to design, develop, and...  .... ~ Proficiency in programming languages commonly used in robotics (e.g., C++,...  ...and stock options Health, dental, and vision insurance Flexible work environment... 
    Remote job
    Full time
    Flexible hours

    xdof

    San Mateo, CA
    4 days ago
  •  ...research is done. Our team brings together engineers, AI researchers, and scientists to...  ...discovery. What you’ll do as a Member of Technical Staff - Agent Engineer at Phylo: Advance...  ...~ Full medical, dental, and vision coverage, including free therapy sessions... 
    Full time
    Work at office

    phylo

    South San Francisco, CA
    4 days ago
  •  ...You'll be joining a highly technical founding team, including leading researchers and engineers from Google DeepMind/Brain and...  ...Microsoft who pioneered research in language models, shipped GenAI products...  ...Comprehensive Medical/Dental/Vision insurance for you and... 
    Full time
    Work at office
    Local area

    compound%20jobs

    San Mateo, CA
    4 days ago
  •  ...scheduling, kernel and runtime performance, networking, storage, Linux. We serve over 40 trillion tokens a day doing it. Reliability Engineering makes sure that platform runs dependably as it grows. You will work across cloud infrastructure, AI systems, and product teams to... 
    Remote job
    Full time

    fireworks

    San Mateo, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff, Vision / Language Engineer. Be the first to apply!