Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff: Policy Evaluation & Experiment Infrastructure

Walden Robotics

Position Summary You will build the tooling that lets the autonomy team measure whether our robot policies are actually getting better—in simulation and on real hardware. This is a high-leverage engineering role at the center of the research loop, close to real robot behavior, with strong mentorship and room to grow quickly alongside senior engineers. Position Summary You will build the tooling that lets the autonomy team measure whether our robot policies are actually getting better—in simulation and on real hardware. This is a high-leverage engineering role at the center of the research loop, close to real robot behavior, with strong mentorship and room to grow quickly alongside senior engineers. Core Responsibilities Policy Evaluation: Build and maintain the pipelines that evaluate robot policies—in sim and on hardware—and the experiment-tracking tooling the team uses daily. Metrics for Robot Behavior: Implement task-success metrics, dashboards, and automated checks that turn messy robot rollouts into trustworthy, comparable signal. Iteration Speed: Improve the speed and reliability of the experiment loop so researchers can evaluate policies faster. Debugging: Track down issues across the evaluation stack and in policy rollouts—from flaky jobs to misleading metrics to surprising robot behavior. Growth: Learn the autonomy stack alongside senior engineers and take on growing ownership. Required Qualifications Software Fundamentals: Solid engineering fundamentals and a bias toward building reliable, well-tested tooling. Robot Policies: Hands-on experience working with robot policies or robotic systems—running, evaluating, or debugging them (research, projects, or industry). ML Systems Interest: Genuine interest in ML systems and evaluation, and enthusiasm for working where research meets real robots. Delivery: The ability to take a well-scoped problem and deliver it end to end. Curiosity & Drive: Eagerness to learn quickly from feedback and code review. Preferred Qualifications Experience evaluating or benchmarking robot policies in simulation or on hardware. Exposure to ML experimentation, evaluation, or data pipelines. Familiarity with Python and with cloud or compute infrastructure. Walden Robotics offers a competitive total compensation program, including salary, annual cash bonus, company equity, company-subsidized insurance programs, 401(k) with company match, flexible PTO, daily lunch, and other benefits. The pay ranges noted on our posts are for salary only. Walden Robotics is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to View email address on click.appcast.io. Walden Robotics participates in E-Verify. If you receive an offer of employment from Walden, you will need to go through the E-Verify process of digital verification of your employment authorization documents as provided on the Form I-9. Participation in E-Verify does not limit your right to work and verification will only be completed after you become At Walden Robotics, we envision a world where general-purpose robots dramatically improve the quality of life for all people—supporting us at home, at work, in factories, on farms, and beyond. To accomplish this, we are building a team of exceptional professionals who combine world-class technical skills with creative vision, grounded in humility and collaboration. #J-18808-Ljbffr Walden Robotics

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff: Policy Evaluation & Experiment Infrastructure in San Francisco, CA vacancy
  •  ...building, and scaling core infrastructure that powers a high-...  ...are looking for team members who love building...  ...looking for folks with experience managing cloud...  ...inference workloads, evaluation pipelines, observability...  ...Unlimited paid time off policy Daily catered lunch... 
    Policy
    Work at office

    LlamaIndex, Inc.

    San Francisco, CA
    4 days ago
  • $200k - $400k

     ...product, a campaign, a policy, or a script — the...  ...We're building the infrastructure to understand human...  ...distributed training, evaluation, serving, and...  ...About the Role As a Member of Technical Staff in Research Infrastructure...  ...feature generation, experiment tracking, training orchestration... 
    Policy
    Live in
    Flexible hours

    Simile

    San Francisco, CA
    5 days ago
  • $200k - $400k

     ...Rauch. About the Role As a Member of Technical Staff in Evaluations Engineering, you will...  ...across data and evaluation infrastructure, evaluation execution...  ...Fundamentals: Several years of experience building and maintaining...  ...Off: Flexible time off policies to support work-life... 
    Policy
    Flexible hours

    Simile

    San Francisco, CA
    3 days ago
  •  ...Overview Reflection.AI is looking for a Member of Technical Staff - Infrastructure Security to secure our...  ...auditable Kubernetes authorization policy enforcement Automate monitoring and...  ...workloads Required Qualifications Deep experience securing Kubernetes clusters and... 
    Policy
    Full time
    Relocation package

    aijoblist

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...Guillermo Rauch. About the Role As a Member of Technical Staff, Model Evaluations at Simile, you will build the...  ...intervention response, first‑party experiments, and eventually multi‑agent group...  ...coverage. Time Off: Flexible time off policies to support work‑life balance. Our... 
    Policy
    Flexible hours

    Simile

    San Francisco, CA
    2 days ago
  • $160k - $220k

     ...building the simulation, evaluation, and observability...  ...AI agents — the infrastructure that makes conversational...  ...The Role As a Member of Technical Staff, you\'ll architect and...  ...professional engineering experience A high technical bar...  ...Francisco, CA Work policy — Fully on-site, 5... 
    Policy
    Full time

    David Joseph & Company

    San Francisco, CA
    4 days ago
  • $300k

    Member of Technical Staff - Mechanistic Interpretability About V max...  ...objectives. Develop infrastructure for reproducible, large-scale experiments on LLM agents, interpretability...  ..., baselines, evaluation design, and failure...  ...Role specific location policy This role is based in... 
    Policy
    Work at office
    Local area

    Vmax

    San Francisco, CA
    4 days ago
  • Level: Senior-level (5+ years experience) Location: SF Bay Area...  ...Runta Runta builds runtime infrastructure that lets AI agents execute...  ...infrastructure roadmap as an early technical leader, working directly...  ...for 10 minutes. Autoscaling policies tuned for web traffic fall over... 
    Policy
    Local area

    Runta

    San Francisco, CA
    18 hours ago
  •  ...Mandolin is laying the clinical and financial infrastructure to get groundbreaking treatments to...  ...on GCP. Establish autoscaling policies, HA networking, and cost-efficient environments...  ...and alerting. Streamline developer experience. Provide dev-containers, local-env scripts... 
    Policy
    Local area

    Mandolin

    San Francisco, CA
    3 days ago
  • $160k - $220k

    Bluejay — Member of Technical Staff Type: Full-time | On-site | San...  ...they built critical infrastructure for MSFT Copilot and...  ...Bluejay builds the evaluation infrastructure to make...  ...1+ years of experience (JD body references...  ...Competitive On-site policy — Fully on‑site, SF,... 
    Policy
    Full time

    davidjoseph-co

    San Francisco, CA
    5 days ago
  •  ...and scalable simulation infrastructure used to train the next...  ...We are looking for a Member of Technical Staff - Robotics to help...  ...full robotics stack-from evaluating foundation models and policies in simulation, to training...  ..., or related fields Experience working with physical... 
    Policy

    Moonlake AI

    San Francisco, CA
    1 day ago
  • Member of Technical Staff, Applied AI The opportunity We are looking...  ...ML researcher with experience in generative...  ...unique data challenges, evaluation paradigms and...  ...and model-serving infrastructure. Adapt and fine-tune...  ...contributions Generous leave policies (including gender... 
    Policy
    Flexible hours

    Latent Labs

    San Francisco, CA
    1 day ago
  • $225k - $300k

    Bluejay - Senior Member of Technical Staff Type: Full-time | On-site...  ...they built critical infrastructure for MSFT Copilot and...  ...observability, and evaluation infrastructure to...  ...SWE Technical lead experience owning projects end...  ...Competitive On-site policy - 5 days/week in person... 
    Policy
    Full time
    Work at office

    davidjoseph-co

    San Francisco, CA
    5 days ago
  • Member of Technical Staff, Applied AI Research San Francisco, CA...  ...more personalized experiences for our customers,...  ...agent environments and evaluation methods, design...  ...developing platform and infrastructure capabilities to...  ...Candidate Privacy Policy and applicable state... 
    Policy
    Hourly pay
    Work at office
    Local area
    Immediate start
    Flexible hours

    DoorDash USA

    San Francisco, CA
    1 day ago
  • Job Title Member of Technical Staff, Applied Research Salary Not Disclosed + Equity...  ...Well-funded AI infrastructure startup Job Description Join...  ...benchmarking frameworks to evaluate model performance across diverse...  ...candidate 3-7 years of experience in ML engineering or applied... 

    Jack & Jill

    San Francisco, CA
    1 day ago
  • $200k - $350k

    Member of Technical Staff, LLM Evaluation Infra Bay Area Research In office Full-time Inception creates the...  ...scientists to develop the evaluation infrastructure and systems that drive frontier...  ...a related field (or equivalent experience). At least 2 years of experience... 
    Full time
    Work at office
    Immediate start
    Flexible hours

    Inception

    San Francisco, CA
    4 days ago
  •  ...Germany and Paris. Join us! Why this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring...  ...models (LLMs) on distributed training infrastructures. Conduct experiments to evaluate model performance and identify... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    San Francisco, CA
    18 hours ago
  • $200k - $400k

     ...product, a campaign, a policy, or a script — the...  ...We're building the infrastructure to understand human...  ...About the Role As a Member of Technical Staff (MTS) in Research, you...  ...the stack to train, evaluate, deploy, and monitor...  ...the initial experiments and validating results... 
    Policy
    Flexible hours

    Simile

    San Francisco, CA
    5 days ago
  •  ...As a Member of Technical Staff (MTS), you'll build production-grade systems that power continuous optimization loops for AI agents—from evaluation pipelines and data/trace infrastructure to APIs that deploy improved policies. This role is a blend of MLE + backend engineering... 
    Policy

    VizopsAI

    San Francisco, CA
    4 days ago
  • $256k - $276k

     ...The Opportunity As a Member of Technical Staff and AI Agent...  ...scientists on scalable experiments and productize research...  ...collaboration and innovation. Evaluate new tools,...  ...Partner with product and policy teams to align AI...  ...design and cloud infrastructure. Passion for AI safety... 
    Policy
    Work at office
    Flexible hours
    3 days per week

    Visa Hunt

    San Francisco, CA
    5 days ago
  • $120k - $300k

     ...The Role A backend-leaning Member of Technical Staff building the end-to-end...  ...workflows — high-performance infrastructure, reliability, and backend...  .... Requirements Experience with backend development and...  ...San Francisco, CA Work policy — On-site Compensation... 
    Policy
    Full time
    H1b
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    27 days ago
  • $140k - $225k

     ...Tools / AEC The Role A Member of Technical Staff owning agent engineering...  ...broader AEC ecosystem Evaluation harnesses to determine whether...  ...agent-engineering experience — context-window design, tool...  ...Salesforce Tower) Work policy — On-site, 5 days/week... 
    Policy
    Full time
    H1b
    Work at office
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    26 days ago
  • $225k - $300k

     ...simulation, observability, and evaluation layer for Voice AI agents — the infrastructure that lets companies...  ...aligned Leading the technical execution of projects...  ...6 years of engineering experience at a senior level...  ...Francisco, CA Work policy — On-site, 5 days/week... 
    Policy
    Full time
    Work at office

    David Joseph & Company

    San Francisco, CA
    10 days ago
  • $250k

     ...: AI Tools The Role A Member of Technical Staff who can handle everything...  ...engineering or ML frameworks Experience building and deploying...  ..., APIs, and cloud infrastructure (AWS, GCP) Experience with...  ...San Francisco, CA Work policy — On-site Compensation... 
    Policy
    Full time
    H1b
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    26 days ago
  •  ...industry's leading security infrastructure. Home to Anchorage...  ..., we have a security policy mandating all new...  ...in 4 major areas: Technical Skills:...  ...years of professional experience with Go. Have experience...  ...team of more than 600 members, we are united in one... 
    Policy
    Full time

    Anchorage Digital

    San Francisco, CA
    4 days ago
  • $185k - $255k

    Member of Technical Staff - Reinforcement Learning Optimized deploys AI agents...  ...models, training loops, and evaluations that turn raw model...  ...PhD or equivalent research experience in RL, ML, or a related field...  ...Understand reward modeling, policy optimization, and... 
    Policy

    Optimized, Inc.

    San Francisco, CA
    4 days ago
  •  ...company-building, with each member having previously...  .... Design and run experiments and prototypes to validate...  ...novel hypotheses. Define evaluation methodologies and...  ...practical systems. Act as the technical lead for this research...  ...such as RLHF and policy optimization. Comfort... 
    Policy

    Enam, Inc.

    San Francisco, CA
    4 days ago
  • $150k - $350k

    Sieve — Member of Technical Staff, Applied Research Type: Full-time | On-site...  ...combining exabyte-scale video infrastructure, novel video understanding...  ...Requirements 3+ years of experience in computer vision or...  ...Equity 0.05%-0.4% On‑site policy In‑person at SF HQ Visa sponsorship... 
    Policy
    Full time
    Work experience placement
    H1b
    Work at office
    Visa sponsorship

    davidjoseph-co

    San Francisco, CA
    5 days ago
  •  ...and operate large-scale GPU infrastructure for high-throughput model inference...  ...capable of serving and evaluating models across thousands of...  ...generation, evaluation, and policy improvement loops. Work closely...  ...compute systems. Ideal Experience Experience deploying and operating... 
    Policy
    Relocation package

    Reflection

    San Francisco, CA
    3 days ago
  •  ...deployment is what wins. Role: Member of Technical Staff, Research Why this role...  ..., foundation models, and policies that ship at customer...  ...-robot deployment. Build infrastructure for large scale data collection...  ...industry depth. Experience. 3+ years combined graduate... 
    Policy
    Full time
    Relocation package
    Shift work

    Industrial Next (YC W22)

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff: Policy Evaluation & Experiment Infrastructure. Be the first to apply!