Member of Technical Staff: Policy Evaluation & Experiment Infrastructure
Walden Robotics
Position Summary You will build the tooling that lets the autonomy team measure whether our robot policies are actually getting better—in simulation and on real hardware. This is a high-leverage engineering role at the center of the research loop, close to real robot behavior, with strong mentorship and room to grow quickly alongside senior engineers. Position Summary You will build the tooling that lets the autonomy team measure whether our robot policies are actually getting better—in simulation and on real hardware. This is a high-leverage engineering role at the center of the research loop, close to real robot behavior, with strong mentorship and room to grow quickly alongside senior engineers. Core Responsibilities Policy Evaluation: Build and maintain the pipelines that evaluate robot policies—in sim and on hardware—and the experiment-tracking tooling the team uses daily. Metrics for Robot Behavior: Implement task-success metrics, dashboards, and automated checks that turn messy robot rollouts into trustworthy, comparable signal. Iteration Speed: Improve the speed and reliability of the experiment loop so researchers can evaluate policies faster. Debugging: Track down issues across the evaluation stack and in policy rollouts—from flaky jobs to misleading metrics to surprising robot behavior. Growth: Learn the autonomy stack alongside senior engineers and take on growing ownership. Required Qualifications Software Fundamentals: Solid engineering fundamentals and a bias toward building reliable, well-tested tooling. Robot Policies: Hands-on experience working with robot policies or robotic systems—running, evaluating, or debugging them (research, projects, or industry). ML Systems Interest: Genuine interest in ML systems and evaluation, and enthusiasm for working where research meets real robots. Delivery: The ability to take a well-scoped problem and deliver it end to end. Curiosity & Drive: Eagerness to learn quickly from feedback and code review. Preferred Qualifications Experience evaluating or benchmarking robot policies in simulation or on hardware. Exposure to ML experimentation, evaluation, or data pipelines. Familiarity with Python and with cloud or compute infrastructure. Walden Robotics offers a competitive total compensation program, including salary, annual cash bonus, company equity, company-subsidized insurance programs, 401(k) with company match, flexible PTO, daily lunch, and other benefits. The pay ranges noted on our posts are for salary only. Walden Robotics is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to View email address on click.appcast.io. Walden Robotics participates in E-Verify. If you receive an offer of employment from Walden, you will need to go through the E-Verify process of digital verification of your employment authorization documents as provided on the Form I-9. Participation in E-Verify does not limit your right to work and verification will only be completed after you become At Walden Robotics, we envision a world where general-purpose robots dramatically improve the quality of life for all people—supporting us at home, at work, in factories, on farms, and beyond. To accomplish this, we are building a team of exceptional professionals who combine world-class technical skills with creative vision, grounded in humility and collaboration. #J-18808-Ljbffr Walden Robotics
- ...building, and scaling core infrastructure that powers a high-... ...are looking for team members who love building... ...looking for folks with experience managing cloud... ...inference workloads, evaluation pipelines, observability... ...Unlimited paid time off policy Daily catered lunch...PolicyWork at office
$200k - $400k
...product, a campaign, a policy, or a script — the... ...We're building the infrastructure to understand human... ...distributed training, evaluation, serving, and... ...About the Role As a Member of Technical Staff in Research Infrastructure... ...feature generation, experiment tracking, training orchestration...PolicyLive inFlexible hours$200k - $400k
...Rauch. About the Role As a Member of Technical Staff in Evaluations Engineering, you will... ...across data and evaluation infrastructure, evaluation execution... ...Fundamentals: Several years of experience building and maintaining... ...Off: Flexible time off policies to support work-life...PolicyFlexible hours- ...Overview Reflection.AI is looking for a Member of Technical Staff - Infrastructure Security to secure our... ...auditable Kubernetes authorization policy enforcement Automate monitoring and... ...workloads Required Qualifications Deep experience securing Kubernetes clusters and...PolicyFull timeRelocation package
$200k - $400k
...Guillermo Rauch. About the Role As a Member of Technical Staff, Model Evaluations at Simile, you will build the... ...intervention response, first‑party experiments, and eventually multi‑agent group... ...coverage. Time Off: Flexible time off policies to support work‑life balance. Our...PolicyFlexible hours$160k - $220k
...building the simulation, evaluation, and observability... ...AI agents — the infrastructure that makes conversational... ...The Role As a Member of Technical Staff, you\'ll architect and... ...professional engineering experience A high technical bar... ...Francisco, CA Work policy — Fully on-site, 5...PolicyFull time$300k
Member of Technical Staff - Mechanistic Interpretability About V max... ...objectives. Develop infrastructure for reproducible, large-scale experiments on LLM agents, interpretability... ..., baselines, evaluation design, and failure... ...Role specific location policy This role is based in...PolicyWork at officeLocal area- Level: Senior-level (5+ years experience) Location: SF Bay Area... ...Runta Runta builds runtime infrastructure that lets AI agents execute... ...infrastructure roadmap as an early technical leader, working directly... ...for 10 minutes. Autoscaling policies tuned for web traffic fall over...PolicyLocal area
- ...Mandolin is laying the clinical and financial infrastructure to get groundbreaking treatments to... ...on GCP. Establish autoscaling policies, HA networking, and cost-efficient environments... ...and alerting. Streamline developer experience. Provide dev-containers, local-env scripts...PolicyLocal area
$160k - $220k
Bluejay — Member of Technical Staff Type: Full-time | On-site | San... ...they built critical infrastructure for MSFT Copilot and... ...Bluejay builds the evaluation infrastructure to make... ...1+ years of experience (JD body references... ...Competitive On-site policy — Fully on‑site, SF,...PolicyFull time- ...and scalable simulation infrastructure used to train the next... ...We are looking for a Member of Technical Staff - Robotics to help... ...full robotics stack-from evaluating foundation models and policies in simulation, to training... ..., or related fields Experience working with physical...Policy
- Member of Technical Staff, Applied AI The opportunity We are looking... ...ML researcher with experience in generative... ...unique data challenges, evaluation paradigms and... ...and model-serving infrastructure. Adapt and fine-tune... ...contributions Generous leave policies (including gender...PolicyFlexible hours
$225k - $300k
Bluejay - Senior Member of Technical Staff Type: Full-time | On-site... ...they built critical infrastructure for MSFT Copilot and... ...observability, and evaluation infrastructure to... ...SWE Technical lead experience owning projects end... ...Competitive On-site policy - 5 days/week in person...PolicyFull timeWork at office- Member of Technical Staff, Applied AI Research San Francisco, CA... ...more personalized experiences for our customers,... ...agent environments and evaluation methods, design... ...developing platform and infrastructure capabilities to... ...Candidate Privacy Policy and applicable state...PolicyHourly payWork at officeLocal areaImmediate startFlexible hours
- Job Title Member of Technical Staff, Applied Research Salary Not Disclosed + Equity... ...Well-funded AI infrastructure startup Job Description Join... ...benchmarking frameworks to evaluate model performance across diverse... ...candidate 3-7 years of experience in ML engineering or applied...
$200k - $350k
Member of Technical Staff, LLM Evaluation Infra Bay Area Research In office Full-time Inception creates the... ...scientists to develop the evaluation infrastructure and systems that drive frontier... ...a related field (or equivalent experience). At least 2 years of experience...Full timeWork at officeImmediate startFlexible hours- ...Germany and Paris. Join us! Why this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring... ...models (LLMs) on distributed training infrastructures. Conduct experiments to evaluate model performance and identify...Full timeWork at officeLocal areaRemote workHome office
$200k - $400k
...product, a campaign, a policy, or a script — the... ...We're building the infrastructure to understand human... ...About the Role As a Member of Technical Staff (MTS) in Research, you... ...the stack to train, evaluate, deploy, and monitor... ...the initial experiments and validating results...PolicyFlexible hours- ...As a Member of Technical Staff (MTS), you'll build production-grade systems that power continuous optimization loops for AI agents—from evaluation pipelines and data/trace infrastructure to APIs that deploy improved policies. This role is a blend of MLE + backend engineering...Policy
$256k - $276k
...The Opportunity As a Member of Technical Staff and AI Agent... ...scientists on scalable experiments and productize research... ...collaboration and innovation. Evaluate new tools,... ...Partner with product and policy teams to align AI... ...design and cloud infrastructure. Passion for AI safety...PolicyWork at officeFlexible hours3 days per week$120k - $300k
...The Role A backend-leaning Member of Technical Staff building the end-to-end... ...workflows — high-performance infrastructure, reliability, and backend... .... Requirements Experience with backend development and... ...San Francisco, CA Work policy — On-site Compensation...PolicyFull timeH1bVisa sponsorship$140k - $225k
...Tools / AEC The Role A Member of Technical Staff owning agent engineering... ...broader AEC ecosystem Evaluation harnesses to determine whether... ...agent-engineering experience — context-window design, tool... ...Salesforce Tower) Work policy — On-site, 5 days/week...PolicyFull timeH1bWork at officeVisa sponsorship$225k - $300k
...simulation, observability, and evaluation layer for Voice AI agents — the infrastructure that lets companies... ...aligned Leading the technical execution of projects... ...6 years of engineering experience at a senior level... ...Francisco, CA Work policy — On-site, 5 days/week...PolicyFull timeWork at office$250k
...: AI Tools The Role A Member of Technical Staff who can handle everything... ...engineering or ML frameworks Experience building and deploying... ..., APIs, and cloud infrastructure (AWS, GCP) Experience with... ...San Francisco, CA Work policy — On-site Compensation...PolicyFull timeH1bVisa sponsorship- ...industry's leading security infrastructure. Home to Anchorage... ..., we have a security policy mandating all new... ...in 4 major areas: Technical Skills:... ...years of professional experience with Go. Have experience... ...team of more than 600 members, we are united in one...PolicyFull time
$185k - $255k
Member of Technical Staff - Reinforcement Learning Optimized deploys AI agents... ...models, training loops, and evaluations that turn raw model... ...PhD or equivalent research experience in RL, ML, or a related field... ...Understand reward modeling, policy optimization, and...Policy- ...company-building, with each member having previously... .... Design and run experiments and prototypes to validate... ...novel hypotheses. Define evaluation methodologies and... ...practical systems. Act as the technical lead for this research... ...such as RLHF and policy optimization. Comfort...Policy
$150k - $350k
Sieve — Member of Technical Staff, Applied Research Type: Full-time | On-site... ...combining exabyte-scale video infrastructure, novel video understanding... ...Requirements 3+ years of experience in computer vision or... ...Equity 0.05%-0.4% On‑site policy In‑person at SF HQ Visa sponsorship...PolicyFull timeWork experience placementH1bWork at officeVisa sponsorship- ...and operate large-scale GPU infrastructure for high-throughput model inference... ...capable of serving and evaluating models across thousands of... ...generation, evaluation, and policy improvement loops. Work closely... ...compute systems. Ideal Experience Experience deploying and operating...PolicyRelocation package
- ...deployment is what wins. Role: Member of Technical Staff, Research Why this role... ..., foundation models, and policies that ship at customer... ...-robot deployment. Build infrastructure for large scale data collection... ...industry depth. Experience. 3+ years combined graduate...PolicyFull timeRelocation packageShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member of Technical Staff: Policy Evaluation & Experiment Infrastructure. Be the first to apply!
- life support technician San Francisco, CA
- personal computer support technician San Francisco, CA
- systems support technician San Francisco, CA
- technical support analyst San Francisco, CA
- user support analyst San Francisco, CA
- help desk technical support San Francisco, CA
- senior technical analyst San Francisco, CA
- technical support specialist San Francisco, CA
- IT assistant San Francisco, CA
- help desk assistant San Francisco, CA


