Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer, Reinforcement Learning (Palo Alto)

$130k - $250k
Full-time

1X

Join to apply for the Research Engineer, Reinforcement Learning role at 1X

Join to apply for the Research Engineer, Reinforcement Learning role at 1X

Target start date: Immediately. Relocation provided.

Since its founding in 2015, 1X has been at the forefront of developing advanced humanoid robots designed for household use. Our mission is to create an abundant supply of labor via safe, intelligent humanoids. At 1X, you’ll own critical projects, tackle unsolved research problems, deliver great products to customers, and be rewarded based on merit and achievement.

We are looking for a Research Engineer in Reinforcement Learning (RL). In this role, you will teach NEO to learn new capabilities via RL algorithms. This enables our robots to be safe and robust in a variety of conditions.

Responsibilities

  • Full-stack engineering, from data engineering to model architecture design to shipping polished products
  • Train NEO to do a diverse set of manipulation and locomotion tasks.
  • Close the sim2real gap between policies trained in simulation and real.
  • Work with controls, QA, and data collection teams to ship RL policies to the production fleet.
  • Deploy skills trained with RL into home environments
  • Getting general-purpose robots to work in the home is just about the hardest problem one can work on. We are looking for people with the courage to tackle unsolved technical challenges with an intense work ethic.
  • 4+ years of Python programming experience.
  • Strong empirical research abilities and a keen eye for spotting performance bottlenecks in RL training.
  • Experience with tuning reward functions, hyperparameters and exploration strategies to solve complex tasks with deep RL.
  • Experience with authoring environments and benchmarks in simulators like Mujoco, Pybullet, or Isaac Sim.

Nice to have

  • Advanced degree (MS or PhD) in Computer Science or related field
  • Published RL research in top ML conferences (NeurIPS, CoRL, RSS, ICML, etc.)
  • Have trained real-world quadruped or biped locomotion with RL
  • Robotics and control theory knowledge

Sample Projects

We encourage you to apply even if you do not meet every single qualification. If you have direct experience in solving one of the “sample projects” listed below, please let us know in your cover letter.

  • Fuse separate RL policies (walking, running, standing up) into a single hybrid policy that smoothly transitions between modes.
  • Speed up the simulator to enable faster training and evaluation.
  • Design and implement infra for re-training models deployed in the real world using offline RL methods.
  • Reduce the amount of “reward engineering” needed to solve long-horizon tasks by formulating general objectives like energy minimization, self-play, and data-driven reward functions.

Compensation

At 1X your work and results will be rewarded with a total rewards package consisting of a base salary, stock options and benefits. Base salary range is $130,000 to $250,000. Your actual salary will be based on your knowledge, skills and experience.

Location Policy

We believe the best work is done when collaborating and therefore require in-person presence in our office locations.

We're excited to get to know you and the prospects of having you on board!

Seniority level

  • Seniority level

    Not Applicable

Employment type

  • Employment type

    Full-time

Job function

Referrals increase your chances of interviewing at 1X by 2x

Sign in to set job alerts for “Research Engineer” roles.

Fremont, CA $147,372.00-$196,497.00 1 day ago

R&D Engineer, Detector Design, Model, and Analysis

Palo Alto, CA $120,000.00-$160,000.00 2 weeks ago

Mountain View, CA $166,000.00-$244,000.00 2 weeks ago

Research Scientist, World Models for Autonomous Vehicles

Research Scientist/Engineer, Mobile Manipulation - Behaviors

Research Scientist, Latent State Inference for World Models

San Francisco Bay Area $99,461.00-$128,329.00 2 weeks ago

San Jose, CA $177,400.00-$236,500.00 1 day ago

San Jose, CA $190,000.00-$320,000.00 3 weeks ago

Redwood City, CA $127,000.00-$142,000.00 14 hours ago

Sunnyvale, CA $139,000.00-$229,000.00 1 day ago

Fremont, CA $70,000.00-$110,000.00 2 weeks ago

San Jose, CA $142,700.00-$257,600.00 2 weeks ago

Fremont, CA $110,000.00-$115,000.00 2 weeks ago

Mechanical Engineer (New Grad / Entry Level)

Research Scientist (L5) - Globalization - Multimodal LLM

Redwood City, CA $142,000.00-$176,000.00 14 hours ago

Sunnyvale, CA $213,000.00-$293,000.00 1 week ago

Research Scientist (AI) – Biomedical Imaging

Research Scientist, World Models – Policy Training and Evaluation

Palo Alto, CA $100,000.00-$200,000.00 15 hours ago

Hayward, CA $125,000.00-$150,000.00 1 week ago

Mountain View, CA $138,225.00-$207,575.00 1 week ago

Sunnyvale, CA $165,000.00-$180,000.00 5 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Research Engineer, Reinforcement Learning (Palo Alto) in Palo Alto, CA vacancy
  • $190k - $235k

     ...experience — talk with your recruiter to learn more. Base pay range $190,000.00/yr -...  ...We are seeking a Staff Actuator Design Engineer to lead the design and development of electromechanical...  ...) plus equity. On-site role based in Palo Alto, CA (with flexibility as needed).... 
    Suggested
    Full time

    Intelletec Energy

    Palo Alto, CA
    7 hours ago
  • $120k - $250k

     ...talk with your recruiter to learn more. Base pay range $120,000...  ...high-performance, AI-ready data engines. Your work here will directly...  .... About the Role As a Research Engineer at Orbifold AI, you...  ...boundaries of training, RAG, and reinforcement learning for enterprise AI applications... 
    Suggested
    Full time
    Internship
    Flexible hours

    Orbifold AI

    Los Altos, CA
    6 hours ago
  • $162.8k - $203.5k

     ...Product Security Infrastructure Engineer Product Security Infrastructure Engineer 6 days ago Be among the first 25 applicants...  ...be located at one of our California locations in Irvine, CA or Palo Alto, CA and reports directly to the Sr. Manager, Product Security... 
    Suggested
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work

    Rivian and Volkswagen Group Technologies

    Palo Alto, CA
    7 hours ago
  • $180k

    AI Engineer & Researcher - Product Safety Join to apply for the AI Engineer & Researcher - Product Safety role at xAI . About the Role At xAI...  ...moderation AI models. Experienced with large-scale machine learning systems and multimodal AI development. Adept at designing... 
    Suggested
    Full time

    xAI

    Palo Alto, CA
    7 hours ago
  • $150k - $300k

     ...experience — talk with your recruiter to learn more. Base pay range $150,000.00/yr...  ...radar performance. As an Antenna Design Engineer , you will design, simulate, and validate...  ...related field ~3+ years of industry or research experience in antenna or RF systems engineering... 
    Suggested
    Permanent employment
    Full time

    Array Labs

    Palo Alto, CA
    7 hours ago
  • $180k

     ...motivated, and focused on engineering excellence. This organization...  .... All engineers and researchers are expected to have strong...  ...domains Strong knowledge of reinforcement learning techniques Experience...  ...~ We hire engineers in Palo Alto. Our team usually works from... 
    Full time
    Work at office
    Work from home
    Relocation

    Xai

    Palo Alto, CA
    1 day ago
  • $150k - $250k

     ...need to make critical decisions. The founding team of Stanford engineers was named Forbes 2019 30 under 30 and is backed by top investors...  ...ways. Skills and Qualifications You mush be able to learn and understand a problem really fast, self‑driven by curiosity.... 
    Full time
    Work at office

    WindBorne Systems

    Palo Alto, CA
    7 hours ago
  •  ...An innovative firm is seeking an AI Engineer & Researcher to enhance product safety through cutting-edge research and development. This role is pivotal in shaping safe, reliable AI solutions that prioritize user trust and integrity. You will lead efforts in multimodal... 
    Full time
    Worldwide

    xAI

    Palo Alto, CA
    7 hours ago
  • $158.8k - $218.1k

     ...Lab Summary The Robot Intelligence Lab at Samsung Research America is a new facility dedicated to advancing the field of robotics...  ...‑action (VLA) models, vision language models (VLMs), reinforcement learning, imitation learning, advanced sensing, and sensor fusion to... 
    Work at office
    Local area

    Samsung Research America

    Mountain View, CA
    1 day ago
  •  ...world models, and agents to learn, evaluate, plan, experiment,...  ...previous Stanford professors, SAIL researchers, Olympiad medalists (IPhO,...  ...training, inference, and reinforcement learning systems that reason...  ...with researchers and engineers, you'll help make Voltai the... 

    Voltai, Inc

    Palo Alto, CA
    1 day ago
  •  ...Research Engineer We are seeking a highly motivated and skilled Research Engineer to join our Reinforcement Learning & Formal Methods team. This position will be focused on advancing mathematical theorem proving using cutting-edge RL techniques. The successful candidate... 

    Harmonic

    Palo Alto, CA
    1 day ago
  • $500 per month

     ...accessible to everyone—from solo researchers to large enterprises. By...  ...offices in New York City, Palo Alto, and London and are backed by...  ...are looking for a research engineer to work directly on the Lightning...  ...will transform the machine learning ecosystem. What you’ll do... 
    Local area
    Home office
    Flexible hours

    Lightning AI

    Palo Alto, CA
    more than 2 months ago
  •  ...A leading radar technology company is seeking an Antenna Design Engineer to design and validate antennas for advanced radar satellites. You will work with a team to optimize antennas and ensure their integration with spacecraft. Required qualifications include a Bachelor... 
    Full time

    Array Labs

    Palo Alto, CA
    7 hours ago
  • $205k - $235k

     ...the Year.    As a  Senior Machine Learning Engineer , you will be responsible for...  ...tech company   ~ Publications and research experiences in ML venues and/or vision...  ...This is a hybrid role reporting to our Palo Alto office 3 days a week.   Base Salary:... 
    Full time
    Work at office
    Local area
    Flexible hours
    3 days per week

    Typeface

    Palo Alto, CA
    1 day ago
  • $180k

     ...accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a... 
    Full time
    Temporary work

    xAI

    Palo Alto, CA
    7 hours ago
  • $141k - $202k

     ...specialists with backgrounds in machine learning, computer science, physics, chemistry, biology...  ...(GDM) is pursuing a ground-breaking research program in materials, aiming to...  ...of domain experts, ML researchers, and engineers exploring a diverse set of important scientific... 
    Full time

    DeepMind

    Mountain View, CA
    3 days ago
  • $150k - $200k

     ...your skills and experience — talk with your recruiter to learn more. Base pay range $150,000.00/yr - $200,000.00/yr Shape...  ...for enterprise-grade language models. Responsibilities As a Research Scientist/ ML Engineer, you will play a crucial role in conducting and enabling... 
    Full time

    Collinear AI

    Mountain View, CA
    7 hours ago
  • $179.2k - $246.15k

     ...The Robot Intelligence Lab at Samsung Research America is a new facility dedicated to advancing...  ...Research America is looking for an engineer who has solid technical skills and rich...  ...algorithms for robot perception, control, learning, navigation, and manipulation Develop... 
    Full time
    Work at office
    Local area

    Samsung Research America

    Mountain View, CA
    7 hours ago
  • $160k - $240k

     ...time and energy. About the role We're seeking a Senior Research Engineer to lead cutting-edge perception research and drive our...  ...precise spatial understanding Build and scale robust machine learning infrastructure supporting large-scale training while... 
    Work from home

    Matic

    Menlo Park, CA
    5 days ago
  • $180k - $250k

     ...to move fast, we’d love to have you on board. Join us in shaping the future of healthcare. Job Summary We’re hiring an Applied AI Engineer to focus on building and scaling real‑world AI workflows. This role is designed for engineers who are hands‑on with deploying generative... 
    Full time
    Live in
    Flexible hours

    Qualified Health

    Palo Alto, CA
    7 hours ago
  •  ...world models, and agents to learn, evaluate, plan, experiment,...  ...previous Stanford professors, SAIL researchers, Olympiad medalists (IPhO,...  ...serve as the foundation for reinforcement learning and automated chip...  ...work closely with hardware engineers, RL researchers, and... 

    Voltai

    Palo Alto, CA
    18 days ago
  •  ...enhancement for healthy users. Headquartered in Palo Alto, Subsense brings together leading scientists and engineers to redefine the future of human–machine interaction...  ...Opportunity We are seeking a highly hands-on Research Engineer to lead and execute multidisciplinary... 

    Subsense

    Mountain View, CA
    2 days ago
  •  ...developing world models, and agents to learn, evaluate, plan, experiment, and interact...  ...of previous Stanford professors, SAIL researchers, Olympiad medalists (IPhO, IOI, etc.),...  ...computer architecture to design rich reinforcement learning environments that capture the... 

    Voltai

    Palo Alto, CA
    18 days ago
  • $90 - $121.86 per hour

     ...Job Description Job Description LLM Research Engineer Key Responsibilities: Design,...  ...language processing (NLP) and machine learning to improve model performance. Explore...  ...using CUDA. ~ Knowledge of reinforcement learning and RLHF (Reinforcement Learning... 
    Hourly pay

    Cypress HCM

    Mountain View, CA
    20 days ago
  • A tech innovation company in Mountain View, California, is seeking a Machine Learning Research Engineer. You'll design sophisticated robot learning algorithms to enhance dexterous manipulation in home environments. The role requires 3+ years in machine learning for robotics... 
    Full time

    Sunday Robotics

    Mountain View, CA
    7 hours ago
  • $75k - $90k

     ...and experience — talk with your recruiter to learn more. Base pay range $75,000.00/yr - $90,000....  ...dynamic growth phase and seeking top early-career engineering talent. We are hiring a Design Engineer to join their team in Palo Alto, CA . This is a full-time, onsite position... 
    Full time
    Internship

    Adecco USA

    Palo Alto, CA
    1 day ago
  • $181.1k - $318.4k

     ...Apple's Camera Algorithm team is looking for extraordinary engineers and researchers interested in developing next generation of image capture,...  .... Programming skills in C/C++. Exposure to machine learning algorithms. Passion for photography and videography.... 
    Full time
    Relocation

    Apple Inc.

    Cupertino, CA
    7 hours ago
  • $180k

     ...small, highly motivated, and focused on engineering excellence. This organization is for...  ...skills are important. All engineers and researchers are expected to have strong communication...  ...Location ~ We hire engineers in Palo Alto. Our team usually works from the office... 
    Full time
    Work at office
    Work from home
    Relocation

    Xai

    Palo Alto, CA
    1 day ago
  •  ...Research Engineer At Mind Robotics, we're building generalized physical AI—robotic systems capable of dexterous, adaptive, and reasoning-intensive work in real-world industrial environments. Our ability to iterate quickly on large-scale models depends on world-class... 

    Mind Robotics

    Palo Alto, CA
    3 days ago
  • $19 - $65 per hour

     ...Research Engineer Intern PlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks...  ...and experience. Your opportunities joining PlusAI Work, learn and grow in a highly future-oriented, innovative and dynamic... 
    Hourly pay
    Internship

    PlusAI, Inc.

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer, Reinforcement Learning (Palo Alto). Be the first to apply!