Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Engineer, Multimodal Perception and Authentication

Full-time

OpenAI

About the Team

The Future of Computing Research team is an applied research team within OpenAI’s Consumer Devices group. We study how AI systems perceive people and their surroundings, and we turn that research into capabilities for future products.

 

Our work spans machine learning, sensing, and hardware, with a focus on building systems that work beyond controlled environments.

 

About the Role

We’re looking for a machine learning engineer to help shape how future AI systems understand the physical world and the people in it. The role focuses on multimodal perception and authentication, bringing together signals from cameras, microphones, and other sensors.

 

You’ll work with specialized perception models and larger multimodal models, and partner with hardware, firmware, software, and product teams to bring new research into real-world systems.

 

This role is based in San Francisco. We work in the office three days per week and offer relocation assistance.

 

In this role, you will:

  • Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.

  • Explore how specialized perception models and larger multimodal models can work together.

  • Design data, training, and evaluation approaches that improve performance in real-world conditions.

  • Study model behavior, robustness, and failure modes across sensing, data, and deployment environments.

  • Integrate and validate new capabilities in real-time or resource-constrained systems.

  • Work with hardware, firmware, software, and product teams to turn research into working systems.

 

You might thrive in this role if you:

  • Have a strong background in computer vision, audio or speech machine learning, multimodal learning, or sensing.

  • Have experience developing specialized machine learning models, larger multimodal models, or both.

  • Have brought research ideas into practical systems, prototypes, or products.

  • Know how to design experiments, build evaluations, and investigate model behavior.

  • Have worked with sensing hardware, real-time systems, or other deployment constraints.

  • Are proficient in Python and PyTorch and comfortable with C++ or systems integration.

  • Have experience with authentication, biometrics, or other privacy-sensitive applications.

  • Enjoy working across disciplines on research problems that are still taking shape.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement .

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form . No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link .

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Machine Learning Engineer, Multimodal Perception and Authentication in Remote vacancy
  • $213k - $263k

     ...specialized subgroup within the Perception organization at Waymo. Our...  ...an onboard multi-task, multimodal perception model designed to...  ...collaboration to engineer robust, high-reliability training...  ...or MS in Computer Vision, Machine Learning, Robotics, or a related field... 
    Suggested
    Full time
    Remote work

    Waymo

    Remote
    2 days ago
  • $170k - $216k

    Role Description The Perception team builds the system which learns the spatial-temporal representation...  ...new, diverse, and multimodal data streams (e.g.,...  ...years of experience in Machine Learning, with a focus on...  ...Computer Science, Electrical Engineering, or a related field, or... 
    Suggested
    Full time

    Waymo

    Remote
    a month ago
  • $204k - $259k

     ...15+ U.S. states. The Perception team builds the system which learns the spatial-temporal representation...  ...of sensors, enabling engineers like you to (1) develop...  ...new, diverse, and multimodal data streams (e.g.,...  ...years of experience in Machine Learning, with a focus on... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  •  ...We are seeking an AI engineer to design and develop auto-labeling...  ...model development for the Perception component of our autonomous...  ...you will work closely with Machine Learning engineers, data scientists,...  ...that auto-label PBs of multimodal data and manage versioned datasets... 
    Suggested
    Full time
    Temporary work
    Relocation package

    Zoox

    Remote
    2 days ago
  • $180k - $256k

     ...complex environments. As an engineer in the ODIN team, you will develop advanced multimodal large language models that...  ...capabilities. Collaborate with perception, planning, safety, and...  ...or PhD in Computer Science, Machine Learning, or related technical field... 
    Suggested
    Full time
    Temporary work
    Relocation package

    Zoox

    Remote
    2 days ago
  • $230k - $332k

     ...complex environments. As an engineer in the ODIN team, you will develop advanced multimodal large language models that...  ...capabilities Collaborate with perception, planning, safety, and...  ...or PhD in Computer Science, Machine Learning, or related technical field... 
    Full time

    Zoox

    Remote
    2 days ago
  • $184k - $287.5k

    Intelligent machines powered by Artificial Intelligence computers that can learn, reason and interact with people are no longer science fiction. GPU Deep Learning...  ...are now looking for an extraordinary Senior Perception Engineer to develop and productize NVIDIA’s autonomous... 
    Odd job
    Full time
    Work experience placement
    Remote work

    Nvidia

    Washington DC
    4 days ago
  • $177.3k - $212.8k

     ...truck manufacturer. Meet the TeamTorc's Multi-Modal Perception team is responsible for developing the machine learning systems that enable our autonomous trucks to...  ...autonomous driving.As a Senior Machine Learning Engineer - 3D Perception, you'll join a collaborative team... 
    Full time
    Work at office
    Immediate start
    Remote work
    Relocation

    Torc Robotics

    Blacksburg, VA
    3 days ago
  • $175k - $215k

     ...autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. As a Perception Machine Learning Engineer, you will build the intelligent systems that "see" the world, directly shaping the future of autonomous travel.... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  • $250k - $295k

     ...mechanism. The real product is a scalable risk engine, our Stand World Model . We stay...  ...friction. The Opportunity: As a Machine Learning Engineer on the Applied Science team,...  ..., with a central focus on the multimodal meshing of our Stand World Model with powerful... 
    Full time
    Temporary work
    H1b
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    Stand Insurance

    San Francisco, CA
    2 days ago
  • $170.6k - $261.3k

     ...connected, shaping the future of transportation on a global scale.As a Senior Machine Learning Engineer on the State Estimation and Mapping (SEAM) organization, you will develop and improve the ML perception model that powers the secondary (fallback) autonomy stack for Super... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, TX
    4 days ago
  • $254k - $350k

     ...Autonomy Software /Full-time /HybridThe Perception team at Zoox is fundamental to our autonomous...  ..., and tracking systems.As a software engineer on the perception mapping team, you will...  ...with training and deploying deep learning modelsExperience with with Python libraries... 
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    18 hours ago
  • $213k - $263k

     ...simulation across 15+ U.S. states. The Perception team builds the system which learns the spatial-temporal...  ...diverse set of sensors, enabling engineers like you to (1) develop methods for...  ...experience ~3+ years experience in Machine Learning and/or Computer Vision... 
    Full time
    Remote work

    Waymo

    Remote
    2 days ago
  •  ...healthcare, this is the place. The Role As a Senior Machine Learning Engineer, you will build the intelligence layer that automates...  ...process end to end. What You’ll Work On Build and improve multimodal AI pipelines that process healthcare documents, OCR output... 
    Full time
    Work at office

    Hike Medical

    Remote
    2 days ago
  • $140k - $230k

     .... TEAM The Vehicle Perception team at Woven by Toyota tackles...  ...the core challenges of machine learning for 3D perception, sensor fusion...  ...as analyzing petabytes of multimodal driving data, solving...  ...a skilled Machine Learning Engineer to help advance a cutting-edge... 
    Full time
    Temporary work
    Work at office
    Flexible hours
    3 days per week

    The Woven

    Remote
    18 hours ago
  • $242k - $290k

     ...The Perception team at Zoox is fundamental to our autonomous vehicle...  ...and tracking systems. As an engineer on the Localization team, you...  ...training and deploying deep learning models Experience with with...  ...intersection of robotics, machine learning, and design, Zoox aims... 
    Full time
    Temporary work
    Relocation package

    Zoox

    Remote
    2 days ago
  • $170k - $216k

     ...simulation across 15+ U.S. states. The Perception team builds the system which learns the spatial-temporal...  ...diverse set of sensors, enabling engineers like you to (1) develop methods for...  ...methods and recipes for human and machine labeling of foundation scale data... 
    Full time
    Remote work

    Waymo

    Remote
    2 days ago
  • $251k - $310k

     ...Foundations team is to develop machine learning solutions addressing open...  ...train and deploy state-of-the-art Multimodal LLMs and World models to perform 3D Perception using sensor information from...  .... Partner effectively with engineering and research teams across Waymo... 
    Full time
    Temporary work
    Remote work

    Waymo

    New York, NY
    2 days ago
  • $251k - $310k

     ...Team & Mission: In the Oracle Perception team, our mission is to build the ultimate cognitive engine for autonomous driving. We...  ...pioneering the use of large multimodal foundation models (e.g., Gemini...  ...tuning (SFT) and Reinforcement Learning (RLHF/RLAIF, DPO/GRPO/PPO)... 
    Full time
    Remote work

    Neura Market

    Mountain View, CA
    18 hours ago
  • $138.91k - $285.98k

     ...development and research of applied machine learning. Our initiatives span a...  ...computer vision, multimodal large language models, multimodal...  ...group of approximately six engineers and a product prototyping...  ...models and improve their visual perception and tool using capabilities... 
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    3 days ago
  • $200k - $235k

     ...with communities in a more authentic way. The Community You Will...  ...data scientists, software engineers, fraud intelligence, and operations...  ...Make: As a Senior Machine Learning Engineer on the Trust...  ...practices. ~ Experience with multimodal models (vision, document,... 
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    Airbnb

    San Francisco, CA
    4 days ago
  • $142.65k - $213.98k

     ...ensuring you can proudly bring your authentic self to the workplace. Join us....  ...transcription, summarization, or multimodal correlation—and the framework orchestrates...  ...looking for a **mid-level Backend Engineer** to join our **Machine Learning Platform team**. This role focuses... 
    Full time
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Comcast

    Washington DC
    1 day ago
  • $220k - $330k

     ...other teams from product, engineering, sales, logistics, operations...  ...RoleWe are looking for a Machine Learning Engineer to apply the latest...  ...object detection models for perception on edge compute devices...  ...please verify the agency's authenticity by reaching out to contact@... 
    Full time
    Work experience placement
    Live in
    Immediate start
    Remote work

    Anduril Industries

    Irvine, CA
    18 hours ago
  •  ...ISEE is seeking a full-time Machine Learning Engineer to join our team. The ideal candidate has several...  ...on the intersection of sensing and perception algorithms. - Prototyping and...  ...and deploying deep learning models in multimodal (sensors space and temporal) real world... 
    Full time
    Work experience placement

    Isee

    Remote
    2 days ago
  • $213k - $263k

     ...most comprehensive offboard perception autolabels at a massive...  .... We are an advanced ML and engineering team that leverages state-of...  ...-art computer vision, deep learning, and generative AI to automatically...  ...-the-art computer vision / multimodal models (e.g., Gemini) to... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  • $140.7k - $175.95k

    Calabasas, CAScience & Engineering - Intelligent Systems -...  ...Our teams advance human-machine synergy, operationalized machine learning models and complex...  ...pipelines, ontologies, and multimodal retrieval systems to improve...  ..., inclusive, and authentic workplace, so if you’re... 
    Full time

    HRL Laboratories

    Calabasas, CA
    18 hours ago
  • $200k - $235k

     ...-form and natural-language multimodal queries, extract entities and...  ...experience in applied Machine Learning, inclusive MS or PhD in relevant...  ...or equivalent) and data engineering skills ~Deep understanding...  ...guests to connect with communities in a more authentic way.... 
    Full time

    Airbnb

    Remote
    a month ago
  • $140.7k - $175.95k

     ...scientific discoveries and engineering innovations continues...  ...teams advance human-machine synergy, operationalized machine learning models and complex systems...  ...on machine learning, multimodal AI, cognitive state sensing...  ..., inclusive, and authentic workplace, so if you’re... 
    Full time

    Hrl Laboratories, Llc

    Remote
    2 days ago
  • $126k - $180k

     ...As a Senior Machine Learning Engineer within the AI Squad at Canopy and reporting to the Director...  ...developing and implementing ML for perception systems with expertise in at least one...  ...culture that embraces diversity and authenticity, enabling us to flourish as a team of... 
    Full time
    Temporary work
    Work at office
    Remote work

    Canopy

    Detroit, MI
    2 days ago
  •  ...Responsibilities Develop, evaluate, and release learned driving policies for complex navigation and yielding scenarios. Translate multimodal perception outputs into robust behavioral actions across perception and planning stacks. Deploy learned models into closed... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Engineer, Multimodal Perception and Authentication. Be the first to apply!