Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

(Senior) Software Engineer - Evaluation

$120k - $250k
Full-time

Pony Ai

Description

Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai’s leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural “XB100” 2023 list of the world’s top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in November 2024.

Responsibility

  • Design and build end-to-end data processing pipelines and toolchains to support large-scale data collection, batch processing, curation, and multi-dimensional evaluation.
  • Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing.
  • Collaborate across complex business components to lead the design of targeted system-level evaluation metrics, testing frameworks, and advanced simulation environments.
  • Leverage and improve industry-leading, open-source distributed technologies to continuously advance infrastructure capabilities and processing efficiency.
  • Drive critical architectural decisions and technology selection, ensuring rigorous standards for security, stability, scalability, and high performance.
  • Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations.
  • Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs.

Requirements

  • Strong programming skills in C/C++, Python, and software design
  • Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis.
  • Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum.
  • Pursueing a BS/MS or Ph.D in Computer Science or a related field
  • Experience in large data set processing and familiarity with real time systems
  • Solid experience in a fast-paced and structured engineering environment
  • Full stack experience including both front end and back end is preferred
  • Statistics analysis experience is preferred

Compensation and Benefits

Base Salary Range: $120,000 - $250,000 Annually

Compensation may vary outside of this range depending on many factors, including the candidate’s qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.

Also, we provide the following benefits to eligible employees:

  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (Traditional and Roth 401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Free Food & Snacks

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the (Senior) Software Engineer - Evaluation in Remote vacancy
  • $80 - $100 per hour

     ...Design and build the coding benchmarks and evaluation pipelines used to test frontier AI models on real software engineering work: Design coding benchmarks that evaluate...  ...their country of residence. Nice to have Senior or Lead-level profile with a history of... 
    Senior
    Remote job
    Full time
    Contract work
    For contractors

    G2i

    Miami, FL
    11 hours ago
  •  ...experiences. About the Organization: The Evaluation team builds and evolves the evaluation...  ...provide clear, explainable insights to engineering and leadership, including trend...  ...design, code reviews, and by following software-engineering best practices. Interface with... 
    Senior
    Local area
    Work from home

    General Motors

    Sunnyvale, CA
    4 days ago
  • $204k - $259k

     ...other Waymo teams that consume map data. You will: Evaluate and launch machine learning models that automatically generate...  ...work on various parts of the system ~ A passion for good software engineering We prefer: M.S. or Ph.D in Computer Science or a similar... 
    Senior
    Full time
    Remote work

    Waymo

    Remote
    11 hours ago
  • $204k - $259k

     ...simulation across 15+ U.S. states. The Planner Evaluation team works on one of the key challenges...  ...and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    9 hours ago
  • $40 per hour

     ...Role Overview: This position focuses on building LLM evaluation and training datasets aimed at addressing realistic software engineering challenges. The role involves creating verifiable software engineering tasks based on public repository histories, utilizing a synthetic... 
    Senior
    Remote job
    Contract work
    For contractors

    SaidGig

    United States
    17 days ago
  •  ...training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality,...  ...pedigree. Project Overview What Does a Typical Day Look Like? Evaluate and refine AI-generated code to ensure that it is efficient,... 
    Senior
    For contractors
    Remote work
    Flexible hours

    Turing

    Charlotte, NC
    3 days ago
  • $40 per hour

     ...leading tech companies, focused on testing, evaluating, and improving AI systems....  ...NOT: Not data labeling. Not prompt engineering. Not writing code from scratch - the...  ...evaluate. Qualifications ~5+ years in software development. ~Core stack: Python (FastAPI... 
    Senior
    Part time

    Mindrift

    Remote
    6 days ago
  • $160k - $180k

     ...Greenfield Engineering, a Saalex Company, is seeking a  Senior Software Engineer in Patuxent River, MD . This role involves applying advanced engineering principles to design, develop, and evaluate mission-critical military and aviation systems, ensuring compliance... 
    Senior
    Full time

    Saalex

    Remote
    11 hours ago
  • $150k - $250k

    Slingshot Aerospace is seeking a Senior AI Engineer to join our AI and Data Science team. This role involves developing evaluation frameworks for intelligent systems in mission-critical space operations. Responsibilities include maintaining our validation SDK, designing... 
    Senior
    Remote job

    Slingshot Aerospace

    New York, NY
    4 days ago
  • $85k - $100k

     ...Full-time Description Job Description: Software Engineer Position Overview The Software Engineer will provide critical engineering support in the design, development, testing, evaluation, and sustainment of software systems for Air Force and joint service... 
    Senior
    Full time

    Diaconia

    Remote
    11 hours ago
  • Role Description We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks. Essentially...  ...scope and deeper involvement. Qualifications ~Strong software engineering experience: 8+ years in any modern programming language,... 
    Senior
    Contract work
    Freelance
    Remote work
    Flexible hours

    Toloka

    Remote
    2 days ago
  •  ...LiDAR, Radar) Build and maintain data collection, labeling and evaluation (metrics) pipeline Maintain proprietary multi-modal dataset...  ...a deterministic secondary perception system Mentor junior engineers about best practices You have ~ Bachelor’s or Master’s... 
    Senior
    Remote job
    Full time

    Aerovect

    Remote
    11 hours ago
  •  ...perception Build and maintain radar data collection, labeling, and evaluation pipelines Architect a deterministic secondary perception system with radar as a primary modality Mentor junior engineers on radar perception best practices You have ~ Bachelor's or... 
    Senior
    Full time

    Aerovect

    Remote
    11 hours ago
  •  ...billion dollar HR tech industry. Job Description The Senior Software Engineer works as a leader/key player on our development team to...  ...Definition of requirements and design specifications # Evaluation of system integration requirements with other providers of... 
    Senior
    Full time

    Chequed.com

    Remote
    11 hours ago
  • $140k - $175k

     ...development of the Gentuity imaging application software and internal software tools ·...  ...features, GUI ideas, and for hardware evaluation. · Participate in evaluation and selection...  ...of 5 years of experience in Software Engineering · Modern C++, including Objected... 
    Senior
    Full time

    Gentuity, LLC

    Remote
    11 hours ago
  • $161.89k - $193.7k

     ...procedures for new assignments and select approaches through the evaluation and adaptation of complex techniques. Contribute to the...  ...Implement REST services, XML, and XSD using MVC architecture. Software development and implementation using JavaScript, C#, jQuery... 
    Senior
    Full time

    Convera

    Remote
    11 hours ago
  •  ...smarter and more capable. The Role We’re looking for senior software engineers to help us realize TruckSmarter’s vision of eliminating...  ...Stay ahead of emerging AI frameworks and technologies, evaluating and introducing them when they create real product advantage... 
    Senior
    Full time
    Work at office
    Flexible hours

    Trucksmarter, Inc.

    Remote
    11 hours ago
  • $95k - $150k

     ...only the best from us. RSC2 is currently looking for a Senior Software Engineer to join our growing team in Aberdeen to support our SAI...  ...Salary-Exempt  We are an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion... 
    Senior
    Full time
    Contract work
    Part time

    Rsc2, Inc.

    Remote
    11 hours ago
  • $50 - $70 per hour

     ...Location: Remote Role Responsibilities Develop and complete coding tasks in various enterprise languages . Evaluate and improve systems and build toolchains using C and Rust . Enhance enterprise JVM and build ecosystems with C#... 
    Senior
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    11 hours ago
  •  ...Department: IT Development Reports to: Software Engineering Manager Location: Hybrid - Dublin, Ohio (3 days) Remote (2 days) Full-...  ...current with emerging technologies and industry trends. Evaluate frameworks, technology, platforms, and tooling solutions.... 
    Senior
    Full time
    Remote work

    T-Cetra

    Dublin, OH
    11 hours ago
  •  ...Overview \ \ We are seeking an experienced Software Engineer to develop, maintain, and enhance complex software systems supporting mission...  ..., including hardware/software trade -off analysis. \\ Evaluate opportunities for software reuse and integration of Commercial... 
    Senior
    Full time
    Local area

    J

    Remote
    11 hours ago
  •  ...observability platform built on the Snowflake AI Data Cloud and engineered for scale. We ingest and store logs, metrics, traces, and...  ...scale. Experience with query DSLs, CEL, or similar expression evaluation frameworks. Prior experience in a tech lead or staff engineer... 
    Senior
    Full time

    Snowflake

    Remote
    11 hours ago
  • $120.54k - $140k

     ...Job Title: Senior Software Engineer Employer: Procare Software, LLC Job Location: Denver, CO Salary: $120,536 - $140,000 Job Duties...  ...lifecycle. Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development... 
    Senior
    Full time
    Remote work

    Procare Solutions

    Denver, CO
    11 hours ago
  • $213k - $270k

     ...simulation across 15+ U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking new ways. We...  ...or scientific software ~ Experience building or evaluating machine learning models in production ~ Experience... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    11 hours ago
  •  ...test, integrate, debug, and maintain system architectures and software solutions Develop scalable microservices using a combination...  ...code repositories (e.g., GitHub, GitLab, Jira) Ability to evaluate open-source tools and recommend solutions for implementation... 
    Senior
    Full time

    Vets Hired

    Remote
    11 hours ago
  •  ...Technologies, Inc. (CPT) is seeking a motivated and detail-oriented Software Engineer to join our team. As a key member of the team, you will play...  ...and improve software quality. Responsibilities: Evaluate, recommend, and implement automated test tools and... 
    Senior
    Remote job
    Full time
    Local area
    Flexible hours

    Command Post Technologies

    Remote
    11 hours ago
  •  ...developing state of the art autonomous vehicle software for our purpose built vehicle. We...  ...define and enforce the best practices for engineering across the company. Our approach...  ...experience. \n In this role, you will: Evaluate the current suite of development tools... 
    Senior
    Full time
    Temporary work
    Relocation package

    Zoox

    Remote
    11 hours ago
  •  ...Determine operational feasibility by evaluating analysis, problem definition,...  ...and clear code. Develop software solutions by studying...  ...program manager and Chief Software Engineer. Coordinate software...  ..., or related STEM degree. Senior-level experience deploying microservices... 
    Senior
    Full time
    Contract work
    Temporary work

    Trinity Global Consulting, Llc

    Remote
    11 hours ago
  •  ...About Tycho.AI Tycho.AI builds autonomy software for unmanned systems operating in GPS-...  ...looking for experienced energetic software engineers to join our growing team building out...  ...and test driven development as well as evaluation pipelines) and is enthusiastic about making... 
    Senior
    Full time

    Tycho Ai

    Remote
    11 hours ago
  • $110k - $140k

     ...Description Supervisor’s Title: Software Engineer Manager Exempt Status: Exempt Location...  ...Basic Functions  We are seeking a Senior Software Engineer who is comfortable operating...  ...duties of the job as necessary for its evaluation in relation to other jobs in the... 
    Senior
    Full time
    Flexible hours

    Imricor Medical Systems Inc

    Remote
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to (Senior) Software Engineer - Evaluation. Be the first to apply!