(Senior) Software Engineer - Evaluation
$120k - $250kPony Ai
Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai’s leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural “XB100” 2023 list of the world’s top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in November 2024.
Responsibility
- Design and build end-to-end data processing pipelines and toolchains to support large-scale data collection, batch processing, curation, and multi-dimensional evaluation.
- Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing.
- Collaborate across complex business components to lead the design of targeted system-level evaluation metrics, testing frameworks, and advanced simulation environments.
- Leverage and improve industry-leading, open-source distributed technologies to continuously advance infrastructure capabilities and processing efficiency.
- Drive critical architectural decisions and technology selection, ensuring rigorous standards for security, stability, scalability, and high performance.
- Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations.
- Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs.
- Strong programming skills in C/C++, Python, and software design
- Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis.
- Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum.
- Pursueing a BS/MS or Ph.D in Computer Science or a related field
- Experience in large data set processing and familiarity with real time systems
- Solid experience in a fast-paced and structured engineering environment
- Full stack experience including both front end and back end is preferred
- Statistics analysis experience is preferred
Compensation and Benefits
Base Salary Range: $120,000 - $250,000 Annually
Compensation may vary outside of this range depending on many factors, including the candidate’s qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.
Also, we provide the following benefits to eligible employees:
- Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (Traditional and Roth 401k)
- Life Insurance (Basic, Voluntary & AD&D)
- Paid Time Off (Vacation & Public Holidays)
- Family Leave (Maternity, Paternity)
- Short Term & Long Term Disability
- Free Food & Snacks
$80 - $100 per hour
...Design and build the coding benchmarks and evaluation pipelines used to test frontier AI models on real software engineering work: Design coding benchmarks that evaluate... ...their country of residence. Nice to have Senior or Lead-level profile with a history of...SeniorRemote jobFull timeContract workFor contractors- ...experiences. About the Organization: The Evaluation team builds and evolves the evaluation... ...provide clear, explainable insights to engineering and leadership, including trend... ...design, code reviews, and by following software-engineering best practices. Interface with...SeniorLocal areaWork from home
$204k - $259k
...other Waymo teams that consume map data. You will: Evaluate and launch machine learning models that automatically generate... ...work on various parts of the system ~ A passion for good software engineering We prefer: M.S. or Ph.D in Computer Science or a similar...SeniorFull timeRemote work$204k - $259k
...simulation across 15+ U.S. states. The Planner Evaluation team works on one of the key challenges... ...and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how...SeniorFull timeRemote work$40 per hour
...Role Overview: This position focuses on building LLM evaluation and training datasets aimed at addressing realistic software engineering challenges. The role involves creating verifiable software engineering tasks based on public repository histories, utilizing a synthetic...SeniorRemote jobContract workFor contractors- ...training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality,... ...pedigree. Project Overview What Does a Typical Day Look Like? Evaluate and refine AI-generated code to ensure that it is efficient,...SeniorFor contractorsRemote workFlexible hours
$40 per hour
...leading tech companies, focused on testing, evaluating, and improving AI systems.... ...NOT: Not data labeling. Not prompt engineering. Not writing code from scratch - the... ...evaluate. Qualifications ~5+ years in software development. ~Core stack: Python (FastAPI...SeniorPart time$160k - $180k
...Greenfield Engineering, a Saalex Company, is seeking a Senior Software Engineer in Patuxent River, MD . This role involves applying advanced engineering principles to design, develop, and evaluate mission-critical military and aviation systems, ensuring compliance...SeniorFull time$150k - $250k
Slingshot Aerospace is seeking a Senior AI Engineer to join our AI and Data Science team. This role involves developing evaluation frameworks for intelligent systems in mission-critical space operations. Responsibilities include maintaining our validation SDK, designing...SeniorRemote job$85k - $100k
...Full-time Description Job Description: Software Engineer Position Overview The Software Engineer will provide critical engineering support in the design, development, testing, evaluation, and sustainment of software systems for Air Force and joint service...SeniorFull time- Role Description We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks. Essentially... ...scope and deeper involvement. Qualifications ~Strong software engineering experience: 8+ years in any modern programming language,...SeniorContract workFreelanceRemote workFlexible hours
- ...LiDAR, Radar) Build and maintain data collection, labeling and evaluation (metrics) pipeline Maintain proprietary multi-modal dataset... ...a deterministic secondary perception system Mentor junior engineers about best practices You have ~ Bachelor’s or Master’s...SeniorRemote jobFull time
- ...perception Build and maintain radar data collection, labeling, and evaluation pipelines Architect a deterministic secondary perception system with radar as a primary modality Mentor junior engineers on radar perception best practices You have ~ Bachelor's or...SeniorFull time
- ...billion dollar HR tech industry. Job Description The Senior Software Engineer works as a leader/key player on our development team to... ...Definition of requirements and design specifications # Evaluation of system integration requirements with other providers of...SeniorFull time
$140k - $175k
...development of the Gentuity imaging application software and internal software tools ·... ...features, GUI ideas, and for hardware evaluation. · Participate in evaluation and selection... ...of 5 years of experience in Software Engineering · Modern C++, including Objected...SeniorFull time$161.89k - $193.7k
...procedures for new assignments and select approaches through the evaluation and adaptation of complex techniques. Contribute to the... ...Implement REST services, XML, and XSD using MVC architecture. Software development and implementation using JavaScript, C#, jQuery...SeniorFull time- ...smarter and more capable. The Role We’re looking for senior software engineers to help us realize TruckSmarter’s vision of eliminating... ...Stay ahead of emerging AI frameworks and technologies, evaluating and introducing them when they create real product advantage...SeniorFull timeWork at officeFlexible hours
$95k - $150k
...only the best from us. RSC2 is currently looking for a Senior Software Engineer to join our growing team in Aberdeen to support our SAI... ...Salary-Exempt We are an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion...SeniorFull timeContract workPart time$50 - $70 per hour
...Location: Remote Role Responsibilities Develop and complete coding tasks in various enterprise languages . Evaluate and improve systems and build toolchains using C and Rust . Enhance enterprise JVM and build ecosystems with C#...SeniorFull timeContract workSummer workRemote work- ...Department: IT Development Reports to: Software Engineering Manager Location: Hybrid - Dublin, Ohio (3 days) Remote (2 days) Full-... ...current with emerging technologies and industry trends. Evaluate frameworks, technology, platforms, and tooling solutions....SeniorFull timeRemote work
- ...Overview \ \ We are seeking an experienced Software Engineer to develop, maintain, and enhance complex software systems supporting mission... ..., including hardware/software trade -off analysis. \\ Evaluate opportunities for software reuse and integration of Commercial...SeniorFull timeLocal area
- ...observability platform built on the Snowflake AI Data Cloud and engineered for scale. We ingest and store logs, metrics, traces, and... ...scale. Experience with query DSLs, CEL, or similar expression evaluation frameworks. Prior experience in a tech lead or staff engineer...SeniorFull time
$120.54k - $140k
...Job Title: Senior Software Engineer Employer: Procare Software, LLC Job Location: Denver, CO Salary: $120,536 - $140,000 Job Duties... ...lifecycle. Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development...SeniorFull timeRemote work$213k - $270k
...simulation across 15+ U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking new ways. We... ...or scientific software ~ Experience building or evaluating machine learning models in production ~ Experience...SeniorFull timeRemote work- ...test, integrate, debug, and maintain system architectures and software solutions Develop scalable microservices using a combination... ...code repositories (e.g., GitHub, GitLab, Jira) Ability to evaluate open-source tools and recommend solutions for implementation...SeniorFull time
- ...Technologies, Inc. (CPT) is seeking a motivated and detail-oriented Software Engineer to join our team. As a key member of the team, you will play... ...and improve software quality. Responsibilities: Evaluate, recommend, and implement automated test tools and...SeniorRemote jobFull timeLocal areaFlexible hours
- ...developing state of the art autonomous vehicle software for our purpose built vehicle. We... ...define and enforce the best practices for engineering across the company. Our approach... ...experience. \n In this role, you will: Evaluate the current suite of development tools...SeniorFull timeTemporary workRelocation package
- ...Determine operational feasibility by evaluating analysis, problem definition,... ...and clear code. Develop software solutions by studying... ...program manager and Chief Software Engineer. Coordinate software... ..., or related STEM degree. Senior-level experience deploying microservices...SeniorFull timeContract workTemporary work
- ...About Tycho.AI Tycho.AI builds autonomy software for unmanned systems operating in GPS-... ...looking for experienced energetic software engineers to join our growing team building out... ...and test driven development as well as evaluation pipelines) and is enthusiastic about making...SeniorFull time
$110k - $140k
...Description Supervisor’s Title: Software Engineer Manager Exempt Status: Exempt Location... ...Basic Functions We are seeking a Senior Software Engineer who is comfortable operating... ...duties of the job as necessary for its evaluation in relation to other jobs in the...SeniorFull timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to (Senior) Software Engineer - Evaluation. Be the first to apply!
- software engineer full time Remote
- software system engineer Remote
- consulting software engineer Remote
- software engineer travel Remote
- software engineer mainframe Remote
- software engineer unity Remote
- real time software engineer Remote
- network software engineer Remote
- senior software engineer remote Remote
- entry level software engineer remote Remote





