Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML / AI Software Engineer - C++ Metrics Frameworks

$118k - $188.4k

Israelvcforum

Job Description As a AI/ML Engineer on the Metrics Frameworks team, part of the Simulation, Evaluation, and Data organization, you will be an individual contributor focused on developing and optimizing infrastructure to accelerate autonomous vehicle development, testing, and deployment by creating specialized analytics frameworks and tools. We are seeking experienced software engineers to build analytical frameworks and tools that empower internal users to construct quantitative analysis pipelines and develop metrics. These metrics will support and accelerate feature design, prioritization, and development, as well as evaluate the impact of recently released features. Our analytics framework equally supports road event monitoring, data mining and training, and simulation metrics. About the Organization The Simulation, Evaluation, and Data organization is dedicated to advancing the development of autonomous vehicles through cutting‑edge simulation technologies. The Metrics Frameworks team within this organization focuses on creating, maintaining, and evolving the analytics framework that supports GM's goal of safe, high‑performing, and scalable driverless technology. The team delivers robust and scalable tools that facilitate data‑driven decision‑making throughout the AV feature development lifecycle. We collaborate closely with Simulation Evaluation, Embodied AI, and System and Test Engineering teams to enhance productivity across the organization by developing automation tools and shared libraries for all engineering teams. We are accountable for the performance, reliability, and scalability OKRs of the analytics framework. This includes, but is not limited to, developing customized analytics workflows, improving operational telemetry and dashboards to track relevant KPIs for prioritization, and identifying, designing, and implementing solutions to achieve key results. What You'll Do Create tooling that can receive signals from various sources (Simulation, Road, etc.) and allow users to easily build quantitative analysis pipelines to extract usable insights. Accelerate team's effectiveness and efficiency by designing and implementing scalable automation tools for test creation, data collection and analysis, debugging, and performance monitoring. Design and implement extensible and well‑tested shared libraries that will be used by many engineers across the organization. Collaborate with other frameworks and data infra teams to build and deploy tools to improve productivity. Work closely with autonomous vehicle engineering to enable rapid development and model feedback. Maintain a high technical standard for code quality on the team, through architectural design and code reviews. Your Skills & Abilities Experience developing scalable software solutions that will be used by many developers. Experience writing Python and C++ in a production environment (unit testing, code review, algorithm performance and tradeoffs, etc.). Experience developing automation scripts (Python and Bash scripts). BS in Computer Science, Electrical Engineering, Mechanical Engineering, or Aerospace Engineering. 5+ years of industry experience. Strong organizational and communication skills. What Will Give You a Competitive Edge Experience with SQL and related tools/tech (Big Query, DuckDB, etc.). Experience with time‑series data analysis and online performance monitoring tools. Experience building high performance framework / infrastructure and performance optimization in C++/Python. Familiarity with ROS, Pandas, Python bindings for C++, and plotting/visualization libraries. Familiarity with Data orchestration and transformation tools like AirTable, AirFlow, DBT, etc. Compensation The salary range for this role is ($118,000 and $188,400). The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. Hybrid: This role is categorized as hybrid. This means the successful candidate is expected to report to the Mountain View, San Francisco, Warren or Milford Technical Center three times per week, at minimum. Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers. All employment decisions are made on a non‑discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws. Accommodations General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us or call us at View phone number on click.appcast.io. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the ML / AI Software Engineer - C++ Metrics Frameworks in San Francisco, CA vacancy
  • Israelvcforum is seeking an experienced AI/ML Engineer in San Francisco to contribute to the Metrics Frameworks team. In this role, you’ll develop infrastructure to accelerate...  ...position requires strong skills in Python and C++, and offers a hybrid work arrangement. Join us... 
    Suggested

    Israelvcforum

    San Francisco, CA
    4 days ago
  • $160k - $235k

    Software Engineer - Simulation C++ Framework Build the architecture for simulation software, enabling rapid and efficient development for autonomous driving. Location: San Francisco Bay Area Compensation: $160,000 - 235,000 USD / year About The Role Simulation C++ Framework... 
    Suggested
    Temporary work
    Relocation package

    jobs.frontdoordefense.com - Jobboard

    San Francisco, CA
    2 days ago
  • Anysphere is seeking a Software Engineer for the Agent Quality team in San Francisco...  ...to evaluate and improve ML agents. Responsibilities...  ...evaluation systems, defining quality metrics, and collaborating with...  ...candidates will have experience in AI evaluations, data analysis,... 
    Suggested

    Anysphere

    San Francisco, CA
    4 days ago
  •  ...platform for evaluating how AI models perform in the...  ...a team of researchers, engineers, academics, and...  ...models, pipelines, and metrics that turn raw user activity...  ...distributed data processing frameworks Familiarity with Delta...  ...learning systems or ML‑adjacent analytics... 
    Suggested
    Permanent employment
    Work at office

    Arena

    San Francisco, CA
    5 days ago
  • $180k - $250k

     ...practices. The firm's AI Innovation team builds...  ...structured outputs Engineer solutions for large-scale...  ...AI-to-tool integration frameworks (LangChain, LlamaIndex,...  ...Understanding of ML fundamentals: fine-tuning...  ...QLoRA, PEFT), evaluation metrics, NLP tasks, and MLOps/LLMOps... 
    Suggested
    Full time
    Temporary work
    Work at office
    Immediate start
    Remote work
    Worldwide

    Kilpatrick Townsend & Stockton

    San Francisco, CA
    4 days ago
  • $155k - $235k

     ...Databricks, to the semantic and AI layers that sit on top....  ...for a Senior AI Data Engineer to lead the AI...  ...identify the right AI tools, frameworks, and agentic patterns...  ...1 year focused on AI/ML infrastructure or LLM-powered...  ...Have Familiarity with metrics-as-code frameworks or... 
    Local area
    Home office
    Flexible hours

    Scribd

    San Francisco, CA
    2 days ago
  •  ...Applied AI Engineer We're looking for an Applied AI Engineer with 2-5 years of...  ...between LLM approaches and traditional ML when designing solutions. You care...  ...that directly move marketplace metrics. Design evaluation frameworks that measure real-world performance... 

    Paraform

    San Francisco, CA
    4 days ago
  •  ...Senior AI Engineer Disney Entertainment and ESPN Product & Technology...  ...AI capabilities, evaluation metrics, and adoption accelerators....  ...evaluation and observability frameworks for quality, reliability, and...  ...years of backend or applied AI/ML engineering with a track... 

    The Walt Disney Studios

    San Francisco, CA
    4 days ago
  •  ...Senior Software Engineer - AI Core Engineering Disney Entertainment and ESPN...  ...AI capabilities, evaluation metrics, and adoption accelerators....  ...evaluation and observability frameworks for quality, reliability, and...  ...of backend or applied AI/ML engineering with a track record... 

    Walt Disney Company

    San Francisco, CA
    4 days ago
  • $197.3k - $313.7k

     ...efforts. Job Category Software Engineering Job Details...  ...Salesforce is the #1 AI CRM, where humans with...  ...next generation of our ML/AI platform that doesn...  ...sandboxes, and evaluation frameworks that let AI agents be...  ...track agent quality metrics over time; own the signal... 

    Salesforce.Com Inc

    San Francisco, CA
    1 day ago
  •  ...Kastle Kastle is building AI operating system for...  ...a Founding Applied AI Engineer, you'll be instrumental...  ...Optimization: Monitor performance metrics and continuously...  ...building and deploying ML/AI systems in...  ...Python and deep learning frameworks (TensorFlow, PyTorch) Experience... 
    Live in
    Relocation package

    Kastle

    San Francisco, CA
    2 days ago
  •  ...point-of-sale to AI-powered profit tools...  ...is a new 5-person engineering team with a...  ...engineering org builds software - then make that the...  ...an escalation framework you design that determines...  ...weeks with real metrics. You turn skeptics...  ...tooling, and AI/ML systems without... 
    Shift work

    SpotOn

    San Francisco, CA
    1 day ago
  •  ...Salesforce is a leading AI‑powered customer relationship...  ...seeking a Lead AI Engineer to develop next‑generation AI and ML systems. The role focuses...  ...offline and online evaluation frameworks Develop evaluation...  ...experiments and track key metrics (quality, revenue impact,... 

    Salesforce

    San Francisco, CA
    2 days ago
  •  ...About the Role As an Applied AI Engineer, you'll work on everything from browser agent reliability to document understanding...  .... Requirements (Must-Have) Strong Python and ML frameworks, particularly PyTorch. Eval-and-metric mindset. You think in terms of metrics that matter... 
    Relocation

    Ersilia

    San Francisco, CA
    2 days ago
  • $141.9k - $190.3k

     ...global organization of engineers, product developers, designers...  ...We're hiring a Senior AI Engineer to build the...  ..., evaluation metrics, and adoption accelerators...  ...evaluation and observability frameworks for quality,...  ...backend or applied AI/ML engineering with a track... 

    Disney Entertainment and ESPN Product & Technology Careers

    San Francisco, CA
    1 day ago
  •  ...looking for We’re looking for an Applied AI Engineer with 2-5 years of experience...  ...between LLM approaches and traditional ML when designing solutions. You care about...  ...that directly move marketplace metrics. Design evaluation frameworks that measure real-world performance,... 

    Paraform

    San Francisco, CA
    2 days ago
  •  ...provides blockchain analytics and AI solutions to help law...  ...world for all. The AI Research Engineer will join our AI Engineering...  ...the orchestration of AI/ML systems, ensuring scalable,...  ...foundation in experimentation frameworks, evaluation metrics, and ML Ops practices. Proven... 
    Worldwide

    Dormont Manufacturing Company

    San Francisco, CA
    1 day ago
  •  ...of integrating modern AI and LLMs into the Oura...  ..., blending traditional ML with modern LLMs, reasoning...  ...years. As a Senior AI Engineer, you will design, build...  ...the primary success metrics. What you will do You...  ...implementation of evaluation frameworks and tooling to measure... 
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Femtech Insider Ltd.

    San Francisco, CA
    2 days ago
  • $160k - $210k

     ...Role We’re seeking a strong Software Engineer to join our AI Evaluation team, focused...  ...build and maintain evaluation frameworks for individual system...  ...guardrails. Partner with ML, engineering and QA teams...  ...debugging tools (logging, metrics, tracing) and building internal... 
    Flexible hours

    Dormont Manufacturing Co

    San Francisco, CA
    2 days ago
  • $150k - $210k

    AI Engineer Location: San Francisco, CA, in-office Compensation...  ...and code‑first AI frameworks , to build intelligent...  ...feedback, performance metrics, and evolving business...  ...advancements in AI/ML, especially in agent frameworks...  ...of experience in software engineering with a... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    Argo AI

    San Francisco, CA
    5 days ago
  • $150k - $185k

    Early-career founding AI role for a recent graduate or engineer with roughly two...  ...gets captured. The software that was supposed to...  ...which changes move metrics and which just feel...  ...to AI/ML repos (LangChain, LlamaIndex...  ...published projects. Eval frameworks you've built or... 
    Full time
    Internship
    Work at office

    Matterhaul Inc.

    San Francisco, CA
    5 days ago
  •  ...simply, we build software for the people who...  ...Fieldguide is building AI agents for the...  ...investors. As an AI Engineer, Quality , you...  ...the intersection of ML engineering,...  ...Implement comparison frameworks that measure effectiveness...  ...based on metrics and are obsessed with... 
    Work at office
    Remote work
    Work from home
    Flexible hours

    Fieldguide

    San Francisco, CA
    4 days ago
  •  ...As a Senior Forward Deployed AI Engineer, you'll sit at the intersection...  ...into concrete evaluation frameworks to prototyping pipelines and...  ...years of experience in applied ML, AI research engineering, or...  ...systems, eval frameworks, quality metrics). Excellent communication... 
    Full time
    Work at office
    Flexible hours
    Shift work

    Apply

    San Francisco, CA
    3 days ago
  • $240k - $280k

    A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably... 

    Sentry

    San Francisco, CA
    4 days ago
  • $180k - $260k

     ...AI And ML Engineer Profound is the marketing platform for the AI era. As people increasingly...  ...generation and citations Create evaluation frameworks for generated content, including...  ..., and go-to-market teams on success metrics and experiments that move customer-facing... 
    Work at office
    Shift work

    Profound

    San Francisco, CA
    4 days ago
  • $170k - $265k

     ...Software Engineer, Agentic Runtime Mountain View,...  ...Glean is the Work AI platform that helps...  ...observability, and ML infra integrations...  ...internal evaluation frameworks to improve quality...  ...(tracing, metrics, logs) and create...  ...Python, Go, Java, or C++, with a focus on reliability... 
    Home office
    Flexible hours
    3 days per week

    Glean.info

    San Francisco, CA
    4 days ago
  •  ...building a reasoning engine that must navigate...  ...alongside leading AI companies. We're looking...  ...orchestration frameworks Own systems end-to...  ...: You're a strong Software engineer. Your code...  ...— designing metrics, running systematic...  ...never looked back. An ML engineer who realized... 
    Full time
    Shift work
    Night shift
    Weekend work

    Hilbert's AI

    San Francisco, CA
    1 day ago
  •  ...re looking for applied AI engineers to help bring Codex...  ...agent performance on real software engineering tasks and...  ...with modern ML tooling. Have worked on...  ...outcomes, not just model metrics. Enjoy debugging messy...  ...Experience with agent frameworks or tool‑using LLM systems... 

    Slope

    San Francisco, CA
    1 day ago
  • $160k - $220k

    About Actively AI Actively AI is defining a new...  ...for a Senior / Staff Software Engineer - Search & Retrieval to...  ...infrastructure using classical IR metrics, task-level success...  ...retrieval or applied ML. You’ve tuned...  ...retrieval evaluation frameworks using IR metrics, task... 
    Work at office
    Shift work

    Dormont Manufacturing Company

    San Francisco, CA
    5 days ago
  • $180k - $260k

     ...developing cutting-edge AI/ML products to address...  ...traces (OpenTelemetry), metrics, and logs for each...  ...with ML, product, data engineering, and client-SDK teams...  ...FastAPI, or similar async frameworks. Deep understanding of...  ...deployable software. Preferred B.S./M.S. in... 
    Remote work
    Flexible hours

    Dormont Manufacturing Company

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML / AI Software Engineer - C++ Metrics Frameworks. Be the first to apply!