Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

End-to-End Delivery Engineer, AI Evaluation & Standards

Socket

AIUC in San Francisco is hiring an engineer to own end-to-end evaluation work for enterprise agents. You will sit with customers, understand how their agent works, and integrate it into our evaluation system. You will work across delivery, core engineering, and sales to shape how we test, certify, and insure agents. This high-agency role offers direct impact and collaboration with founders and enterprise partners. #J-18808-Ljbffr Socket

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the End-to-End Delivery Engineer, AI Evaluation & Standards in San Francisco, CA vacancy
  • Artificial Intelligence Underwriting Company in San Francisco seeks an engineer to own end-to-end evaluation work for enterprise AI agents. You will read API docs, integrate with customer systems, and run evaluations in our platform to prove agent safety and reliability... 
    Suggested

    Artificial Intelligence Underwriting Company

    San Francisco, CA
    21 hours ago
  •  ...San Francisco seeks a senior data engineer to build the data backbone for physical AI, ingesting and processing multi-sensor...  ...collectors. You will own end-to-end pipelines, apply privacy and...  ...researchers and operators to shape data standards and workflows in a fast-moving,... 
    Suggested

    Mercor

    San Francisco, CA
    2 days ago
  • Lance is seeking a flexible, high-ownership engineer for our Members of Technical Staff role in San Francisco. You will own hard problems end-to-end, designing systems that span product, AI, infrastructure, and the physical world. You may work across frontend, backend,... 
    Suggested
    Flexible hours

    Lance

    San Francisco, CA
    3 days ago
  • A leading AI infrastructure firm based in San Francisco is looking for engineers to join their founding core team. You will work directly with the founders to develop...  ...opportunity to define the technical roadmap, oversee end-to-end ownership, and access substantial... 
    Suggested

    Meter Service

    San Francisco, CA
    21 hours ago
  • $250k

    Dex is seeking a founding engineer in San Francisco to build the product from the ground up and own full architecture end-to-end. You will work directly with founders, set engineering standards, and help shape what gets built in a fast-paced, early-stage setting. You could... 
    Suggested

    DEX

    San Francisco, CA
    3 days ago
  • XOXO AI Inc. is hiring an experienced Android engineer to build the consumer app with a groundbreaking interface for intelligence. You will own the full mobile surface end-to-end, from architecture to polish, delivering a highly visual design system that feels intentional... 

    XOXO AI Inc.

    San Francisco, CA
    3 days ago
  • $95.86k - $208.27k

     ...Privileged Access Management Delivery Engineer to join our Advisory...  ...enablementPerform risk assessments, evaluate privileged access controls,...  ...PAM tooling; contribute to standardization of PAM delivery patterns...  ...Time Off; one is at year end and the other is around the... 
    H1b
    Local area

    KPMG

    San Francisco, CA
    4 days ago
  •  ...Francisco Bay Area seeks a hardworking mechanical engineer to build great experiences and bring Apple products to life. You will lead end-to-end design, development, and validation...  ...tolerance studies, and meeting cosmetic standards while supporting external #J-18808-Ljbffr... 

    Apple Inc.

    San Francisco, CA
    21 hours ago
  • Kindredventures is building a Large Physics foundation Model and seeks a Data Engineer to own data end-to-end, from source discovery to ingestion pipelines ensuring training-ready quality. You will build petabyte-scale pipelines, implement QA checks, and collaborate with... 

    Kindredventures

    San Francisco, CA
    21 hours ago
  • $150k - $250k

    Get AI-powered advice on this job and more exclusive features. This range is provided...  ...will adapt to experts across fields: engineering, research, operations, and beyond. About...  ...requirements Lead through quality, setting standards and mentoring others by example Value... 
    Full time
    Summer work
    Internship
    Remote work
    Flexible hours

    Stealth AI Startup

    San Francisco, CA
    3 days ago
  • $140k - $269k

     ...code, or iterating with AI. From idea to product,...  ...for a Content Support Engineer to own the knowledge systems...  ...to own a function end to end.This is a full time...  ...content governance standards including style guides,...  ...cohesive system with an evaluation strategy (especially for... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    San Francisco, CA
    5 days ago
  • $257k - $335k

     ...Security Systems Engineer to define and deliver...  ...powering advanced AI systems. As OpenAI...  ...architecture standards, technical requirements...  ..., technology evaluations, deployment oversight...  ...of employment or end of assignment; and...  ...offices, and meal delivery credits as eligibleRelocation... 
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • Chime is seeking a Growth Engineer to own end-to-end features from React/TypeScript interfaces to Rails services and APIs. You will design, implement, test, and refine consumer features, collaborate with product and design teams, and drive experiments to measure impact.... 

    Flourish Ventures

    San Francisco, CA
    2 days ago
  • $180k - $285k

     ...Job Description Job Description Forward Deployed Engineer – Healthcare AI Location: San Francisco, CA Work Arrangement:...  ...applications and agents. Build and deploy AI agents end-to-end, including evaluations to ensure they are performing as intended.... 
    Full time
    Work at office
    Relocation
    Visa sponsorship
    Relocation package

    Morgan Pinnacle Group

    San Francisco, CA
    5 days ago
  • $152.9k - $210.2k

     ...devices.As a Staff QA Engineer in the Dolby Cinema QA...  ...help advance practical AI-assisted QA tools that...  ...Responsibilities Lead QA strategy and end-to-end test ownership...  ...calibration, image evaluation, video playback, color...  ...alignment on test standards, issue escalation, defect... 
    Full time
    Work at office
    Local area
    Worldwide

    Dolby

    San Francisco, CA
    6 days ago
  • $145k - $195k

     ...Francisco, CAProduct Systems Engineering - Product Systems /...  ...entire missions end to end, significantly...  ...modular systems with standardized interfaces across power...  ...intentionally wide as we evaluate individuals based on their...  ..., on-orbit AI, national security missions... 
    Full time
    Temporary work

    Loft Orbital

    San Francisco, CA
    7 days ago
  • $197.3k - $313.7k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ...Software Engineer (PMTS) to join the...  ...teams, owning the end-to-end...  ...implementation, and delivery of secure, highly...  ...addressed, and propose standards where they don't yet...  ...recruiters assess and evaluate candidates’... 
    Long term contract
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • $172.35k - $209.51k

     ...challenges and set a new standard for urban transit...  ...Project Manager and Lead Engineer, the 5241 Resident...  ...project’s seven phases, evaluating construction plans prepared...  ...transit service delivery team including operations...  ...finalist(s) at the end of the selection process... 
    Full time
    Contract work
    Temporary work
    For contractors
    Work experience placement
    Work at office
    Immediate start
    Monday to Friday
    Flexible hours

    City and County of San Francisco

    San Francisco, CA
    3 days ago
  • Pareto AI in the San Francisco Bay Area is seeking an experienced engineer to own RL environments end to end, from scoping with researchers to shipping production-ready solutions. You will build the images and tools, write graders, manage deployments, and maintain health... 

    Pareto AI

    San Francisco, CA
    21 hours ago
  • $172.55k - $203k

     ...Senior Software Test Engineer Hybrid - San Francisco...  ...and executing tests for end to end features, data...  ...performance. Champion quality standards, ensuring all teams...  ...Improvement Evaluate and introduce new tools...  ...Explore the use of AI-driven testing approaches... 
    Work at office
    Local area
    Flexible hours

    Oura

    San Francisco, CA
    1 day ago
  • Dataleap (YC S24) is searching for a highly skilled engineer to operate at a CTO-level, focusing on AI product development. You will own significant parts of the product from inception to production, enhancing our agentic systems and working at the forefront of AI engineering... 

    Dataleap (YC S24)

    San Francisco, CA
    2 days ago
  •  ...funded startup building AI-native solutions for...  ...looking for a Founding Engineer & CTO to be the technical...  ...Do Define and own the end-to-end technological architecture...  ..., and data privacy standards appropriate for the...  ..., audit trails). Evaluate and integrate third-party... 
    Flexible hours

    NovusMinds AI

    San Francisco, CA
    2 days ago
  • Rifa AI, based in San Francisco, builds an AI agents platform for contact centers in regulated industries. We create voice and chat...  ...automated testing and post-analysis to ensure compliance. As an Agent Engineer, you own a client's voice or chat agent in production, including... 

    Rifa AI

    San Francisco, CA
    2 days ago
  • Brahma Consulting Group in San Francisco seeks a Research Engineer for Foundation Models who will train models from scratch and own pretraining work end-to-end. The role emphasizes architecture decisions, data pipelines, and running training runs, using PyTorch and JAX... 

    Brahma Consulting Group

    San Francisco, CA
    21 hours ago
  •  ...The Opportunity AI is rapidly transforming the world. Whether it's developing...  ...the leading AI observability and evaluation platform , empowering AI engineers to build and deploy high-performing,...  ...volume of webinars, owning them end to end from topic selection to the demo... 
    Full time
    Local area
    Shift work
    Afternoon shift

    Arizeai

    San Francisco, CA
    9 days ago
  • Socket.dev is seeking a Member of Technical Staff - Mechanical Engineer to design and develop robotic manipulation hardware for an AI research lab. You will prototype tools like grippers and end-of-arm tooling, enabling high-quality data collection for researchers. Collaboration... 

    Socket.dev

    San Francisco, CA
    4 days ago
  • Weave Robotics, Inc. is building a new generation of home robotics and is seeking a Sensing Engineer to own sensors end-to-end. The role covers emitter/detector electronics, analog front ends, and processing/calibration across modalities, embedded in soft or fabric-like... 

    Weave Robotics, Inc.

    San Francisco, CA
    11 hours ago
  • This is a fully in-person Mechanical Engineer role in the Bay Area. You will design, build, and scale robotic and mechanical systems for...  ...recent graduates with hands-on project experience. You will own end-to-end development and potentially lead a small hardware team.... 

    Surge Group

    San Francisco, CA
    3 days ago
  • $257k - $327k

     ...for the next generation of AI. The Data Center Engineering team defines the strategy...  ...requirements, and delivery standards for the large-scale data...  ...rack-power architectures, evaluate new technologies and vendor...  ...termination of employment or end of assignment; and... 
    For contractors
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $197.3k - $313.7k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ...TLS termination, end-to-end encryption,...  ...systems engineers who are passionate...  ..., feature delivery, and retirement of...  ...on infrastructure standards that reduce toil and...  ...recruiters assess and evaluate candidates’ resumes... 
    Full time

    Salesforce

    San Francisco, CA
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to End-to-End Delivery Engineer, AI Evaluation & Standards. Be the first to apply!