Senior AI Evaluation Engineer — Metrics & Data Pipelines (San Francisco)
$240k - $280kFull-time
Sentry
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably. Candidates should have 5+ years of experience, proficiency in Python and TypeScript, and a background in AI/ML. The position offers a hybrid work model and a salary range of $240,000 to $280,000.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Evaluation Engineer — Metrics & Data Pipelines (San Francisco) in San Francisco, CA vacancy
$215k - $265k
...DDN, based in San Francisco, is looking for a Senior Staff Engineer specializing in AI Data Path & Storage. This role is critical for leading the integration of advanced storage systems with AI pipelines, ensuring high-performance data movement. Ideal candidates will...PipelineSeniorFull timeDDN
San Francisco, CA2 hours ago$160k - $210k
...A data intelligence firm in San Francisco is looking for a Senior Data Engineer to design and maintain their core small business data product. The role requires extensive experience in data systems, strong collaboration skills, and an ability to deliver customer impact...PipelineSeniorFull timeEnigma
San Francisco, CA2 hours ago- ...A leading audio data research company in San Francisco is looking for a Senior Backend Engineer to design and maintain scalable backend services. You will work with APIs and distributed systems, ensuring high performance under heavy data loads. Ideal candidates should...PipelineSeniorFull timeFlexible hours
David AI
San Francisco, CA2 hours ago $160k - $180k
...A leading cloud technology firm in San Francisco is looking for a Senior Software Engineer to own major parts of their AI stack. This role involves prototyping new workflows and designing multi-step pipelines. Candidates should have over 7 years of engineering experience...PipelineSeniorFull timeContract workFilevine
San Francisco, CA2 hours ago- ...A leading cloud workflow company in San Francisco is seeking an experienced Senior Software Engineer to own and innovate major parts of their AI stack. The role involves designing workflows... ...customers, and handling high-volume data processing. Ideal candidates will possess...PipelineSeniorFull time
Filevine
San Francisco, CA2 hours ago - A growing tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of experience... ...engineering. You will develop robust data pipelines and support data science initiatives, using...PipelineSeniorFull time
Crustdata (YC F24)
San Francisco, CA2 hours ago $140k - $200k
A dynamic software company in San Francisco is seeking a Mid-Senior Software Engineer to design and build user-facing products. Collaborating with founders, you will shape the product and infrastructure using tools such as React and Node.js. Ideal candidates have 3+ years...PipelineFull timeCiro
San Francisco, CA2 hours ago$170k - $200k
...technology recruitment firm in San Francisco is looking for a Technology... ...Ideal candidates are versatile Senior Software Engineers with strengths in Machine Learning, Data Engineering, and Full-Stack... ...industrial partners and creating data pipelines. The compensation range is $1...PipelineSeniorFull timePremier Group
San Francisco, CA2 hours ago$160k - $180k
...Get AI-powered advice on this job and more exclusive features... ...Gridware Gridware is a San Francisco-based technology company... ...Role Description As a Senior Data Engineer at Gridware, you will design... ...’ll build high‑performance pipelines that transform massive streams...PipelineSeniorFull timeGridware
San Francisco, CA2 hours ago$248.4k - $310.5k
...A leading AI solutions provider in San Francisco is seeking a Software Engineer for Robotics & Autonomous Systems. You will build production systems for data collection and model training, and collaborate with stakeholders. Ideal candidates have 3+ years in software engineering...PipelineFull timeScale AI, Inc.
San Francisco, CA2 hours ago- ...Boston, MA; Chicago, IL; San Francisco Bay Area, CA; and... ...to scale its Data-as-a-Service (DaaS)... ...We are looking for a Senior Staff Software Engineer to architect and lead... ...streaming, and event-driven pipelines, while ensuring data... ...-wide analytics, AI, and product...PipelineSeniorFull timeRemote workFlexible hours
WEX
San Francisco, CA2 hours ago $163k - $229k
...to apply for the Senior Analytics Engineer role at Nextdoor... ...bringing together data from a wide variety... ..., building data pipelines, owning and defining metrics in collaboration with... ...explore and apply AI and emerging... ...accordance with the San Francisco Fair Chance Ordinance...PipelineSeniorFull timeLocal areaFlexible hoursNextdoor
San Francisco, CA2 hours ago$170k - $230k
...Senior Software Engineer - Data Platform About Highnote Founded in 2020 by a team of leaders from... ...140+ employees. Headquartered in San Francisco, we’ve managed to build one of the... ...and reliable data platforms and data pipelines. With the data platforms, we will be...PipelineSeniorFull timeWork at officeLocal areaHome officeFlexible hoursHighnote Health Inc.
San Francisco, CA2 hours ago$204k - $348k
...Principal/Principal Software Engineer, App Cambridge, MA USA; San Francisco, CA USA Your Impact at... ...collaborate with AI. About The Team The... ...automated lab workflows, ML pipelines, and multi-domain knowledge... ...and manage diverse data systems (SQL, NoSQL, Vector...PipelineSeniorFull timePart timeWork at officeLocal areaFlexible hoursLila Sciences
San Francisco, CA2 hours ago- A rapidly growing tech start-up in San Francisco is seeking a Senior Data Engineer to enhance their cloud infrastructure and develop PB scale data pipelines. The role requires over 7 years of experience... ...to join a team that's leveraging AI to innovate in the data engineering...PipelineSeniorFull time
Evolve Group
San Francisco, CA2 hours ago - Senior ML Systems Engineer, Frameworks & Tooling at Cohere... ...are building AI systems to power... ...abstractions (data, tensor, and pipeline parallelism, FSDP... ...with evaluation and serving frameworks... ...Develop internal metrics and monitoring... ...Toronto, New York, San Francisco, London and...PipelineSeniorFull timeWork at officeRemote workFlexible hours
Cohere
San Francisco, CA2 hours ago $180k - $220k
...behalf of an early stage start-up who are leveraging AI to modernize the data engineering industry. They're looking for a Senior Data Engineer to join their team in San Francisco and work on PB scale data pipelines, scaling their cloud infrastructure, and build their intelligent...PipelineSeniorFull timeEvolve Group
San Francisco, CA2 hours ago$196k - $220.5k
A leading platform for gaming communication in San Francisco is seeking a Senior Data Engineer to enhance data pipelines and support analytics across the organization. You'll be integral in building robust data systems and collaborating closely with data science and engineering...PipelineSeniorFull timeDiscord
San Francisco, CA2 hours ago$133.5k - $212k
...the leading AI‑powered customer... ...customer data, design seamless... ...offices in San Francisco, New York, Denver... ...for a Senior Machine Learning Engineer to build the... ...retrieval systems, evaluation frameworks,... ...including retrieval pipelines, indexing... ...offline metrics, golden datasets...PipelineSeniorFull timeContract workLocal areaImmediate startRemote workWorldwideHome officeFlexible hoursIterable
San Francisco, CA2 hours ago$170k - $230k
...A growing fintech startup in San Francisco seeks a Senior Software Engineer for its Data Platform Team to design and build scalable data systems. The role requires 8+ years in data platforms, proficiency in Java and Python, and cloud experience. Benefits include flexible...PipelineSeniorFull timeWork at officeFlexible hoursHighnote Health Inc.
San Francisco, CA2 hours ago$180k - $260k
...Engineer data systems that change how people live and work. As a senior data engineer at Gallup, you’ll play a key... ...transforming legacy pipelines to improve efficiency... ...leveraging Generative AI to improve automation... ...on‑site at Gallup’s San Francisco office at least three...PipelineSeniorFull timeWork at office3 days per weekGallup
San Francisco, CA2 hours ago$150k - $350k
...Collate Collate is an AI document generation... .... Our AI researchers, engineers, and designers have worked... ...standards for how we evaluate, and deploy models... ...’s products. Build pipelines and infrastructure to... ...experience and level (Tier 1, San Francisco). #J-18808-LjbffrPipelineFull timeCollate
San Francisco, CA2 hours ago$155k - $235k
...the Team The Data Platform team... ...semantic and AI layers that sit... ...for a Senior AI Data Engineer to lead the AI... ...need to ship pipelines faster without... ...aligned and evaluated (RLHF, fine‑tuning... ...with metrics-as-code frameworks... ...Lake City | San Diego | San Francisco | Seattle | Washington...PipelineSeniorLocal areaHome officeFlexible hoursScribd
San Francisco, CA1 day ago$150k - $225k
AI Software Engineer (Top AI/LLM Startup) AI Software... ...billion dollar evaluation and over $100M in... ...AI researchers, data experts and software... ...data strategy, pipelines, data processing... ...is based in San Francisco and requires a total... ...skills. Seniority level Seniority...PipelineFull timeFreelanceRemote work2 days per weekFocus Capital Markets
San Francisco, CA2 hours ago- ...scale revolutionary AI‑powered enterprise... ...an experienced AI Engineer with deep... ...join our team as a Senior Staff Architect. In... ...including training pipelines, simulation environments... ...with product, data, and platform teams... ...production systems. Evaluation & Monitoring:...PipelineSeniorFull timeFlexible hours
JazzX AI
San Francisco, CA2 hours ago $175k - $200k
...seeking a Safety Engineer to lead... ...performance evaluations and data-driven assessments... ...safety metrics ~ Strong skills... ...open roles. Seniority level ~... ...Engineer jobs in San Francisco Bay Area .... ...civil / pipelines Stockton,... ...the help of AI. #J-18808-LjbffrPipelineSeniorOdd jobFull timeWork at officeGatik
San Francisco, CA2 hours ago$225.4k - $257.2k
...creating responsible and reliable AI systems, changing banking... ...‑class applied science and engineering teams to deliver our... ...similarity search, guardrails, model evaluation, experimentation, governance... ...for Sr. Lead AI Engineer San Francisco, CA: $245,900 – $280,600 for...SeniorFull timePart timeLocal areaCapital One National Association
San Francisco, CA2 hours ago$160k - $260k
...Powering Financial Progress with AI At Kikoff, our mission is to... ...Kikoff is headquartered in San Francisco and backed by top-tier VC... .... Role We are looking for a Data Engineer or Analytics Engineer to... ...datasets and the relevant data pipelines Establish data quality management...PipelineSeniorWork experience placementWork at officeLocal areaRelocationVisa sponsorship- ML/AI Research Engineer — Agentic AI Lab (Founding Team) Location: San Francisco Bay Area Type: Full-Time Compensation... ...the design, training, evaluation, and optimization of... ...of our enterprise data fabric. This isn’... ...Build and optimize RAG pipelines using LangChain,...PipelineFull time
Fabrion
San Francisco, CA2 hours ago - ...Senior AI Architect – Multi-Agent Systems... .../ Head of Engineering Seniority:... ...prompt engineering pipelines, retrieval-... ...and structured data sources.... ...refine test plans, evaluation pipelines, and... ...live performance metrics, observability... ...Architect San Francisco, CA $210,600.0...PipelineSeniorFull timeWork at officeRemote work
Nivalto
San Francisco, CA2 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Evaluation Engineer — Metrics & Data Pipelines (San Francisco). Be the first to apply!
Related searches
- ai engineer remote San Francisco, CA
- senior ai engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- junior data engineer remote San Francisco, CA
- data engineering intern summer San Francisco, CA
- hadoop big data developer San Francisco, CA