Staff Engineer, Trustworthy ML Evaluation Platform
AI Chopping Block, Inc.
AI Chopping Block, Inc. is seeking a Member of Technical Staff to build and maintain the evaluation platform used across Magic. You will develop infrastructure for large-scale evaluations and ensure correctness in measurements that influence key research decisions. The ideal candidate should have strong software engineering skills, attention to detail, and experience with machine learning systems. This is an opportunity to contribute to advanced AI research in a collaborative environment. #J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Staff Engineer, Trustworthy ML Evaluation Platform in San Francisco, CA vacancy
- ...Proficiency in Python and standard ML frameworks (e.g., JAX,... ...with large-scale simulation platforms and their integration with ML... ...designing and using metrics for evaluating complex AI systems , (... ...for researchers and software engineers who are passionate about developing...Platform
$220.8k - $298.8k
...seeking an Applied AI Engineer to drive the quality and... ...experimentation, and evaluation. In this role, you... ...to deliver accurate, trustworthy results. This is a research... .... Drata's compliance platform is document-heavy: VRM... ..., agents, and classic ML: chunking, embedding models...PlatformFlexible hoursDrata
San Francisco, CA3 hours ago$208k - $282k
...Staff Data Engineer At Komodo Health, our mission is to reduce... ..., performant, and trustworthy for customers and internal... ...business needs. Platform Hardening: Built and... ...needs. AI & ML Enablement: Experience... ..., feature pipelines, evaluation datasets, or infrastructure...PlatformWork experience placementLocal areaFlexible hoursKomodo Health
San Francisco, CA20 hours ago$220.8k - $298.8k
...Type Hybrid Department Engineering Our Mission & Values... ...experimentation, and evaluation. In this role, you will... ...to deliver accurate, trustworthy results. This is a research... .... Drata's compliance platform is document‑heavy: VRM... ..., agents, and classic ML: chunking, embedding...PlatformFull timeWork at officeImmediate startWorldwideMonday to FridayFlexible hours- ...advisory workflows. As a Staff AI Engineer, you'll shape the... ...organization Establish evaluation standards,... ...roadmap Create reusable platforms, patterns, and tooling... ...leading complex AI/ML systems ~ Deep expertise... ...transparent and trustworthy Complex domains:...PlatformRemote workFlexible hours
Atexo
San Francisco, CA3 days ago $189.31k - $389.75k
...the world come to our platform to find creative ideas... ...We’re looking for a Staff Machine Learning Engineer to lead the development of ML systems that power Pinterest... ...for scalable, trustworthy, and privacy-aware ML... ...quality, feature pipelines, evaluation, experimentation,...PlatformFull timeWork at officeLocal areaRelocationRelocation package$189k - $274k
...We're searching for a Staff Security Engineer to join our Enterprise Security... ..., building, and owning the platforms, integrations, and... ...remediation plans. ~ Experience evaluating security posture and identifying... ...with securing AI/ML platforms or applications built...PlatformWork at officeLocal area3 days per weekEarly shiftAurora Innovation
San Francisco, CA1 day ago$150k - $226k
...is the leading AI analytics platform, helping over 4,700... ...is seeking an experienced Staff IT Security Engineer to design and build controls... ...infrastructure security, not securing ML pipelines, models, or AI... ...reviews (intake, risk evaluation, remediation tracking, and...PlatformWork at officeHome officeFlexible hoursAmplitude
San Francisco, CA4 days ago- ...Machine Learning Engineer Specializing In Ai Watershed is the enterprise sustainability platform. Companies like Airbnb, Carlyle Group,... ...LLMs, embeddings and other ML technologies ~ Full lifecycle... ...practice, including model evaluation and performance ~ Strong full...PlatformWork at officeRemote work
WaterSHED
San Francisco, CA20 hours ago $238k - $302k
...applied to a range of vehicle platforms and product use cases. The... ...The Driver Understanding and Evaluation team at Waymo develops a rich... ...collaborate across teams to bring ML to production systems and... ...for researchers and software engineers who are passionate about developing...PlatformFull timeWork experience placementRemote workWaymo
San Francisco, CA2 days ago- ...world. Our product engineering teams build and operate... ...offerings, and platform services that support... ...accessible, intuitive, and trustworthy. You will partner with... ...Have interest in AI/ML; direct AI/ML experience... ...Member of Technical Staff . We use Staff / Senior...PlatformInternship
OpenAI
San Francisco, CA20 hours ago $185.1k - $335.3k
...development, and performance engineering so that every cycle on... ...teams to co-design a platform that enables new ideas... .... The Role As a Staff Compiler Engineer on... ..., and effortless for ML engineers across the... ...in a company vehicle evaluation program, through which...PlatformLocal areaRemote workWork from homeRelocation packageFlexible hoursGeneral Motors
San Francisco, CA20 hours ago- ...Staff Machine Learning Engineer EvenUp is on a mission to close the justice gap... ...proprietary claims-intelligence platform. You'll partner closely... ..., mentor a top-tier ML team, and set the vision for... .... Establish rigorous evaluation standards to reduce hallucinations...PlatformFull timeTemporary workWork at officeLocal areaHome officeFlexible hours
EvenUp Inc.
San Francisco, CA2 days ago $188.24k - $235.3k
...Twilio's next L4, Machine Learning Engineer, Trust Intelligence Platform About the job Join Twilio's rapidly... ...operate the cloud-native data and ML infrastructure that powers every... ...Build reproducible ML training, evaluation, and inference workflows using modern...PlatformLocal areaRemote workWorldwideTwilio
San Francisco, CA5 days ago$250k - $350k
...scribe. We're building the AI intelligence platform that restores humanity to healthcare... ...started. The Role: As a Staff ML Engineer on the Frontier AI team at Ambience, you... ...contributions to ML libraries, benchmarks, or evaluation frameworks. Why Here: Our...PlatformWork at officeImmediate startRemote workFlexible hours3 days per weekAmbience Healthcare
San Francisco, CA4 days ago- ...and most valuable kind of AI engineering there is. What You'll Do Architect... ...Lead the rebuilding of core platform systems — including our... ...generation (RAG), and agent evaluation. Experience building reliable... ...production AI systems. Classical ML experience — supervised/...PlatformLive inRemote work
$215k - $322k
...Join GoFundMe as our next Staff Machine Learning Engineer (Pricing) . In this role,... ...expertise in building production ML systems (data → training →... ..., training, and evaluation. Build low-latency real... ...diverse set of tools and platforms, including Python, AWS, Databricks...PlatformFull timeTemporary workWork at officeFlexible hoursGoFundMe
San Francisco, CA4 days ago$264.8k - $331k
...through our data annotation platform, generative AI solutions,... ...the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General... ...model and system design to evaluation, deployment, and iteration... .... Experience deploying ML systems in cloud environments...PlatformFull timeScale AI
San Francisco, CA5 days ago$230k - $332k
Senior/Staff Machine Learning Engineer - Perception Offline Driving Intelligence Develop... ...impact in our robotaxi platform, ensuring they can... ...at Zoox. Drive end‑to‑end ML solutions from research to... ...preprocessing, model training, and evaluation Proficiency in Python and...PlatformFull time$275k - $325k
...Staff Back End Engineer, Evals - Hazel AI San Francisco, CA Altruist is... ...industry by building an AI platform for wealth professionals. We... ...opportunity: Architect our evaluation platform from first... ...model quality, fine-tuning, or ML platform work for production...PlatformWork at officeImmediate startAltruist
San Francisco, CA4 days ago$275k - $325k
...industry by building an AI platform for wealth... ...Hazel is building the AI engine for wealth management that... ...we're excited to hire a Staff Back End Engineer focused... ...Familiarity with AI/ML use cases such as content... ...performance review cycles. By evaluating compensation on a...PlatformWork at officeImmediate startFlexible hoursAltruist
San Francisco, CA20 hours ago$230k - $322k
...teams. We are looking for a Staff Machine Learning Engineer who will lead the... ...owner for ACU’s signals and ML systems. Roughly 50% of their... ...and systems craft. Develop evaluation systems and quality... ...signals registry. Partner with platform teams and other content understanding...PlatformFlexible hours$231k - $318k
...Staff Backend Engineer - Search FX (Discovery Experience) San Francisco, CA... ...Faire is a technology wholesale platform built on the belief that the... ...the intersection of search, evaluation, and personalization shaping... ...technical direction. AI/ML Familiarity: Experience...PlatformWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per weekFaire Inc
San Francisco, CA10 days ago- ...team of former Scale AI engineers and operators. In less... ...engineers build the pipelines, platforms, and models that... ...About this role As a Staff Product Engineer at David... ...insights. Deploy and evaluate LLM‑ and DSP‑based solutions... ..., data engineering, ML, and signal processing....PlatformWork at office
$190k - $285k
...we are seeking multiple GenAI Engineers from junior levels to more... ...products, and strengthening our platform architecture to enable... ...domains. Design and implement ML pipelines for data preprocessing... ...hyperparameter tuning, and model evaluation, enabling rapid...PlatformWork at officeLocal areaWorldwide$251k - $310k
...also be applied to a range of vehicle platforms and product use cases. The Waymo Driver... ...challenging real-world problems with ML and engineering solutions. Use state of the art techniques... ..., algorithms, pipelines and evaluation systems on Google's extensive data infrastructure...PlatformFull timeContract workInternshipRemote workWaymo
San Francisco, CA1 day ago$250k - $334.53k
...applied to a range of vehicle platforms and product use cases. The... ...diverse set of sensors, enabling engineers like you to (1) develop... ...Develop methods and recipes for evaluating real-world performance of models... ...Design, build and implement ML data infra and validate the...PlatformFull timeRemote workWaymo
San Francisco, CA20 hours ago- ...Staff AI Engineer We are looking for a Staff AI Engineer to join the GenAI + Discovery Platform team at Strava, a team at the core of Strava's AI strategy... ..., search and retrieval to evaluation and ROI frameworks. This... ...: Working fluidly with ML engineers, data engineers,...PlatformWork at officeWorldwideFlexible hours3 days per week
Strava
San Francisco, CA4 days ago $141k - $249k
...performance bottlenecks. - Identify and evaluate emerging technologies that can be... ...techniques. - Work with researchers and ML engineers on best-practices for optimal resource... ...Experience with Kubernetes-based training platforms. The US yearly salary range for...PlatformWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA29 days ago- ...Staff AI Engineer Goodfin is an AI-native wealth platform focused on private markets. We're building intelligent, agentic... ...accredited investors research, evaluate, and act on private investment opportunities... ..." looks like when traditional ML metrics fall short. Trust as...Platform
goodfin
San Francisco, CA20 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, Trustworthy ML Evaluation Platform. Be the first to apply!
Related searches
- assistant engineering manager San Francisco, CA
- assistant mechanical engineer San Francisco, CA
- staff data engineer San Francisco, CA
- staff design engineer San Francisco, CA
- engineering aide San Francisco, CA
- software engineer staff San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff automation engineer San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- technology administrator San Francisco, CA