Staff Engineer, Trustworthy ML Evaluation Platform
AI Chopping Block, Inc.
AI Chopping Block, Inc. is seeking a Member of Technical Staff to build and maintain the evaluation platform used across Magic. You will develop infrastructure for large-scale evaluations and ensure correctness in measurements that influence key research decisions. The ideal candidate should have strong software engineering skills, attention to detail, and experience with machine learning systems. This is an opportunity to contribute to advanced AI research in a collaborative environment. #J-18808-Ljbffr AI Chopping Block, Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Engineer, Trustworthy ML Evaluation Platform in San Francisco, CA vacancy
- ...Proficiency in Python and standard ML frameworks (e.g., JAX,... ...with large-scale simulation platforms and their integration with ML... ...designing and using metrics for evaluating complex AI systems , (... ...for researchers and software engineers who are passionate about developing...Platform
$220.8k - $298.8k
...seeking an Applied AI Engineer to drive the quality and... ...experimentation, and evaluation. In this role, you... ...to deliver accurate, trustworthy results. This is a research... .... Drata's compliance platform is document-heavy: VRM... ..., agents, and classic ML: chunking, embedding...PlatformFlexible hours$220.8k - $298.8k
...Type Hybrid Department Engineering Our Mission & Values... ...experimentation, and evaluation. In this role, you will... ...to deliver accurate, trustworthy results. This is a research... .... Drata's compliance platform is document‑heavy: VRM... ..., agents, and classic ML: chunking, embedding...PlatformFull timeWork at officeImmediate startWorldwideMonday to FridayFlexible hours- ...a strong software engineer who’s built your skills... ...complex AI/ML systems , Deep expertise... ...defining evaluation infrastructure and... ...reasoning transparent and trustworthy , Complex domains:... ...workflows. As a Staff AI Engineer, you'... ..., Create reusable platforms, patterns, and tooling...Platform
$240k - $260k
...extraction) to deliver trustworthy consumer health... ..., inference, evaluation, and analytics (batch... ...with the Product, Engineering, and Data teams and... ...use cases. (Staff scope) Lead architecture... ...and reusable platforms. Examples of problems... ...production ML systems (or equivalent...PlatformWork at officeRemote work$189k - $274k
...We're searching for a Staff Security Engineer to join our Enterprise Security... ..., building, and owning the platforms, integrations, and... ...remediation plans. ~ Experience evaluating security posture and identifying... ...with securing AI/ML platforms or applications built...PlatformWork at officeLocal area3 days per weekEarly shiftAurora Innovation
San Francisco, CA4 days ago- ...the enterprise sustainability platform. Companies like Airbnb,... ...a seasoned machine learning engineer specializing in AI to join our... ...using LLMs, embeddings and other ML technologies ~ Full lifecycle... ...practice, including model evaluation and performance ~ Strong full...PlatformWork at officeRemote work
Watershed Technology, Inc
San Francisco, CA1 day ago $190.72k - $290k
...agentic AI, an enterprise-grade platform, and deep domain expertise,... .... Role Overview As a Staff Database Engineer on the Engineering team at... ...engineering in vendor evaluations, build-vs-buy decisions, and... ...Elasticsearch, Kafka) relevant to AI/ML workloads in regulated...PlatformRemote workRelocation packageHarvey
San Francisco, CA4 days ago- ...and most valuable kind of AI engineering there is. What You'll Do Architect... ...Lead the rebuilding of core platform systems — including our... ...generation (RAG), and agent evaluation. Experience building reliable... ...production AI systems. Classical ML experience — supervised/...PlatformLive inRemote work
- ...at Join EvenUp as a Staff Machine Learning Engineer and build the future of personal... ...claims-intelligence platform. You'll partner closely... ...innovation, mentor a top-tier ML team, and set the vision... ...). Establish rigorous evaluation standards to reduce...PlatformFull timeTemporary workWork at officeLocal areaHome officeFlexible hours
EvenUp Inc.
San Francisco, CA22 hours ago $250k - $350k
...scribe. We're building the AI intelligence platform that restores humanity to healthcare... ...started. The Role: As a Staff ML Engineer on the Frontier AI team at Ambience, you... ...contributions to ML libraries, benchmarks, or evaluation frameworks. Why Here: Our...PlatformWork at officeImmediate startRemote workFlexible hours3 days per weekAmbience Healthcare
San Francisco, CA2 days ago$185.1k - $335.3k
...development, and performance engineering so that every cycle on... ...teams to co-design a platform that enables new ideas... .... The Role As a Staff Compiler Engineer on... ..., and effortless for ML engineers across the... ...in a company vehicle evaluation program, through which...PlatformLocal areaRemote workWork from homeRelocation packageFlexible hoursGeneral Motors
San Francisco, CA3 days ago$215k - $322k
...Join GoFundMe as our next Staff Machine Learning Engineer (Pricing) . In this role,... ...expertise in building production ML systems (data → training →... ..., training, and evaluation. Build low-latency real... ...diverse set of tools and platforms, including Python, AWS, Databricks...PlatformFull timeTemporary workWork at officeFlexible hoursGoFundMe
San Francisco, CA2 days ago$141k - $249k
...performance bottlenecks. - Identify and evaluate emerging technologies that can be... ...techniques. - Work with researchers and ML engineers on best-practices for optimal resource... ...Experience with Kubernetes-based training platforms. The US yearly salary range for...PlatformWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA7 days ago$230k - $332k
Senior/Staff Machine Learning Engineer - Perception Offline Driving Intelligence Develop... ...impact in our robotaxi platform, ensuring they can... ...at Zoox. Drive end‑to‑end ML solutions from research to... ...preprocessing, model training, and evaluation Proficiency in Python and...PlatformFull time$205k - $272.5k
...matter most. Omnitag, our ML-powered multimodal data... ...framework, is the engine that powers this discovery. As a Staff Machine Learning Engineer... ...you will ensure our ML platforms act as a reliable, mission... ...learning architectures, evaluation methodologies, and production...PlatformWork at officeRemote workMotional
San Francisco, CA4 days ago$231k - $318k
...a technology wholesale platform built on the belief that... ...of search, evaluation, and personalization shaping... ...feels less like a search engine and more like a trusted... ...what will sell. As a Staff Engineer on the Search... ...technical direction. AI/ML Familiarity: Experience...PlatformWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per weekFaire Inc
San Francisco, CA3 days ago$230k - $385k
Staff / Senior Staff Product Engineer, Frontend B2B Applications - San Francisco About the... ...enterprise offerings, and platform services that support... ...accessible, intuitive, and trustworthy. You will partner with design... ...teams. Have interest in AI/ML; direct AI/ML experience...PlatformInternship$230k - $322k
...teams. We are looking for a Staff Machine Learning Engineer who will lead the... ...owner for ACU’s signals and ML systems. Roughly 50% of their... ...and systems craft. Develop evaluation systems and quality... ...signals registry. Partner with platform teams and other content understanding...PlatformFlexible hours- ...team of former Scale AI engineers and operators. In less... ...engineers build the pipelines, platforms, and models that... ...About this role As a Staff Product Engineer at David... ...insights. Deploy and evaluate LLM‑ and DSP‑based solutions... ..., data engineering, ML, and signal processing....PlatformWork at office
$180k - $247k
...Identity belongs to you. The Staff Product Security Engineer Opportunity The... ...against an internal developer platform. The findings this team... ...vendor and tooling evaluation program: design and operate... ...offensive research, or AI/ML security. ~ Demonstrated...PlatformLocal areaRemote workWorldwideFlexible hoursOkta, Inc.
San Francisco, CA3 days ago- Senior Staff Machine Learning Engineer, Post Training Remote - USA Airbnb was born... ...Service to Marketing we rely on ML to ensure that guests and... ..., RAG/Search, LLM evaluation and testing automation, feedback... ...contribute to Airbnb’s ML platform architecture and strategy....PlatformWork experience placementRemote work
$112k - $269k
Summary Yelp engineering culture is driven by our values... ...edge Machine Learning (ML) and Artificial... ...geographical locations. As a Staff‑level ML Engineer on... ...contributing to the ML platforms these models rely on.... ...prompt engineering and evaluation. A Bachelor’s Degree...PlatformRemote jobWork experience placementLocal area$189.31k - $389.75k
...around the world come to our platform to find creative ideas,... ...process here. Position As a Staff Machine Learning Engineer focused on Agentic AI &... ...Recommendations, you will lead the ML strategy and execution for... ...development, and offline evaluation through production...PlatformWork at officeLocal areaRemote workRelocationRelocation package1 day per week$190k - $285k
...we are seeking multiple GenAI Engineers from junior levels to more... ...products, and strengthening our platform architecture to enable... ...domains. Design and implement ML pipelines for data preprocessing... ...hyperparameter tuning, and model evaluation, enabling rapid...PlatformWork at officeLocal areaWorldwide- ...manager alike. Our innovative platform is engineered from the ground up to boost... ...COO, Qasar Younis. As a Staff Engineer, you will: Help define... ...want to work with. Delightful, trustworthy, and deeply effective. Join... ...or Node.js Knowledge of ML, AI, LLMs Guiding Principles...PlatformImmediate startShift work
$170.4 per hour
...best data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers, we leap at every opportunity... ...grasp of model training, evaluation, and deployment in distributed... ...environments. Experience managing the ML lifecycle, including...PlatformLocal areaWorldwide$250k - $334.53k
...applied to a range of vehicle platforms and product use cases. The... ...diverse set of sensors, enabling engineers like you to (1) develop... ...Develop methods and recipes for evaluating real-world performance of models... ...Design, build and implement ML data infra and validate the...PlatformFull timeRemote workWaymo
San Francisco, CA3 days ago- ...Staff AI Engineer We are looking for a Staff AI Engineer to join the GenAI + Discovery Platform team at Strava, a team at the core of Strava's AI strategy... ..., search and retrieval to evaluation and ROI frameworks. This... ...: Working fluidly with ML engineers, data engineers,...PlatformWork at officeWorldwideFlexible hours3 days per week
Strava
San Francisco, CA2 days ago - ...Staff AI Engineer Goodfin is an AI-native wealth platform focused on private markets. We're building intelligent, agentic... ...accredited investors research, evaluate, and act on private investment opportunities... ..." looks like when traditional ML metrics fall short. Trust as...Platform
goodfin
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, Trustworthy ML Evaluation Platform. Be the first to apply!
Related searches
- software engineer staff San Francisco, CA
- assistant engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- staff design engineer San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- technology administrator San Francisco, CA
- staff data engineer San Francisco, CA
- assistant chief engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- staff engineer San Francisco, CA