ML Safety & Benchmarking Research Engineer
Apple Inc.
A leading technology company located in San Francisco is seeking a Machine Learning Research Engineer to design and develop safe AI benchmarking methodologies. This role involves collaboration with various teams to implement responsible evaluation techniques. Candidates should possess a strong research background, proficiency in Python, and experience in AI/ML model evaluation. The position offers competitive compensation, stock option opportunities, and comprehensive benefits including medical, dental coverage, and educational reimbursement.#J-18808-Ljbffr
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the ML Safety & Benchmarking Research Engineer in San Francisco, CA vacancy
- ...models. Mercor's APEX benchmark family measures AI's real... ...You’ll work alongside researchers, operators, and AI... ...Role As a Research Engineer at Mercor, you’ll work... ...use, reasoning errors, safety/alignment issues); categorize... ...-on experience with ML models and evaluation...SuggestedWork at officeRelocation package
Mercor
San Francisco, CA3 days ago $150k - $250k
...Join a small, highly technical team of researchers and engineers — including International Olympiad... ...early-stage startup building high-quality benchmarks to evaluate frontier AI agents on... ...execution. The company operates in the AI/ML evaluation and reinforcement learning...SuggestedWork at officeRemote workVisa sponsorshipClera
San Francisco, CA6 days ago$140k - $200k
...Research Engineer & Scientist The Center for AI Safety (CAIS) is a leading research and advocacy organization focused on... ...introducing the first state-of-the-art benchmarks for measuring it. More... ...multiple papers published at a top ML conference venues (e.g., NeurIPS,...SuggestedFull timeWork at officeLocal areaCenter for Artificial Intelligence Safety Inc
San Francisco, CA7 days ago$174k - $253k
Research new alignment methods, studying alignment failures, and applying... ...Science, a related Software Engineering field, or equivalent... ...experience in software development, ML engineering, or ML research.... ...research to improve the safety and alignment of frontier AI...Suggested$174k - $253k
...Computer Science, a related Software Engineering field, or equivalent practical... ...experience in software development, ML engineering, or ML research. ~ Experience working with research... ...to applied research to improve the safety and alignment of frontier AI systems...SuggestedFull timeDeepMind
San Francisco, CA18 days ago- United States Digital Space LLC is seeking a bio safety researcher to design and run capability evaluations for frontier models in biology... ...training data for safety classifiers, and collaborate with ML engineers to ensure robustness and practical deployment. The role...
$200k - $225k
...AlembicAlembic is where top engineers are solving marketing's hardest... ...advanced analyticsDocument research and implementation decisions... ...measurement domainsUnderstanding of ML engineering and MLOps... ...hires earn at or above real-time benchmarks. Ownership: Our generous...$300k - $405k
...is a quickly growing group of committed researchers, engineers, policy experts, and business leaders... ...looking for research engineers to build the safety and oversight mechanisms that govern... ...on those classifiers alongside our ML engineers, and measuring how they hold...Work at officeVisa sponsorshipFlexible hoursShift work$315k
We are looking for Research Engineers to build “gold standard” evaluations for catastrophic risks, in order to understand what AI Safety Level (ASL) to assign to models. Research leads on this... ...You may be a good fit if you: Have an ML-focused background and engineering...Currently hiringWork at officeImmediate startHome officeVisa sponsorshipRelocation package- ...scale commercial projects while improving safety and predictability on the job site.... ...edge deployment on Jetson AGX Orin. Every research project will have a deployment milestone.... ...Requirements BS/MS/PhD in CS, Robotics, ML, or equivalent experience shipping learned...
Origin
San Francisco, CAmore than 2 months ago - ...The Impact You'll Make Our research team is expanding to keep... ...engagements that require real ML depth, and emerging opportunities... ...of the field. As a Research Engineer, you'll take a research... ...– finding the right papers, benchmarks, and prior work, reimplementing...Full time
SuperAnnotate AI
San Francisco, CAa month ago $264.8k - $331k
...complex agents in enterprises around the world. The Enterprise ML Research Lab works on the front lines of this AI revolution. We are... ...algorithms to real life enterprise datasets across our clients + benchmarks. This will involve creating best-in-class Agents that achieve...Full time- ...Every applied AI company we benchmark against like Decagon, Harvey,... ...every day. We see exactly where research meets production and where... ...alongside elite and competitive engineering minds. Translate findings... ...world agent behavior; production ML systems (latency, reliability...Relocation
$350k
...quickly growing group of committed researchers, engineers, policy experts, and business... ...training production ML systems Have experience designing evals or benchmarks for LLMs Have domain expertise... ...perspectives on our team. Your safety matters to us. To protect yourself...Work at officeVisa sponsorshipFlexible hours- ...Join to apply for the Senior Innovation Engineer (Remote) role at Jobright.ai 1 day ago... ...out Preferred: • Experience with AI/ML frameworks like PyTorch, TensorFlow, or OpenAI... ...Machine Learning Engineer, Trust & Safety Sr Staff Engineer - Production Readiness...Full timeRemote work
Jobright.ai
Mill Valley, CA4 days ago $250k - $350k
...backgrounds in technology — from AI research to systems engineering to product design — creating a tight... ...collaborate closely with research scientists, ML engineers, and systems teams to... .... Create evaluation frameworks, benchmarks, and metrics to measure SLAM accuracy...Full timeWorld Labs
San Francisco, CA5 days ago- ..., seeks a leader to drive our in-house research and post-training efforts. You will train... ...models, evaluate quality, and build benchmarks while shaping the public research narrative... ...to platform tooling, and help grow the engineering team. Expect startup speed, strong...
$250k - $300k
...powers breakthrough AI models at leading research labs and enterprises. Since 2018, we've been... ...and tools to construct, train, benchmark and evaluate autonomous agent capabilities... ...years of experience addressing sophisticated ML problems with successful delivery to customers...Work at officeFlexible hours2 days per week- ...safe, and under control. The Role We are seeking a Staff Research Engineer, AI/ML & Cybersecurity to serve as a core technical pillar in the... ...observability, and reproducibility Develop model evaluation, benchmarking, and stress-testing workflows Cybersecurity & Governance...
$200k - $350k
...building at the intersection of research, product, and creativity .... ...a Machine Learning Research Engineer , you’ll own end-to-end... ...design, visual style) Develop benchmarks and evaluation methods for... ...–6+ years in post‑training, ML research, or ML engineering...Coders Connect
San Francisco, CA11 hours ago$200k - $350k
...Francisco is seeking a Machine Learning Research Engineer to own end-to-end research cycles. The... ...creative domains, developing evaluation benchmarks, and collaborating with creative... ...will have 2-6+ years of experience in ML research, strong skills in Python and PyTorch...Coders Connect
San Francisco, CA11 hours ago$197.3k - $313.7k
...looking for talented software and platform engineers to embed in our AI team to bridge the gap... ...skills directly enable world-class research and products used by millions?At Salesforce... ...practice.Build tools and pipelines to support ML and AI efforts.Design, build, deploy, and...Full time$110.7k - $379.2k
Position Summary Research Engineer — Post-Training & Small Language Models (SLMs), Healthcare... ...how each affects reasoning quality, safety, latency, cost, and reliability. •... ...healthcare-grade evaluation — held-out clinical benchmarks, deployment regression gates,...Local areaVisa sponsorship- Factory is seeking innovative Research Engineers to design and integrate advanced AI and ML capabilities that revolutionize productivity and accelerate innovation within software organizations.What you will do and achieve:Design, develop, and deploy AI-driven agentic systems...Work at office
$164.6k - $313.3k
...OpportunityAdobe's Sound Design AI group (SODA) is looking for a driven Data/ML engineer to push the boundaries of audio GenAI. Join the team behind... ...in Adobe products.We’re a small, collaborative and efficient research team looking for highly motivated candidates of all levels...Full timeTemporary workLocal areaWorldwide$150k - $250k
...the Role We're a ~15-person engineering team — made up of Olympiad medalists and published researchers — building infrastructure that... ...experience in software engineering, ML engineering, or AI research —... ...evaluation frameworks, benchmarks, or testing environments for AI...RelocationVisa sponsorshipClera
San Francisco, CA6 days ago- ...Scale is seeking a Machine Learning Research Engineer, Agents - Enterprise GenAI to advance state-of-the-art Agent RL training for enterprise... ..., and contribute to experimental results across client benchmarks. Ideal candidates have 1–3 years building with LLMs in production...
Scale
San Francisco, CA11 hours ago $227.2k - $284k
...tooling that power agentic AI in production, paired with applied ML research, design, and evaluation to ensure these systems perform... ...looks like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across the full breadth of AIS’s technical needs...Full time- ...accomplished a lot as just one engineer and one designer!) to a clan... ...performance on relevant benchmarks, generating novel insights along... ...life". Specifically, in an AI research engineer role, we are looking... ...write down or describe core ML modeling equations such as gradient...
- ...environmental aspects of the grid that affect reliability and safety. Gridware’s advanced Active Grid Response platform uses high-... ...Role Description We are seeking a creative, hands-on Senior Research Engineer to lead ambiguous sensing and measurement problems with real-...Local area
Gridware
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Safety & Benchmarking Research Engineer. Be the first to apply!
Related searches
- ai ml engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- safety engineer San Francisco, CA