ML Safety & Benchmarking Research Engineer
Apple Inc.
A leading technology company located in San Francisco is seeking a Machine Learning Research Engineer to design and develop safe AI benchmarking methodologies. This role involves collaboration with various teams to implement responsible evaluation techniques. Candidates should possess a strong research background, proficiency in Python, and experience in AI/ML model evaluation. The position offers competitive compensation, stock option opportunities, and comprehensive benefits including medical, dental coverage, and educational reimbursement. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Safety & Benchmarking Research Engineer in San Francisco, CA vacancy
$174k - $253k
Research new alignment methods, studying alignment failures, and applying... ...Science, a related Software Engineering field, or equivalent... ...experience in software development, ML engineering, or ML research.... ...research to improve the safety and alignment of frontier AI...Suggested$150k - $250k
...Olympiad medalists and published AI researchers — building high-quality benchmarks to evaluate frontier AI agents on... ...specific workflows. As a Research Engineer, Benchmarks , you'll own the design... ...experience in software engineering, ML engineering, or research roles. ~...SuggestedFull timeWork at officeVisa sponsorship$200k - $225k
...AlembicAlembic is where top engineers are solving marketing's hardest... ...advanced analyticsDocument research and implementation decisions... ...measurement domainsUnderstanding of ML engineering and MLOps... ...hires earn at or above real-time benchmarks. Ownership: Our generous...Suggested- ...scale commercial projects while improving safety and predictability on the job site.... ...edge deployment on Jetson AGX Orin. Every research project will have a deployment milestone.... ...Requirements BS/MS/PhD in CS, Robotics, ML, or equivalent experience shipping learned...Suggested
$264.8k - $331k
...complex agents in enterprises around the world. The Enterprise ML Research Lab works on the front lines of this AI revolution. We are... ...algorithms to real life enterprise datasets across our clients + benchmarks. This will involve creating best-in-class Agents that achieve...SuggestedFull time$200k - $350k
...building at the intersection of research, product, and creativity .... ...a Machine Learning Research Engineer , you’ll own end-to-end research... ..., visual style) Develop benchmarks and evaluation methods for subjective... ...2-6+ years in post‑training, ML research, or ML engineering...$75 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam... ...Position: Human Baseliner for Open-Ended ML Research Tasks Type: Contract Compensation...Contract workFor contractorsSummer workRemote work$110.7k - $379.2k
Position Summary Research Engineer — Post-Training & Small Language Models (SLMs), Healthcare... ...how each affects reasoning quality, safety, latency, cost, and reliability. •... ...healthcare-grade evaluation — held-out clinical benchmarks, deployment regression gates,...Local areaVisa sponsorship$197.3k - $313.7k
...looking for talented software and platform engineers to embed in our AI team to bridge the gap... ...skills directly enable world-class research and products used by millions?At Salesforce... ...practice.Build tools and pipelines to support ML and AI efforts.Design, build, deploy, and...Full time- Factory is seeking innovative Research Engineers to design and integrate advanced AI and ML capabilities that revolutionize productivity and accelerate innovation within software organizations.What you will do and achieve:Design, develop, and deploy AI-driven agentic systems...Work at office
$164.6k - $313.3k
...OpportunityAdobe's Sound Design AI group (SODA) is looking for a driven Data/ML engineer to push the boundaries of audio GenAI. Join the team behind... ...in Adobe products.We’re a small, collaborative and efficient research team looking for highly motivated candidates of all levels...Full timeTemporary workLocal areaWorldwide$174k - $253k
...Computer Science, a related Software Engineering field, or equivalent practical... ...experience in software development, ML engineering, or ML research. ~ Experience working with research... ...to applied research to improve the safety and alignment of frontier AI systems...Full time$150k - $250k
...and evaluation pipelines. Our engineering team of ~15 includes Olympiad medalists and published researchers, and we're growing it with... ...environments, evaluations, and benchmarks. ~ Detail-oriented mindset... ...work at an early-stage AI or ML startup. Compensation & Benefits...Work at officeRemote workVisa sponsorship- ...real scenarios). Making that feel human is one of the hardest engineering problems in AI, and our engineering team's unique ability to solve... ...agents and orchestration, browser/computer use, and applied ML such as multimodal evals Comfortable in a small team where you...
Sable AI, Inc
San Francisco, CA14 hours ago - ...environmental aspects of the grid that affect reliability and safety. Gridware’s advanced Active Grid Response platform uses high-... ...Role Description We are seeking a creative, hands-on Senior Research Engineer to lead ambiguous sensing and measurement problems with real-...Local area
Gridware
San Francisco, CA26 days ago $216k - $270k
...tooling that power agentic AI in production, paired with applied ML research, design, and evaluation to ensure these systems perform... ...looks like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across the full breadth of AIS’s technical needs...Full time- ...accomplished a lot as just one engineer and one designer!) to a clan... ...performance on relevant benchmarks, generating novel insights along... ...life". Specifically, in an AI research engineer role, we are looking... ...write down or describe core ML modeling equations such as gradient...
$220k - $290k
...Sciences LLC) is an Alphabet-founded research and development company whose... ...Calico seeks Machine Learning Research Engineers to join our rapidly growing ML team. You will play a critical... ...implement evaluation frameworks, benchmarks, and scientific workflow tools that...- ...experienced Senior Lead Application Pen Testing Cyber Security Research Engineer to join the Application Penetration Testing department. This... ...frameworks using modern programming languagesExperience assessing AI/ML systems, Generative AI applications, LLM security risks,...Full timeWork experience placementRemote work
- ...building Agentic AI that empowers software engineers by automating production engineering and... ...powered workflows end‑to‑end, balancing research and engineering to create production‑... ...training and evaluation Design and execute benchmarks to evaluate AI models, improve...Full timeWork at officeVisa sponsorshipFlexible hours
$160k - $250k
Join to apply for the Founding Research Engineer role at Adam Join to apply for the Founding Research Engineer role at Adam This range is provided... ...inference Have a track record of original contributions in ML (first-author papers, open-source projects, or shipped systems...Full time$150k - $250k
...About the Role Join an early-stage AI/ML startup building the infrastructure layer... ...data at the frontier. As Lead Research Engineer, Data Quality , you will own the strategy... ...across RL environments, synthetic data, benchmarks, and domain-specific workflows. Define...Work at officeVisa sponsorshipRelocation package$150k - $250k
...world workflows. As a Forward Deployed Research Engineer , you'll own end-to-end resolution of... ...environments. ~ Experience working on benchmarks and evals, with sound judgment about... ...forward-deployed engineering role at an AI/ML company. Familiarity with RL...Remote workRelocationVisa sponsorship- ...The Impact You'll Make Our research team is expanding to keep... ...engagements that require real ML depth, and emerging opportunities... ...of the field. As a Research Engineer, you'll take a research... ...– finding the right papers, benchmarks, and prior work, reimplementing...Full time
$150k - $250k
...serial AI startup founders, and researchers with publications at top... .... We're looking for Research Engineers to work across agent quality control automation, benchmarks, and synthetic data — shaping... ...contributions to open-source ML/AI tooling. Compensation &...Visa sponsorship$264.8k - $331k
...the RoleAs a Senior/Staff Machine Learning Engineer (MLE) on the General Agents team, you’ll... ...in ambiguous problem spaces, balancing research-driven approaches with pragmatic product... ...systems in production.Experience deploying ML systems in cloud environments and operating...Full time$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large... ...inference. The platform has been powering MLEs, researchers, data scientists and operators for fast... ...distributed ML systemsStrong software engineering skills, proficient in frameworks and...Full time$192.6k - $344.85k
...OpportunityFoundation models are reshaping how engineers, architects, and designers... ...systems is still an open research problem.Autodesk touches more... ..., tool use, agentic behavior, safety, and real-world workflow... ...world-class talent across ML, RL, alignment, and foundation...Full timeFor contractorsRemote work- ...company based in San Francisco, California. The Role: As a Research Engineer - AI Performance & Kernel Optimization , you will improve and... ...: Kernel development and optimization for large-scale ML workloads, using any level of the stack from PTX/assembly to CUDA...Work at officeRelocation package
Zyphra
San Francisco, CAa month ago $148.5k - $223.9k
...the Role:The Adversarial AI & Research Team is a specialized group of cross-functional security engineers working at the intersection of... ...experience testing the security of AI/ML systems, with a deep... ...pipelines.Familiarity with current AI safety research and frameworks like...Full timeRemote workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Safety & Benchmarking Research Engineer. Be the first to apply!
Related searches
- graduate machine learning engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- senior safety engineer San Francisco, CA
- safety engineer San Francisco, CA