Research Engineer — AGI Evaluation & On-Device Perf
AGI, Inc.
AGI, Inc. in San Francisco is looking for a skilled professional to build evaluation harnesses that ensure models and agents are performing at their best. You will set criteria for releases, audit existing evaluation processes, and develop tooling to assist research and product teams. The position emphasizes collaboration and delivery of dependable performance metrics to improve AI capabilities. You'll need to have a firm grasp on non-deterministic systems and QA processes in a production environment, enhancing user experience and device performance. Competitive compensation and relocation support are offered. #J-18808-Ljbffr AGI, Inc.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Research Engineer — AGI Evaluation & On-Device Perf in San Francisco, CA vacancy
- ...the Team The Future of Computing Research team is an applied research team within the Consumer Devices group focused on developing new methods, models, and evaluation frameworks that support our... ...work closely across research, engineering, design, product, and safety to...SuggestedWork at officeImmediate startRelocation package
- ...Mission Build everyday AGI. Trustworthy, consumer-... ...elite founders and AI researchers, with backgrounds spanning... ..., agentic behavior, on-device performance, and end-... ...what we want Product engineers, by instrumenting real-... ...expected to learn On-device perf trade-offs and how they...SuggestedRelocation package
$320k
Anthropic in New York City is seeking a Research Engineer to develop evaluations for Claude’s capabilities. The ideal candidate should have strong Python programming skills, experience with distributed systems, and the ability to communicate technical results effectively...SuggestedRemote job- Arcada is seeking an ML Research Engineer to improve evaluation methods and understanding of AI capabilities. You will design large-scale experiments to analyze performance and contribute to public leaderboards and tools. The ideal candidate has deep expertise in evaluating...Suggested
$315k
We are looking for Research Engineers to build “gold standard” evaluations for catastrophic risks, in order to understand what AI Safety Level (ASL) to assign to models. Research leads on this team collaborate with engineers in one of our focus areas: CBRN, Cyber, Autonomy...SuggestedCurrently hiringWork at officeImmediate startHome officeVisa sponsorshipRelocation package- ...Description We are Genmo, a research lab dedicated to building open... ...unlocking the right brain of AGI. Join us in shaping the... ...seeking an exceptional Software Engineer to join our research team in... ...Opportunity Employer. Candidates are evaluated without regard to age, race,...Work at office
Genmo
San Francisco, CA3 days ago - Drata in San Francisco is looking for an Applied AI Engineer to enhance AI systems through research and experimentation. The role involves optimizing retrieval strategies, designing evaluation frameworks, and collaborating with engineers. Candidates should have extensive...Remote work
- Drata is seeking a Senior Applied Research Engineer to enhance the quality of AI systems through rigorous evaluation and experimentation. This role emphasizes applied research, focusing on information retrieval and reasoning strategies. The ideal candidate will bring 5...
$192k - $237.1k
A leading compliance software company in San Francisco is seeking an Applied AI Engineer to innovate compliance automation through applied research and evaluation. This role emphasizes experimentation over production engineering, requiring strong skills in information...$200k - $250k
Research Engineer Location San Francisco (On-site) Compensation $200,000 - $250,000 + variable... ...dataset curation, model training and evaluation, retrieval and tool use, safety and alignment... ...datasets from EHR, claims, labs, devices, and chat logs with rigorous...$175k - $200k
...a creative, hands‑on Senior Mechanical Research Engineer with significant vibration and dynamics... ...sensing performance requirements. Select and evaluate new sensors for current and new... ...Translate findings into design guidance, device installation requirements, monitoring and...$190k - $320k
Research Engineer - Computer Vision & Machine Learning Want to build vision systems that let... ...team developing a new class of computing devices where perception, language, and... ...model architectures, training pipelines, evaluation frameworks, and inference systems Working...- About the Team The Privacy Engineering Team at OpenAI is committed to... ...Artificial General Intelligence (AGI). Our focus is on all OpenAI... ...-functional engineering and research partners with the necessary... ...Develop internal libraries, evaluation suites, and documentation that...Relocation package
- ...AI Research Scientist We're building the first truly private, personal AI that learns your... .... • Think carefully about how to evaluate quality. We're not trying to push up numbers... ...The challenge of human relevance in a post-AGI world isn't going to solve itself. • A...Shift work
Workshop Labs
San Francisco, CA5 days ago $147.4k - $272.1k
...Camera Software- Sr. Machine Learning Research Engineer iPhone is the most popular camera in... ...algorithms for Apple's mobile devices, including the iPhone and iPad. Combining... ...video datasets. Develop comprehensive evaluation frameworks including implementing quantitative...RelocationApple
San Francisco, CA1 day ago- ...Turing is the world’s leading research accelerator for frontier AI... ...We create RL environments to evaluate and improve our customers' models... ...: Environments for Software Engineering / coding agents UI-... ...design. Real impact (path to AGI): your datasets and environments...For contractorsFlexible hours
$320k
...a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to... ...role We're looking for Research Engineers to build the evaluations that tell us — and the world — what Claude can actually do...Remote jobWork at officeVisa sponsorshipFlexible hours- ...seeking a Senior ML Scientist/Engineer to design models that operate... .... This role blends applied research, model optimization, and low-... ...engineering, model training, evaluation, and optimization. Design... ...deploying production ML models, on-device. ~3+ years of applied...
Gridware
San Francisco, CA4 days ago - ...Research Engineer, Foundation Models About the Opportunity We are seeking a Research Engineer to help advance the next generation... ...research and engineering, focusing on the development, training, evaluation, and deployment of state-of-the-art machine learning models....Visa sponsorshipRelocation packageFlexible hours
Acceler8 Talent
San Francisco, CA4 days ago - ...Research Engineer San Francisco, CA $750k+ Total Comp. This is a rare opportunity to build production grade AI systems that directly... ...architectures, prompting strategies, tool integrations, and evaluation frameworks Build reusable infrastructure such as agent...Work at office
Harnham
San Francisco, CA1 hour ago - ...infrastructure / Reinforcement Learning (RL) training data & evaluations Compensation: Competitive (range not provided) +... ...craftsmanship. The Opportunity Our partner is hiring a Research Engineer to help scale the quality assurance (QA) systems behind training...Remote work
talentpluto
San Francisco, CA3 days ago - ...company based in San Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will be a core contributor on... ...training stack Audio dataset collection, processing, and evaluation Architecture and training methodology ablations and...Work at officeRelocation package
Zyphra
San Francisco, CA3 days ago - ...used at work. The role involves building evaluations with real data, addressing search... ...strong ability to execute independent research and effectively communicate ideas through... ...prototyping and collaboration with product and engineering teams are crucial. #J-18808-Ljbffr...
Composio
San Francisco, CA2 days ago - A leading AI research organization is looking for a Research Engineer/Scientist to join their Future of Computing Research team in San Francisco. The role focuses... ...reward models and conducting long-horizon evaluations. Candidates should have strong backgrounds in machine...Relocation package
- ...company based in San Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models , you will be a core contributor... ...’ll Work Across: Large-scale EEG model training runs and evaluation Architecture and training methodology ablations and...Work at officeRelocation package
$150k - $180k
A cutting-edge AI company in California is seeking an Applied Research Engineer to manage their GPU cluster infrastructures for model training and evaluation. This role requires hands-on experience in distributed compute orchestration, strong proficiency in Python, and...Remote job$160k - $240k
Research Engineer — Evals You’ll build the evaluation systems that tell us whether Firecrawl actually works. That sounds simple. It isn’t. Our core promise — convert any URL into clean, structured, LLM‑ready data reliably — is hard to measure rigorously across millions...Full timeTemporary workRemote work$315k
...a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build... ...hardware errors and networking to training dynamics and evaluation infrastructure Design and run experiments to improve training...Full timeWork at officeVisa sponsorshipFlexible hoursWeekend workAfternoon shift$180k - $270k
Research Engineer (Focused on RL) You'll bring reinforcement learning to Firecrawl's core product — building the training infrastructure,... ...from scratch: Design and operate the systems that train and evaluate Firecrawl's models. You'll own the full loop — data collection...Full timeTemporary workRemote work- ...eliminating complexity and friction with seamless automation. As a Research Engineer at Capably, you’ll help define how intelligent systems... ...and production, developing the models, systems, and evaluation approaches that make agentic workflows reliable, repeatable,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer — AGI Evaluation & On-Device Perf. Be the first to apply!
Related searches
- research software engineer San Francisco, CA
- senior research engineer San Francisco, CA
- research engineer San Francisco, CA
- ai research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- research programmer San Francisco, CA
- research sonographer San Francisco, CA
- research and development analyst San Francisco, CA