Research Engineer — AGI Evaluation & On-Device Perf
AGI, Inc.
AGI, Inc. in San Francisco is looking for a skilled professional to build evaluation harnesses that ensure models and agents are performing at their best. You will set criteria for releases, audit existing evaluation processes, and develop tooling to assist research and product teams. The position emphasizes collaboration and delivery of dependable performance metrics to improve AI capabilities. You'll need to have a firm grasp on non-deterministic systems and QA processes in a production environment, enhancing user experience and device performance. Competitive compensation and relocation support are offered. #J-18808-Ljbffr AGI, Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Engineer — AGI Evaluation & On-Device Perf in San Francisco, CA vacancy
- ...searching for a dedicated professional to help build the evaluation harness necessary for our advanced AGI models. You will audit existing processes, establish... ...insights into actionable strategies and elevate our research standards, leading to impactful AI developments in a...Suggested
- AGI, Inc. in San Francisco is seeking a dedicated individual to build evaluation frameworks essential for AGI product releases. You will create eval suites that... ...This role involves collaboration with researchers and product engineers, ensuring that all releases are based...SuggestedRelocation package
- AGI Inc, located in San Francisco, is seeking a dedicated professional for a full-time role to evaluate agent models and develop practical assessment rubrics. This position offers competitive... ...to ensure product quality and enhance the research strategy. #J-18808-Ljbffr AGI IncSuggestedFull timeRelocation package
$295k
Research Engineer / Research Scientist -Personal AGI, Proactivity Post-training - San Francisco About the Team The Proactivity Research team, within OpenAI... ...works on reinforcement learning, dataset creation, evaluations, and other post-training methods. We partner...SuggestedWork at officeRelocation packageShift work- ...the Team The Future of Computing Research team is an applied research team within the Consumer Devices group focused on developing new methods, models, and evaluation frameworks that support our... ...work closely across research, engineering, design, product, and safety to...SuggestedWork at officeImmediate startRelocation package
- About the Role You’ll work as a Research Engineer / Scientist on the North Stars team within the broader Personal AGI research organization. Your mission will be to bring the... ..., translate these insights into robust evaluations, training data, reward signals, and both model...Work at officeRelocation package
- About the Team The Proactivity Research team, within OpenAI’s Personal AGI team, focuses on building proactive AI... ...the user. About the Role Research Engineer / Scientist position. Research and... ...learning, dataset creation, evaluations, and post‑training methods. Collaborate...Work at officeRelocation package3 days per week
$295k
Research Engineer / Research Scientist - Personal AGI (Post Training) San Francisco, CA - hybrid (3 days in the office per week). About the Team The Personal... ...to optimize their own models. Build robust evaluations for tracking modeling improvements. Design, implement...Work at officeRelocationRelocation package- ...Mission Build everyday AGI. Trustworthy, consumer-... ...elite founders and AI researchers, with backgrounds spanning... ..., agentic behavior, on-device performance, and end-... ...what we want Product engineers, by instrumenting real-... ...expected to learn On-device perf trade-offs and how they...Relocation package
- The Consulting Solutions is seeking a Research Engineer / Scientist to join the North Stars team. In this role, you will work on enhancing... ...agenda while collaborating closely with other teams and building evaluations to track improvements. This position offers a hybrid work...Work at officeRelocation package3 days per week
$295k
OpenAI is looking for a Research Engineer / Scientist in San Francisco to research and develop improvements to machine learning models. This... ...deep understanding of ML applications, experience in model evaluation, and programming skills to work on complex projects...- Refresh AI is seeking a Research Engineer in San Francisco to push the boundaries of benchmarking technology. You will build benchmarks that labs use for evaluating coding abilities and computer-use capability. Your role will require expertise in reinforcement learning...Full time
- ...seeking a dedicated professional to develop evaluation metrics for advanced AI models and... ...trustworthiness in AI performance and shaping research outcomes by establishing rigorous... ...closely with both researchers and product engineers. Competitive cash and equity compensation...Relocation package
- ...Research Engineer About Us Lotus Health is a groundbreaking primary care app that integrates... ...dataset curation, model training and evaluation, retrieval and tool use, safety and... ...datasets from EHR, claims, labs, devices, and chat logs with rigorous deidentification...
Lotus Health AI, Inc
San Francisco, CA2 days ago $225k
...Research Engineer Magic's mission is to build safe AGI that accelerates humanity's progress on the world's most important problems. We believe the most promising... ...As a Research Engineer, you'll work on training, evaluating, and serving large AI models and new inference-...RelocationVisa sponsorshipMagic Inc
San Francisco, CA5 days ago- AGI, Inc. is seeking a talented engineer to bridge the gap between research and engineering for AI agents. You will work closely with partners to turn concepts into shipping features, providing on-site technical leadership and developing product surfaces for consumer-grade...Relocation package
$315k
We are looking for Research Engineers to build “gold standard” evaluations for catastrophic risks, in order to understand what AI Safety Level (ASL) to assign to models. Research leads on this team collaborate with engineers in one of our focus areas: CBRN, Cyber, Autonomy...Currently hiringWork at officeImmediate startHome officeVisa sponsorshipRelocation package- Drata is seeking a Senior Applied Research Engineer to enhance the quality of AI systems through rigorous evaluation and experimentation. This role emphasizes applied research, focusing on information retrieval and reasoning strategies. The ideal candidate will bring 5...
- ...tokens—let alone do this on-device. We’re pioneering the model... ...innovation and systems engineering paired with a design‑minded... ...for model training. Build evaluations of speech models, both via manual... ...systems that bridge research and production. What We Offer...Work at officeRelocation package
Cartesia
San Francisco, CA1 day ago $175k - $200k
...a creative, hands‑on Senior Mechanical Research Engineer with significant vibration and dynamics... ...sensing performance requirements. Select and evaluate new sensors for current and new... ...Translate findings into design guidance, device installation requirements, monitoring and...$200k - $370k
...tightly connect capability assessment, evaluations, and internal red teaming for frontier... ...models, as well as overall coordination on AGI preparedness. The team’s core goal is... ...We are looking to hire exceptional research engineers that can push the boundaries of our frontier...Permanent employmentTemporary work$360k
...mission to build and deploy safe AGI, driving our commitment to AI... ...or decision relevant research to ensure we shape AI keeping... ...exceptional research scientists/engineers that can push the rigor of work... ...findings into robust evaluations Facilitating and growing our...Work at officeRelocation package- About the Team The Privacy Engineering Team at OpenAI is committed to... ...Artificial General Intelligence (AGI). Our focus is on all OpenAI... ...-functional engineering and research partners with the necessary... ...Develop internal libraries, evaluation suites, and documentation that...Relocation package
$190k - $320k
Research Engineer - Computer Vision & Machine Learning Want to build vision systems that let... ...team developing a new class of computing devices where perception, language, and... ...model architectures, training pipelines, evaluation frameworks, and inference systems Working...- ...Turing is the world’s leading research accelerator for frontier AI... ...We create RL environments to evaluate and improve our customers' models... ...: Environments for Software Engineering / coding agents UI-... ...design. Real impact (path to AGI): your datasets and environments...For contractorsFlexible hours
$185k - $200k
...are seeking a creative, hands‑on Senior Research Engineer to lead ambiguous sensing and... ...measurement performance requirements. Select and evaluate new sensors for current and new sensing... ...phenomena observability. Downsize on‑device data. Develop signal compression techniques...- AI Chopping Block in San Francisco is seeking a Research Engineer / Scientist to enhance AI capabilities for diverse users. In this role, you will drive a research agenda to improve model performance, collaborating closely with various teams. Ideal candidates possess strong...
$160k - $190k
...demands. Responsibilities Lead the Ideation, Evaluation, Demonstration, and Deployment of... ...requirements from potential customers, engineering and construction companies, equipment manufacturers... ...Optional legal and pet insurance plans Device purchase support EEO Statement SB Energy...Work at officeRemote workFlexible hours$310k
...OpenAI’s mission to build and deploy safe AGI, driving our commitment to AI safety and... ...and enable earlier, more reliable safety evaluation during training. We aim to: Develop upstream... ..., we will conduct the foundational research necessary for understanding how behaviors...Work at officeLocal areaRelocation packageFlexible hours$245k
...mission to build and deploy safe AGI, driving our commitment to AI... .... The Safety Reasoning Research team is poised at the intersection... ..., model training, evaluation and deployment, including active... ...Possess 5+ years of research engineering experience and proficiency in...Temporary workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer — AGI Evaluation & On-Device Perf. Be the first to apply!
Related searches
- ai research engineer San Francisco, CA
- research software engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- senior research engineer San Francisco, CA
- research programmer San Francisco, CA
- research assistant engineering San Francisco, CA
- research engineer San Francisco, CA
- research nurse practitioner San Francisco, CA
- scientific research San Francisco, CA