Model Quality Engineer — Build Eval Systems for Claude Code
$320kMenlo Ventures
Menlo Ventures is seeking a Software Engineer (Model Quality) to join the Claude Code team in San Francisco or New York. The role involves collaboration with researchers to enhance Claude's coding abilities through infrastructure and tooling improvements. The position demands strong systems-building skills and experience with complex software. The selected candidate will receive a generous annual compensation ranging from $320,000 to $485,000 USD, along with opportunities for visa sponsorship. #J-18808-Ljbffr Menlo Ventures
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Model Quality Engineer — Build Eval Systems for Claude Code in San Francisco, CA vacancy
$405k
...and steerable AI systems. We want AI to be safe... ...researchers, engineers, policy experts, and... ...working together to build beneficial AI systems... ...research on the Claude Code team. In this role,... ...team * Architect eval frameworks that measure model capabilities across...SuggestedWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA1 day ago$136k - $160k
...growing team of world-class engineering, operations, medical... ...use a wide variety of systems. Our people use Google... ...an experienced Senior Quality Software Engineer to ensure... ...cases using Python Build complex data sets to be... ...SCRUMs, design reviews, code reviews and providing feedback...SuggestedWork experience placementRemote workGrabJobs
San Francisco, CA6 days ago$125k - $155k
A robotics technology company in San Francisco is seeking a full-time Robotics QE Engineer to ensure the reliability and performance of robotic software and hardware systems. Key responsibilities include leading the testing of robotic solutions, validating hardware/software...SuggestedFull time- MoData in San Francisco is looking for skilled engineers to join their team focused on innovative data solutions. Ideal candidates should... ...in deploying applications, monitoring performance, and building scalable infrastructure. Responsibilities include troubleshooting...SuggestedFlexible hours
$98k - $140k
...Notion helps you build beautiful tools for... ...You’ll own the quality bar for Notion AI... ...with product and engineering teams to build systems to define what “good... ...days writing code. Instead, you'll... ...ll shape Notion’s model strategy and work... ...Measurement — Design eval strategies, build...SuggestedLive inWork at officeLocal area- ...resolution and depth. This is a vertically integrated effort building cutting-edge hardware, software, and research capabilities... ...rigor and integrity from each other. About the role As a Quality Systems Engineer at Nudge, you will: Ensure that new and existing product designs...
$192k - $260k
...breakthroughs. We do this by building and running the... ...Foundation Model Serving is the API... ...models like Claude and OpenAI GPT. For... ...We're looking for engineers who have owned high... ...operational sensitive systems like customer... ...best practices for code quality, testing, and operational...Local areaWorldwideDatabricks
San Francisco, CA2 days ago$207k - $295k
...Team Our Safety Systems team is at the... ...OpenAI's mission to build and deploy safe... ...Safety Systems, the Model Policy team aligns... ...closely with research, engineering, product,... ...policy and evaluation quality over time. Identify... ...adjudication, and eval coverage analysis,...Work at officeWork from homeRelocation packageShift workOpenAI
San Francisco, CA14 hours ago$126.8k - $220.9k
Wireless System Automation and Test Engineer San Francisco Bay Area, California, United States Hardware Do... ...with their devices. Join us and help build world-renowned wireless systems that... ...development while maintaining exceptional quality. This role offers the opportunity to...Relocation$135k - $175k
...75,000 Job Overview As the Quality Control Systems Manager, you will work onsite... ...for fast-paced design-build projects. You will be responsible... ...the Project Manager, Project Engineer, and Project Superintendent.... ..., and maintain a log of all code and independent inspections...Contract workFor contractorsFor subcontractorLocal areaFlexible hours$135k - $175k
...telecom facilities, commercial buildings, disaster relief programs,... ...Position Overview As the Quality Control Systems Manager, you will work... ...the Project Manager, Project Engineer, and Project Superintendent... ...and maintain a log of all code and independent inspections...Contract workFor contractorsFor subcontractor$142k - $178k
...electrify RVs demands building cutting edge... ...controls. As a Senior Systems Test Engineer, you will design and... ...ensure a high bar of quality for our embedded software... ...infrastructure Proficiency coding in Python Experience... ...and MATLAB for model-based HIL testing Ability...Full timeWork from homeFlexible hours$272k - $336k
...Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver — The World's Most Experienced Driver — to... ...of billions in simulation across 15+ U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in...Odd jobFull timeRemote work- ...LLM, speech, and vision models. Partner with ML... ...infrastructure and training engineers to build a fast, cost-effective... ...without sacrificing quality. Use techniques... ...latency. Significant systems programming experience... ...low-level systems code. Always up to date...Full timeContract workFlexible hours
SESAME
San Francisco, CA3 days ago $217k - $312.2k
...breakthroughs. We do this by building and running the world'... .... Databricks’ Model Serving product provides... .... As a Senior Engineering Manager, you will lead... ...Promote best practices in code quality, testing, observability... ...large‑scale distributed systems, preferably real‑time...Local areaWorldwide- ...mission is to automate coding. The first step in... ...our journey is to build the best tool for... ..., design, and engineering. Our organization... ...You will lead the Model Routing & Inference... ...change. Building the systems that dynamically... ..., latency, and quality. Managing GPU cluster...
- ...medicine—and the inference systems that power them need to... ...class. We’re looking for an Engineering Manager to lead and grow our Model Inference team. The... ...inference engineers focused on building and scaling... ...on technical designs and code reviews Has thrived in a...Hourly payFull timeFlexible hours
$180k - $340k
A tech company in San Francisco is seeking a Research Engineer to enhance AI quality across its products. This role involves designing metrics, conducting... ...should have over two years of experience with AI systems, a strong background in prompt engineering, and a...Work at officeRemote work$196k - $242k
...Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced... ...across 15+ U.S. states. Waymo's Systems Engineering team works together to blend software... ...experience ~ Excellent debugging and coding skills, with a passion for both “firefighting...Full timeRemote workWaymo
San Francisco, CA14 hours ago- ...hire a highly capable Quality Engineer who possesses excellent... ...with everything they build. Duties & Responsibilities... ...end and back end systems. • Diagnose issues, report... ...peers to monitor code coverage; recommend bug... ...features and building eval harnesses for non-deterministic...Work from home
GrabJobs
San Francisco, CA1 day ago $220k - $320k
...techniques into production systems, we'd love to meet... ...language models for companies that need frontier-quality AI at a fraction of... ...ten-person team of engineers who work in-person... ...team has been writing code for over 10 years,... ...into production Build tooling and benchmarks...Work at officeInference
San Francisco, CA2 days ago- ...• Senior Software Test Engineer will design and implement... ...solutions with highest quality using agile tools &... ...execution of robot and sub-system tests • Development of... ...defects in software coding • Should possess the programing... ...• Experience in building and executing automated...Work experience placementRemote work
CatchProbe Intelligence Technologies
San Francisco, CA14 hours ago - ...our start-of-the-art AI models, allowing them to do... ...We are looking for an engineer who wants to take the world... ...inference stack. Build tools to give us visibility... .... Optimize our code and fleet of Azure VMs... ...production distributed systems. Bonus point if worked...
OpenAI
San Francisco, CA14 hours ago $85k - $115k
...-modal data collection systems are transforming how retailers... ...Software Test & QA Engineer to help ensure the... ...performance, reliability, and quality of Simbe's robotics... ...testability, and build automated tests. Constantly... ...of C++ and Python code (reading/debugging across...Local areaRemote workWorldwideSimbe Robotics Inc
San Francisco, CA2 days ago- The Sr. Quality Engineer will report to the Technology Department... ...SaaS, and On-Premises models. You will be an... ...empowering engineers to build a smarter health benefits... ...workflow, improve code quality, and solve complex... ...between the system under test and the automation...Remote jobNight shift
- ...Condor exists to change that. We are a system of action, building the financial intelligence layer... ...therapies reach patients. The Role As a Quality Engineer at Condor, you will play a critical... ...automation and test infrastructure code. Perform manual testing when needed...Contract workLive inImmediate start
- Title: Model Based Systems Engineer Job Type: W2 Contract Contract Length: 6 months Pay Range: 65-75/hr Start Date: 3/24 Location: Onsite - Foster City, CA About the Opportunity: Our client, a leader in Autonomous Vehicle Technology, is looking for a skilled Model Based...Contract workFor contractors
$320k
...City is seeking a Research Engineer to develop evaluations for Claude’s capabilities. The ideal... ...with distributed systems, and the ability to communicate... ...include designing evaluations, building infrastructure for... ...role offers a hybrid work model and competitive compensation...Remote job- ...Capital in San Francisco seeks a Research Program Manager to build foundational model evaluations and safety frameworks. This role demands a... ...management and AI safety. You will engage with research and engineering teams while establishing operational processes that...
$315k
...and steerable AI systems. We want AI to be... ...committed researchers, engineers, policy experts,... ...together to build beneficial AI systems... ...Anthropic's production models undergo... ...into the refined Claude models that users... ...directly impact the quality, safety, and capabilities...Work at officeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Model Quality Engineer — Build Eval Systems for Claude Code. Be the first to apply!
Related searches
- program quality engineer San Francisco, CA
- advanced quality engineer San Francisco, CA
- senior quality systems engineer San Francisco, CA
- quality engineer remote San Francisco, CA
- customer quality engineer San Francisco, CA
- quality systems engineer San Francisco, CA
- senior supplier quality engineer San Francisco, CA
- supplier quality engineer San Francisco, CA
- senior data quality engineer San Francisco, CA
- quality engineer San Francisco, CA