Senior AI Systems Engineer - Model Evaluation
Deepgram
Deepgram is seeking a Senior Software Engineer - Model Evaluation & AI Systems to join the team responsible for validating the quality of our speech, audio, and multilingual models before they reach customers. You will define evaluation methodologies, build scalable pipelines, and integrate quality gates into CI/CD, working with Research, training, inference, and product teams to protect the customer experience. #J-18808-Ljbffr Deepgram
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Systems Engineer - Model Evaluation in San Francisco, CA vacancy
- ...the emerging trillion-dollar Voice AI economy, providing real-time APIs... ...’s voice-native foundation models are accessed through cloud APIs or... ...Opportunity Deepgram is looking for a Senior Software Engineer - Model Evaluation & AI Systems to join the team responsible for...Senior
$159.2k - $301.6k
The Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build... ...infrastructure, service integration layers, evaluation systems, and reliability mechanisms... ...to AI-powered services, agents, and model-backed workflows. Define clean...SeniorFull timeTemporary workLocal areaRemote workWorldwideAdobe Systems
San Francisco, CA1 day ago$124k - $280k
...in data and analytics engineering focus on leveraging... ...implementing advanced AI and ML solutions to drive... ...algorithms, models, and systems to enable intelligent... ...and health plans. As a Senior Manager, you will drive... ...with team members. We evaluate these factors thoughtfully...SeniorFull timeH1bPwC
San Francisco, CA3 days ago- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team... ...Notifications pod is creating the systems that determine what message... ...production path that turns models and AI capabilities into... ...inputs, freshness expectations, evaluation hooks, and production-...SeniorFull timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA1 day ago - Leadout Capital seeks an experienced Distributed Systems Software Engineer - GovCloud (Senior/Lead) to join our public cloud engineering team in the U.S. You... ...systems, ensure high availability, and integrate AI-driven tooling into production workflows. The role emphasizes...Senior
$242.25k - $285k
...connected platform and AI-native ecosystem for private... ...tools with a single system of record, Carta brings... ...’ll join Carta’s ML Engineering team, embedded in Carta... ...agents, specialized legal models, document intelligence... ...from post-training and evaluation through model serving...SeniorFull timeContract workCarta
San Francisco, CA1 day ago$110.7k - $372.9k
Position Summary Senior Agentic AI Engineer — Healthcare AI Three hundred... ...Americans rely on a healthcare system whose decision-making has... ..., building the reasoning models and agentic systems to rebuild... ...right time. Reliability, evaluation & safety • Implement observability...SeniorLocal areaVisa sponsorshipDeloitte
San Francisco, CA2 days ago$122k - $240.5k
...Summary Agentic AI is moving from... ...growing a team of engineers who want to work at... ...autonomous, multi-agent systems powered by Anthropic's Claude models for some of the... ...state management, evaluation, guardrails, and human... ...level employees to senior leaders, we believe...SeniorWork at officeLocal areaVisa sponsorshipShift workDeloitte
San Francisco, CA1 day ago$124k - $280k
...Strategy& Strategy Consulting - Business Model Reinvention - Senior Manager you will provide strategic... ...that tell a holistic story, applying systems thinking to identify underlying... ...collaborating closely with team members. We evaluate these factors thoughtfully to...SeniorFull timeH1bPwC
San Francisco, CA3 days ago$122k - $240.5k
...Summary Join our AI & Engineering team in transforming... ...platforms. Our delivery models are tailored to meet... ...Agentic AI or multi-agent systems 2+ years of hands-on... ...models, model evaluation, and agent orchestration... ...entry-level employees to senior leaders, we believe there...SeniorLocal areaVisa sponsorshipDeloitte
San Francisco, CA2 days ago$77k - $202k
...OpportunityAs a Strategy& - Strategy Consulting Business Model Reinvention - Senior Associate, you will provide strategic guidance and insights... ...proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and...SeniorFull timeH1bPwC
San Francisco, CA3 days ago- ...hiring the world’s best engineers, scientists, designers,... ..., and you decide how AI runs here rather than inheriting... ...-unit chargeback model.Keep the platforms... ...platforms to internal systems, with least-privilege access... ...and tools, with the evaluation and guardrails to keep...
Juul
San Francisco, CA2 days ago - Raydar is a seed-stage AI company in San Francisco building the... ...infrastructure layer to improve model quality in creative domains. You will join as AI Engineer, RL & Evals to design,... ...implement, and scale RL environments, evaluation systems, and production-grade backend...
$192.2k - $260k
...advanced robotics systems that will transform... ...innovative AI, sophisticated control... ...and large language models.We leverage advanced... ....As a Senior Applied Scientist,... ...internal research), evaluate them on representative... ...results and solid engineering practices, closing...SeniorLocal areaWorldwideFlexible hoursAmazon
San Francisco, CA3 days ago$130k - $220k
...the leading independent AI benchmarking and insights company. They help engineers, enterprises, investors... ...described as an AI Evaluation Engineer / Technical Generalist... ...projects evaluating AI systems and technologies.... ...applications, foundation models, and hardware systems....Full timeWorldwide$91k - $321.5k
...SummaryThe OpportunityAs a CTIO - AI Engineer- Senior Manager, you will play a... ...analysis, statistical modeling, and creating data visualizations... ...a holistic story, applying systems thinking to identify underlying... ...with team members. We evaluate these factors thoughtfully to...SeniorFull timeH1bPwC
San Francisco, CA1 day ago$125k - $186k
...comes next.Job Title:Senior AI Applied EngineerCompany... ...hypothesis-driven pilots, evaluating results, and... ...architectures and strong software engineering practices.•... ...delivering production-quality systems.• Expert Python skills... ...: SQL, data modeling, APIs/integration patterns...SeniorFull timePrologis
San Francisco, CA1 day ago$124k - $280k
...people in data and analytics engineering focus on leveraging advanced... ...and implementing advanced AI and ML solutions to drive innovation... ...and optimising algorithms, models, and systems to enable intelligent... ...closely with team members. We evaluate these factors thoughtfully...SeniorFull timeH1bPwC
San Francisco, CA4 days ago- ...role:SoFi’s SeniorStaff AI Engineer is a hands-on AI... .... This is a critical, senior role responsible for setting... ...failoversDeep Model Optimization: Pioneer... ...GenAI, LLMs, and NLP, evaluating and experimenting with... ...methodologies for LLM and agentic systems.Experience with cloud...SeniorRemote work
SoFi
San Francisco, CA4 days ago $293.5k
...Information Job Title Expert Senior Manager, AI Engineering Job ID 104335... ...as part of an integrated system that combines technology... ...redesigned processes, operating model changes, and adoption at... ...experimentation, and evaluation design to production system...SeniorPermanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per weekBain & Company
San Francisco, CA1 day ago$240k - $270k
...we’re not just adding AI—we’re building the future... ...come in. As an AI/ML Engineer, you’ll join a growing... ...opportunitiesPrototype and productionize AI systems that feel intuitive but... ...or training foundation models (language or multimodal... ...for the purposes of evaluating your candidacy for...SeniorFull timeWork at officeSigma Computing
San Francisco, CA16 hours ago$228.6k - $342.8k
...world's best data and AI infrastructure... ...finds.We are hiring a Senior Staff Applied AI Engineer to own context retrieval... ..., retrieval, and evaluation — across the Enterprise... ...across multiple systems.Build the search subagents... ...-tuning embedding models, rerankers, or query...SeniorWork at officeLocal areaImmediate startWorldwideDataBricks
San Francisco, CA3 days ago- ...Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the environments, evaluation systems, and supporting infrastructure used to... ...credentials or publication history. Seniority The opportunity is open to exceptional...
MaxIT Consulting - Max Corporate Group
San Francisco, CA9 days ago - Google LLC seeks a Senior Software Engineer for AI interactions in XR to design and build scalable ML-driven... .... You will work on multimodal systems, collaborating with UX, product and... ...end-to-end ML including deployment, evaluation, data processing and debugging, with...Senior
$160k - $225.9k
...SENIOR AI PRODUCT ENGINEER - AGENTIC SYSTEMS & PRODUCTION AI BAY AREA (HYBRID / 3 DAYS IN OFFICE) $160,000 - $225,900 (SENIOR) | $225,000 - $250,0... ...and applications Own the full lifecycle: prompting, evaluation, debugging, and scaling Turn ambiguous problems...SeniorWork at officeHarnham
San Francisco, CA16 hours ago- ...build and maintain trust, with AI at the core of their next... ...patterns Partner with AI Engineers to define API contracts and... ...decisions, surfacing where model outputs break down and iterating... ...in shaping how AI systems are built, evaluated, and deployed in high-trust...Senior
- ...to transform a healthcare system that remains slow,... ...care experience that brings AI agents and clinicians together... .... The Opportunity: Senior AI Engineer Healthcare is adopting AI... ...systems: pick the right models, design rigorous evaluations, optimize for speed and cost...Senior
- ...Job Description AI Talent Now job # Senior AI Product Engineer (ZR_95_JOB) Our San Franisco... ...tooling with the best AI models. Join them on their... ...and generative models to evaluate quality, revise prompts,... ...for a non-deterministic AI system end-to-end (can explain how...SeniorWork experience placement
AI Talent Now
San Francisco, CA1 day ago - ...partnering with a frontier AI research company on a search... ...generation open-weight foundation models with a mission to make... ...team includes researchers, engineers, and operators from some of... ...help define how advanced AI systems are evaluated, stress-tested, and safely deployed...Senior
$72k - $184.44k
...OpportunityAs part of the AI Engineering team within the Digital Assurance... ...and optimizing algorithms, models, and systems to enable intelligent... ...involving lead testing and evaluation of AI-enabled systems, analyze... ...AI deployment.As a Senior Associate, you will build meaningful...SeniorFull timeH1bPwC
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Systems Engineer - Model Evaluation. Be the first to apply!
Related searches
- senior ai engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai prompt engineer San Francisco, CA
- system performance engineer San Francisco, CA
- senior linux systems engineer San Francisco, CA