Staff Engineer, AI Evaluation & Observability
Pantera Capital
Perplexity is seeking an engineer to advance its evaluation infrastructure and production-grade systems supporting Answer Quality. You will collaborate with data scientists, engineers, and product teams to identify quality problems, measure their impact, and drive improvements across prompts, tools, search systems, datasets, and models. You will build scalable pipelines for processing and analyzing large-scale interaction traces, ensuring reliability, observability, and actionable insights for #J-18808-Ljbffr Pantera Capital
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Engineer, AI Evaluation & Observability in Palo Alto, CA vacancy
- Waymo is seeking a data-minded software engineer and data scientist to advance its Planner Evaluation work, evaluating the quality and impact of the Onboard software... ...frameworks and metrics for non-deterministic AI agents, and scale complex evaluation problems. This...Suggested
- Orbifold AI is hiring Members of Technical Staff to build the data and evaluation foundations for world models and embodied AI systems. The role emphasizes real-world performance and practical impact, not solely theoretical work. Candidates will design data pipelines,...Suggested
$251k - $310k
...insight tools, improve and speed up the evaluation and onboard developer journeys. It will combine... ...are looking for researchers and software engineers who are passionate about developing... ...and using metrics for evaluating complex AI systems. Track record of technical leadership...SuggestedFull time$238k - $302k
....S. states. The Driver Understanding and Evaluation (DUE) team at Waymo is developing rich metrics... ...are looking for researchers and software engineers who are passionate about developing... ...high-volume workflows Design and build Gen AI LLM/VLM solutions for self driving car...SuggestedFull time$207k - $340k
.... We’re hiring a Principal Staff Software Engineer to lead LinkedIn’s GPU-Based... ...Platform, a foundational AI infrastructure stack that powers... ...cost.Build scalable, observable, and highly available multi... ...shape the platform roadmap.Evaluate emerging GPU technologies,...SuggestedFor contractorsWork at officeRemote workWork from homeFlexible hours$278k - $330k
...build and deploy cutting-edge AI technology to help people... ...-veteran scientists and engineers. As a Staff Machine Learning Engineer,... ...model performance, robustness, observability, and operational excellence... ..., data pipelines, evaluation frameworks, and deployment...Permanent employmentImmediate start- Moveworks' AI agents don't just generate text — they act, plan, and change state in enterprise systems. You will own the central problem... ...and improve the system. This role focuses on designing reliable evaluation signals, combining deterministic validators with probabilistic...
$203k - $224k
...transforming how SaaS is secured. With AI driving rapid SaaS growth and... ...readiness. We're hiring an experienced Staff IT Systems Engineer to be the senior technical owner of... .... Use read-only tooling for live observability, drift triage, and log investigation,...Work from homeFlexible hoursObsidian Security
Palo Alto, CA8 days ago- ...HIRING: Senior / Staff Full Stack Engineer – AI Location: Mountain View, CA – 3 Days Hybrid ⏰ Interview... ...-Time Applications ✅ Production Observability – Logs, Metrics, Alerts & Incident... .../ Cursor ⭐ Good to Have: * AI Evaluation platforms/tools * Active-Active /...Temporary work
Delan Associates, Inc
Mountain View, CA23 days ago - Waymo is seeking researchers and software engineers to advance machine learning evaluation systems for the Waymo Driver. You will build scalable ML infrastructure, data systems, and simulation tools to support hundreds of metrics and components of autonomous driving technology...
$148.2k - $222.2k
Staff Engineer, Infrastructure Platforms Position SummaryThe Staff Engineer... ...and operational excellence.Evaluate emerging technologies and... ...enterprise monitoring, logging, and observability platforms.Strong... ..., genomics, bioinformatics, AI/ML, or other scientific computing...Full timeWork from homeMonday to Friday$169k - $199k
...generation of security operations—leveraging AI-driven automation, Autonomic Security... ...industry!About the RoleAs a Staff Security Engineer (IC6) on the Detection & Response team,... ...to identify security vulnerabilities, evaluate threat vectors, and guide remediation.Mentor...Work at officeFlexible hoursShift work3 days per week$156k - $255k
...collaborate across the organization to evaluate the security maturity of our... ...is to leverage security engineering, advanced risk analytics, and... ...standards. About the RoleAs a Staff Security Engineer focused on Third... ...including complex SaaS/AI tools meet our security standards...For contractorsWork experience placementWork at officeFlexible hours$148.2k - $222.2k
Staff Engineer, IT InfrastructureAbout the RolePacBio is looking for a Staff Engineer, IT Infrastructure... ..., networking, security, storage, observability, and automation.As part of a relatively... ....Explore opportunities to use AI-assisted automation for troubleshooting...Full timeImmediate startWork from homeMonday to Friday$111k - $159.8k
...enterprise. To usher in this new era, we seek AI-native thinkers across every function who... ...proactive and holistic support for the Observe leadership team. As an Executive... ...Preferred experience supporting Product or Engineering leadership. Proven ability to manage time...Work experience placementWork at officeFlexible hours$152k - $277k
...that can be easily consumed by engineers and scientists. You will also... ...track key performance metrics to evaluate model impact and identify high... ...services like Vertex AI, BigQuery or SageMakerExperience... ...compensation.The base pay for Staff position ranges from $152K/year...Temporary work$200k - $235k
...everything possible.The Senior Staff GenAI Engineer leads the design,... ...scalable, reliable generative AI systems, driving agentic automation... ...reliability, performance, observability, and long‑term... ...workflows, model governance, evaluation methodologies, safety reviews...Full timeWork experience placementImmediate start$207k - $300k
Build advanced AI-generated content (AIGC) quality frameworks... ...content through advanced context engineering and agentic feedback loops to... ....Conduct advanced quality evaluations and leverage downstream dense... ...fulfill user interests. As a Staff Machine Learning Engineer...$215.28k - $364.32k
...innovation, integrating advanced AI and autonomous driving... ...Python code with strong testing, observability, reproducibility, and... ...prove model feasibility.Curate evaluation datasets and establish a comprehensive... ...programming and software engineering skills.Ability to work...Full time$262k - $364k
...reinforcement learning, and generative AI, from concept to production.... ..., and exploration.Mentor engineers and promote best practices in... ...e.g., model deployment, model evaluation, data processing, debugging,... ...technology forward.As a Senior Staff Generative AI Engineer, you will...$229k - $343k
...other digital services.Snap Engineering teams build fun and technically... ....We’re looking for a Staff Machine Learning Engineer to... ...improvementDesign robust offline evaluation, online experimentation, and... ...systems, ads ranking, generative AI, LLM-based ranking, and retrieval...Full timeLive inWork at officeLocal area- ...role:We're currently looking for research engineers with specialized skills in LiDAR, camera,... ...collaborate with a team of experts in AI, robotics, and software engineering to push... ...maintain large-scale datasets for training and evaluating perception models, including the...
$176.1k - $308.2k
...Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to... ...global market leader, bringing innovative AI-enhanced technology to over 8,100 customers... ...parallel ranking experimentsDevelop metrics to evaluate ranking performanceQualificationsWhat You...Work at officeRemote workFlexible hours$199k - $234k
...high, and so are the rewards.The AI R&D team is at the core of... ...to growth, product, and data engineering—translating complex financial... ...this is the team for you!As a Staff Machine Learning Engineer on the... ...constraints are first-class concerns.Evaluate, experiment with, and...Work at officeFlexible hoursShift work3 days per week$265k - $331.3k
...scale our Enterprise Applied AI solutions driving impact across internal teams. As a Staff AI Engineer (Staff or Senior Staff), you... ...‑augmented generation, evaluation frameworks, and scalable serving... ...code quality, reliability, observability, and cost/performance of AI...Full timeContract workLocal area$186k - $232.5k
...Role Summary Are you a Staff or Lead-level Platform Engineer passionate about developer... ...Toolchain Integration: Evaluate and integrate modern developer tools, including AI-assisted coding and review... ...strict standards for quality, observability, compliance, security, and...Full timeContract workTemporary workPart timeLocal areaShift workRivian
Palo Alto, CA4 days ago- Rhoda AI in Mountain View is seeking a candidate to design scalable curation pipelines for web-scale video pretraining data, focusing on ingestion, deduplication, and content classification across internet-scale video corpora. The ideal candidate will have a strong understanding...
$265k - $331k
...strategy for consumer and robotaxi platforms. Design, build, evaluate, deploy, and maintain the core perception components critical... ...s, Master's, or PhD in Computer Science, Robotics, Electrical Engineering, or a related technical field. Extensive experience developing...Full timeContract workTemporary workPart timeLocal areaShift work$146.2k - $233.7k
...with you.Job DescriptionAs a Staff Data Engineer, you'll join our Value Added... ...automation, monitoring, and observability for data pipelines across... ...proof-of-concept initiatives to evaluate and adopt new data... ...pipelines, and productizing AI/ML models.• Proficient in technologies...Full timeWork experience placementWork at officeLocal areaImmediate start$164k - $282k
...scale.We are looking for a visionary Staff Software Engineer to lead the architectural design and implementation... ...6 nines availability while leveraging AI to automate complex system behaviors... ...-source distributed systems projects.Observability Expert: Expertise in building highly...Temporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, AI Evaluation & Observability. Be the first to apply!
Related searches
- senior staff systems engineer Palo Alto, CA
- assistant engineer Palo Alto, CA
- engineering aide Palo Alto, CA
- software engineer staff Palo Alto, CA
- senior staff engineer Palo Alto, CA
- technology administrator Palo Alto, CA
- staff engineer Palo Alto, CA
- assistant audio engineer
- project engineer assistant project manager
- senior staff systems engineer