Senior SDET — LLM Evaluation & Automation Architect
Jobleads-US
Apple Inc. is seeking a Senior SDET in San Diego, CA to lead automated model evaluation for LLM features. You’ll own eval automation across pipelines, building repeatable tests, and collaborating with modeling, framework, and infrastructure teams to ensure high quality releases.
You will design components and end-to-end tests, triage results, and help catch regressions before they reach users. This hands-on role emphasizes maintainable tooling and scalable automation across Apple’s Generative AI
#J-18808-Ljbffr Jobleads-USVacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Senior SDET — LLM Evaluation & Automation Architect in Cupertino, CA vacancy
$175k - $308.5k
...Senior Software Development Engineer in Test — LLM Evaluation & Automation, T3E San Diego, California, United States Software and Services The Apple Intelligence... ...before they ship. We are looking for a Senior SDET to lead the design and implementation of automated...SeniorRelocationApple Inc.
Cupertino, CA9 hours ago- ...Fractal Analytics Inc. seeks a hands-on Lead GenAI Engineer to architect and ship production GenAI systems. You will own delivery... ...prototype against evolving requirements and implement robust evaluation, observability, and guardrails to ensure reliable analytics delivery...Senior
$184k - $287.5k
...Exploring innovative communication technologies: Research and evaluate new communication technologies and techniques to enhance the performance... .... ~ Experience in evaluating, analyzing, and optimizing LLM training and inference performance of state-of-the-art models on...SeniorWork experience placementNVIDIA Corporation
Santa Clara, CA9 hours ago$140k - $224.25k
..., Santa Clara Full time JR2018424 Are you passionate about automation, AI-assisted development, gaming technology, and improving software... ..., including how agents are created, configured, prompted, evaluated, and integrated into engineering workflows. Prior experience...SeniorFull time- ...Capgemini is seeking a seasoned Modern Workplace Architect to design and implement end-user computing solutions in Irvine, CA. You will... ...Management initiatives, optimize the Service Desk, and drive automation to enhance productivity and security across enterprise environments...Senior
- ...seeking a Sr Principal AI Engineer to lead the Generative AI transformation of our GTM and customer experience processes. You will architect intelligent, agentic workflows and deliver enterprise-grade full-stack systems with a strong hands-on approach. The role...Senior
- ...Google LLC invites an experienced Senior Principal On-Device and Voice LLM Architect to shape the future of XR with on-device intelligence. You will own architectural vision for LLM integration and voice interfaces across wearables, bridging silicon capabilities with...Senior
$141k - $231k
...builds the analytical and automation foundation that powers... .... We're hiring an AI Architect to design, build, and... ...prototyping, through evaluation and rollout, to... ...technical stakeholders and senior leadership. QualificationsBasic... ...(e.g., LangChain, LLM APIs). 1+ years of...For contractorsWork at officeFlexible hoursLinkedin
Sunnyvale, CA12 hours ago$170.6k - $238k
...and address mapping to enable new DRAM features. Develop the automation test scripts using Python to improve the overall simulation methodologies... ...requirements, quality requirements, and design constraints. Evaluate existing systems to determine effectiveness, and suggest...SeniorFull timeLocal area$210.87k - $329.86k
...Artificial Intelligence and intelligent automation across its Hardware Engineering... ...-right execution. We are seeking a senior AI Architect – Hardware Engineering to lead this transformation... ...resources to develop solutions; evaluate external AI technologies and vendors;...SeniorTemporary workLocal areaWorldwideShift workCelestica International LP
San Jose, CAa month ago$141k - $231k
...builds the analytical and automation foundation that powers... ...We're hiring an AI Architect to design, build, and... ...prototyping, through evaluation and rollout, to monitoring... ...stakeholders and senior leadership. Qualifications... ...(e.g., LangChain, LLM APIs). ~1+ years of...Full timeFor contractorsWork at officeFlexible hours- ...Kardow in Sunnyvale, CA seeks a senior software engineer to design high-performance AI frameworks for large-scale distributed systems... ...will optimize GPU-driven workloads, integrate LLMs, and lead test-automation infra across Kubernetes-based clusters. You are expected to...Senior
$184k - $287.5k
...approaches for multi-die architectures that improve utilization of available silicon while meeting product and performance requirements.Evaluate yield, performance, area, implementation cost, complexity, and product flexibility, then work across architecture, performance,...SeniorFull timeNvidia
Santa Clara, CA2 days ago$184k - $287.5k
We are now looking for a Senior Architect for GPUs and SoCs:The NVIDIA Architecture Modelling group is looking for architects and software... ...practices.Learn about newer modelling techniques and frameworks, evaluate the best solution for our needs and work with your manager to...SeniorFull timeWork experience placementNvidia
Santa Clara, CA3 days ago$142.3k - $263.3k
...Development Engineer in Test (SDET), Creative Apps San Diego,... ...and Services What if your automation code was the last line of... ...be. Description You'll architect and own test automation frameworks... ...-wide quality practices by evaluating and integrating emerging tooling...RelocationApple Inc.
Cupertino, CA9 hours ago$240k - $295k
...Knightscope is looking for a Sr. Architect to lead the design of our AI-... ...standards, mentor senior engineers, and make build‑vs‑... ...actionable alerts, insights, and automated responses. Set platform‑wide... ...scalable platform capabilities. Evaluate build‑vs‑buy decisions and...SeniorFull timeKnightscope
Sunnyvale, CA1 day ago$184k - $287.5k
...quality and establishes new standards in AI-enhanced automation!What you'll be doing:Compose, build, and... ...lifecycle of agentic services: from prototype through evaluation, deployment, and continuous improvementBuild robust LLM-powered pipelines for code generation, automated...SeniorFull timeNvidia
Santa Clara, CA3 days ago$144.7k - $221.4k
...‑free miles driven, GM is proving that automation can be trusted, intuitive, and helpful.... ...experiences. About the Organization The Evaluation team builds and evolves the evaluation... ...What You’ll Do (Responsibilities) Architect and implement metrics and analyses to...SeniorWork at officeLocal areaWork from homeRelocationRelocation packageFlexible hours- ...Micron Technology is seeking a Senior / Principal Layout Engineer to drive pathfinding and architecture exploration for next-generation... ...design decisions. You will lead layout-driven exploration, evaluate routing topologies, define design envelopes for extreme-speed...Senior
- ...Palo Alto Networks is seeking a Senior Principal Engineer/Architect to serve as the technical authority for global SRE and Platform Engineering initiatives... ...teams to translate complex requirements into automated infrastructure. You will own projects end-to-end, drive...Senior
- ...Hewlett Packard Enterprise is seeking a Senior Principal Thermal Engineer to define and lead thermal architectures for liquid-cooled hardware across multiple platforms, from concept to production. You will oversee validation plans, mentor engineers, and influence cross...Senior
- ...the most important technology firms in the world. As a Senior Principal Architect at JPMorganChase within Corporate and Investment Bank Technology... ...current with emerging technologies and industry trends Evaluate and recommend appropriate technologies and frameworks, and...Senior
Next Frontier Capital
Palo Alto, CA1 day ago $185k
...analytics. This is a builder's role. You will personally architect and ship production systems, own delivery quality,... ...from a distance. Own the architecture across LLM orchestration, retrieval, agentic workflows, evaluation, and the analytics delivery layer. Rapidly...Hourly payFull timeLocal areaFractal
Sunnyvale, CA3 days ago- ...design solutions for research, testing, manufacturing and production facilities. Gordon Prill, Inc. is seeking a talented Senior Architect with the experience and skills to develop designs for complex industrial and technology projects from inception through construction...SeniorLocal areaFlexible hours
Gordon Prill
Sunnyvale, CA3 days ago $168k - $258.75k
...that matter to the world. This is our life’s work, to amplify human creativity and intelligence. NVIDIA is looking for a Product Architect to help define & design SoC- and GPU-based products and drive hardware/software feature improvements through collaboration with the...SeniorNVIDIA Corporation
Santa Clara, CA9 hours ago- ...Senior High-Performance Storage Architect (Santa Clara, CA) NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we...Senior
NVIDIA Corporation
Santa Clara, CA9 hours ago - Gigamon seeks a Principal Hardware Engineer to lead system and board-level architecture for networking products. You will design and develop board-level circuits, high-speed interfaces, power distribution, and signal integrity while ensuring manufacturability and reliability...Senior
- ...Nuvacore, Inc. in Santa Clara, CA is seeking a Custom Clock Design and Distribution Engineer to architect end-to-end clock networks for high-frequency CPUs, collaborate with PLL/DFT teams, and drive PPA targets. You will perform transistor-level clock circuit design...Senior
- ...Everpure, Inc. is seeking a senior System Hardware Architect to lead end-to-end architecture, validation, and quality of enterprise storage hardware... ...include driving next-generation design, automating stress tests, and implementing robust validation methodologies...Senior
- ...Semiconductor, Inc. in San Jose, CA, seeks a Principal AI System Architect to solve system interconnect challenges linking XPUs into... ...across node, rack, and cluster to enable efficient large‑scale LLM training and inference, with hands‑on NPU hardware experience preferred...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior SDET — LLM Evaluation & Automation Architect. Be the first to apply!
Related searches
- senior software engineer ruby on rails Cupertino, CA
- senior customer service Cupertino, CA
- senior living Cupertino, CA
- senior vmware engineer Cupertino, CA
- senior consulting engineer Cupertino, CA
- senior sas developer Cupertino, CA
- remote senior project manager Cupertino, CA
- senior Cupertino, CA
- senior software engineer remote Cupertino, CA
- senior activities Cupertino, CA