AI Agent Evaluation & Reliability Engineer
Sivad Consulting Inc
Sivadconsulting in San Jose, CA is seeking a Software Engineer for Agent Harness & Evaluation to advance AI agents for hardware applications. You will identify failure modes, design comprehensive evaluations, and translate experiments into production software. You will join a growing team of software engineers, researchers, and hardware experts, collaborating across discovery, evaluation design, applied research, and product development to tackle real-world engineering challenges.
#J-18808-LjbffrVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Agent Evaluation & Reliability Engineer in San Jose, CA vacancy
$128k - $256k
...team combines system engineering and machine learning to... ...alignment, and intelligent agent systems. Beyond model... ...Language Models and AI Agent systems to join... ...the year. Design evaluation systems for LLM-based... ...reasoning quality, and reliability. Build benchmarks and...SuggestedTemporary workInternshipLocal areaByteDance
San Jose, CA22 hours ago$388k
...a part of what’s next.AI and ML power innovation... ...Agentic systems transparent, reliable, and production-ready... ...for a hands-on senior engineer to build the frameworks... ..., model performance, evaluation, and vendor integration... ...feature pipelines, and agent orchestration, so teams...SuggestedHourly payFull timeImmediate startFlexible hoursNetflix
Los Gatos, CA5 days ago$180k - $325k
...Software Engineer, Agent Harness & Evaluation – San Jose, CA $180k to $325k We are hiring Software Engineers to improve the performance, reliability, and efficiency of AI agents for hardware applications. You'll identify failure modes, design and run evaluations,...SuggestedSIVAD Consulting
San Jose, CA4 days ago$155k - $222.6k
...Silicon Operations Quality & Reliability team at the core of Cisco's next... ...powering modern AI data center clusters and hyperscale... ..., packaging, and reliability engineers who partner closely with ASIC... ...standards by managing critical evaluations such as HTOL, HAST, ESD (HBM/...SuggestedFull timeTemporary workLocal areaFlexible hoursCISCO Systems
San Jose, CA4 days ago$116k - $159.5k
...a global leader in materials engineering solutions used to produce virtually... ...connect our world - like AI and IoT. If you want to push... ...on Quality Engineering and Reliability Engineering. We are working with... ...implementation of solutions. Evaluates, from a reliability...SuggestedFull timeWorldwideApplied Materials
Santa Clara, CA4 days ago$168k - $270.25k
...Join our team at NVIDIA as a Senior Site reliability engineer focused on HPC storage and play a... ...procedures and practices, perform technology evaluations, related to distributed file systems.... ...is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes....Full timeNvidia
Santa Clara, CA5 days ago$195k - $285k
...unleashing the potential of generative AI to power the transformation of... ...per week.Title: Director, Quality and Reliability Engineering - AI HardwareThe Role:d-Matrix is seeking... ...processes and maintain a consistent and fair evaluation of al applicants. Thank you for your...Contract work3 days per weekd-Matrix
Santa Clara, CA4 days ago- ...Category: Frontier Model Evaluation · Pay: Hourly rate confirmed after the interview process... ...: Remote — US-eligible · Contractor AI Agent Evaluator is a remote evaluation track for... ...when a prompt itself is the problem. Reliable async availability for at least 10 hours...Hourly payContract workFor contractorsRemote work10 hours per week
AuraOne
San Jose, CA14 days ago $186.9k - $267.7k
...New York City.The Splunk Agent Resilience team is defining the future of AI resilience. Together... ...scalable, cost-effective evaluation and guardrails that... ...as intended, improving reliability and reducing risks. This... ...Staff Site Reliability Engineer (SRE), you will provide...Full timeTemporary workLocal areaFlexible hours2 days per weekCISCO Systems
San Jose, CA4 days ago$150.4k - $277.6k
...Machine Learning Engineer – LLMs, Agent Systems, and Simulation Tooling, Siri... ...States Machine Learning and AI Join the team redefining... ...advancing how LLMs plan, adapt, and evaluate actions in realistic... ...contributing to the development of reliable and trustworthy AI agents....Temporary workRelocationApple Inc.
Cupertino, CA4 days ago$131.01k - $196.3k
...Across enterprise, cloud and AI, and carrier architectures, our... ...is breadth of ownership: engineers here aren't limited to validating... ...root-cause analysis and reliability improvements after cluster or... ...Our interviews are designed to evaluate your individual experience, thought...Permanent employmentFull timeInternshipWork from homeMarvell
Santa Clara, CA3 days ago$175k - $265k
...the potential of generative AI to power the transformation of... ...infrastructure layer that every engineering team and customer depends on... ...that team, responsible for reliability, automation, and observability... ...a consistent and fair evaluation of al applicants. Thank you for...d-Matrix
Santa Clara, CA1 day ago$195k - $285k
...unleashing the potential of generative AI to power the transformation of... ...the infrastructure underpinning our engineering organization must be as reliable and scalable as the chips we build.... ...and maintain a consistent and fair evaluation of al applicants. Thank you for your...Remote workd-Matrix
Santa Clara, CA4 days ago- ...next generation of Enterprise Agentic Solutions and Self-Evolving AI Agents. You will work with internal datasets to design, evaluate, and deploy autonomous agents that offload routine workflows in engineering, DevOps, and product growth. The internship offers hands-on...Internship
TikTok USDS Joint Venture
San Jose, CA3 days ago - ...into the unlimited potential of AI to define the next era of... ..., high‑volume telemetry into reliable, job‑centric insights and automation... ...Join our team of innovative engineers who are building this... ...addressing incidents, and follow‑up evaluations that drive measurable...
NVIDIA Gruppe
Santa Clara, CA1 day ago $132.6k - $214.5k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...collaborate closely with our engineering teams to develop innovative... ...cutting-edge technologies, evaluate their potential impact on our... ...the product and ensure the reliability and availability of our services...Full timeWork at officeVisa sponsorshipWork visaPalo Alto Networks
Santa Clara, CA3 days ago$212.8k
...and adoption of enterprise AI agent capabilities, AI harness platforms... ...automation, memory, evaluation, observability, and governance... ...capabilities. Partner with product, engineering, data, security, and... ...technical leadership on AI reliability, scalability, observability,...Temporary workLocal areaOverseasByteDance
San Jose, CA7 hours ago- ...team combines system engineering and machine learning to... ...alignment, and intelligent agent systems. Beyond model... ...Language Models and AI Agent systems to join... ...resume. Design evaluation systems for LLM-based... ...reasoning quality, and reliability. Build benchmarks and...Internship
ByteDance
San Jose, CA2 days ago $184.7k - $324.8k
...California, United States Machine Learning and AI Join the team redefining what a deeply... ...(Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly... ...a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. Our...RelocationApple Inc.
Cupertino, CA7 hours ago$151.2k - $295.2k
...Team Overview:The team builds the TikTok AI Ad Agent by leveraging AI capabilities to help... ...driven solutions- Collaborate closely with engineering, ML, data science, and operations teams... ...iterate AI Agent capabilities- Define evaluation frameworks and success metrics to...Temporary workLocal areaTikTok
San Jose, CA7 hours ago$224k - $356.5k
...Autonomous agents now do real work across NVIDIA, and every piece... ..., tools, skills, and plugins. Evaluation is how a team knows whether a... ...We're looking for a principal engineer to set evaluation strategy at... ...existing vacancy. NVIDIA uses AI tools in its recruiting processes...NVIDIA Corporation
Santa Clara, CA3 days ago- ...Job Overview We are looking for an AI Agent Architect to design and build enterprise internal agents... ...delivery plans, then improve them through evaluation and production feedback. What We Look For Strong software engineering and system architecture fundamentals, with experience...
Maxinsights
Santa Clara, CA4 days ago - ...seeking a Senior Software Engineer to help build NeMo Helix,... ...product for developing, evaluating, deploying, and operating AI systems at scale. This role... ...open source plugin-based agent execution framework and... ...platform APIs, while improving reliability and performance across...Flexible hours
NVIDIA
Santa Clara, CA1 day ago - ...seeking a Senior Machine Learning Engineer to lead architecture and execution of our AI Risk & Compliance Intelligence Platform and Intelligent Data Agent Ecosystem. You will bridge prompt... ...reasoning, tackling offline/online evaluation, synthetic data for small-sample scenarios...
TikTok USDS Joint Venture
San Jose, CA5 days ago - ...Job Title: AI Skills and Agents Lead (Low/No code) Start Date: ASAP or Mid-November Duration... ...solutions that are useful, intuitive, and reliable. Connect AI capabilities to... ...including prompting, grounding, retrieval, evaluation, structured outputs, tool use, and...Full timeWork at officeImmediate startRemote work2 days per week3 days per week
Jobrapido
Santa Clara, CA1 day ago $218.4k
...About teamWe are the Engineering Architecture team of the PICO-Interactive... ...consumption deployment of AI models, strive for excellence... ...and development of AI Agent, improving the application capabilities... ...Multi-Agent frameworks and evaluation mechanisms.- Explore...Temporary workLocal areaByteDance
San Jose, CA22 hours ago- ...NVIDIA Corporation is seeking a Senior System Reliability Engineer to join its Reliability Engineering team, located in Santa Clara, California. In this role, you will be responsible for leading reliability testing and collaborating cross-functionally with engineering...
NVIDIA
Santa Clara, CA5 days ago - ...computing experiences—from AI and data centers, to... ...execution of the AI Agent roadmap in the Intelligence... ...agentic research into reliable, scalable, customer-... ...researchers, software engineers, QA, and cross-functional... ...effective mechanisms for evaluating the impact of research...
AMD
San Jose, CA3 days ago - ...discovery to powering AI and the technologies people... ...ML Systems Research Engineers to build the reinforcement... ..., inference, and evaluation infrastructure behind AI... ...on the systems that let agents and models improve real... ...iteration speed. You can build reliable infrastructure, reason...
Advanced Micro Devices , Inc.
Santa Clara, CA3 days ago $176.8k - $286k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...Product Manager to build AI agents that handle day-to-day branch... ...week, and work closely with engineering to ship. You will also own... ..., multi-agent setups, and evaluation. Certifications such as CCNP...Full timeWork at officePalo Alto Networks, Inc.
Santa Clara, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Agent Evaluation & Reliability Engineer. Be the first to apply!
Related searches