Senior Software Engineer - AI Automation

Responsibilities

• Design and develop automated test frameworks for APIs and data pipelines.
• Containerize automated quality checks for complex orchestrated services.
• Use agentic AI workflows to author and maintain integration tests, triage failures, and debug production issues.
• Build retrieval and context pipelines grounded in code, schemas, telemetry, and business logic.
• Implement tool-calling and MCP-style integrations with test runners, CI, ticketing, logs, and data services.
• Build and maintain CI/CD workflows and infrastructure as code using Terraform or CloudFormation.
• Establish evaluation, observability, and monitoring for test reliability, flake rate, triage time, agent success rate, latency, and cost.
• Build controlled rollouts, drift detection, and safeguards for production agent workflows.
• Create reusable testing templates and paved-path patterns in partnership with development, data engineering, and product teams.

Requirements

• At least 5 years of experience in software testing and automation, software engineering, or adjacent domains.
• Strong software engineering fundamentals and the ability to build production-grade systems.
• Expertise in Python or Java and familiarity with the other; C/C++ or another systems language is a plus.
• Experience designing test plans, test cases, and automated frameworks for APIs, services, and data pipelines.
• Hands-on experience with LLM-based systems, prompt design, retrieval, tool use, memory handling, and agent orchestration.
• Experience building retrieval and context pipelines, agent frameworks, and MCP servers or equivalent function-calling architectures.
• Experience with CI/CD tooling such as GitLab runners, GitHub Actions, Jenkins, or Travis CI.
• Experience with AWS, GCP, or Azure; Docker and Kubernetes; and REST APIs.
• Experience with Terraform or CloudFormation for infrastructure as code.
• Working knowledge of Linux and Bash scripting.
• Experience with observability, evaluation, experimentation, feedback loops, and monitoring for AI systems in production.
• Bachelor's or master's degree in a listed technical field or equivalent engineering experience.
• Strong analytical, problem-solving, communication, collaboration, independence, and engineering judgment skills.

Benefits

• Estimated California annual base salary of $141,300–$360,700.
• Health insurance, healthcare options including medical, dental, and vision, life insurance, disability benefits, parental leave, wellness benefits, mental health and financial wellness resources, commuter benefits, retirement options, and paid time off.
• Hybrid work generally involves working in the office Monday through Thursday, with Fridays generally flexible for remote work.
• Additional local statutory and voluntary benefits may vary by location and role.