Software Engineer, Product - Testing

What you’ll do

We work in small, autonomous teams oriented around customer problems. Here are some examples of what you’ll work on:

• Agent Architecture: What primitives do we need to build agents that are steerable and verifiable, but also conversational and empathetic? How do we future-proof this as LLMs evolve?

• Retrieval: How do we ground answers in a customer’s knowledge base? How do we use retrieved context conversationally, handling cases where the answer is unclear or needs clarification from the user?

• Evals: How do we measure an agent’s quality? How do empower our customers to improve agent quality?

• Voice: How do we make our chat agents “just work” over the phone? How do we deliver lifelike conversations at low latency?

• Simulation & Benchmarking: How can we craft a simulation platform to test AI agents against every real-world scenario imaginable?

• Content Management: How do we create intuitive, no-code tools that allow anyone to guide and test AI agents?

• Agent Development Lifecycle: How do we adapt traditional software development methodologies to accommodate AI agents’ non-deterministic behavior, natural language interactions, and reliance on large language models

• Generative Agent Development: How do we accelerate agent creation using generative tools like Cursor and Claude Code? Can we build self-improving systems based on real-world interactions, customer-driven feedback, and self-play?

What you'll bring

• A passion for being on the frontier of AI products.

• Motivation and high-agency to drive outcomes - we have a high-autonomy culture and each team member has lots of agency to overcome obstacles and achieve customer impact.

• Alignment to our company values throughout your work, notably finding a balance between Craftsmanship, Customer Obsession, and Competitive Intensity.

• 4+ years hands-on experience building production products and systems.

• Experience and comfort to build and ship full-stack solutions.

• Degree in Computer Science or related field, or equivalent professional experience.

Even better...

• Experience building AI-powered products.

• A sharp eye for design.

• Experience with Go and Typescript.

• Experience building developer tooling, programming languages, or databases.

• Leadership experience on technical projects or teams.

Our values

• Trust: We build trust with our customers with our accountability, empathy, quality, and responsiveness. We build trust in AI by making it more accessible, safe, and useful. We build trust with each other by showing up for each other professionally and personally, creating an environment that enables all of us to do our best work.

• Customer Obsession: We deeply understand our customers’ business goals and relentlessly focus on driving outcomes, not just technical milestones. Everyone at the company knows and spends time with our customers. When our customer is having an issue, we drop everything and fix it.

• Craftsmanship: We get the details right, from the words on the page to the system architecture. We have good taste. When we notice something isn’t right, we take the time to fix it. We are proud of the products we produce. We continuously self-reflect to continuously self-improve.

• Intensity: We know we don’t have the luxury of patience. We play to win. We care about our product being the best, and when it isn’t, we fix it. When we fail, we talk about it openly and without blame so we succeed the next time.

• Family: We know that balance and intensity are compatible, and we model it in our actions and processes. We are the best technology company for parents. We support and respect each other and celebrate each other’s personal and professional achievements.

What we offer

We want our benefits to reflect our values and offer the following to full-time employees:

• Flexible (Unlimited) Paid Time Off

• Medical, Dental, and Vision benefits for you and your family

• Life Insurance and Disability Benefits

• Retirement Plan (e.g., 401K, pension) with Sierra match

• Parental Leave

• Fertility and family building benefits through Carrot (U.S. only)

• Lunch, as well as delicious snacks and coffee to keep you energized 

• Discretionary Benefit Stipend giving people the ability to spend where it matters most

• Free alphorn lessons

Be you, with us

We're working to bring the transformative power of AI to every organization in the world. To do so, it is important to us that the diversity of our employees represents the diversity of our customers. We believe that our work and culture are better when we encourage, support, and respect different skills and experiences represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status, pregnancy, gender expression or identity, sexual orientation, citizenship, or any other legally protected class.