Software Engineer, Test Frameworks and Tooling | Klaviyo
The Briefed
Klaviyo’s Test Frameworks and Tooling team builds the automation and CI/CD frameworks that make deploying to production a non-event. They are infrastructure engineers, not testers, creating the systems, repository standards, and automated guardrails that let every engineer ship quickly and confidently. In this role, you will help drive Sev-1 incidents toward zero by building tools that hundreds of engineers use every day.
Key Responsibilities
- Own and enhance integration and end-to-end testing frameworks across backend and frontend stacks, keeping them fast, reliable, and easy for other teams to adopt
- Optimize how tests run in CI so engineers get feedback in minutes
- Help define repository standards for writing unit tests and measuring code quality
- Develop tools that simplify complex testing scenarios, and backfill critical coverage gaps at scale with data mocking and service isolation
- Lead efforts to apply AI to testing, including automated regression detection, flaky test analysis, and intelligent test generation
- Partner with feature teams to troubleshoot flaky tests and close coverage gaps
- Monitor the health of test suites and CI pipelines to keep the environment stable and performant
Requirements
- 2+ years of software engineering experience with a focus on clean, maintainable code
- Strong debugging and root-cause analysis skills, with a habit of implementing systemic fixes
- Comfort working across the stack, from React components in E2E tests to Python integration tests
- Experience with, or a strong desire to learn, CI/CD tools and how automated testing fits into a modern deployment pipeline
- Education: Not specified
Skills
Technical Skills
- Backend: Python, Django, Go
- Frontend: React, TypeScript, JavaScript
- Testing Frameworks: Playwright, Cypress, Pytest, Jest
- Infrastructure and CI: AWS, Kubernetes, Terraform, Helm, Buildkite
- Data: MySQL, Redis, Kafka
- AI Tools: Claude, Cursor, Copilot, or internal AI enablement frameworks
Soft Skills
- Analytical problem solving
- Ownership mindset and initiative
- Quality advocacy
- Collaboration with feature teams
Benefits
- Total compensation may include an annual cash bonus, equity, and sign-on payments, depending on eligibility
- Comprehensive health, welfare, and wellbeing benefits
$116k - $174k
...Software Engineer II, Test Frameworks & ToolingAt Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos... ...total confidence. By building the foundational tools that guarantee production readiness, you will play...Suggested- ...currently sourcing for a QA Engineer to work in Fidelity’s... ...Team. This is a core software engineering role in our... ...in defining test cases at the right level... ...knowledge in test automation frameworks and demonstrate proficiency... ...continuous delivery tools.Passionate about engineering...SuggestedTemporary work
$148k - $222k
...building Customer Agent, Klaviyo’s AI-native... ...conversational experiences, tool integrations,... ...mentor, driving engineering quality and... ...designed, thoroughly tested solutions that prioritize... ...~7+ years of software engineering... ...embeddings, eval frameworks, or LLM orchestration...Suggested$75k - $150k
...Software Engineer In TestTeam: QA & Release EngineeringCountry: United StatesRemote... ...Software Engineers in Test to work on Site Vault, a... ...knowledge of code coverage tools and metricsWork with quality... ...functional test automation frameworks. e.g., Cucumber/Selenium/TestNg...SuggestedWork experience placementWork at officeLocal areaRemote workWork from home- ...Software Engineer - Test & VerificationPDS Defense, Inc. is seeking a Software Engineer - Test & Verification... ...maintains automated test scripts and frameworks to improve efficiency and... ...execution is a plus. Willingness to use AI Tools in HIL development required, familiarity...SuggestedContract workTemporary workFor contractorsLocal areaRelocation
- ...Klaviyo’s PLS (Profiles, Lists and Segments) team builds and scales... ...product. The team owns the tools that help customers... ...data flows in. As a Senior Software Engineer, you will design and build scalable... ...reviews and running a robust testing cycle with automated testing...
- We're looking for a Senior Software Engineer in Test who brings a builder's mindset to quality engineering. You'll be a hands-on senior engineer... ...Test Automation: Build, extend, and help maintain the frameworks, tooling, and CI integration the team's testing runs on — taking...Remote workFlexible hoursShift work
$140k - $220k
...looking for a Senior UI Platform Engineer to lead the design and build of the shared developer tooling foundation for our next-... ...into module federation, run its tests, cut a release with one command... ...Need: You’ve built shared frameworks, tooling or platforms that other...Contract workWork experience placementWork at officeLocal areaRemote workShift work- ...Our client is seeking a Senior Software Engineer in Test to ensure product quality across a digital... ...automated testing solutions, evolve testing frameworks, and drive quality throughout the... ...~ Experience with API testing using tools such as Rest Assured, Karate, or...Hourly payLocal area
$140k - $210k
At Klaviyo, we value the unique backgrounds, experiences... ...People Technology Engineer to be the first dedicated... ..., testing, security, and observability... ...company-wide AI patterns, tooling, and best practicesEnable... ...by building:Reusable frameworks and workflowsPlaybooks...Shift work- ...Klaviyo’s Platform Engineering team provides infrastructure primitives, platforms, tooling, and guidance to Klaviyo’s engineering organization. This role focuses on core platform... ...and developer experience. As a Senior Software Engineer, you will craft a paved path for...
- ...impact you will have in this role:As a Software Development Engineer in Test (SDET), you will be part of a... ...maintain Java-based test automation frameworks and solutions across UI, API, and backend... ...with performance testing tools such as JMeter.Experience working in...Remote workFlexible hours
$116k - $174k
...EngineerRemote Remote Apply Software Engineering & QASoftware Engineer... ...– RecommendationsAt Klaviyo, we value the unique... ...Spark or similar frameworks) that transform raw... ...decision making and A/B testing efforts —ensuring... ...monitoring and debugging tools. Share knowledge,...Remote work- ...Senior Software Engineer In TestStrategic Advisors Technology (SAT) is looking for a Senior Software Engineer in Test to help automate the testing of our products. The ideal candidate... ...review requirements, build automation frameworks and implement solutions in an Agile environment...Work at officeWork from home
$130k - $175k
...Places to Work.”About YouYou're an engineer at heart who finds joy in building the software that other software runs on — and... ...to use AI-assisted development tools to move faster, improve the developer... ...-quality, efficient, and well-tested code that aligns with project...Temporary workWork at officeLocal areaFlexible hours3 days per week$148k - $222k
...Senior Software Engineer – Profiles, Lists and SegmentsAt Klaviyo, we value the unique backgrounds, experiences... ...segments. We own the tools that let customers... ...reviews and running a robust testing cycle using automated testing practices and frameworks, including end-to-end...- ...is the leader in automated software engineering you can trust. As AI writes... ...dedicated Software Engineer in Test (SDET) hire for this space,... ...software, compiler or language tooling, developer tools, embedded... ...and scaling automated test frameworks, distributed execution systems...Remote workRelocation packageFlexible hoursShift work
- We don't just build software; we're changing the way people use energy. We innovate through... ...an immediate opening for a Software Engineer in Test, focusing on developing automated... ...skills. 2+ years using test automation frameworks ie: Cucumber, FitNesse, TestNG, and Selenium...Immediate start
- ...Quality Assurance and Engineering. As a technical associate... ...partners in Manual & Test automation. Your... ...using Selenium automation framework with Java. Performs regression... ...and accelerates software delivery, using... ...Continuous Delivery (CI/CD) tools. Tests and validates...
- ...Expert (SME)/Technical Lead Engineer (TLE) Level Test & Verification Engineers... ...involving CI/CD pipelines and AI tools. \tThis position will be... ..., including hardware, software, and network configurations... ...automated test scripts and frameworks to improve efficiency and effectiveness...Full timeWork experience placementRemote workRelocation
- ...Software Engineer – Quantitative Research ToolsRole Overview: Design internal analytical tools for quants and PMs—backtesting frameworks, visualization dashboards, data QA pipelines, custom trading interfaces.Must-Haves:Degree in CS or relatedExperience with Python, web...
$160k - $175k
...environment where ideas are tested, diverse perspectives... ...’s flagship internal software products, delivering a... ...test, and enhance new tools to attribute drivers... ...managers, quants, and engineers to align tools with... ...and modern front-end frameworks.· CFA designation is a...Casual workWork at officeWorldwideFlexible hours3 days per week$122k - $240.5k
Position Summary Software Engineer III with Agentic AI Experience,... ...augmented generation pipelines, tool-calling workflows, and... ...performance, write automated tests, and support production readiness... ...least one modern front-end framework such as React, Angular, or...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work$95.6k - $188.4k
Position Summary Software Engineer II, AI & Engineering/Engineering... ...stack developer who builds, tests, and ships reliable software... ...Implement agentic AI patterns — tool-calling agents, RAG... ....js) and a modern front-end framework (React, Angular, or Vue.js)....Local areaVisa sponsorshipFlexible hours$65 - $80 per hour
...next generation of quality engineering practices across a modern technology... ...for a highly technical software engineer with strong Python... ...enjoys building automated testing solutions for data platforms... ...designing scalable automation frameworks, improving test coverage...Full timeTemporary workFlexible hours- ...MAJob Type: PermanentPay: $160000Posted: 2026-08-24Senior Software Engineer, Test InfrastructureJoin an innovative technology company building... .... Develop integration and hardware-in-the-loop test frameworks. Design fault-injection and system validation capabilities...Immediate start
$116k - $174k
At Klaviyo, we value the unique backgrounds, experiences... ...their own destiny.Software Engineer, Conversational... ...software lies not only in tools that help people work... ..., regression testing, qualitative error analysis... ...with modern backend frameworks such as FastAPI or Django...- ...Software Development / Software Test Engineer (SDE/STE)We are seeking a Software Development / Software Test Engineer... ...software, build automated testing frameworks, and improve engineering workflows... ...test coverage.Develop software tools and automation to improve engineering...
$216k - $324k
...Senior Lead Software Engineer – Data PlatformThe Data Platform... ...product use cases across Klaviyo. This Senior Lead role... ...-based data platform tooling, modeled data systems,... ...managed table frameworks such as Materialized Views... ...administer a lie detector test as a condition of...Shift work- ...combine advanced science, modern software engineering, and powerful analytics to... ...Develop cloud-based analytical frameworks, performance-driven algorithms, and specialized tooling.DevOps Excellence: Contribute actively to automated testing, continuous integration (CI),...H1bFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Test Frameworks and Tooling | Klaviyo. Be the first to apply!
- software engineer internship remote Boston, MA
- software engineer remote Boston, MA
- graduate software developer no experience Boston, MA
- work from home software developer Boston, MA
- junior software developer Boston, MA
- information technology software engineer Boston, MA
- senior software engineer remote Boston, MA
- rust software engineer Boston, MA
- part time software developer Boston, MA
- software developer night shift Boston, MA



