Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Test Frameworks and Tooling | Klaviyo

The Briefed

Klaviyo’s Test Frameworks and Tooling team builds the automation and CI/CD frameworks that make deploying to production a non-event. They are infrastructure engineers, not testers, creating the systems, repository standards, and automated guardrails that let every engineer ship quickly and confidently. In this role, you will help drive Sev-1 incidents toward zero by building tools that hundreds of engineers use every day.

Key Responsibilities
  • Own and enhance integration and end-to-end testing frameworks across backend and frontend stacks, keeping them fast, reliable, and easy for other teams to adopt
  • Optimize how tests run in CI so engineers get feedback in minutes
  • Help define repository standards for writing unit tests and measuring code quality
  • Develop tools that simplify complex testing scenarios, and backfill critical coverage gaps at scale with data mocking and service isolation
  • Lead efforts to apply AI to testing, including automated regression detection, flaky test analysis, and intelligent test generation
  • Partner with feature teams to troubleshoot flaky tests and close coverage gaps
  • Monitor the health of test suites and CI pipelines to keep the environment stable and performant
Requirements
  • 2+ years of software engineering experience with a focus on clean, maintainable code
  • Strong debugging and root-cause analysis skills, with a habit of implementing systemic fixes
  • Comfort working across the stack, from React components in E2E tests to Python integration tests
  • Experience with, or a strong desire to learn, CI/CD tools and how automated testing fits into a modern deployment pipeline
  • Education: Not specified
Skills

Technical Skills

  • Backend: Python, Django, Go
  • Frontend: React, TypeScript, JavaScript
  • Testing Frameworks: Playwright, Cypress, Pytest, Jest
  • Infrastructure and CI: AWS, Kubernetes, Terraform, Helm, Buildkite
  • Data: MySQL, Redis, Kafka
  • AI Tools: Claude, Cursor, Copilot, or internal AI enablement frameworks

Soft Skills

  • Analytical problem solving
  • Ownership mindset and initiative
  • Quality advocacy
  • Collaboration with feature teams
Benefits
  • Total compensation may include an annual cash bonus, equity, and sign-on payments, depending on eligibility
  • Comprehensive health, welfare, and wellbeing benefits
#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Test Frameworks and Tooling | Klaviyo in Boston, MA vacancy
  • $116k - $174k

     ...Software Engineer II, Test Frameworks & ToolingAt Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos...  ...total confidence. By building the foundational tools that guarantee production readiness, you will play... 
    Suggested

    Venturefizz Product Management Community

    Boston, MA
    12 hours ago
  •  ...currently sourcing for a QA Engineer to work in Fidelity’s...  ...Team. This is a core software engineering role in our...  ...in defining test cases at the right level...  ...knowledge in test automation frameworks and demonstrate proficiency...  ...continuous delivery tools.Passionate about engineering... 
    Suggested
    Temporary work

    Samprasoft

    Boston, MA
    4 days ago
  • $148k - $222k

     ...building Customer Agent, Klaviyo’s AI-native...  ...conversational experiences, tool integrations,...  ...mentor, driving engineering quality and...  ...designed, thoroughly tested solutions that prioritize...  ...~7+ years of software engineering...  ...embeddings, eval frameworks, or LLM orchestration... 
    Suggested

    The Briefed

    Boston, MA
    2 days ago
  • $75k - $150k

     ...Software Engineer In TestTeam: QA & Release EngineeringCountry: United StatesRemote...  ...Software Engineers in Test to work on Site Vault, a...  ...knowledge of code coverage tools and metricsWork with quality...  ...functional test automation frameworks. e.g., Cucumber/Selenium/TestNg... 
    Suggested
    Work experience placement
    Work at office
    Local area
    Remote work
    Work from home

    Veeva Systems

    Boston, MA
    1 day ago
  •  ...Software Engineer - Test & VerificationPDS Defense, Inc. is seeking a Software Engineer - Test & Verification...  ...maintains automated test scripts and frameworks to improve efficiency and...  ...execution is a plus. Willingness to use AI Tools in HIL development required, familiarity... 
    Suggested
    Contract work
    Temporary work
    For contractors
    Local area
    Relocation

    ClearanceJobs

    Cambridge, MA
    1 day ago
  •  ...Klaviyo’s PLS (Profiles, Lists and Segments) team builds and scales...  ...product. The team owns the tools that help customers...  ...data flows in. As a Senior Software Engineer, you will design and build scalable...  ...reviews and running a robust testing cycle with automated testing... 

    The Briefed

    Boston, MA
    2 days ago
  • We're looking for a Senior Software Engineer in Test who brings a builder's mindset to quality engineering. You'll be a hands-on senior engineer...  ...Test Automation: Build, extend, and help maintain the frameworks, tooling, and CI integration the team's testing runs on — taking... 
    Remote work
    Flexible hours
    Shift work

    Akoya

    Boston, MA
    3 days ago
  • $140k - $220k

     ...looking for a Senior UI Platform Engineer to lead the design and build of the shared developer tooling foundation for our next-...  ...into module federation, run its tests, cut a release with one command...  ...Need: You’ve built shared frameworks, tooling or platforms that other... 
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    Shift work

    CrowdStrike

    Boston, MA
    1 day ago
  •  ...Our client is seeking a Senior Software Engineer in Test to ensure product quality across a digital...  ...automated testing solutions, evolve testing frameworks, and drive quality throughout the...  ...~ Experience with API testing using tools such as Rest Assured, Karate, or... 
    Hourly pay
    Local area

    Eliassen Group

    Boston, MA
    more than 2 months ago
  • $140k - $210k

    At Klaviyo, we value the unique backgrounds, experiences...  ...People Technology Engineer to be the first dedicated...  ..., testing, security, and observability...  ...company-wide AI patterns, tooling, and best practicesEnable...  ...by building:Reusable frameworks and workflowsPlaybooks... 
    Shift work

    Klaviyo

    Boston, MA
    3 days ago
  •  ...Klaviyo’s Platform Engineering team provides infrastructure primitives, platforms, tooling, and guidance to Klaviyo’s engineering organization. This role focuses on core platform...  ...and developer experience. As a Senior Software Engineer, you will craft a paved path for... 

    The Briefed

    Boston, MA
    4 days ago
  •  ...impact you will have in this role:As a Software Development Engineer in Test (SDET), you will be part of a...  ...maintain Java-based test automation frameworks and solutions across UI, API, and backend...  ...with performance testing tools such as JMeter.Experience working in... 
    Remote work
    Flexible hours

    DTCC- The Depository Trust & Clearing Corporation

    Boston, MA
    12 hours ago
  • $116k - $174k

     ...EngineerRemote Remote Apply Software Engineering & QASoftware Engineer...  ...– RecommendationsAt Klaviyo, we value the unique...  ...Spark or similar frameworks) that transform raw...  ...decision making and A/B testing efforts —ensuring...  ...monitoring and debugging tools. Share knowledge,... 
    Remote work

    Venturefizz Product Management Community

    Boston, MA
    12 hours ago
  •  ...Senior Software Engineer In TestStrategic Advisors Technology (SAT) is looking for a Senior Software Engineer in Test to help automate the testing of our products. The ideal candidate...  ...review requirements, build automation frameworks and implement solutions in an Agile environment... 
    Work at office
    Work from home

    Samprasoft

    Boston, MA
    4 days ago
  • $130k - $175k

     ...Places to Work.”About YouYou're an engineer at heart who finds joy in building the software that other software runs on — and...  ...to use AI-assisted development tools to move faster, improve the developer...  ...-quality, efficient, and well-tested code that aligns with project... 
    Temporary work
    Work at office
    Local area
    Flexible hours
    3 days per week

    Tulip Interface

    Somerville, MA
    3 days ago
  • $148k - $222k

     ...Senior Software Engineer – Profiles, Lists and SegmentsAt Klaviyo, we value the unique backgrounds, experiences...  ...segments. We own the tools that let customers...  ...reviews and running a robust testing cycle using automated testing practices and frameworks, including end-to-end... 

    Venturefizz Product Management Community

    Boston, MA
    12 hours ago
  •  ...is the leader in automated software engineering you can trust. As AI writes...  ...dedicated Software Engineer in Test (SDET) hire for this space,...  ...software, compiler or language tooling, developer tools, embedded...  ...and scaling automated test frameworks, distributed execution systems... 
    Remote work
    Relocation package
    Flexible hours
    Shift work

    Code Metal, Inc.

    Boston, MA
    2 days ago
  • We don't just build software; we're changing the way people use energy. We innovate through...  ...an immediate opening for a Software Engineer in Test, focusing on developing automated...  ...skills. 2+ years using test automation frameworks ie: Cucumber, FitNesse, TestNG, and Selenium... 
    Immediate start

    Roberts Recruiting

    Boston, MA
    4 days ago
  •  ...Quality Assurance and Engineering. As a technical associate...  ...partners in Manual & Test automation. Your...  ...using Selenium automation framework with Java. Performs regression...  ...and accelerates software delivery, using...  ...Continuous Delivery (CI/CD) tools. Tests and validates... 

    PeopleSERVE, Inc.

    Boston, MA
    15 days ago
  •  ...Expert (SME)/Technical Lead Engineer (TLE) Level Test & Verification Engineers...  ...involving CI/CD pipelines and AI tools. \tThis position will be...  ..., including hardware, software, and network configurations...  ...automated test scripts and frameworks to improve efficiency and effectiveness... 
    Full time
    Work experience placement
    Remote work
    Relocation

    Systemart LLC

    Cambridge, MA
    22 days ago
  •  ...Software Engineer – Quantitative Research ToolsRole Overview: Design internal analytical tools for quants and PMs—backtesting frameworks, visualization dashboards, data QA pipelines, custom trading interfaces.Must-Haves:Degree in CS or relatedExperience with Python, web... 

    Fynetra Limited

    Boston, MA
    12 hours ago
  • $160k - $175k

     ...environment where ideas are tested, diverse perspectives...  ...’s flagship internal software products, delivering a...  ...test, and enhance new tools to attribute drivers...  ...managers, quants, and engineers to align tools with...  ...and modern front-end frameworks.· CFA designation is a... 
    Casual work
    Work at office
    Worldwide
    Flexible hours
    3 days per week

    Acadian Asset Management

    Boston, MA
    12 hours ago
  • $122k - $240.5k

    Position Summary Software Engineer III with Agentic AI Experience,...  ...augmented generation pipelines, tool-calling workflows, and...  ...performance, write automated tests, and support production readiness...  ...least one modern front-end framework such as React, Angular, or... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    Shift work

    Deloitte

    Boston, MA
    12 hours ago
  • $95.6k - $188.4k

    Position Summary Software Engineer II, AI & Engineering/Engineering...  ...stack developer who builds, tests, and ships reliable software...  ...Implement agentic AI patterns — tool-calling agents, RAG...  ....js) and a modern front-end framework (React, Angular, or Vue.js).... 
    Local area
    Visa sponsorship
    Flexible hours

    Deloitte

    Boston, MA
    2 days ago
  • $65 - $80 per hour

     ...next generation of quality engineering practices across a modern technology...  ...for a highly technical software engineer with strong Python...  ...enjoys building automated testing solutions for data platforms...  ...designing scalable automation frameworks, improving test coverage... 
    Full time
    Temporary work
    Flexible hours

    Motion Recruitment

    Boston, MA
    1 day ago
  •  ...MAJob Type: PermanentPay: $160000Posted: 2026-08-24Senior Software Engineer, Test InfrastructureJoin an innovative technology company building...  .... Develop integration and hardware-in-the-loop test frameworks. Design fault-injection and system validation capabilities... 
    Immediate start

    Talener

    Boston, MA
    12 hours ago
  • $116k - $174k

    At Klaviyo, we value the unique backgrounds, experiences...  ...their own destiny.Software Engineer, Conversational...  ...software lies not only in tools that help people work...  ..., regression testing, qualitative error analysis...  ...with modern backend frameworks such as FastAPI or Django... 

    Klaviyo

    Boston, MA
    12 hours ago
  •  ...Software Development / Software Test Engineer (SDE/STE)We are seeking a Software Development / Software Test Engineer...  ...software, build automated testing frameworks, and improve engineering workflows...  ...test coverage.Develop software tools and automation to improve engineering... 

    Kaleidoscope Innovation

    Boston, MA
    4 days ago
  • $216k - $324k

     ...Senior Lead Software Engineer – Data PlatformThe Data Platform...  ...product use cases across Klaviyo. This Senior Lead role...  ...-based data platform tooling, modeled data systems,...  ...managed table frameworks such as Materialized Views...  ...administer a lie detector test as a condition of... 
    Shift work

    Venturefizz Product Management Community

    Boston, MA
    12 hours ago
  •  ...combine advanced science, modern software engineering, and powerful analytics to...  ...Develop cloud-based analytical frameworks, performance-driven algorithms, and specialized tooling.DevOps Excellence: Contribute actively to automated testing, continuous integration (CI),... 
    H1b
    Flexible hours

    Hackajob

    Boston, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Test Frameworks and Tooling | Klaviyo. Be the first to apply!