Software Engineer, Developer Experience

About the Company

Braintrust is the AI observability platform. By connecting evals and observability in one workflow, Braintrust gives builders the visibility to understand how AI behaves in production and the tools to improve it.

Teams at Notion, Stripe, and Vercel use Braintrust to compare models, test prompts, and catch regressions — turning production data into better AI with every release.

About the Role

We're looking for an Engineer who loves building tools for other engineers. You'll own the systems we touch every day — local dev, CI, and the deploy pipeline — and make shipping to production fast, safe, and reliable. The work compounds across every engineer at the company and is very important to our whole team.

What You'll Do

• Work directly with the engineering team to find friction and remove it — help them be nimble, happy and productive

• Drive CI runtime down: parallelization, caching, sharding, test selection, and killing flakes

• Own the deploy pipeline: progressive rollouts, fast rollbacks, and clear signals when something is wrong

• Own our build toolchain — bundlers, compilers, monorepo tooling — and keep cold builds and rebuilds fast as the codebase and architecture grows

• Harden our supply chain: SBOMs, signed artifacts, locked-down GitHub Actions, secret hygiene, and provenance for every build

• Build CLIs, GitHub Apps, and bots that make the right thing the easy thing

Ideal Candidate Credentials

• 5+ years building developer tools, CI/CD, or platform infrastructure

• A track record of taking slow, painful workflows and making them fast and pleasant

• Deep GitHub expertise: Actions, Apps, APIs, merge queues, and branch protections

• Strong fluency with JavaScript/TypeScript build and bundling tools (esbuild, swc, Vite, Turbopack, tsc, pnpm) and a clear sense of when to reach for which

• Comfortable profiling and optimizing across the stack — flamegraphs, tracing, and just plain measurement

• Supply chain security experience: SBOMs, Sigstore/cosign, SLSA, GitHub Actions hardening

• Strong opinions on safe, reliable production deploys

Benefits Include

• Medical, dental, and vision insurance

• Daily lunch, snacks, and beverages

• Flexible time off

• Competitive salary and equity

• Wifi & cellphone stipend

Equal Opportunity

Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.