Software Engineer, Infrastructure

Responsibilities

• Set the technical direction for infrastructure spanning databases, search and retrieval, data processing, asynchronous execution, and cloud architecture.
• Redesign search and retrieval systems for fast investigation across billions of pieces of content.
• Evolve relational database architecture through sharding, partitioning, indexing, caching, and new data-access patterns.
• Lead application and infrastructure changes for safe live-system migrations, including service topology and deployment strategy.
• Design scalable asynchronous systems for scheduling, queues, workflows, retries, backpressure, rate limiting, and failure recovery.
• Build high-volume ingestion, streaming, batch-processing, enrichment, and reprocessing infrastructure.
• Develop shared infrastructure services, APIs, libraries, and primitives for product engineers.
• Own cloud foundations including compute, storage, networking, isolation, resource management, and deployment architecture.
• Make build-versus-buy and architecture tradeoffs across latency, throughput, consistency, durability, cost, and complexity.
• Operate production systems, automate recurring operational work, write technical proposals, establish architectural standards, and guide engineers through complex systems decisions.

Requirements

• Experience operating at staff scope by identifying important technical problems, setting direction across team boundaries, and leading complex projects from design through adoption.
• Track record of designing and building distributed infrastructure systems used by other engineers or products.
• Experience scaling production systems through major increases in data volume, traffic, or workload complexity.
• Deep knowledge of relational database architecture, including data modeling, access patterns, indexing, partitioning, sharding, caching, and migration.
• Experience building or evolving high-throughput asynchronous systems with knowledge of scheduling, ordering, retries, idempotency, backpressure, and partial failure.
• Experience with large-scale search and retrieval systems and the tradeoffs among lexical search, vector retrieval, indexing speed, freshness, relevance, and cost.
• Experience building ingestion, streaming, or batch-processing systems for large data volumes.
• Ability to work across cloud infrastructure when compute, storage, networking, or deployment architecture changes are needed to scale data systems.
• Experience growing and leading infrastructure teams is valuable as the function scales.

Benefits

• For employees in New York, an in-person work arrangement five days per week with flexibility as needed from a Brooklyn waterfront office.
• 100% company-paid medical, dental, and vision insurance for employees.
• Flexible paid time off.
• Annual company retreats and regular in-person events.