Infrastructure Engineer

Job Description

Job Description

San Francisco, CA · On-site · Full-time Compensation: $150,000–$250,000 + 0%–1% equity

About the Company

Our client does LLM interpretability and context-optimization research, building custom machine-learning models that analyze and compress token contexts before they reach the underlying model. The result is roughly a 50% inference-cost reduction, lower latency, and measurably higher accuracy for the enterprises and scale-ups integrating LLMs into their products. About seven months old, it already serves roughly 1,000 customers and is well-backed by top-tier investors and notable operators.

Founded 2025 · 1–10 people (Seed) · Industry: AI Tools

The Role

Own the full multi-region GPU infrastructure stack end to end as the sole infra hire — global low-latency serving, multi-cloud and on-prem deployments, reliability, and cost efficiency — for a seed-stage LLM context-compression company. In-person in SF at a high-intensity pace.

Tech stack: AWS, GCP, Base10, Terraform, Docker, CI/CD, GPU/ML inference infrastructure, AWS Marketplace.

What you'll be doing

• Own the cloud systems serving the compression API end to end
• Build and operate global, low-latency, high-throughput GPU ML inference infrastructure
• Work across AWS, Terraform, Docker, and CI/CD
• Continuously improve and research infrastructure solutions

Requirements

• Has built and operated production infrastructure at a startup or larger company
• Learns new solutions and technologies quickly
• Based in or willing to relocate to San Francisco to work in person at the hacker house
• Willing to work startup hours in a high-intensity (9am–9pm, six-day) environment

Nice to Haves

• A quick learner who grasps products and systems fast
• Experience building for performance and reliability at scale
• A research-and-product-focused mindset
• A high-ownership mentality
• A startup-minded operator who prioritizes learning and growth over work-life balance
• GPU-infrastructure experience in production, or a background at an infrastructure company
• First infra-hire experience at a startup

Why Join

• Sole infra owner, full stack, day one: own every layer of a multi-region GPU stack (AWS, GCP, Base10, on-prem), sitting directly in the critical path of ~1,000 customers
• Strong backing and early traction: ~1,000 customers within seven months, well-funded by top-tier investors
• Comp and lifestyle support for high output: $150K–$250K + up to 1% equity, with housing and food provided at the SF hacker house, visa sponsorship, laundry/cleaning, meal delivery, and health/dental

Details

• Location — San Francisco, CA
• Work policy — On-site, high intensity (six days/week)
• Compensation — $150,000–$250,000 + 0%–1% equity
• Visa sponsorship — Available (H-1B, O-1, OPT)
• Employment type — Full-time