Infrastructure Engineer
$200kPeople Culture Talent
Note: We are recruiting on behalf of our valued client. This opportunity is for a position with their organization, not with People Culture Talent. We're excited to help connect talented professionals with this exceptional team!
The Role Arena Intelligence is the open platform for evaluating how AI models perform in the real world. Born out of UC Berkeley's SkyLab and the team behind Arena.ai, our leaderboards are the industry's gold standard for AI model evaluation - trusted by researchers, developers, and enterprises shaping the future of AI. We're building the API-based services for enterprise customers- We want to provide enterprises with the best of the ML products (like Arena Max) but customized to their business. You'll own core infrastructure that turns our research advantage into an enterprise products. This is a founding role on the developer/enterprise team. You'll work directly with the founders and early customers to define what we build and how we build it. What You'll Do • Build API based products from the ground up. Design and implement a low-latency, high-reliability APIs for leaderboards, models, and arenas.• Solve hard streaming problems. Handle SSE/streaming responses across heterogeneous providers, including partial failure recovery, mid-stream fallback, and consistent response normalization.
• Ship enterprise-grade infrastructure. Build the systems enterprise customers expect: rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC2 compliance
• Build deep observability. Instrument infrastructure with distributed tracing, latency breakdowns, token-level usage tracking, and real-time dashboards so customers (and we) can see exactly what's happening.
• Build AI centered products. Integrate with our core evaluation platform, Arena data, and customer-specific benchmarks. Collaborate with the research team to turn novel ideas into full-featured products
• Flex across the stack. Contribute to the backend of our Leaderboards and Evals platforms when needed, helping unify our public and private data architectures. What We're Looking For • 4+ years of backend engineering experience, with meaningful time spent on distributed systems, infrastructure, or developer-facing platforms.
• Strong proficiency in Go and/or Rust, with hands-on experience building high-throughput APIs or proxy/gateway systems.
• Experience with LLM provider APIs (OpenAI, Anthropic, Google, etc.) and a working understanding of the challenges: streaming, token management, rate limits, model-specific quirks.
• Solid cloud infrastructure skills - you're comfortable with AWS or GCP, Kubernetes, Terraform, and database systems like Postgres and Redis.
• A product-oriented mindset. You think about the developer experience of your APIs, not just the implementation. You ask "why" before "how."
• Comfort with ambiguity. We're a startup. Scope is fluid, context shifts, and you'll wear many hats. That should sound exciting, not stressful. Nice to Have • Experience building API gateways, proxies, or developer tools (Bifrost, Kong, Envoy, Tyk, or custom).
• Background in ML infrastructure, model serving, or evaluation frameworks.
• Experience building enterprise-ready features: SSO, RBAC, audit logs, multi-tenancy.
• Familiarity with the modern AI infra stack (vLLM, LiteLLM, LangChain, etc.).
Compensation Band Their openings span more than one career level. The starting salary for this role is $200k and could range up to $350k USD, plus equity. The provided salary depends on many factors, such as work experience and transferable skills, business needs and impact, and market demands. Benefits
- Comprehensive health, dental, vision, and additional support programs.
- The opportunity to work on cutting-edge AI with a small, mission-driven team.
- A culture that values transparency, trust, and community impact.
- Visa sponsorship available.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Infrastructure Engineer in San Francisco, CA vacancy
$109k - $186k
...performance and scale, as well as executed flawlessly. As a Deployment Engineer, you will be responsible for translating customer... ...Meter to scale and meet the growing demand for reliable internet infrastructure.You will have an impact byDesigning performant and resilient...Suggested- ...and deploy new network-automation tools to accelerate network infrastructure deployments across diverse devices and vendors. Develop and... ...for new products including documentation, training for engineering teams, customers, and end-users. Build and maintain dynamic,...SuggestedFull time
$155.4k - $273.7k
...with superintelligence relies on a foundational truth: our platform must be available, performant, and reliable, 24/7. As an Infrastructure engineer, you'll be at the heart of making this a reality, impacting every enterprise customer who trusts us with their AI-powered...SuggestedFull timeWork at officeLocal areaShift work$130k - $165k
...and Google Lens. Before that, Clay led the product and design teams for Google Workspace. We’re looking for a hands-on IT Infrastructure Engineer to help scale Sierra’s internal systems during a critical period of growth. You’ll be the second member of our IT Engineering...SuggestedFull timeFlexible hours$230k - $390k
...Google Lens. Before that, Clay led the product and design teams for Google Workspace. What you’ll doAs a Forward Deployed Infrastructure Engineer at Sierra, and a founding member of this function, you will own the end-to-end lifecycle of customer deployments, while helping...SuggestedFull timeFlexible hours$100.79k - $160.26k
...for building, managing, monitoring and operating DLA Pipers infrastructure systems and environments. These environments support the Firm... ...stay on current versions.Resolves escalated cases from other Engineers and Helpdesk. Performs fault resolution and root-cause diagnosis...Full timeWork at officeRemote workVisa sponsorship- ...talent in your field. At one of the world's most iconic financial institutions, where infrastructure is of paramount importance, you can play a pivotal role.As an Infrastructure Engineer III at JPMorgan Chase within the Enterprise Technology - Network Services Group, you...
- ...consulting, enterprise architecture Experience in Cisco DC networks like Cisco Nexus Switching, network security, internet connectivity/infrastructure design and DC network migration is must.DC network design, implementation and migration compromising Cisco Nexus (ACI & NXOS),...Flexible hours
$7.5k
...Infrastructure Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high-growth technology startup to appoint a mission-critical Infrastructure Engineer to own the brand feel of the company and the...Work at officeDay shift- ...Infrastructure Engineer Console is building the AI agents that power autonomous enterprises. We use AI to autonomously resolve IT, HR, Legal, Finance, Security, and Ops tasks the moment they come in from Slack or Teams. We're building toward a future where enterprise...Full timeWork at office
$150k - $200k
...The Role We're looking for Infrastructure Engineers who will be instrumental in building and securing the backbone of our enterprise-grade AI data platform. You'll design systems that handle large volumes of sensitive financial data under strict security and compliance...Work at office- ...Arena Intelligence Engineer Arena Intelligence is looking for an engineer to build the core infrastructure that sits beneath our online evaluation systems — the AI gateways, automated arena runtimes, and serving layers that make real-world model evaluation possible...Permanent employmentFlexible hoursShift work
- ...About Us Relace is building the models and infrastructure that code agents reach for. We power the fastest model on OpenRouter (10,... ...is the place for you. The Role As an Infrastructure Engineer at Relace, you'll design and operate the systems that power our...Work at office
- ...including the rate of pay, benefits, etc., are currently subject to negotiation with the appropriate union. The Senior Infrastructure Engineer serves as a key contributor in the planning, design, construction, renovation, and delivery of infrastructure across UCSF facilities...Work experience placementLocal areaWorldwide
- ...The Role As Triumph's first dedicated Infrastructure Engineer, you'll own the foundation that everything else runs on. Until now, our infrastructure has been built and maintained by the core engineering team alongside everything else - you'll be the first person whose...
$180k - $250k
...Senior Infrastructure EngineerTitle of Role: Senior Infrastructure EngineerLocation: San Francisco, hybridCompany Stage of Funding: Seed... ...Background5+ years of experience in infrastructure engineering or DevOps roles.Proficiency in Kubernetes and Terraform for...- ...Infrastructure Engineer Opportunity At ReductoReducto is the agentic document platform for leading AI teams who demand enterprise performance at scale. We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading...Work at officeLocal area
$125k - $195k
...Infrastructure & Site Reliability EngineerThe fab2 team can build anything. We design all the hardware and software needed to make chips... ...deployments, and networking infrastructure that empower our software engineers. Our ultimate goal is complete command and control everything...Work at officeNight shift$176k - $210k
...Senior Infrastructure EngineerAt Komodo Health, our mission is to reduce the global burden of disease. And we believe that smarter use of... ...new feature rollout with solution architects, forward-deployed engineers, and customer success teamsLed the development of...For contractorsWork experience placementWork at officeLocal areaFlexible hours- Company DescriptionSonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled...
- ...Infrastructure Engineer The Infrastructure team owns the platform that delivers Navigator to the warfighters who depend on it. Our charter spans Kubernetes clusters in commercial and government cloud, application streaming for thin-client users on classified networks...Local area
- ...Why Join Ivo? Every civilization runs on the same infrastructure: agreements between people who don't fully trust each other. Sumerians... ...Series B and have grown 800% over the last 12 months. Engineering at Ivo Engineers at Ivo are inventors. Ivo was first-to-market...Contract workWork at officeVisa sponsorshipRelocation packageFlexible hours
- ...Infrastructure EngineerAt Komodo Health, our mission is to reduce the global burden of disease. And we believe that smarter use of data... ...you help operate and optimize. You will partner closely with engineering, data, and security teams, meeting the security and...For contractorsWork at officeLocal area
- ...campaign change, every A/B test, then waiting on design and engineering to do it. Today we deliver on-brand pages on your own domain... ...agents in parallel, the core hard problem of this role. Cloud infrastructure end-to-end: architecture, provisioning, CI/CD, deployments....Work at officeNight shift
- ...and alerting at scale.Kubernetes or Terraform, and containerized multi-tenant systems.Comfortable being the first person to own infrastructure at a fast-growing startup.Based in or willing to relocate to San Francisco.Nice to HaveHands-on with observability tooling such...Relocation
- ...Kernel Infrastructure Engineer Kernel is crazy fast, open source browser infrastructure for AI agents. We handle autoscaling, observability, and the messy details of web interaction, so developers can focus on what their agents do instead of how they do it. Teams...Relocation package
$165k - $200k
...Infrastructure EngineerAs a member of our infrastructure team, you'll be at the heart of a fast-paced startup environment. Your primary... ...role; you'll need to wear many hats—acting as an infrastructure engineer one moment, and a developer, or even a security analyst.You...Work from home- ...Chalk Infrastructure EngineerChalk is building the data platform that powers the future of machine learning applications. We tear down complexity... ...0 million Series A, led by Felicis.We are hiring exceptional engineers to join the Infrastructure team. This is an opportunity to...Work at officeFlexible hours
$180k - $250k
...LatchBio Engineering RoleYou will own the infrastructure layer of Latch including container orchestration, distributed filesystems, cloud architecture, and database systems. While our team is operationally proficient, we do not have the bandwidth to tackle exciting areas...Work at officeVisa sponsorship$160k - $260k
...businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 250,000 businesses worldwide -... ...s next.About the teamCorporate IT drives our IT support, IT engineering and business engineering functions at Airwallex. IT...Temporary workWork at officeLocal areaRemote workWorldwideFlexible hoursWeekend work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Infrastructure Engineer. Be the first to apply!
Related searches
- data infrastructure engineer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- infrastructure automation engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA

