Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Infrastructure Engineer

$1,000 per month

Elicit

About Elicit Elicit is an AI research assistant that uses language models to help researchers figure out what's true and make better decisions, starting with common research tasks like literature review. What we're aiming for: Elicit radically increases the amount of good reasoning in the world. For experts, Elicit pushes the frontier forward. For non-experts, Elicit makes good reasoning more affordable. People who don't have the tools, expertise, time, or mental energy to make well-reasoned decisions on their own can do so with Elicit. Elicit is a scalable ML system based on human-understandable task decompositions, with supervision of process, not outcomes. This expands our collective understanding of safe AGI architectures. Visit our Twitter to learn more about how Elicit is helping researchers and making progress on our mission. Why we're hiring for this role Elicit is an AI research platform used by scientists, pharma companies, and decision-makers for high-stakes evidence synthesis. A single session could trigger hundreds of thousands of language model invocations across multiple providers, which means our infrastructure decisions directly impact cost, reliability, and the quality of research outcomes for users making decisions worth millions of dollars. Our infra is well-architected using best practices - Terraform, Kubernetes, Argo CD, GitHub Actions. But we're at an inflection point: enterprise contracts are getting larger, single-tenant deployments are multiplying, and the surface area that needs dedicated attention has outgrown what our current team can cover part-time. This is the first dedicated infrastructure hire and you'll define how this function works at Elicit. James (Head of Engineering, ex-Square) set up the original infrastructure and will be your close partner. This role will own and evolve the infrastructure platform that underpins Elicit's product. You will ensuring it is reliable, secure, cost-efficient, and ready for the demands of a growing enterprise customer base. Under your ownership, our systems will scale gracefully across single-tenant deployments, our SLAs will be backed by real engineering rigor rather than best intentions, and our compliance posture will be a selling point rather than an afterthought. What you'll own Own our cloud infrastructure across AWS and GCP - Kubernetes clusters, networking, databases (Aurora PostgreSQL, Redis, MongoDB Atlas), Cloudflare, and our CI/CD pipeline. Scale single-tenant deployments from a handful to many - each with distinct data retention, geographic, monitoring, and compliance requirements. Make a private cloud deployment a repeatable, low-overhead operation. Build our observability and incident response practice - proactive monitoring, alerting, SLA tracking, and structured post-mortems that make the whole team better at diagnosing and resolving issues. Drive compliance and security operations - ensure we follow through on the policies we've written (SOC 2, NIST AI framework, EU Cyber Resilience). Own disaster recovery exercises, database restoration drills, and security event monitoring (SIEM). Manage infrastructure cost and capacity - make smart decisions about where we run workloads (AWS, CoreWeave, Parasail), optimize spend, and plan capacity as usage grows. Improve developer experience - CI/CD pipeline performance, preview environments, local development tooling, and deployment confidence. Contribute to backend systems where infrastructure and application intersect - circuit breakers, inference routing, data connector infrastructure for enterprise customers bringing their own data. What success will look like (6-12 months) A private cloud deployment is a ~1-day turnkey operation. Playbooks and templated Terraform make standing up Elicit in a customer's cloud routine, which opens up 8-figure enterprise deals. Our observability signal:noise ratio improves 10-fold. Health monitors cover every endpoint and job, and an alert firing means something needs attention. Disaster recovery is practiced. We run database restoration drills and provider-outage dry runs on a schedule, with post-mortems that make the whole team better at diagnosis. Our SLAs are backed by engineering rigor. We follow through on SOC 2, NIST AI framework, and EU Cyber Resilience commitments, and enterprise security reviews go faster because of it. Inference is faster and cheaper. You've found and executed opportunities like shifting load between providers to cut p95 latency and cost at the same time. What we're looking for 5+ years of hands-on infrastructure/SRE/platform engineering experience. An AI-native way of working . Agentic coding tools (Claude Code, Cursor, Devin, etc.) are how we build at Elicit, and infrastructure is no exception: agents help us write IaC and investigate incidents. You should be an enthusiastic practitioner who uses AI to multiply your impact, and excited to find new places agents can safely take on infrastructure work. Bonus: you've written about, spoken about, or built projects demonstrating this. Solid Terraform experience . this is our primary infrastructure-as-code layer and the most important technical requirement. Strong Kubernetes expertise . You've operated production clusters, not just deployed to them. Comfortable with EKS, networking, autoscaling (Karpenter), and debugging cluster-level issues. AWS experience (primary), with GCP familiarity a plus. GitOps and CI/CD fluency . Argo CD, GitHub Actions, or equivalent. You understand deployment automation, rollback strategies, and change management. SRE mindset . You've built or significantly improved observability stacks (DataDog or equivalent), incident response processes, and on-call practices. Security and compliance awareness. Experience with SOC 2 or similar frameworks, SIEM tooling, and translating compliance requirements into engineering practice. Ability to write software . You can contribute to our backend codebases where infrastructure meets application logic. Am I a good fit? Strong applicants will find it easy to answer these questions: Can you describe a time you designed and executed a multi-tenant or single-tenant deployment architecture for enterprise customers? How have you approached disaster recovery planning and testing at a previous company? Walk me through how you'd evaluate whether to build vs. buy for a new infrastructure component at a ~30-person startup. Have you owned compliance follow-through (not just policy writing) for a framework like SOC 2? Who will I work with? James (Head of Engineering) : set up the original infrastructure and will be your closest partner. You'll own execution, with James as sounding board and advocate. Product: PMs covering the core product, ML, and evals. They carry the customer side of enterprise deployments, so you'll work together to turn requirements like data residency, compliance commitments, and SLAs into architecture, and to weigh the cost and latency tradeoffs behind product decisions. Eval infrastructure is a shared surface with Ben, from CI integration to inference capacity. The whole engineering team : we're ~30 people company-wide, so you'll work directly with the engineers whose developer experience you're improving, and pair with them where infrastructure meets application code. Andreas and Jungwon (cofounders) : you'll meet both during the interview process, and infrastructure decisions with strategic weight (enterprise deployments, compliance posture) get their direct attention. On-call & incident expectations We don't have a formal on-call rotation yet. Incidents today are handled by the engineers closest to the affected system. Part of this role is building the incident response practice we should have: sensible alerting, SLA tracking, structured post-mortems, and eventually a rotation designed so it doesn't burn anyone out. You'd design the on-call setup you'll then live with. Why join us? The work matters. Our mission is to radically improve reasoning for high-stakes decisions. Over 2 million people use Elicit, including pharma teams making R&D decisions worth tens of millions of dollars, and the reliability of our platform is part of what makes those decisions sound. Infrastructure work is close to the business. Single-tenant deployments open enterprise deals, and inference routing choices show up directly in our costs and latency. You'll see the effect of your work in the company's trajectory. Built for the long term. We're a Public Benefit Corporation that spun out of a non-profit AI research lab. Long-term impact and AI safety are part of the corporate charter. High agency, low bureaucracy. ~30 curious, slightly weird people who write things down and trust each other to run with a vague brief. Serious investment in your growth. $1,000 per quarter for every person to explore AI tools, courses, and events, plus quarterly in-person team retreats. Location and travel We have a great office in Oakland, CA, and we'd love to see you there if you're local. That said, we're just as happy for you to work remotely. We do get the whole team together for a quarterly retreat somewhere fun, because in-person time matters to us. Benefits and perks In addition to working on important problems as part of a productive and positive team, we also offer great benefits (with some variation based on location): Flexible work environment: work from our office in Oakland or remotely with time zone overlap (between GMT and GMT-8), as long as you're comfortable traveling for quarterly in-person offsites. Fully covered health, dental, vision, and life insurance for you, generous coverage for the rest of your family (FSA/HSA, too). Flexible vacation policy, with a minimum recommendation of 20 days / year and plenty of company holidays. Every Elician receives a $200 monthly wellbeing stipend to spend on whatever supports your health and wellbeing. 401K with a 6% employer match. A new Mac + $1,000 budget to set up your workstation or home office in your first year, then $500 every year thereafter. $1,000 quarterly AI Experimentation & Learning budget, so you can freely experiment with new AI tools to incorporate into your workflow, take courses, purchase educational resources, or attend AI-focused conferences and events. A team administrative assistant who can help you with personal and work tasks. You can find more reasons to work with us in this thread! Compensation For all roles at Elicit, we use a data-backed compensation framework to keep salaries market-competitive, equitable, and simple to understand. For this role, we target starting ranges of: Senior (L4): $185-260k + equity Expert (L5): $250-280k + equity Principal (L6): >$260 + significant equity We're optimizing for a hire who can contribute at a L4/senior-level or above. We offer above-market equity for all roles at Elicit, as well as employee-friendly equity terms. Elicit

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Infrastructure Engineer in New York, NY vacancy
  • $211k - $317k

     ...THE POSITION Our roster has an opening with your name on it As the Infrastructure Engineering Director, you'll own FanDuel's foundational cloud and outpost-based infrastructure layer. You'll establish operational excellence, standardization, and reliability across... 
    Suggested
    Temporary work
    Local area
    Worldwide

    FanDuel

    New York, NY
    1 day ago
  • $140k - $224.25k

    The NVIDIA Experience (NVEX) Solutions Engineering team is looking for a senior Computer or Software Engineer who is ready to become...  ...Spectrum-X network systems that interconnect GPUs and AI compute infrastructure.The level of work we do requires a software engineering... 
    Suggested
    Full time
    Weekend work

    Nvidia

    New York, NY
    14 hours ago
  • $168k - $270.25k

     ...the world.The NVIDIA Enterprise Experience (NVEX) Solutions Engineering team is looking for a senior Computer or Software Engineer....  ...InfiniBand, NVLink, and Spectrum-X that link GPUs and AI compute infrastructure. Candidates must have a software development background in... 
    Suggested
    Full time
    Weekend work

    Nvidia

    New York, NY
    1 day ago
  •  ...This is a senior-level contract role on a W2, can be based in either Warren, NJ, or NYC. Key Responsibilities Provide infrastructure operations support through incident response and service request fulfillment Monitor enterprise infrastructure and respond to... 
    Suggested
    Contract work

    The Connors Group

    New York, NY
    14 hours ago
  •  ...We are seeking to recruit an Infrastructure Engineer. The position will be in our headquarters in midtown Manhattan. Our office works on a hybrid, 4-day in-office schedule with mandatory Tuesday through Thursday attendance. Core responsibilities Work closely with... 
    Suggested
    Full time
    Work at office
    Remote work

    CDW

    New York, NY
    2 days ago
  •  ...About the Role We are seeking an experienced Azure Infrastructure Engineer to design, manage, and optimize enterprise Azure and hybrid cloud environments. This individual will serve as a technical subject matter expert across Azure infrastructure and networking, working... 
    Full time

    Green Key Resources

    New York, NY
    1 day ago
  •  ...Associate Infrastructure Engineer Hybrid | New York City The Opportunity We are seeking an Associate Infrastructure Engineer to join a hands-on technology operations team supporting cloud infrastructure, internal IT, and DevOps initiatives. This is an excellent... 
    Internship
    Remote work

    Green Key Resources

    New York, NY
    2 days ago
  • $30 - $45 per hour

     ...Client Overview Our client is a well-established national organization seeking an experienced Endpoint / Infrastructure Engineer to join its New York City technology team. This is a hands-on engineering position focused on resolving complex endpoint and infrastructure... 
    Hourly pay
    Temporary work
    Work at office

    Atrium

    New York, NY
    2 days ago
  •  ...Infrastructure Engineers — Mid, Senior & Staff Level We’re looking for exceptional infrastructure engineers with strong technical foundations and experience building infrastructure from the ground up. What we’re looking for: ~3+ years of infrastructure engineering... 

    Acceler8 Talent

    New York, NY
    14 hours ago
  •  ...We're Hiring: Infrastructure Engineer – Performance & Load Testing Location: New York City (NYC) Duration: Long-Term Contract Job Summary We are looking for an experienced Infrastructure Engineer specializing in Performance & Load Testing to design, build... 
    Long term contract
    Full time

    Quebec Solution Inc

    New York, NY
    9 hours ago
  • $136k

     ...Position Summary As a Sr Corp Infrastructure Engineer, you will play a key role in our technical delivery team by working with the Internal IT team to drive the technology programs, including Cloud implementation and support, desktop engineering escalation and networking... 
    Full time
    Relocation
    Flexible hours
    Night shift

    ECI

    New York, NY
    14 hours ago
  •  ...Associate Infrastructure Engineer About the Opportunity A growing financial technology-driven organization is seeking an Associate Infrastructure Engineer to join its Infrastructure team. This individual will help support and improve cloud-based systems, contribute... 

    Green Key Resources

    New York, NY
    14 hours ago
  •  ...new products on crypto rails.Privy owns the abstractions and infrastructure layer above wallets, integrating across chains, third-party providers...  ...is trust. While we have a dedicated security team, every engineer brings security to their designs from the start.In practice,... 
    Flexible hours

    Stripe

    New York, NY
    1 day ago
  • $175k - $250k

    Senior ‘Developer Infrastructure’ EngineerThe Systematic Platform Execution & Exchange Data (SPEED) Team is at the core of Millennium’s Equities...  ...time‑critical markets. As a Senior Developer Infrastructure Engineer on SPEED, you will own and evolve the build and CI/CD... 
    Remote work

    Millennium Management

    New York, NY
    1 day ago
  • $190k - $210k

     ...Boeing, and RTX Ventures, Axion is poised to lead the quality revolution in manufacturing.About the Role:We're seeking a Senior Infrastructure Engineer to play a key role in shaping and scaling our cloud infrastructure. You'll be responsible for designing, implementing, and... 
    Local area
    Work from home
    Flexible hours
    Night shift
    Weekend work

    Axion Ray

    New York, NY
    3 days ago
  • $65 - $75 per hour

    DescriptionKforce has a client in NYC that is seeking an Infrastructure Engineer. Key Responsibilities:* Provision, configure, and maintain secure sandbox runtime environments within Amazon EKS* Support deployment and operation of AI execution environments including NVIDIA... 

    KForce

    New York, NY
    4 days ago
  •  ...Network Engineer – WAN, LAN, Voice & DevOps Location: New York City / Hybrid Type: Permanent Salary: Competitive, dependent...  ...manager is seeking a hands-on Network Engineer to join its infrastructure team. This is a broad and varied role covering the design, build... 
    Permanent employment
    Full time
    Remote work

    Autonomai Recruitment

    New York, NY
    4 days ago
  • $230k - $280k

     ...Staff Infrastructure Engineer Location: Soho, New York City (Onsite – 4–5 days per week) Salary: $230,000 – $280,000 + Competitive Equity Employment Type: Full-Time, Permanent The Opportunity Are you an experienced Infrastructure Engineer with a strong... 
    Permanent employment
    Full time
    H1b

    CRG – People & Transformation

    New York, NY
    3 days ago
  •  ...Network Engineer Overview As a Network Engineer, you will design and operate high-performance network platforms for a quantitative...  ...teams to ensure seamless integration of network infrastructure with compute and application platforms. Drive innovation by... 

    Green Key Resources

    New York, NY
    1 day ago
  •  ...Network Engineer Contract Duration: 12 Months Location: Midtown, New York, NY (Onsite 4 days/week) Overview Our direct client is in need of a Network Operations & Infrastructure Engineer who combines deep hands-on networking expertise with the ability to lead... 
    Full time
    Contract work
    Work at office
    Remote work

    Gotham Technology Group

    New York, NY
    9 hours ago
  •  ...Network Engineer - New York - Investment Management We’re partnering confidentially with a global investment firm looking for a...  ...doing: Designing, implementing and maintaining global network infrastructure Building network automation and self-service capabilities... 
    Full time
    Work at office

    Autonomai Recruitment

    New York, NY
    9 hours ago
  • $120k - $165k

     ...highly skilled and versatile, Swiss Army Knife IT Operations Engineer to support enterprise-class data centers and ensure seamless...  ...on ensuring high availability and performance of network infrastructure while contributing to game-day success. The ideal candidate... 
    Full time
    Contract work
    Local area
    Relocation
    Night shift
    Day shift

    Blue Mantis

    New York, NY
    2 days ago
  •  ...Title: Low Latency Network Engineer Location: New York or Chicago (4x per week onsite) Salary: Up to 250k base + bonus ($500...  ...technology business. You’ll influence architecture, deliver major infrastructure projects and help develop an experienced engineering team.... 
    Full time

    Hamilton Barnes 🌳

    New York, NY
    14 hours ago
  • Job Responsibilities: 1、Provide back-end technical support and assistance to system integrators, distributors, and channel partners; 2、Establish and continuously improve the service process system, including technical support and RMA procedures, while ensuring the quality...
    Full time

    Ruijie Networks

    New York, NY
    3 days ago
  •  ...Senior Network Engineer | Elite Quant Trading firm I’m partnered with an elite quantitative trading firm who are looking for an...  ...Engineer to help design, build and scale their global network infrastructure, supporting everything from low-latency production trading and... 
    Work at office

    Acquire Me

    New York, NY
    14 hours ago
  •  ...A growing investment platform focused on sustainable infrastructure is seeking an Associate to join its private credit investment team. This is a hands-on opportunity to work across direct lending and more complex, strategic credit investments within a lean and collaborative... 
    Full time

    Investment FIrm

    New York, NY
    14 hours ago
  •  ...OT Network Engineer Job Summary Support substation automation and modernization projects through SCADA, OT networking, RTU configuration, network architecture, and cybersecurity . Work with Protection & Controls, IT, field engineering, vendors, and contractors... 
    For contractors

    Coalesce Management Consulting

    New York, NY
    1 day ago
  • $140k - $170k

     ...Job Title: AI Infrastructure Support Engineer Location: New York, NY Type - Hybrid 4 days Onsite Terms; Full Time Salary- $140000/yr - $170000/yr Our client provides a range of financial products and services in the United States and internationally. It... 
    Full time
    Work at office

    Yoh, A Day & Zimmermann Company

    New York, NY
    14 hours ago
  •  ...Job Title: HPC Network Engineer | High-Performance Infrastructure Location: New York or Chicago preferred | Other US locations considered (Flexible work arrangements) Salary: Up to $800,000 TC (Depending on experience) Do you want to join a global quantitative... 
    Flexible hours

    Hamilton Barnes 🌳

    New York, NY
    9 hours ago
  •  ...Low Latency Network Engineer Location: New York Type: Permanent Experience: 5 plus years in network/infrastructure engineering (trading/HFT experience strongly preferred) Design, build and support the high-performance network that powers a proprietary trading... 
    Permanent employment
    Full time

    Autonomai Recruitment

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Infrastructure Engineer. Be the first to apply!