Member of Technical Staff, Infrastructure
LlamaIndex
Join Us And Help Shape The Future Of Ai By Defining The Narrative Around Document Understanding
The Infra team at LlamaIndex owns the foundations that our product is built upon as well as many of the tools that enable engineers to develop, ship, and observe their code. We are responsible for designing, building, and scaling core infrastructure that powers a high-volume data platform for AI applications. We are looking for team members who love building enabling systems that empower our engineers and power our rapidly growing product.
We're looking for folks with experience managing cloud infrastructure, working through various stages of scale, and helping the broader Engineering team be more effective and productive. Some traits that are important to our company culture: customer-obsessed, collaborative, hard-working, and optimistic. And we're looking for owners, so we hope you'll help us expand this list.
Responsibilities
- Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth.
- Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments.
- Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance.
- Enable external customer deployment success through maintaining clear infrastructure boundaries and principles.
- Optimize and improve the release and deployment processes to enhance efficiency and reliability.
- Ensure compliance with relevant regulations and implement robust security measures across different deployment environments.
Qualifications
- 5+ years of engineering experience.
- Worked on platform or infrastructure teams on significant projects involving infrastructure components (Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, observability, etc.)
- Experience in optimizing cloud resource utilization.
- Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency.
- Willing to build LlamaIndex's engineering culture as we grow.
- You can balance speed and pragmatism and build the appropriate solutions for each stage of the company's growth.
Preferred Qualifications
- Experience building out infrastructure from the ground up at a fast-growing startup.
- Experience with observability tools like Prometheus, Grafana, and New Relic.
- Experience with GitOps tools like ArgoCD and Flux for continuous deployment.
- Experience with security compliance and audits in cloud environments such as SOC2.
- Familiar with Python, Postgres, multi-cloud deployments
Location
We offer a hybrid-friendly culture based out of our downtown San Francisco office.
Why Join Us?
- Impactful Mission: Work on innovative AI products that redefine how knowledge is accessed and utilized.
- Collaborative Team: Join a team of passionate individuals committed to pushing the boundaries of technology.
- Growth Opportunities: Be at the forefront of the AI revolution, with ample opportunities to grow alongside our scaling organization.
Additional Benefits
- Competitive base salary and equity compensation
- Comprehensive medical/dental/vision coverage for you and your family
- Unlimited paid time off policy
- Daily catered lunch and snacks in the San Francisco office
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.
$200k - $350k
...About the job Pantheon - Member of Technical Staff: Infrastructure Member of Technical Staff: Infrastructure Posted by Transparent Search Group on behalf of Pantheon . About Pantheon Autonomous physical labor Website: The role We are...SuggestedH1bRemote workVisa sponsorship$180k
...Member Of Technical Staff - RL Infrastructure Palo Alto, CA xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence....SuggestedTemporary work$256k - $276k
...World" graphic novel to understand the bigger picture and our vision at Postman. The Opportunity As a Member of Technical Staff on AI Infrastructure, you will build and maintain the foundational systems and distributed infrastructure that power AI model post training...SuggestedWork at officeFlexible hours3 days per week$10k
...millions of calls. It's freakin hard and a lot of fun. What You'll Do: 30 Day: You'll ramp on our multi-cluster, multi-cloud infrastructure. 60 Day: You'll deliver a new service like Anycast Global Router. 90 Day: You'll own a domain like GPU inference clusters....SuggestedFlexible hoursShift work$10k
...Hiring This Role Vapi runs live phone calls — when something breaks, callers hear it. We're building cell-based, multi-region infrastructure to drive 99.99% call completion, and this hire owns the foundation: multi-cluster Kubernetes on EKS, a stateful data plane (...SuggestedFlexible hours- ...About us Parallel is a web infrastructure company. Our products are used by leading businesses in sales, marketing, insurance, and... ...We're a flat, talent-dense organization dedicated to solving technical and creative problems. We seek like-minded individuals who...Work at officeVisa sponsorshipFlexible hours
$160k - $270k
...About Mandolin Nearly every disease will become treatable in our lifetimes. Mandolin is laying the clinical and financial infrastructure to get groundbreaking treatments to patients faster, powered by AI agents. Mandolin partners closely with the largest healthcare...Full timeWork at officeLocal area$180k - $300k
...Member Of Technical Staff - Infrastructure Engineer Freiburg (Germany), San Francisco (USA) About Black Forest Labs We're the team behind Latent Diffusion, Stable Diffusion, and FLUX—foundational technologies that changed how the world creates images and video...Work at officeRemote workWorldwideRelocation2 days per week$200k
...context, and inference-time compute to achieve this goal. About the Role As an engineer on the Supercomputing Platform & Infrastructure team, you will design, build, and operate the large-scale GPU infrastructure that powers Magic's model training and inference workloads...RelocationVisa sponsorship$300k
...from human expertise. About the role This role is for strong infrastructure engineers who can build the systems layer for RL at scale:... ...Experience building tools, platforms, or services used by other technical users. Strong judgment around technical tradeoffs: when to...Full timeWork at officeLocal area$200k - $400k
...Infrastructure Engineer Opportunity We are looking for an Infrastructure Engineer who thrives on the complexity of modern deployment... ...it" mentality. ~ Communication: Ability to write clear technical specs for both internal teams and external customers....Flexible hours- ...Member of Technical Staff, Product TL;DR: Listen is building the human layer of AI. We're Sequoia-backed, raised $100M, and our customers... ...the product and makes decisions across the LLM pipeline, infrastructure, backend, and UX. You're a future or past founder....Flexible hoursShift work
$180k
...Member Of Technical Staff - Inference Palo Alto, CA About Xai Xai's mission is to create AI systems that can accurately understand... ...systems end-to-end. You will own everything from distributed infrastructure (global KV cache, continuous batching, load balancing,...Temporary work- ...Member Of Technical Staff @ Lotus AI Lotus AI is a groundbreaking primary care app that integrates your medical records, AI, and real doctors... ...with system refactors, schema migrations, and data infrastructure simplification Familiarity with PostgreSQL (including...
- ...and cost with today's homogeneous, vertically integrated infrastructure. Gimlet addresses this by decoupling AI workloads from the... ...AI datacenters. Mission Gimlet Labs is seeking a Member of Technical Staff focused on distributed systems. In this role, you will...
$200k
...Join to apply for the Member of Technical Staff role at Listen Labs . TL;DR: We are seeing strong market demand and an aggressive 6‑month product... ...product and must make decisions across the LLM pipeline, infrastructure, backend, and UX. You have a high bar for quality: In a...Flexible hours- ...Member Of Technical Staff, Platform Engineer You'll design, build, and own distributed systems and core platform infrastructure end-to-end across the stack - from user-facing product surfaces and real-time interactions to evaluation pipelines, model orchestration,...
- ...and cost with today's homogeneous, vertically integrated infrastructure. Gimlet addresses this by decoupling AI workloads from the... ...AI datacenters. Mission Gimlet Labs is seeking a Member of Technical Staff focused on kernels and GPU performance. In this role, you...
- ...and cost with today's homogeneous, vertically integrated infrastructure. Gimlet addresses this by decoupling AI workloads from the... ...datacenters. Mission Gimlet Labs is seeking an Member of Technical Staff focused on AI research. As an AI Researcher, you will be...
$150k - $300k
...Building Open Superintelligence Infrastructure Prime Intellect is building the open superintelligence... ...that runs the jobs. Core Technical Responsibilities Hosted Training... ...in open development and encourage team members to contribute to the broader AI...Work at officeLocal areaRemote workVisa sponsorshipRelocation packageFlexible hours- ...and cost with today's homogeneous, vertically integrated infrastructure. Gimlet addresses this by decoupling AI workloads from the... ...AI datacenters. Mission Gimlet Labs is seeking a Member of Technical Staff focused on ML systems and inference. In this role, you...
$150k - $280k
...Member of Technical Staff (Backend) San Francisco, CA Compensation: $150,000 – $280,000 + Competitive Equity Type: Full-Time Visa... .... 3. Decisions at the Speed of Money - Build infrastructure that processes millions of transactions on AWS, including...Full timeTemporary workH1bWork at officeVisa sponsorshipRelocation package- ...and resources that strengthen the broader AI ecosystem. As a member of SII, you'll conduct original and impactful research on... ...Identify and analyze security and privacy threats across AI systems, infrastructure, and user-facing products. Develop novel defenses,...
$150k
...We are seeking a Member of Technical Staff Simulation Engineer to join our AI robotics research team developing foundation models for robotics... ...impact. We leverage Amazon's massive computational infrastructure and rich real-world datasets to train and deploy state-of...InternshipLocal area$10k
Vapi (/ˈVɑːpi/) We're creating the shift to voice as humanity's default interface We're the most configurable platform for deploying voice agents We've grown to over 600k developers in two years, adding 2,000+ every day Try talking to Vapi now! Why We're...Flexible hoursShift work- ...Member Of Technical Staff Atomic is the leading venture studio for company creation, partnering with extraordinary founders to launch businesses... ...burdensome sector. We're building the AI-native infrastructure to power the next generation of insurance services....Local area
- ...Member of Technical Staff — Internal AI Harness Stuut is transforming accounts receivable for B2B companies—making collections smarter and... ...role focuses on designing and implementing the internal infrastructure, automation, and AI-driven workflows that increase leverage...Full timeFlexible hoursShift work
$150k
...Amazon's Frontier AI & Robotics (FAR) team is seeking a Member of Technical Staff to drive foundational research and build intelligent robotic... ...systems and algorithms, leveraging our extensive infrastructure to prototype and evaluate at scale - Collaborate with our...Local area- ...Member of Technical Staff, Product Development Mirendil Mirendil is a tech-first company focused on solving core bottlenecks that... ...training, reinforcement learning, reasoning systems, and infrastructure for large-scale experiments. Our team includes researchers...
$200k - $300k
...Member of Technical Staff (Platform) Title of Role: Member of Technical Staff (Platform) Location: San Francisco, onsite Company... ...deployment. Build and optimize data pipelines and infrastructure to support AI-powered functionalities. Engage in system...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member of Technical Staff, Infrastructure. Be the first to apply!
- technical support assistant San Francisco, CA
- technical analyst San Francisco, CA
- end user support technician San Francisco, CA
- IT assistant San Francisco, CA
- help desk assistant San Francisco, CA
- IT support technician San Francisco, CA
- operations support technician San Francisco, CA
- desktop support analyst San Francisco, CA
- support analyst San Francisco, CA
- technical associate San Francisco, CA

