Forward Deployed Engineer

About Groq

Inference is the engine that powers AI and Groq was built from the silicon up to deliver the worlds fastest inference at scale. We pioneered the LPUthe first processor designed specifically for AI inferenceand are transforming that innovation into a global cloud platform powering production AI workloads.

With the capital infrastructure and team to execute were uniquely positioned to define the next era of AI infrastructure. The opportunity is massive and its still wide open. Now lets go build it!

Mission

As a Sr./Staff Forward Deployed Engineer focused on AI Infrastructure at Groq you will work at the frontier of large-scale AI systems taking complex customer infrastructure programs from requirements to working production environments. Youll help bring some of the newest accelerator and infrastructure technologies into production spanning next-generation NVIDIA GPU systems alongside Groqs purpose-built inference platform.

You will operate across GroqCloud GroqMetal (Groqs infrastructure platform) GPU and LPX infrastructure and the networking storage orchestration observability and workload layers around them. This is an opportunity to work on infrastructure where the playbooks are still being written: bringing up new systems solving problems that emerge only at scale and helping customers deploy demanding AI workloads on platforms at the leading edge of the market. You will work directly with customers while partnering closely with Commercial Field Engineering Platform and Cloud Engineering Networking Data Center Operations Security and Support teams.

This is a deeply hands-on individual-contributor role. You will work directly in systems write code and automation troubleshoot across layers of the stack and turn ambiguous customer requirements into deployed and validated solutions. The work you do in the field will also shape what comes next: turning hard-won lessons into reusable tooling deployment patterns reference architectures and improvements to the Groq platform for the customers that follow.

Location: This role will be based in one of our three hiring hubs: the Dallas San Francisco or New York City area . The person hired for this role must be based in one of these three areas. Youll have the flexibility to work remotely while we establish our local Groq office with the expectation that this role will transition to onsite once the office opens.

Responsibilities & Opportunities in This Role

• Own technical execution across complex customer engagements from discovery and architecture through PoCs demos deployment cluster bring-up validation acceptance production readiness and operational handoff.
• Translate incomplete or ambiguous customer requirements into practical architectures implementation plans test criteria runbooks and concrete engineering actions.
• Work hands-on across Linux bare-metal infrastructure Kubernetes and Slurm networking storage observability automation and Groq platform integrations to bring customer environments online and resolve issues.
• Support large-scale GPU and LPX deployments including infrastructure bring-up cluster health and performance validation workload testing benchmarking failure isolation and production-readiness evidence.
• Understand customer AI workloads well enough to reason about training and inference behavior concurrency throughput latency data movement caching scheduling and infrastructure bottlenecks.
• Lead technical portions of customer discovery architecture reviews demonstrations and proofs of concept clearly explaining design choices tradeoffs performance results and risks to both engineering and business stakeholders.
• Partner with Networking and Security teams on customer requirements such as private connectivity and peering routing ingress and egress load balancing network policy access controls security architecture reviews and enterprise security diligence.
• Troubleshoot production and pre-production issues that cross organizational or technical boundaries drive them to resolution and coordinate the right internal experts without losing end-to-end ownership.
• Embed with Platform Cloud Infrastructure or Operations teams when priority customer deployments expose gaps that require concentrated engineering execution automation or integration work.
• Build reusable tools automation reference architectures test suites deployment patterns documentation and lessons learned so that customer-specific engineering makes the platform better for the next deployment.
• Bring structured customer feedback and field evidence back to Product and Engineering identifying recurring gaps and helping turn one-off solutions into repeatable platform capabilities.

Ideal Candidates Have/Are

• 4 years of hands-on experience building deploying operating or troubleshooting cloud infrastructure AI infrastructure HPC systems large-scale platforms or similarly demanding production environments.
• Strong Linux and distributed-systems fundamentals with practical experience in Kubernetes Slurm bare-metal environments or comparable infrastructure platforms.
• Meaningful technical depth in at least one area such as GPU or accelerator systems networking storage orchestration/platform engineering or infrastructure reliability with enough breadth to troubleshoot across adjacent layers.
• Working knowledge of AI training and inference workloads and how workload characteristics affect compute networking storage scheduling latency and throughput.
• Strong Python Go Bash or equivalent scripting/programming skills for diagnostics automation deployment tooling testing or integrations.
• A track record of personally debugging and delivering systems rather than operating only at the architecture project-management or escalation level.
• Ability to break ambiguous problems into concrete technical actions and drive issues to resolution when responsibility spans multiple teams.
• Strong written and verbal communication skills including the ability to gather requirements from customer engineers explain technical tradeoffs clearly and document work so that others can reproduce it.
• Comfortable operating in a fast-moving environment where customer requirements platform capabilities and implementation details can evolve in parallel.

Preferred Qualifications

• Experience at a neocloud hyperscaler AI infrastructure provider HPC environment frontier AI company or other organization operating large-scale accelerator infrastructure.
• Hands-on experience with NVIDIA GPU infrastructure and technologies such as CUDA NCCL NVLink/NVSwitch DCGM GPU Operator InfiniBand RoCE Kubernetes or Slurm.
• Experience bringing up qualifying or operating multi-node GPU clusters including health checks burn-in or stress testing collective-communication testing performance benchmarking and acceptance criteria.
• Familiarity with high-performance storage systems such as VAST Weka Lustre Ceph or similar technologies and the data-access patterns of distributed AI workloads.
• Experience with infrastructure automation and lifecycle tooling such as Terraform Ansible CI/CD BMC/Redfish PXE/iPXE or related systems.
• Prior solutions engineering sales engineering solutions architecture or technical pre-sales experience in cloud networking security AI infrastructure or data center systems.
• Customer-facing networking experience including private interconnects and peering BGP and routing load balancing Kubernetes/Cilium network policy and north-south and east-west traffic design.
• Customer-facing security experience including access-control architecture network isolation enterprise security reviews and SOC 2 / ISO 27001-style diligence or questionnaires.
• Experience defining or executing technical PoCs reference architectures cluster acceptance tests performance benchmarks migration plans or production-readiness criteria.

Why Join Us:

• Purposeful Hiring : Youre not here by accident and neither is anyone else. Every teammate is handpicked with intention because who we build with matters.
• Builders Wanted : Youre not just riding the rocket ship youre building it. Your work directly shapes the trajectory of our company.
• Mission-Driven Work : Were here to make a real impact. Our mission fuels everything we do.
• Tackling Hard Problems : If easy isnt your thing youre in the right place. We solve some of the most complex and exciting challenges in our space.
• Excellence Is The Standard : High performance isnt just encouraged its the baseline. And its contagious.

Compensation

Groq is committed to providing competitive compensation through our Total Cash philosophy which incorporates potential bonus value directly into base pay. The total cash salary range for this position which is inclusive of the potential bonus value is $270400-$401600 with individual placement determined by your geographic location experience skills and alignment with internal compensation standards. This range is specific to candidates located in the United States. Compensation for international candidates will vary based on local market dynamics. Beyond cash compensation Groq also offers a Long-Term Incentive (LTI) Program and a robust suite of employee benefits.

US Job Posting

This position may require access to technology and/or information subject to U.S. export control laws and regulations including the Export Administration Regulations (EAR). To comply with these requirements candidates for this role must meet certain citizenship or residency criteria. Specifically they must qualify as U.S. Persons for export control purposes (i.e. U.S. citizen U.S. lawful permanent resident (Green Card holder) or a protected individual under 8 U.S.C. 1324b(a)(3) such as a refugee or asylee) or otherwise be eligible for an applicable export license.

#LI-MS1

US Job Posting

This position may require access to technology and/or information subject to U.S. export control laws and regulations including the Export Administration Regulations (EAR). To comply with these requirements candidates for this role must meet certain citizenship or residency criteria. Specifically they must qualify as U.S. Persons for export control purposes (i.e. U.S. citizen U.S. lawful permanent resident (Green Card holder) or a protected individual under 8 U.S.C. 1324b(a)(3) such as a refugee or asylee) or otherwise be eligible for an applicable export license.

Non-US Job Postings

This position may require access to technology and/or information subject to U.S. export control laws and regulations as well as applicable local laws and regulations including the Export Administration Regulations (EAR). To comply with these requirements candidates for this role must meet all relevant export control eligibility criteria.

Groq is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. All qualified applicants will receive consideration for employment without regard to race color religion national origin sex (including gender identity sexual orientation and pregnancy) age disability genetic information protected veteran status or any other characteristic protected by applicable law.

Groq complies with all applicable federal state and local laws governing nondiscrimination in employment. We do not tolerate discrimination or harassment based on any protected characteristic.

Groq is committed to working with and providing reasonable accommodations to qualified individuals with physical or mental disabilities. If you require a reasonable accommodation to complete an application or to participate in the hiring process please contact us at . This contact is for accommodation requests only which will be considered on a case-by-case basis.

All offers of employment are contingent upon verification of the applicants identity and employment authorization in accordance with federal law.

Groq encourages people with criminal record histories to apply for employment and values diverse experiences including prior contact with the criminal legal system. To that end Groq welcomes such applicants in accordance with the California Fair Chance Act Los Angeles City Fair Chance Act Ordinance Los Angeles County Fair Chance Act Ordinance and San Francisco Fair Chance Act Ordinance. Philadelphia applicants can review information pertaining to Philadelphias Fair Criminal Record Screening Standards Ordinance here: part of our hiring process Groq may use artificial intelligence (AI) tools or automated systems to assist with activities such as reviewing applications evaluating qualifications scheduling interviews analyzing assessment responses or supporting recruiting operations. These tools are designed to assistnot replacehuman decision-making and hiring decisions are subject to human review. We may process information you provide during the application process including resumes application materials interview responses assessments and where applicable audio video or transcript data. If legally required we will request consent before using technologies that analyze biometric or video interview data. Candidates may request reasonable accommodations an alternative evaluation process additional information regarding the use of AI in the hiring process or review of certain automated decisions by contacting

Required Experience:

Staff IC