LLM Inference Intern: GPU, KV Cache & SoC
Linuxconfig
Samsung Semiconductor in San Jose, CA, is offering a summer internship to work on cutting-edge SoC storage and memory projects. You will deploy and operate an LLM inference service on a multi-GPU server and build a reproducible benchmark harness to measure latency and throughput. The role requires hands-on experience with Python and PyTorch on NVIDIA GPUs under Linux and familiarity with vLLM, SGLang, or Hugging Face TGI. #J-18808-Ljbffr Linuxconfig
- Samsung Semiconductor is offering an internship focused on SoC architecture, RTL design, FPGA integration and validation from our San Jose, CA HQ. You will work hands-on on LLM inference, KV cache offloading, and performance benchmarking, collaborating with FPGA, SoC and...InternshipFlexible hours
- Samsung Semiconductor is seeking a hands-on intern to help develop and optimize next-generation SoC/SSD architectures. You will work on LLM inference services, RTL design integration, and validation on a GPU-accelerated stack. The role is onsite in San Jose, CA, reporting...Internship
$100.6k
...on the future of AI inference and AI... ...design challenge. The intern will analyze how model... ...memory bandwidth, KV-cache management, compute... ...high-performance CPU, GPU, or AI accelerator... ...functions with ASICs and SOCs from an... ...impact into Gen AI and LLM level performance/tco...InternshipLocal areaImmediate startShift work$28 - $68 per hour
.... What You’ll Do The SoC Architect team proposes... ...Deploy and operate an LLM inference service (vLLM serving... ...on a 4 × NVIDIA H200 GPU server, working closely... ...goodput). Configure KV cache offloading (LMCache, NVIDIA... ...of LLM serving internals: KV cache, prefix caching...InternshipHourly paySummer internshipWork at officeRelocation packageFlexible hours$105.7k
...The Role and Impact As a Silicon Architecture Graduate Intern, you will contribute to the definition and... ...models and tools for architectural analysis. Explore GPU concepts such as SIMT, parallelism, and cache hierarchies to guide architectural improvements. Apply...InternshipLocal areaImmediate startShift work$146k - $247k
...high‑bandwidth memory (HBM) system‑on‑chip (SoC) base‑die designs. Your work will... ...across current and future HBM generations. (LLM)Responsibilities will include, but are not... ...applicable laws, rules, regulations, and other international and industry labor standards.Micron does...Full timeLocal areaImmediate start$105.65k - $149.15k
...Job Details: Job Description: As a SoC Design Verification Engineer, you will be responsible for ensuring the functionality and reliability... ...improvement into existing methodologies. Understanding of cache coherency principles in multiprocessor SoCs and layered protocols...InternshipLocal areaImmediate startShift work$105.7k
...computing. As a Silicon Hardware Engineering Intern, you'll work on meaningful projects while... ...to innovations in processors, GPUs, SoCs, photonics, and validation systems. Develop... ...Analog Circuit Design Engineer CPU/GPU Design Verification Engineer GPU Physical...InternshipSummer workLocal areaImmediate startWorldwideRelocation packageShift work$122.44k - $200.34k
...and manufacture silicon products that empower people's digital lives. Come join us and do something wonderful.The Role and ImpactAs a GPU Design Verification Engineer, you will play a critical role in the development of next -generation graphics components, ensuring the...InternshipFull timeLocal areaImmediate startShift work$164.47k - $269.1k
...people's digital lives. Come join us and do something wonderful. Role and Impact Intel is seeking a motivated and experienced SoC Validation Engineer to join our Power Management Validation team. In this role, you will be responsible for validating power management...InternshipLocal areaImmediate startShift work$164.47k - $311.89k
...silicon products that empower people's digital lives. Come join us and do something wonderful.Join Intel's AI Revolution Intel's AI SoC organization develops cutting-edge products powering a wide range of AI applications, from edge devices to data center accelerators....InternshipFull timeLocal areaImmediate startWorldwideShift work$97k - $205k
...generation HBM logic die and memory‑centric SoCs. You will work across physical design,... ...chiplet, or 2.5D/3D integration.Background in GPU, CPU, or high‑performance accelerator... ...laws, rules, regulations, and other international and industry labor standards.Micron does...Full timeLocal areaImmediate start- Sierra Nevada Corporation in the United States is seeking a Software Engineering Intern for its summer internship program, offering hands-on experience in aerospace and defense. You will work on real-world projects with mentors, develop technical and professional skills...InternshipSummer internship
- Come start your career with some of the brightest and most innovative minds in the country! As a Software Engineering Intern, you will participate in a comprehensive summer internship program designed to provide hands‑on experience in a dynamic aerospace and defense environment...InternshipSummer workSummer internship
$20 per hour
Allworth Financial, an independent investment advisory firm, invites motivated individuals pursuing CFP designation to join our summer internship program. You will provide supportive service to our on-plan asset management clients under CFP supervision. This paid, part-...InternshipPart timeSummer internship- South Jersey Industries is offering a 11-week Ignite Summer Internship in Collaboration and Productivity Services. Interns gain hands-on experience configuring ServiceNow and Microsoft 365, improving business processes, and automating workflows. The program includes mentorship...InternshipSummer internship
$22 - $27 per hour
Goodfellow Bros., Inc. is seeking an Engineering Intern for the Folsom, CA team for summer 2027. Under supervision, you will assist with layout, form design, and subcontract monitoring, plus change orders, plan checking, document control, and safety monitoring to learn...InternshipHourly paySummer workSummer internshipWork at office$255.85k - $361.2k
...software solutions to enable AI features across Intel products. - Optimize GPU AI workloads for performance, power, and scalability, including benchmarks and simulations. - Collaborate with internal teams and external partners to understand requirements and deliver...Full timeLocal areaImmediate startShift work$111.03k - $181.94k
...graphics issues. The ideal candidate should have strong quantitative, analytical, and problem-solving skills.Key Responsibilities As a GPU Software Development Engineer, your responsibilities will include but are not limited to:• Graphics Driver/Application related...Full timeLocal areaImmediate startShift work$50.24 per hour
...platforms. As a Memory Systems Architecture Intern, you will contribute to the architecture... ...workflows. Understanding of AI training, inference, accelerator architectures, and the role... ...architecture, semiconductor design, or SoC development. The US base salary range that...InternshipFull timeLocal area$145.6k - $218.4k
...Emulation (SVE) team is part of the central SoC validation organization responsible for... ...under demanding AI training and inference scenarios. Own power subsystem bring-up readiness... ...with teams in different time zones - both internal and external Minimum Requirements...Work experience placementWork from home$18.13 - $31.72 per hour
Come start your career with some of the brightest and most innovative minds in the country! As a Software Engineering Intern, you will participate in a comprehensive summer internship program designed to provide hands‑on experience in a dynamic aerospace and defense environment...InternshipFor contractorsWork experience placementSummer workSummer internshipWork at officeImmediate start$20 per hour
...open to a hybrid working schedule. Working hours are between 8:00am to 5:00pm with around 40 work hours per week. This is a summer intern program between May/June and August/September. Duties And Responsibilities Cross trains with various departments of Allworth...InternshipFull timeContract workPart timeSummer internshipWork at officeFlexible hours- ENGEO is offering a 2027 summer internship for talented university students to explore professional engineering consulting careers. The program provides real responsibilities in office, laboratory, and field environments, with opportunities to learn geotechnical, geoenvironmental...InternshipSummer internshipWork at office
$18.75 - $29.75 per hour
...Transportation Engineering InternDewberry is currently seeking a Transportation Engineering Intern for Summer 2027 to join our Rancho Cordova, CA office. This is an excellent career opportunity for an enthusiastic and talented individual to join a team of outstanding...InternshipFull timeSummer workSummer internshipLocal area$103k - $210k
...for AI accelerators, including GPU, TPU, and emerging compute... ...optimizations involving HBM, DRAM, cache, storage, and interconnect... ...or large-scale training and inference environments. The US base... ...rules, regulations, and other international and industry labor standards....InternshipFull timeLocal areaImmediate start- Dewberry Engineers Incorporated is seeking a Transportation Engineering Intern for Summer 2027 in Rancho Cordova, CA. This internship offers hands-on project experience across transportation projects for local and national clients, with potential for professional growth...InternshipSummer workSummer internshipLocal area
- Black & Veatch Corporation is seeking a Structural Engineer (Transmission Line) Summer Intern to contribute to critical infrastructure projects and gain hands-on experience across disciplines. The chosen candidates will be located in Denver (CO), Rancho Cordova (CA), or...InternshipContract workSummer workSummer internship
$149.6k - $284.58k
...and flow enablement in synergy with PDK development, work with internal partners and EDA vendors to deliver competitive TFM to support design... ...tool and flow, design for reliability, Circuit, IP and SOC design reliability validation using PDK, EDA tool and flow development...InternshipWork experience placementLocal areaImmediate startFlexible hoursShift work$36 - $37 per hour
...August 2027 which can provide valuable hands-on exposure to a law school student seeking a professional and challenging experience. Interns will be paid an hourly rate based on year of school with an intended 40 hour work week. What Will Our Ideal Candidate Have?...InternshipHourly payTemporary workSummer workSummer internshipH1b
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Inference Intern: GPU, KV Cache & SoC. Be the first to apply!





