Graduate Software Engineer, Inference Infrastructure
$136.8k - $259.2kPangleglobal
A leading technology company is looking for a Software Engineer Graduate to join the Inference Infrastructure team in San Jose. This role involves designing and building large-scale cluster management systems and collaborating across teams for LLM inference solutions. Candidates should have a strong background in systems and ML, with a competitive salary range of $136,800 - $259,200 annually and comprehensive benefits. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Graduate Software Engineer, Inference Infrastructure in San Jose, CA vacancy
$136.8k - $259.2k
...Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PHD) Location: San Jose Team: Technology Employment Type: Regular The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for...For graduatesTemporary workPangleglobal
San Jose, CA2 days ago$156k - $316.8k
...Responsibilitie About the Team The Inference Infrastructure team is the creator and... ..., and are looking for engineers passionate about cloud-... ...join our team in 2026. As a graduate, you will get opportunities... ...completed a PhD degree in Software Development, Computer Science...For graduatesTemporary workLocal areaByteDance
San Jose, CA4 days ago$136.8k - $359.72k
...Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling) Location: San Jose Team:... ...initiatives like Ray on K8s, and LLM inference control plan project AiBrix. At... ...relevant industry experience; new graduates with Ph.D. degree and strong...For graduatesTemporary workOverseasByteDance
San Jose, CA2 days ago$45 - $60 per hour
...Introduction: The Recommendation Infrastructure Team is responsible for... ...to join one of our engineering teams where you will have the... ...Undergraduate/Masters degree in Software Development, Computer... ...Preferred Qualifications: • Graduating December 2025 onwards with...For graduatesHourly payWork experience placementInternshipSummer internshipLocal areaFlexible hoursTik Tok
San Jose, CA11 hours ago$194k - $410k
...Software Engineer - E-commerce Recommendation Infrastructure - San Jose Software Engineer - E-commerce Recommendation Infrastructure - San Jose Get AI-powered... ...Software Engineer(s) - New Grad (Fall 2025 Graduation) San Jose, CA $100,500.00-$173,250.00 1 month...For graduatesFull timeTemporary workLocal areaTik Tok
San Jose, CA2 days ago- ...Overview We are hiring a Founding ML Infrastructure Engineer to own the end-to-end deployment,... ...Own the end-to-end LLM inference stack , including: Model loading... ..., or production ML roles. ~ Strong software engineering fundamentals; ability to...Work at officeVisa sponsorship
Realm Labs LLC
Sunnyvale, CA2 days ago $156k - $316.8k
...Software Engineer, Ads ML Infrastructure Location: San Jose Employment Type: Regular Job Code: A217691 Responsibilities About the team... ...a good understanding of algorithms, especially causal inference, uplift model, and deep learning. ~ Experience in managing...Temporary workLocal areaTik Tok
San Jose, CA12 days ago$153k - $222k
...Machine Learning Engineer Applied Intuition, Inc. is powering... ...company is creating the digital infrastructure needed to bring intelligence... ...degree in Computer Science, Software Engineering, or equivalent... ...Serving, NVIDIA Triton inference server, etc.) Compensation...Full timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shiftApplied Intuition
Sunnyvale, CA3 days ago$244.8k
...highly performant, scalable and stable infrastructures that serve billions of search requests... ...Evolve TikTok's AI Search multi-agent LLM engine, supporting ReAct + Tool calling, DAG-... ...text/multimodal LLMs, including inference acceleration, model alignment during training...Temporary workLocal areaTik Tok
San Jose, CA11 hours ago$212.8k
...join our team in 2027. As a graduate, you will get opportunities... ...from network architecture, software defined networking (SDN), network... ...global, intelligent network infrastructure to meet the requirements of... ...Computer Science, Computer Engineering, or a related technical...For graduatesTemporary workLocal areaByteDance
San Jose, CA2 days ago$122.57k - $256k
...from network architecture, software defined networking (SDN), network... ...global, intelligent network infrastructure to meet the requirements of... ...join our team in 2026. As a graduate, you will get opportunities... ...whole lifecycle of network engineering. Qualification Minimum...For graduatesTemporary workLocal areaByteDance
San Jose, CA3 days ago$139k - $204k
...What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements... ...orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift workCoreWeave
Sunnyvale, CA2 days ago$165k - $242k
...Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers... ..., and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift workCoreWeave
Sunnyvale, CA2 days ago$152k - $241.5k
...‑powered application is built. We are seeking a Senior Software Engineer – AI Inference to advance open‑source LLM serving by contributing directly... ...reproducible benchmarking and performance regression infrastructure for latency/throughput. Systems performance background...NVIDIA Gruppe
Santa Clara, CA3 days ago$156k - $316.8k
...Software Engineer - AI Agent Memory Infrastructure Location: San Jose Team: Technology Employment Type: Regular Job Code: A238905B Responsibilities... ..., and forgetting mechanisms to support real-time inference and personalized interactions. Explore key...Temporary workLocal areaByteDance
San Jose, CA2 days ago$152k - $241.5k
...Senior Software Engineer – Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning...NVIDIA Gruppe
Santa Clara, CA2 days ago- ...RL training and SOTA LLM and Multimodal inference at scale across multi-GPU and multi-node... ...You will collaborate across internal GPU software teams and engage with open-source... ...THE PERSON: Skilled engineer with strong technical and analytical expertise...
Advanced Micro Devices , Inc.
Santa Clara, CA4 days ago $2,000 per month
...is building the world's first AI inference system purpose-built for transformers... ...investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing... ...sensitive or complex distributed software systems like Linux internals, accelerator...Work at officeRelocation packageETCHED LLC
San Jose, CA2 days ago- ...ROLE: As a senior member of the LLM inference framework team, you will be responsible... ...role sits at the intersection of inference engines, distributed systems, and GPU runtime... ...architectures and kernel development Software Engineering ~ Expertise in Python and...
Advanced Micro Devices , Inc.
Santa Clara, CA4 days ago $139k - $204k
...Senior Software Engineer I, Inference Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers... ...startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift workCoreWeave
Sunnyvale, CA11 hours ago$122.57k - $256k
...talented individuals to join our team in 2026. As a graduate, you will get unparalleled opportunities for you... ...recently completed a Bachelor's or Master's degree in Software Development, Computer Science, Computer Engineering, or a related technical discipline. 2. Deep...For graduatesTemporary workLocal areaTik Tok
San Jose, CA1 day ago$45 - $60 per hour
...Minimum Qualifications: # Currently enrolled undergraduate or graduate student in a computer-related major, able to intern for at... ...and good learning ability. # Have a certain understanding of software R&D processes and DevOps concepts, and those who understand the...For graduatesHourly payInternshipLocal areaTik Tok
San Jose, CA11 hours ago- ...deliver industry-leading training and inference speeds and empowers machine learning users... ...for a deeply technical, hands-on software engineer to join our on-field Kernel Reliability... ...we want to hear from you. New college graduates are welcome. Responsibilities...For graduatesInternship
CEREBRAS SYSTEMS INC.
Sunnyvale, CA2 days ago - ...deliver industry-leading training and inference speeds and empowers machine learning... .... About The Role As a New Graduate Software Engineer, you will collaborate with world-class... ...and usability of next-generation AI infrastructure. This role is ideal for...For graduatesInternship
Cerebras
Sunnyvale, CA11 hours ago $120k - $140k
...curious, self-driven entry level Software Engineer who sits at the intersection of AI and cloud-native infrastructure. You'll work alongside... ...This role for a recent graduate or someone with up to two years... ..., model training and inference, and attention mechanisms (...For graduatesPermanent employmentTemporary workWork at officeZEDEDA
San Jose, CA1 day ago$152k - $241.5k
Senior Software Engineer, Quantized Inference page is loaded## Senior Software Engineer, Quantized Inferencelocations: US, WA, Redmond: US, CA, Santa... ...across the team: CI, build systems, training infrastructure, pipeline friction* Participate in code reviews and incorporate...$184k - $287.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize the GPU-accelerated software that powers today’s most sophisticated AI applications. Our team is responsible...- NVIDIA Gruppe in Santa Clara is seeking a Deep Learning Software Engineer focused on improving performance of deep learning inference software like TensorRT. The ideal candidate will have a strong foundation in C++ and Python, relevant experience with deep learning frameworks...
$136.8k - $280k
...Backend Software Engineer, Infrastructure Platform (Golang) Backend Software Engineer, Infrastructure Platform (Golang) Responsibilities... ...,000.00 7 months ago (General Hire) Software Engineer Graduate (Advertisement Team) - 2025 Start (BS/MS) San Jose, CA...For graduatesFull timeTemporary workSummer workInternshipLocal areaTik Tok
San Jose, CA2 days ago$145k - $250k
...Software Engineer Graduate (Data Arch - AI/ML Infrastructure) - 2026 Start (PhD) Join to apply for the Software Engineer Graduate (Data Arch - AI/ML Infrastructure... ...Research background in ML/AI, with a focus on inference optimization, model acceleration, or efficient ML...For graduatesFull timeTemporary workSummer workInternshipLocal areaTik Tok
San Jose, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Graduate Software Engineer, Inference Infrastructure. Be the first to apply!
Related searches
- software engineer internship remote San Jose, CA
- IT software developer San Jose, CA
- software engineer staff San Jose, CA
- machine learning software engineer San Jose, CA
- software engineer part time San Jose, CA
- senior robotics software engineer San Jose, CA
- software engineer entry level San Jose, CA
- software development engineer aws San Jose, CA
- startup software engineer San Jose, CA
- rust software engineer San Jose, CA