LLM Backend Engineer: High-Throughput Cloud-Native Systems
Bytedance
ByteDance is seeking talented engineers to join Volcano Ark MaaS, a large model service platform. You will contribute to end-to-end services including model inference, evaluation, fine-tuning, AI application development, and a robust plugin ecosystem.
Join a team in San Jose focused on backend and cloud-native engineering, building high-availability systems, and advancing large-scale model inference pipelines.
#J-18808-LjbffrVacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the LLM Backend Engineer: High-Throughput Cloud-Native Systems in San Jose, CA vacancy
- ...launched by Volcano Engine. It is a leading... ...training and inference systems for recommendation... ...Participate in cloud-native architecture... ...design and implement high-availability solutions... ...connections, high throughput, streaming output,... ...Understands basic backend engineering...Cloud
Bytedance
San Jose, CA6 hours ago $190k - $237k
...Our sights are set high and our problems... ...ll DoAs a Staff AI Systems Engineer, you will architect... ..., managing multi-cloud compute scheduling... ...alongside advanced LLM serving engines.... ...Nebius AI Cloud).Cloud-Native Orchestration &... ...building high-throughput data pipelines to...CloudLocal area$160k - $198k
...Our sights are set high and our problems... ...DoAs a Senior AI Systems Engineer, you will architect... ...utilization, managing multi-cloud compute scheduling... ...advanced LLM serving engines.Cross... ...AI Cloud).Cloud-Native Orchestration &... ...Experience building high-throughput data pipelines to...CloudLocal area$272k - $431.25k
...NVIDIA Dynamo is a high-throughput, low-latency inference framework... ...feel like a single system at datacenter scale.... ...of cutting-edge LLM workloads.We are seeking... ...seeking a Principal Systems Engineer to define the vision... ...remote file/object/cloud storage to support large...CloudFull timeLocal areaRemote work$230k - $315k
...Distinguished Software Engineer to serve as a... ...for our backend ecosystem. In this high-impact role, you... ...complex distributed systems challenges, mentor... ...to power LLM-driven autonomous... ...distributed systems in a cloud-native environment.... ...building high-throughput, low-latency data...CloudPermanent employmentFull timeWork at office$170k - $400k
...comes next: agentic systems that interact... ...You'll build the backend systems that make... ...infrastructure problems: high-concurrency... ...and platform engineers, and the systems... ...streaming and high-throughput data processing to... ...Mindset: Comfort with cloud-native architectures (...CloudFull timeHark
San Jose, CA8 days ago$60 - $65 per hour
...Python Backend EngineerWe are seeking... ...Python Backend Engineer to design, develop... ...backend systems and APIs. The ideal... ...backend frameworks, cloud infrastructure,... ...(LLMs), and high-performance... ...maintain cloud-native applications on... ...Knowledge of AI/LLM integration frameworks...CloudHourly payClinDCast LLC
San Jose, CA3 days ago- The Netskope Data Security team seeks a Senior Engineering Manager to lead the Data Lineage group, building a high‑throughput platform that traces data movement across cloud, endpoints, and on‑premises systems. You will serve as both technical lead and product owner, shaping...Cloud
$65 - $70 per hour
...seeking a Back End Node.js Engineer with hands-on AI... ...experience to build scalable backend services and AI-... ...microservices, Redis/caching, cloud deployments, CI/CD,... ...building AI-powered systems using LLM APIs, embeddings,... ...messaging systems, and cloud-native infrastructure....CloudHourly payContract workTemporary workWork experience placementLocal areaSunnyvale, CA20 days ago- ...Cohesity is seeking an experienced backend engineer to design and deliver cloud-native SaaS products on AWS, Azure, and GCP. You will build large-scale distributed... ...acceptable), and strong knowledge of distributed systems and storage concepts. Hybrid onsite 2 days/week in...Cloud2 days per week
Cerebras
Santa Clara, CA6 hours ago - ...Cohesity is seeking a highly skilled engineer to design, develop, and deliver cloud-native SaaS products. You will help build large-scale distributed data platforms... ...week in Santa Clara. Strong coding in C++/Go/Java and deep system design are required. #J-18808-LjbffrCloud2 days per week
Cohesity
Santa Clara, CA5 hours ago $148.7k - $201.2k
...Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new... ...product line. The Nitro Team is looking for engineers with systems knowledge and experience in area such... ...building compute infrastructure to support High Memory and High performance computing...CloudInternshipLocal areaFlexible hours$224k - $356.5k
GeForce NOW is Nvidia’s Cloud Gaming service,... ...looking for a Senior System Software Engineer for Cloud who sees the... ...design, build, and deploy highly scalable cloud-based... ...developing/scaling backend services and microservices... ..., and Kubernetes-native patterns.Proven...CloudFull timeLocal area$184k - $287.5k
...We are now looking for a Senior High-Performance LLM Training Engineer!NVIDIA is seeking experienced engineers... ...the world's most advanced computing systems. This position focuses on optimizing... ...major systems companies and every major cloud service provider to make GPUs...CloudFull timeWork experience placement- ...Volcano Ark MaaS team is hiring a software engineer to design and develop core components for a... ...dialogue and multimodal generation within a cloud-native framework. Candidates should have CS degrees and practical backend development experience, with knowledge of Kubernetes...Cloud
ByteDance
San Jose, CA6 hours ago - ...supercomputing, high-performance computing, cloud, and AI. Whether... ...multi-disciplined engineers that operates... ...assistants and LLM-powered developer... ...VueExperience developing backend services and... ...Linux operating systems, networking,... ..., data pipeline throughput and caching strategiesHands...CloudFlexible hours
$272k - $431.25k
...is seeking a Principal Engineer to drive the performance... ..., GPU architecture, systems software, deep learning... ...optimize frontier-scale LLM workloads running on thousands... ..., distributed systems, high-performance computing,... ...and every major cloud service provider to make...CloudFull time- ...We are a dynamic team of engineers, roboticists, designers,... ....RoleAs a Robotics Systems Engineer, you will build... ...and synchronize with the cloud once a connection is restored.Build the backend infrastructure required... ...time operating systems or high-performance messaging systems...CloudLocal area
$154k - $220k
...lake to power our cloud-native Zero Trust Exchange... ...intelligent systems to stay ahead of evolving... ...faster. We build high-performing teams... ...Software Development Engineer-AI Security to... ...low-latency, high-throughput AI Security plane... ...stack, including LLM models, by employing...CloudFull timeWork at officeLocal area$147k - $237.5k
...TeamEngineering - Our engineering team is at the... ...distributed backend services that... ...about all system components, weigh... ...with cutting-edge cloud technologies —... ....This is an AI-native engineering role... ...— you’ll build LLM-powered and... ...develop, and support highly scalable...CloudFull timeWork at office- ...Lead Backend Engineer – RemoteBright Vision Technologies is a technology consulting... ...company delivering cloud, AI, data, and enterprise solutions... ...deep expertise in distributed systems to design, build, and operate large-scale, high-throughput backend services that power mission...CloudH1bLocal areaImmediate startRemote workVisa sponsorship
Bright Vision Technologies
Milpitas, CA8 hours ago - ...models and agentic systems, our mission is... ...and engineers who thrive on pushing... ...to delivering high-quality, reliable... ...and operate high-throughput, low-latency... ...and operating backend systems at scale... ...across the stack: cloud infrastructure... ...with LLM serving, agentic...Cloud
Boson AI
Santa Clara, CAa month ago - ...Accelloris an AI-native services firm... ..., data, and engineering capabilities.... ...— AI Systems & Platform Internals... ...latency, throughput, reliability,... ...Serving Architect high-throughput,... ...large-scale LLM and GenAI... ...inference systems, cloud... ...large-scale backend engineering....Cloud
Worky
Mountain View, CA6 hours ago $184k - $208k
...Muonspace is seeking a Senior Software Engineer (Back-end) to enhance our Ground Software... ...candidate will play a key role in building cloud infrastructure and applications, while managing... ...have strong Python experience, cloud-native development skills, and 8+ years of work...CloudMuonspace
San Jose, CA6 hours ago- ...founding team, we’re building a high-impact engineering group to bring AI-powered... ...world. Our multi-agent AI systems transform complex business workflows... ...Role We’re looking for a Backend Engineer (Mid-Level) who... ...to deploy and maintain cloud-based services on AWS or GCP...CloudFull time
Tessera Labs
San Jose, CA1 day ago $120.75k - $161k
...to work on complex, high-performance distributed systems, ensuring our... ...balancing. Performance Engineering: Drive the scaling,... ...development and delivery. Cloud Stack Management:... ...experience in backend development. Technical... ...-performance, high-throughput systems....CloudPermanent employmentFull timeWork at office3 days per weekEightfold
Santa Clara, CA1 day ago$272k - $431.25k
...NVIDIA is seeking a Sr. Principal Systems Software Engineer for the Apache Spark Acceleration group.... ...Multi-node GPU deployments will reduce cloud computing costs and lower latency batch... ...skills in designing and implementing high-quality distributed systemsExcellent programming...CloudFull timeWork experience placement$184k - $287.5k
GeForce NOW is NVIDIA's Cloud Gaming service,... ...empowers every GeForce NOW engineer to deliver... ...OwnThis is the Kubernetes-native deployment platform paired... ...with its automation system and the backend services and APIs... ...opportunity employer. As we highly value diversity in...CloudFull timeLocal area- ...Cohesity is seeking a highly skilled backend engineer to design, develop, and deliver next-generation, cloud-native SaaS products. You will build large-scale distributed data platforms... ...strong background in scalable distributed systems, with hybrid work including two days...Cloud
Cohesity Inc.
Santa Clara, CA6 hours ago $161k - $194k
...helping the energy system become more... ...energy, AI, software, engineering, and product to build... ...means doing high-impact work with a... ...of experience in backend programming languages... ...experience with leading cloud platforms (Google... ...org on cloud-native patterns.It’d be great...CloudFull timeWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Backend Engineer: High-Throughput Cloud-Native Systems. Be the first to apply!
Related searches
- back-end developer San Jose, CA
- backend software engineer San Jose, CA
- senior cloud security engineer San Jose, CA
- senior cloud solutions architect San Jose, CA
- senior cloud data engineer San Jose, CA
- cloud engineering manager San Jose, CA
- informatica cloud developer San Jose, CA
- senior cloud engineer San Jose, CA
- cloud architect San Jose, CA
- aws cloud architect San Jose, CA