LLM Backend Engineer - Multimodal Infra & Scale
ByteDance
ByteDance’s Volcano Ark MaaS team is hiring a software engineer to design and develop core components for a scalable, multimodal large model service platform. The role focuses on API capabilities for text dialogue and multimodal generation within a cloud-native framework.
Candidates should have CS degrees and practical backend development experience, with knowledge of Kubernetes, Docker, Istio, and Envoy. Salary ranges reflect the competitive market in San Jose and the broader U.S.
#J-18808-LjbffrVacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the LLM Backend Engineer - Multimodal Infra & Scale in San Jose, CA vacancy
- ...platform launched by Volcano Engine. It is a leading platform in... ...internal business teams with large-scale machine learning compute,... ...for text dialogue, multimodal understanding, and multimodal... ...fundamentals. Understands basic backend engineering systems, including...Suggested
Bytedance
San Jose, CA4 hours ago - Qualcomm Technologies, Inc. in Santa Clara, CA is seeking a Principal Backend Engineer to help design and scale backend systems powering our AI-driven VSaaS platform. You will contribute to robust infrastructure to support rapid growth and evolving device demands. The role...Suggested
- ...ByteDance is seeking talented engineers to join Volcano Ark MaaS, a large model service platform... .... Join a team in San Jose focused on backend and cloud-native engineering, building... ...availability systems, and advancing large-scale model inference pipelines. #J-18808-...Suggested
Bytedance
San Jose, CA5 hours ago $170k - $400k
...intelligence. One that is proactive, multimodal, and capable of interacting... ...Role You'll build the backend systems that make Hark's AI... ...researchers and platform engineers, and the systems you build will... ...systems. Production at Scale: Proven track record of shipping...SuggestedFull timeHark
San Jose, CA8 days ago- ...Nutanix is seeking a software engineer based in Santa Clara, California, to develop AI-powered product features. The role requires building backend services and APIs, implementing LLM workflows, and collaborating with product managers and designers. The ideal candidate...Suggested
Nutanix
Santa Clara, CA4 hours ago $75k - $300k
...autonomous, automotive-grade, and built for private ownership at scale. Founded in 2016 in Silicon Valley, Tensor is... ...industry and make a lasting impact. We’re looking for backend engineers to join our infra team. In this role, you’ll design and develop scalable platforms...Tensor
San Jose, CA4 hours ago$272k - $431.25k
...accelerators feel like a single system at datacenter scale. As large language models rapidly outgrow the... ...enables efficient, resilient deployment of cutting-edge LLM workloads.We are seeking a Principal Systems Engineer to define the vision and roadmap for memory...Full timeLocal areaRemote work$164k - $282k
...scratch, and create a reliable workflow service at scale.We are looking for a visionary Staff Software Engineer to lead the architectural design and... ...or a closely related field6 years of experience in backend software development Proficiency in Java and the Spring...Temporary work$184k - $287.5k
...streaming and agentic multimodal AI. You will demonstrate... ...multimodal foundation models, scaling your ideas through our... ...come join our Nemotron LLM team. For more details... ...perception with backend action-fulfillment and... ...creative and autonomous engineer with a genuine passion...Full timeWork experience placement- ...A leading cybersecurity firm is seeking a candidate to enhance LLM security by architecting monitoring and filtering systems. This role requires expertise in deploying AI systems, managing prompts, and safeguarding against emerging threats. The ideal candidate will have...
Fortinet, Inc.
Sunnyvale, CA4 hours ago $100k - $150k
...A startup in AI technology is seeking a Backend Engineer to design and maintain robust infrastructure for their AI platform. Candidates should have over 3 years of experience in backend development, strong PostgreSQL skills, and familiarity with cloud platforms such as...Full timePeppr AI (YC W25)
Cupertino, CA4 hours ago$140k - $200k
...datasets (image, video, multimodal, reasoning, 3D,... ...full-cycle data engineering, Abaka AI provides... ...Technical Staff, Infra, you'll own the scalability... ...production load. Backend and infra will be... ...is growing and scaling significantly in... ...or integrating AI/LLM-powered features...Flexible hours$217.6k - $290.5k
...to hire a passionate, collaborative and motivated Sr. Staff Backend Engineer (Sr. MTS), who will help us develop and evolve eBay Live to be... ...other related field.10+ years of experience in building large scale, distributed web platforms/APIs with 5+ years as an architect...Immediate startRemote workVisa sponsorshipFlexible hours$65 - $70 per hour
...summary: We are seeking a Back End Node.js Engineer with hands-on AI implementation experience to build scalable backend services and AI-enabled capabilities for enterprise... ...experience building AI-powered systems using LLM APIs, embeddings, vector databases, RAG, prompt...Hourly payContract workTemporary workWork experience placementLocal areaSunnyvale, CA20 days ago$211.8k - $317.8k
...Technologies, Inc. Job Area: Engineering Group, Engineering Group > Software... ...a skilled and motivated Backend Engineer to join our backend team... ...in computer vision or LLM agents. Familiarity with video... ...0 - $317,800.00 The above pay scale reflects the broad, minimum to...Work experience placementWork from home$230k - $315k
...seeking a Distinguished Software Engineer to serve as a primary... ...and technical visionary for our backend ecosystem. In this high-impact... ...utilization.AI/ML Integration at Scale: Drive the transition from traditional... ...required to power LLM-driven autonomous remediation....Permanent employmentFull timeWork at office$166k - $220k
...A leading technology company in Mountain View is seeking an experienced backend or infrastructure engineer to join their ML/AI Environments team. The ideal candidate will have 5+ years of experience and strong programming skills in Python, Scala, or Java. You will be...Menlo Ventures
Mountain View, CA4 hours ago$170.6k - $261.3k
...us. About the team: The AV ML Infra team at GM builds end-to-end ML... ...the productivity of ML engineers, and drive the adoption of cutting... ...performance by running large-scale simulation workloads and managing... ...from user-facing interfaces to backend services and cloud...Full timeLocal areaWork from homeFlexible hours$150k - $200k
...Opportunity:This is a Contract to Full Time roleWe are seeking a backend-focused AI/ML engineer to support fast-moving proof-of-concept projects across a... ...REST APIs (FastAPI, Flask, or similar)Familiarity with LLM APIs (OpenAI, Anthropic, Gemini, or similar)Working...Full timeContract workTemporary workFor contractorsLocal areaImmediate start- ...Selector AI is seeking an experienced backend engineer to own complex data and systems problems, seeing work run in production inside a customer... ...using Python/Go, applying agentic AI workflows to scale data engineering and root-cause analysis. You will provide...
Selector AI
Santa Clara, CA4 hours ago - ...Irvine Technology Corporation is seeking a Senior Software Engineer to design, build, and scale backend services for payment automation in a remote setting. The role emphasizes end-to-end ownership from requirements through deployment, collaborating with a seasoned engineering...Contract workRemote work
Irvine TechNology Corporation
San Jose, CA4 hours ago $213k - $263k
...A leading autonomous driving technology company in California seeks an experienced Senior Software Engineer to design and implement core authoring APIs. In this hybrid role, you will drive technical architecture and collaborate with cross-functional teams. Ideal candidates...Waymo
Mountain View, CA4 hours ago$124k - $195.5k
We are searching for a Backend Compiler Engineer for an exciting and fun role in our GPU Software organization. Our Compiler team is responsible for constructing and emitting the highest performance GPU machine instructions for Graphics (OpenGL, Vulkan, DX) and Compute...Full timeRemote workWorldwide$170k - $220k
...A technology company in Cupertino seeks a senior software engineer with over 8 years of experience, specializing in web-scale systems and data pipelines. The ideal candidate should be proficient in multiple programming languages including Golang, Java, and Python, and...Kloudfuse
Cupertino, CA4 hours ago- ...Location: San Jose, CA Type: Contract to Hire Develop backend eCommerce web applications in cloud platform technologies Collaborate... ...emerging technologies 7+ years' experience developing large scale web applications using Java, Kotlin, Go Java 8 experiences...Contract work
InterSources
San Jose, CA5 hours ago $147k - $237.5k
...SummaryThe TeamEngineering - Our engineering team is at the core of our... ...design and build the distributed backend services that form the... ...productivity tool — you’ll build LLM-powered and agentic features directly... ...traffic and configuration at scale for thousands of enterprise...Full timeWork at office$120k - $180k
...the world’s most advanced AI-native platform. We work on large scale distributed systems, processing almost 3 trillion events per... ...the Role:We are seeking a highly experienced and motivated Backend Engineer III to join the CDE Platform team. In this role, you will be...Full timeWork experience placementWork at officeLocal area- ...Gen AI Backend DeveloperWe are seeking a Backend Developer with strong experience in Generative AI technologies to join our engineering team in San Jose, CA. The ideal candidate will have hands... ...workflows that interact with LLMs or multimodal AI systems.Implement advanced...
Abode Techzone LLC
San Jose, CA3 days ago - ..., is hiring a Member of Technical Staff, Infra. You will own the scalability and reliability... ...our AI-native platform, focusing on backend infrastructure, APIs, and data models while... .... You will work as a product-minded engineer with ownership from day one, contributing...
- ...Python Backend EngineerWe are looking for a Python Backend Engineer to build the backbone of our platform. You will be responsible for creating high-performance... ...ensuring our infrastructure remains rock-solid as we scale. If you enjoy solving complex architectural...
Omni Inclusive
San Jose, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Backend Engineer - Multimodal Infra & Scale. Be the first to apply!
