Senior Staff Software Engineer - AI/LLM Backend Architect
Google is seeking a Software Engineer in Sunnyvale, CA, to develop next-generation technologies for billions of users. The role involves working on core backend infrastructure, integrating AI tools, and collaborating across teams to enhance Google Workspace and Cloud solutions. With a focus on architectural optimization for Large Language Models, candidates should possess extensive programming experience and a strong educational background in technical fields. Google offers a competitive salary package alongside equity and benefits. #J-18808-Ljbffr Google
$262k - $365k
...testing, and launching software products. 3 years of... ...Generative AI tools or LLM interfaces into workflows... ...Master’s degree or PhD in Engineering, Computer Science, or... ...maintain the core backend infrastructure and services... ...Gemini Enterprise. Architect and optimize...BackendSenior- ChatGPT Jobs is hiring an AI Engineer to design and build AI-powered features for web applications... ...ideal candidate should have extensive backend engineering experience, strong knowledge... ...TypeScript or Python, and proven capabilities in LLM orchestration. Other key skills include...BackendSeniorRemote work2 days per week
$196.5k - $219.3k
Job Responsibilities Architect and implement... ...to monitor and filter LLM requests/responses in... ...features. Mentor junior engineers on secure backend development and best... ...delivery of high‑quality software features while adhering... ...models or other AI/ML systems (e.g. implementing...BackendFull time$220.5k - $298.5k
...Builder Catalysts" community as a Senior Staff Software Engineer and contribute to our... ...experimentation, growth analytics, and AI-native experiences; the... ...and integrates cleanly with backend services and data pipelines... ...-on experience applying AI/LLM tooling (e.g., Claude,...BackendSeniorContract workTemporary work- CRB Workforce is seeking an AI Architect to take charge of the AI strategy for enterprise IoT and OT security platforms. The ideal candidate will have significant backend engineering experience and proven expertise in deploying AI solutions. Responsibilities include developing...BackendSeniorRemote job
- NVIDIA is looking for a skilled engineer to design and scale observability platforms in Santa Clara, California. This role entails building backend services for telemetry ingestion and collaborating with various teams to ensure platform health. Candidates should have a...BackendSenior
$143.63k - $299.38k
Yahoo Holdings Inc. seeks an experienced backend engineer to design and develop high-performing systems for Yahoo Mail. This role involves implementing AI-driven efficiencies and mentoring engineering staff. With a BS in Computer Science and at least 8 years of experience...BackendSeniorFlexible hours$214k - $289.5k
...Senior Staff Software Engineer Category: Software Engineering Location: Mountain View, California Job ID:... ...managers and designers by leveraging AI & relevant technology frameworks. Responsibilities... ...and apply it to user experiences or backend solutions Experience with AI...BackendSeniorTemporary workWork experience placementWorldwide- Apple Inc. seeks a Senior AI/ML Software Development Engineer in Test in Cupertino, California. This role involves creating automated testing systems and frameworks for various backend services and AI/ML models. The ideal candidate has a strong background in software engineering...BackendSenior
- Glint Tech Solutions in Sunnyvale, California, is seeking an AI Engineer to join a cutting-edge AI team focused on building next-generation... ...systems. Ideal candidates should possess strong experience in backend services and AI agent development. #J-18808-Ljbffr Glint Tech...BackendSenior
$220.5k - $298.5k
...'s "Builder Catalysts" community as a Senior Staff Software Engineer and contribute to our mission of powering... .... We are dedicated to building AI-native experiences from the ground up,... ...tools and apply it to user experiences or backend solutions. Experience with AI technologies...BackendSeniorTemporary workWork experience placement- ...Integrity, and Inclusion. We weave AI into the fabric of... ...CyberArk is looking for a Senior Software Engineer to join the Secrets Hub group... ...maintain secure and scalable backend services for Secrets Hub.... ...Collaborate with product managers, architects, and fellow engineers...BackendSeniorFull timeWork at officeVisa sponsorshipWork visa
$120k - $200k
...building the world's first AI recruiter. We believe talent... ...for a world-class Senior / Staff level software engineer with extensive experience working... ...individuals with generalist backend engineering backgrounds who... ...experiment with and iterate on LLM powered features with in-...BackendSeniorRemote jobWork from home$170k - $230k
Mithril is hiring a Software Engineer - Member of Technical Staff in Palo Alto, California. This is an opportunity to build backend Python APIs for their innovative AI infrastructure platform. You will manage features from design to monitoring and work across multiple engineering...BackendSenior- ...Autoscience Institute, we automate AI research. Recently, we... ...-time on-site role for a Senior or Staff Software Engineer (Technical Lead) located in... ...for building reliable backend infrastructure and production... ...competitive against major LLM frontier lab packages Unlimited...BackendSeniorFull timeFlexible hours
- ...Mountain View, California is seeking a skilled Software Developer for their Revenue Cycle Management team. You will design LLM-powered automation systems to transform... ...expertise in both frontend (Typescript, React) and backend (Python, Go) development, along with...BackendSenior
$166.5k - $291.4k
Staff Software Engineer, Developer Experience — Moveworks Full-time... ...Moveworks is the Agentic AI Assistant platform... ...operational excellence Mentor senior engineers and raise... ..., and observability Backend engineering depth in... ...agentic systems, LLM-powered developer tooling...BackendFull timeWork at office- Responsibilities Build and ship AI-powered product... ...workflows. Develop backend services and APIs that... ...tool execution. Implement LLM workflows, including pipelines... .... Collaborate with ML engineers to integrate, evaluate,... ...years of professional software engineering experience....BackendSenior
$184k - $287.5k
Senior Software Engineer focused on container and cloud infrastructure at NVIDIA.... ...includes support for disaggregated LLM inference and other emerging... ...NIM runtimes and inference backends; enable reproducible, multi‑... ...13, 2026. NVIDIA uses AI tools in its recruiting...BackendSenior- Nutanix is seeking a software engineer based in Santa Clara, California, to develop AI-powered product features. The role requires building backend services and APIs, implementing LLM workflows, and collaborating with product managers and designers. The ideal candidate...Backend
$262k - $365k
Senior Staff Software Engineer, GeminiApp Gen Media, DeepMind Mountain View, CA, USA... ...working with the cutting edge AI agents developed by our... ...within a single workspace. Architect systems that integrate models... .... Implement sophisticated LLM‑powered systems, including...Senior$152k - $241.5k
...production-grade, highly optimized software (NIMs, NVIDIA Inference... ...+ 3 years, or Electrical Engineering, Bachelor of Science (or... ...production-grade AI distributed systems, backend services, microservices, and... ..., SGLang, Torch, TRT, TRT-LLM).* Proficiency with Python...BackendSenior- NVIDIA is seeking an ambitious Senior Solutions Architect - AI Factory Deployment to join our Infrastructure Specialists team in Santa Clara! In this... ...and validate AI factories while running and debugging AI/LLM workloads on Linux-based GPU clusters. This position demands...Senior
$152k - $241.5k
...inference? Join NVIDIA’s TensorRT Edge-LLM team and help shape the next generation of edge AI for automotive and robotics. We build the software stack that enables Large Language,... ...Computer Science, Electrical/Computer Engineering, or a closely related field. 4+ years...Senior$170k - $240k
...Commure, we're building the AI Operating System for... ...the autonomous backend that turns healthcare's... ...What You’ll Do Build LLM-powered automation that... ...production. Scale a rule engine that runs hundreds of configurable... ...years of professional software development industry...BackendSeniorWork at officeImmediate start- About Boson AI At Boson AI, we are not just building... ...of researchers and engineers who thrive on pushing the... ...build on confidently Architect context and memory systems... ...building and operating backend systems at scale — you'... ...Experience with LLM serving, agentic orchestration...BackendSenior
$152k - $241.5k
...the unlimited potential of AI to define the next era of computing... ...motivated and experienced Senior Software Engineer to join us. At a company... ...multi-functional teams to build backend services and AI Agents to... ...content generation using LLM and Generative AI models. Hands...BackendSenior- NVIDIA is seeking a Senior Inference Engineer in Santa Clara, CA to advance AIConfigurator, optimizing... ...deployment configurations for large-scale LLM inference on NVIDIA platforms. This... ...across teams, and enhancing software for better GPU and model performance....Senior
$184k - $287.5k
...platform for every new AI-powered application. We seek a senior engineer to own and evolve... ...solving deep software engineering challenges... ..., inference backend integrations (vLLM... ...SGLang, TensorRT-LLM, Dynamo), middleware... ...Kubernetes environments.Architect significant new...BackendSenior- A leader in cybersecurity solutions is seeking a Sr. Staff Software Engineer for their IT Customer Experience Team in Santa Clara, CA.... ...Java and microservices architecture, and familiarity with AI systems including LLM APIs. This position offers a competitive salary and the...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff Software Engineer - AI/LLM Backend Architect. Be the first to apply!
- back-end developer Sunnyvale, CA
- senior backend developer Sunnyvale, CA
- java developer backend Sunnyvale, CA
- backend software engineer Sunnyvale, CA
- remote back end developer Sunnyvale, CA
- senior app developer Sunnyvale, CA
- senior international account manager Sunnyvale, CA
- senior magento developer Sunnyvale, CA
- sr marketing manager Sunnyvale, CA
- sr technical product manager Sunnyvale, CA

