Senior AI Inference Orchestration Lead
Renice AI, Inc.
Renice AI in Mountain View, CA is seeking an AI Inference Routing & Scheduling Lead to design and operate the control plane for large-scale, multi-tenant LLM serving. You will translate complex system requirements into practical production policies and own the end-to-end routing, scheduling, and resilience of the service. You will work across teams—machine learning, infrastructure, Kubernetes, networking, reliability, and security—to implement online algorithms, telemetry contracts, and robust #J-18808-Ljbffr Renice AI, Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Orchestration Lead in Mountain View, CA vacancy
- Cerebras Systems is seeking a Staff Engineer to lead the Inference Platform team, owning orchestration across datacenter clusters and connecting cloud components with ML services. You will solve hard problems in Kubernetes operators, security policies, and CI/CD, driving...Senior
- ...to design, implement and iterate agentic AI systems with customers. With your strong... ..., and high-quality code. Design and orchestrate complex systems where AI agents integrate... ...debugging model training, evaluation, and inference pipelines Infrastructure & Deployment Experience...Senior
- Renice AI develops system and infrastructure solutions... ...demands of advanced AI inference workloads. We work... ...Inference Routing & Scheduling Lead to build the control... ...similar inference and orchestration systems. Familiarity... ...leading or mentoring senior engineers and working across...SuggestedContract work
- Accellor is seeking a Technical Architect — AI Systems, Inference & Platform Internals to design, scale, and optimize internal AI systems powering ChatGPT and OpenAI API workloads. The role focuses on inference runtime, model serving, GPU infrastructure, and distributed...Senior
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...complex issues spanning networking, orchestration, deployment, and distributed services...Senior
Cerebras Systems
Sunnyvale, CA6 days ago $124.5k - $272k
...networking for the cloud and AI era. We secure and accelerate... ...education and mentorship, and lead with transparency and curiosity... ...Instagram.Positions are available at Senior Staff and above. Candidates... ...Scientist, you own the inference and optimization layer that makes...SeniorNetskope
Santa Clara, CA4 days ago- Google is seeking an experienced Static Timing Analysis (STA) leader to shape the timing closure for high-performance ASICs and TPU integration. You will drive timing constraints, margins, and ECOs across large compute designs and collaborate with RTL, DFT, and architecture...Senior
- NVIDIA Corporation in Santa Clara, CA seeks a senior AI infrastructure leader to broaden the Dynamo ecosystem. You will build runnable demos, sample code, and technical docs to showcase data center performance and modular tooling. You will represent the developer community...Senior
- Yahoo is seeking an Senior Project Manager to own end-to-end delivery of HR programs, including M&A and Total Rewards, across a fast-paced... ...a portfolio, governance, and senior stakeholder updates with an AI-forward mindset. You will partner with Legal, Finance and HR leadership...Senior
$192k - $278k
Lead Search-wide trust initiatives by setting ambitious, measurable goals and navigating ambiguity to deliver secure user experiences.Oversee... ..., Platforms, and Verticals to scale compliance and Generative AI protections.Operationalize critical program execution while...SeniorGoogle
Mountain View, CA5 days ago- Volta seeks a content lead to shape and publish authoritative narratives about its AI infrastructure platform. You will ghostwrite for the CEO and executives, own the content calendar, and ensure consistent brand voice across posts, blogs, and thought leadership. You’ll...Senior
- Google is seeking a UX Program Manager to lead end-to-end UX programs for the Agent Platform, coordinating across UX, product, and engineering... ...delivery while maintaining a strong focus on user-centered design and quality across enterprise AI surfaces. #J-18808-Ljbffr GoogleSenior
- Gen is seeking a senior creative leader to drive brand campaigns for LifeLock, with oversight of messaging, campaign architecture, and cross... ...product teams to ensure cohesive storytelling, while leveraging AI tools to accelerate ideation and production. Location includes...Senior
$193.93k - $352.29k
...and profound opportunity for AI to drive positive change in the... ..., T. Rowe Price, and other leading investors.About the RoleThe ML... ....Maintain an in-house ML inference platform to serve large language... ...designExperience with data workflow orchestration platformsExperience with ML...SeniorImmediate startFlexible hoursNuro
Mountain View, CA5 days ago- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU... ..., and hardware systems. We build orchestration frameworks, execution engines,...Senior
Cerebras Systems
Sunnyvale, CA3 days ago - ...builds the world's largest AI chip, 56 times larger than... ...to deliver industry-leading training and inference speeds; over 10 times faster... ...region deployments, APIs, orchestration layers, and hardware-backed... ...business.About The RoleAs a Senior Software Engineer in Test...SeniorWork at officeRemote workShift work3 days per week
Cerebras Systems
Sunnyvale, CA7 days ago - Inworld AI in Mountain View, CA, is seeking a Lead Technical Recruiter to own senior searches end to end and partner with founders and leadership across engineering, AI research, and business roles. You will build deep pipelines, drive hiring decisions with data, and apply...Senior
- ...builds the world's largest AI chip, 56 times larger than... ...to deliver industry-leading training and inference speeds; over 10 times faster... ...shared observability, capacity orchestration, rollout safety, and... ...-prem environments.Mentor senior SREs, support critical incident...Shift work
Cerebras Systems
Sunnyvale, CA6 days ago - Sonatus is seeking a Senior Staff AI Engineer to define and build the next generation of AI applications for software-defined vehicles. You... ...customer problems and goals. This high-impact role requires leading architecture, end-to-end AI system design, and collaboration...Senior
- About InworldInworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.Hundreds of millions...Full timeWork at officeRelocation package
Inworld AI
Mountain View, CA6 days ago - ...builds the world's largest AI chip, 56 times larger than... ...to deliver industry-leading training and inference speeds; over 10 times faster... .... This is one of the most senior IC roles on the team, for... ...including networking, compute orchestration, container platforms, and...
Cerebras Systems
Sunnyvale, CA3 days ago $171k - $231.4k
Amazon Web Services (AWS) is seeking a Senior AI Acceleration Lead to join the Customer Success Center of Excellence (CS COE) within the AWS Specialists & Partner Organization. This role is critical to scaling how the CS COE engages with field teams and partners to drive...SeniorWork at officeLocal areaFlexible hoursAmazonWebServices
Mountain View, CA4 days ago$192k - $278k
Senior Technical Program Manager, Trust Portfolio Lead, Search Intelligence Share Senior Technical Program Manager, Trust Portfolio Lead, Search Intelligence corporate... ...stakeholder management especially quality and AI engineers. In depth quality experience (e.g., evaluations...Senior- ...Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-... ...high‑speed inference. We’re hiring a Senior Fullstack Engineer to own and scale...SeniorShift work
$184k - $287.5k
We are looking for an architect that wants to change how the AI inference industry works. With agent adoption taking off and GPUs in shortage... ...covers a wide range of technical skills and the ability to lead high-stakes conversations with partners. Nobody can cover everything...SeniorFull timeNvidia
Santa Clara, CA4 days ago$168k - $258.75k
Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily life, and where... ...deployment techniques. As a Senior Product Manager for AI... ...out from the crowd:Experience leading optimization products for InferenceWorking...SeniorFull timeNvidia
Santa Clara, CA6 days ago- NVIDIA Corporation is hiring a Solutions Architect focused on AI inference to design and deploy scalable inference pipelines on Kubernetes and GPU clusters. You will collaborate with engineering and customer teams to deliver enterprise AI solutions and production-grade...Senior
- ServiceNow is looking for a Distributed Systems Engineer in Mountain View, California, to build the runtime infrastructure for Moveworks' AI agents. The role involves developing a state machine, event-driven systems, and ensuring system observability. Candidates should have...Senior
- Crusoe Energy Systems seeks a Senior Deployment Automation Engineer to advance our AI Cloud infrastructure. You will design and automate deployment and testing... .... You will own CI/CD infrastructure, testing, and orchestration, ensuring stability and scalability of the...Senior
- AMD in Santa Clara is seeking a Senior Product Manager to drive strategy and execution for ROCm, AMD’s open-source GPU software stack. This role involves managing the product roadmap for inference capabilities and engaging with the open-source community to enhance AMD'...SeniorRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Orchestration Lead. Be the first to apply!
Related searches
- senior business development Mountain View, CA
- senior research specialist Mountain View, CA
- senior devops engineer remote Mountain View, CA
- senior information technology project manager Mountain View, CA
- senior vmware engineer Mountain View, CA
- sr electrical engineer Mountain View, CA
- senior dynamics crm developer Mountain View, CA
- senior program analyst Mountain View, CA
- senior research scientist Mountain View, CA
- senior director Mountain View, CA