AI Inference Platform Leader: Scale & Optimize
Google is seeking an experienced Lead Engineer to optimize the serving stack for machine learning models, particularly LLMs like Gemini, in a cloud environment. The ideal candidate will exhibit strong coding skills in C++ or Python, has team leadership experience, and possesses a solid background in machine learning infrastructure. This role requires the ability to drive technical vision and oversee in-depth performance profiling, ensuring that Google's LLMs operate efficiently and cost-effectively. A competitive salary package with bonuses and equity is included. #J-18808-Ljbffr Google
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Inference Platform Leader: Scale & Optimize in Sunnyvale, CA vacancy
- NVIDIA is seeking a Senior Inference Engineer in Santa Clara, CA to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. This role will involve building production-quality APIs, collaborating across teams, and enhancing...Platform
- ...Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency... ...systems optimization, directly impacting industry leader processes in semiconductor design. A successful...Platform
- A leading AI hardware company in California is seeking a Staff Site Reliability... ...and reliability initiatives at scale. You will architect self-service platforms and define reliability practices,... ...to the frontier of AI inference services. The ideal candidate has...Platform
$254k
...delivery from the ground up using advanced optimization, real-time decisioning, and applied AI at massive scale. We’re looking for a Group Director of... ...decision across our delivery ecosystem. This leader will own the platforms that determine how work is created, priced...PlatformFull timeTemporary workPart time- GMI Cloud is a fast-growing AI infrastructure company backed... ...NVIDIA's prestigious Reference Platform Cloud Partner designation. We... ...from GPU compute to AI model inference API solutions. As an NVIDIA... ...building the leading inference optimization solution and the most...PlatformWorldwide
$176k - $420k
Tesla’s AI team is pushing the frontier of real... ...train and deploy large‑scale ML systems powering... ...As part of the Model Optimization group, you will work at... ...make large‑scale model inference fast, reliable, and hardware... ...across Tesla platforms What You'll Bring Proven...PlatformHourly payTemporary workFlexible hours- MatX is seeking a Senior Platform TPM for rack-scale AI Systems in Mountain View, California. This role involves coordinating cross-functional team execution across various engineering domains to drive design-phase tasks effectively. The ideal candidate will have over...Platform
- ...Ltd. is seeking a Senior TLM to lead the development of large-scale machine learning models. This position focuses on innovating efficient... ...ML infrastructures, ensuring high performance across various platforms. The ideal candidate has 10+ years of engineering experience...Platform
- Amazon is seeking a Sr. Worldwide GTM Specialist - AI Inference, Data & AI GTM in Mountain View, CA. The role focuses on shaping go-to-... ...with cross-functional teams, and a strong understanding of AI platforms and AWS services. #J-18808-Ljbffr Gravity Engineering...PlatformWorldwide
$238k - $302k
...View, California. In this role, you will design and build distributed evaluation platforms for large-scale ML evaluation workloads, collaborate with researchers and engineers, and optimize ML infrastructure. You will leverage your knowledge in TensorFlow, JAX, and profiling...PlatformFull time- ...Systems is seeking a Software Engineer to build and maintain high-performance, low-latency inference infrastructure. You will deploy scalable inference services, optimize auto-scaling, and integrate with Docker/Kubernetes in production environments. You will collaborate...Platform
- A leading talent agency is seeking a Tech Lead, Data & Inference Engineer in Palo Alto, California. In this full-time role, you will design and scale an end-to-end data platform and build scalable data pipelines. The ideal candidate holds a relevant degree, has 6-12 years...PlatformFull time
- Crusoe Energy Systems seeks a Senior Software Engineer to join their Cloud Managed AI team in California. This on-site role involves leading the design and implementation of AI inference platform infrastructure, ensuring high performance and availability. The ideal...Platform
$184k - $356k
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve...Platform$191.8k - $288.5k
...looking for an experienced leader to drive optimization across our Total Rewards technology... ...with Workday and related platforms supporting Compensation,... ...perspective on how agentic AI solutions can transform the... ...including identifying and scaling agentic AI capabilities...PlatformWorldwideRelocationShift work$157k - $271.4k
...California What You Will Do AI Development Standardization:... ...hallucination. Model Integration & Inference Optimization: integrate advanced models... ...judgement to the MLOps platform, balancing researcher/data‑scientist... ...working with large‑scale datasets or distributed training...PlatformLocal areaImmediate start- ...with expertise in model optimization and integration into... ...applying state-of-the-art AI innovations to make... ...Engineer on our Platform team, you'll advance the... ...models' efficiency and inference speed on production. Deployment... .... Ensure models can scale horizontally to handle...Platform
- Product Manager - AI Inference Platform (PLG & Growth) Role Overview: We are looking for a strategic... ...(Developer & SMB): Build and optimize the growth lifecycle for developers and... ...platform products with a significant revenue scale (USD 10M+). End‑to‑End Delivery:...PlatformFull time
$305k
...looking for a Product Design leader to drive the creation of... ...products ship at Apple quality and scale. Responsibilities Building... ...closely with Software, AI/ML, and platform teams to ensure hardware designs... ...and module selection, BOM optimization, and platform reuse...PlatformWork experience placementRelocation$210k - $315.05k
...want to be at the forefront of AI technology exploration and... ...a visionary AI Strategy Leader to lead our organization’s AI... ...AI, efficient small models, inference‑time scaling, or advanced reasoning for decision... ...with external AI vendors, platforms, and research partners to...PlatformWork at officeLocal area$118k - $179.04k
...Engineer in Analytics and AI/ML for Digital... ...benefits and support the scaling of future operations.... ...production‑grade pipelines and inference (batch and real time),... ...maintenance, process optimization) and translate them... ...and lakehouse platforms and orchestration (e.g...PlatformLocal areaWorldwide$172.1k - $305.6k
Sr Technical Product Manager, AI & Data Platforms (AiDP) Sunnyvale, California, United States Corporate... ...to have experience managing a large scale portfolio of products and can navigate... ...and land the next-generation of GenAI inferences for Apple Enterprise Teams. Own the...PlatformRelocation- ...leading software company is seeking a Principal Data Platform Architect to design a scalable data platform for AI systems. This role requires extensive experience... ...have a proven track record in designing large-scale data systems. Competitive salary offered in conjunction...Platform
$118k - $179.04k
...Engineer in Analytics and AI/ML for Digital... ...production‑grade pipelines and inference (batch and real‑time),... ...R&D to prioritize and scale high‑value use cases (... ...maintenance, process optimization) and translate them... ...and lakehouse platforms and orchestration (e.g...PlatformTemporary workLocal areaImmediate start$192.6k - $289k
...Qualcomm is a global leader in connected... ...edge, focusing on AI, edge computing and... ...vision, generative AI inference and Agentic AI... ...safety) using Qualcomm platforms and industry... ...instrument, profile, and optimize models and... ...assistants) that scale to production and...PlatformWork experience placementWork from home- ...builds the world's largest AI chip, 56 times larger... ...GPUs. Our novel wafer‑scale architecture provides... ...industry‑leading training and inference speeds and empowers... ...on our Inference Platform team. Our team primarily... ...TLS, mTLS). Experience optimizing latency, throughput, and...Platform
- ...builds the world's largest AI chip, 56 times larger... ...-leading training and inference speeds; over 10 times... ...deploy 750 megawatts of scale, transforming key workloads... ...on our Inference Platform team. Our team primarily... ...TLS, mTLS). Experience optimizing latency, throughput, and...Platform
$184k - $287.5k
...at the forefront of the AI revolution,... ...constraints of an AV compute platform. What You’ll Be Doing: Develop SOTA model optimization techniques, such as speculative... ...strategies for inference, including automated model... ...TensorRT conversion. Scale DL model performance across...Platform$224k - $356.5k
...unlimited potential of AI to define the next era... ...-source benchmarking platform, AIPerf, is the growing... ...across various inference frameworks. Hyperscalers... ...includes choosing GPUs, optimizing costs, reducing latency... ...improving efficiency, and scaling. As Technical Lead...PlatformLocal areaWorldwide- ...builds the world’s largest AI chip with wafer-scale architecture for AI... ...industry-leading training and inference speeds and allows users... ...for our AI infrastructure platform. This leader will operate at the intersection... ...training, and inference optimization. Experience supporting...Platform
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Inference Platform Leader: Scale & Optimize. Be the first to apply!
Related searches
- team lead data science Sunnyvale, CA
- quality assurance team leader Sunnyvale, CA
- group product manager Sunnyvale, CA
- leader Sunnyvale, CA
- member team lead Sunnyvale, CA
- application team lead Sunnyvale, CA
- helpdesk team lead Sunnyvale, CA
- disability team leader Sunnyvale, CA
- team leader full time Sunnyvale, CA
- compliance team leader Sunnyvale, CA