Sr. AI Inference Platform Engineer
$175k - $308.5kApple Inc.
Seattle, Washington, United States Software and Services We are looking for senior engineer to build tooling, automation, and analysis capabilities that strengthen our AI inference platform. This role will focus on developing sophisticated performance benchmarking systems, capacity projection models, and data analysis pipelines that directly inform our AI infrastructure teams and capacity planners. You'll work at the intersection of AI systems performance, distributed infrastructure, and software engineering to help the team make data-driven decisions about scaling and optimizing our inference platform. Description At Apple, we believe the future of AI is defined not just by models, but by the infrastructure that powers them. Our AI inference platform sits at the heart of products and experiences used by hundreds of millions of people worldwide, and we are building the systems that ensure it scales reliably, efficiently, and intelligently.As part of our next-generation datacenter engineering team, you will play a critical role in shaping how we understand, measure, and grow our AI infrastructure. You will design and build the tooling and analysis systems that give our engineers and capacity planners a clear, real-time picture of performance across our fleet. Your work will directly influence how we invest in hardware, how we detect regressions before they reach production, and how we forecast capacity needs months in advance.This is a high-impact, cross-functional role for an engineer who is energized by complexity, thrives on turning raw data into actionable insight, and wants to work on problems that matter at massive scale. Responsibilities Design and build automations to evaluate AI inference performance across hardware generations and configurations. Develop tooling to surface performance trends, regressions, and insights to infrastructure and planning teams. Build projection and forecasting models to support long-term capacity planning decisions. Analyze performance and utilization data to identify bottlenecks, trends, and optimization opportunities. Partner with AI infrastructure engineers, hardware teams, and capacity planners to deliver critical data and tooling. Create and enhance performance analysis workflows to increase team velocity and data reliability. Continuously improve the accuracy, coverage, and usability of performance measurement and analysis systems. Minimum Qualifications BS or MS in Computer Science or related technical field. Solid understanding of AI/ML inference architecture and the performance characteristics of serving systems. 7 or more years of experience with performance and infrastructure engineering in distributed systems. 7 years of experience coding in Python, Go, C++, or other programming languages. Experience with automation engineering, tooling, and data pipelines to support engineering workflows. Strong knowledge of GPU/accelerator architecture as it relates to AI workloads. Practical statistical knowledge applicable to performance analysis and forecasting. Excellent communication skills and ability to turn data into clear guidance for infrastructure teams and capacity planners. Preferred Qualifications Experience with performance benchmarking and methodologies for AI/ML inference systems. Familiarity with capacity planning and forecasting/projection models for large-scale infrastructure. Experience with GPU profiling and observability tools (e.g., Nsight, other vendor-specific profilers). Experience with data visualization and reporting tools/frameworks for surfacing performance trends to stakeholders. Familiarity with ML serving frameworks and runtimes (e.g., Triton, TensorRT-LLM, vLLM, or similar). Experience with CI/CD and workflow orchestration tools for building automated performance analysis pipelines. Knowledge of cluster schedulers and orchestration platforms (e.g., Kubernetes). Experience with metrics and logging tools (e.g., Prometheus, Grafana, Splunk). At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,000 and $308,500, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple BenefitsNote: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple’s workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis. #J-18808-Ljbffr Apple Inc.
$175k - $308.5k
We are looking for an engineer to build tooling, automation, and analysis capabilities that strengthen our AI inference platform. This role will focus on developing sophisticated performance benchmarking systems, capacity projection models, and data analysis pipelines...SeniorWorldwide- ...As a Senior Lead Software Engineer at JPMorgan Chase within the... ...Corporate Sector, Infrastructure Platforms team, you are an integral part... ...platforms optimized for AI/ML workloads. Partner with... ...architecture, ML training, and inference. Experience with Infrastructure...SeniorFor contractors
- Apple seeks an engineer to build tooling, automation, and analysis capabilities for the AI inference platform, focusing on benchmarking, capacity projection models, and data pipelines that inform infrastructure teams and capacity planners. You will design real-time performance...Senior
- Baseten is hiring an Engineer for the Dedicated Inference team to shape developer experience for deploying and operating AI workloads in production. You’ll build CLI, SDKs, APIs, observability, and debugging workflows that customers rely on daily to manage inference deployments...Suggested
- OpenAI is seeking a software engineer to build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop OpenAI-hosted services and partner-side software for long‑lived optimization workflows, generating kernels...Suggested
$184.7k - $324.8k
...Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference Santa Clara, California, United States Machine Learning and AI We are the Foundation Model Inference team within Cloud... ..., working closely with platform and security teams to deliver...SeniorWorldwideRelocation- Baseten is hiring an Infrastructure Software Engineer to build and maintain components of our ML inference platform that powers production AI applications. You"ll help developers deploy, scale, and monitor models with high performance. Join a team working on multi-cloud...
$184.5k
...contribute, and succeed. Within this organization, the Workday Platform Engineering team enables scalable, secure, and reliable technology... ...Workday ecosystem. Identify and implement opportunities to use AI to provide a better user experience or efficiencies back to...Senior$262.7k - $355.4k
As a Principal Engineer on Arm’s AI Inference Cloud team, you will shape the technical direction and develop highly available, scalable services... ...teams to enhance the performance and usability of Arm’s AI platform.Responsibilities:Define and build the architecture for...Work at officeLocal areaVisa sponsorshipRelocation package- ...As a Senior Lead Software Engineer at JPMorgan Chase within the... ...Corporate Sector, Infrastructure Platforms team, you are an integral part... ...platforms optimized for AI/ML workloads. Partner with... ...architecture, ML training, and inference. Experience with Infrastructure...SeniorFor contractors
- Xaira Therapeutics is seeking a Senior Software Engineer to join our Platform team to design, build, and deploy the AI infrastructure that powers our world-class... ...engineers to enable thousands of GPUs for training and inference of biology foundation models in Seattle. This...Senior
- Xaira Therapeutics is seeking a Senior Software Engineer to design, build, and deploy the AI infrastructure powering its research team. You will enable thousands of GPUs for training and inference of advanced biologically focused models, working across cloud clusters and...Senior
$165k - $242k
...CoreWeave, the AI Hyperscaler™ acquired Weights & Biases to... ...the most powerful end-to-end platform to develop, deploy, and iterate... ...clusters, agent building, and inference at scale, we’re combining... ...— 15%: Partner with software engineering teams to define event schemas...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- Veeda AI is building the next generation of multimodal foundation world models for Physical AI. We'... ...robotics, and embodied intelligence. We are seeking engineers to design and deploy tools for experiment lifecycle, inference fleet orchestration, and data pipelines, while...Senior
- ...organizational programs for AWS Mantle—our next-generation distributed inference engine powering Amazon Bedrock. You will operate with independence... ...across VP orgs, define strategy, and make trade-offs to scale AI inference infrastructure globally, delivering measurable...
$216.2k - $324.8k
...Senior Machine Learning iOS Platform Engineer — Responsible AI and Safety San Francisco Bay Area, California, United States Machine Learning and... ...foundation models running on Apple Silicon to server-side inference on Private Cloud Compute (PCC).In this role, you will be...SeniorRelocation$181.63k - $254.28k
...Advanced Concepts and Enterprise Engineering (ACE), supporting Blue Origin... ...are seeking a highly skilled platform software engineer to own the... ...services, including the inference runtime and job orchestration... ...Passion for and understanding of AI and Machine Learning...SeniorPermanent employmentTemporary workLocal areaRemote work$168.1k - $227.4k
Define how AI agents operate in one of the world's largest advertising... ...systems, and scalable inference infrastructure that powers... ...team is developing an agent platform that coordinates multiple specialized... ...team and establishing the engineering practices that scale as the...SeniorInternshipFlexible hoursDay shift- Arm seeks an engineer for its AI Inference Cloud team to define the technical direction and develop highly available, scalable services for running... ...Runtime, and product teams to enhance performance and usability of Arm's AI platform. #J-18808-Ljbffr Arm LimitedSenior
$150.4k - $277.6k
...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States Software... ...Cloud Compute, the backbone of Siri AI and Apple Intelligence. You'll design... ...at scale. You'll join iCloud Platform Engineering team. We build the server...SeniorRemote workWorldwideRelocation$168.1k - $227.4k
...cloud-scale machine learning. This senior software engineering role is part of the Machine Learning Inference Applications team and focuses on delivering high-performance... ...in production on GPUs, AWS Neuron, TPUs, or other AI accelerator hardware- Experience extending or...SeniorWork experience placementInternshipLocal areaFlexible hours$162.7k - $220.2k
...passionate about helping customers optimize price/performance for AI Inference at scale? AWS is seeking a Go-To-Market (GTM) Specialist to... ...initial calls with customers (typically VP/Dir of ML/AI Platforms) in a consultative way to listen to the voice of customer, walk...SeniorLocal areaWorldwideFlexible hours- Baseten is building Voice AI, and you’ll own the in-house inference stack from roadmap to production, powering real-time STT, TTS, and voice agent workloads... .... As the owner, you’ll partner with Forward Deployed Engineers and sister teams to push the boundaries of Voice AI,...
$200k - $287.5k
...To usher in this new era, we seek AI-native thinkers across every function... ...work gets done.Senior Software Engineer — Cortex TrainingThe Snowflake ML Platform team's mission is to let customers... ...orchestration, multi-node training and inference, fault tolerance, and throughput....Senior$262.7k - $355.4k
As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference... ...to enhance the performance and efficiency of Arm’s AI platform.Responsibilities:Define the architecture, interfaces, and...Work at officeLocal area$200k - $287.5k
...usher in this new era, we seek AI-native thinkers across every... ...done.The Billing & Payments Platform team builds Snowflake's central... ...and enable every other engineering team — and the architectures... ...Apps — including token-based inference, agent workflows, and AI-native...Senior$184.5k
...employees. A singular technology platform powered by data and machine... ...Senior Software Development Engineer - ML Platform role is a part... ...engineering and training to real-time inference, monitoring, and cost... ...Safely integrate and operate AI/ML-enabled solutions that...SeniorFull time$148.5k - $223.9k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...for an experienced and hands-on software engineer to join our team to build and scale the next... ...tools, frameworks, workflows, and validation platforms, applying AI tools, that help Salesforce...SeniorFull time$500 per month
The Cloud Inference team scales and optimizes Claude to serve the massive... ...of Claude on each cloud platform, from API integration and intelligent... ...Have significant software engineering experience, with a strong... ...in this work We think AI systems like the ones we’re building...SeniorWork at officeHome officeRelocation packageFlexible hours- ...Sr Principal Software Engineer - Core Platform Engineering Seattle, WA, United States Job Information Job Identification 210725430 Job Category Software Engineering Business Unit Consumer & Community Banking Posting Date 03/17/2026, 05:31 PM Locations...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. AI Inference Platform Engineer. Be the first to apply!
- machine learning ai engineer Seattle, WA
- ai developer Seattle, WA
- ai engineer remote Seattle, WA
- ai ml engineer Seattle, WA
- ai prompt engineer Seattle, WA
- senior ai engineer Seattle, WA
- ai engineer Seattle, WA
- client platform engineer Seattle, WA
- platform engineering manager Seattle, WA
- platform developer Seattle, WA


