Senior Cloud AI Inference Engineer
Arm Limited
Arm seeks an engineer for its AI Inference Cloud team to define the technical direction and develop highly available, scalable services for running AI inference workloads. You will guide architecture and actively contribute across Kubernetes orchestration, workload management, service delivery, and observability, partnering with AI compute, Inference Runtime, and product teams to enhance performance and usability of Arm's AI platform. #J-18808-Ljbffr Arm Limited
- Arm Limited is seeking a Software Engineer for the AI Inference Runtime team, driving architecture and roadmaps for distributed inference workloads... ..., and efficiency improvements, collaborating with cloud, framework, compiler, hardware, and research teams. The role...CloudSenior
$161k - $239k
...architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and... ...platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's... ...internal and external industry leads. Google Cloud accelerates every organization’s...CloudSeniorFull time$184k - $287.5k
We are looking for a strong engineer to join the DRIVE Road Structure... ...interested in inventing human-level AI for navigation in the... ...techniques, and efficient GPU inference using NVIDIA software and hardware... ....Experience with BEV, point-cloud/voxel, neural scene representation...CloudSeniorFull timeRemote workShift work- ...AI Training Infrastructure Engineer Location: Hybrid | Bellevue, WA (downtown) Titles: Senior and Staff (multiple roles available) Build the... ...building a next-generation cloud platform designed to power... ...training, fine-tuning, inference, and emerging agentic AI...CloudSeniorWork at officeRelocation3 days per week
- ...notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the... ...Architect and deploy secure, scalable cloud platforms optimized for AI/ML workloads. Partner with AI... ...architecture, ML training, and inference. Experience with...CloudSeniorFor contractors
- ...notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the... ...Architect and deploy secure, scalable cloud platforms optimized for AI/ML workloads. Partner with AI... ...architecture, ML training, and inference. Experience with...CloudSeniorFor contractors
$176.76k - $232k
...team The Enterprise Data & AI team is a strategic and operational... ....Core responsibilities As a Senior AI/ML Engineer, you will lead the delivery... ...design for serving AI/ML inference solutions in production. You... ..., MLFlow, feature stores, cloud ML platformsMust havesAcknowledge...CloudSeniorPermanent employmentFull timeContract workPart timeWork visa$188k - $275k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers... ...Do Description Of The Team The Inference team is responsible for delivering high... ...Role We are looking for an Applied AI Engineer to help us understand, measure, and...CloudPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$150.4k - $277.6k
...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States Software and Services Apple is looking for a senior... ...routing for Private Cloud Compute, the backbone of Siri AI and Apple Intelligence. You'll design distributed...CloudSeniorRemote workWorldwideRelocation- Anthropic is seeking an experienced engineer to design, build, and operate the high-performance inference infrastructure that serves Claude globally. You will own distributed... ...systems across multiple accelerators and cloud platforms, implementing intelligent routing,...CloudSenior
- DigitalOcean is seeking a Senior Engineer 2 to lead architectural decisions for inference performance and to optimize GPU kernel and inference engine performance. You... ...engineers and driving open-source collaboration in the GPU AI space. #J-18808-Ljbffr DigitalOceanSenior
- Anthropic’s Cloud Inference team in Seattle builds and operates the Claude inference stack across CSPs. You will own validation, deployment, and performance optimizations for inference servers and load balancers, ensuring correctness at scale. Join a high-leverage infrastructure...CloudSenior
- ...community where each individual can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI lifecycle by bridging the... ...infrastructure technologies, including Docker, Kubernetes, and cloud platforms such as AWS, GCP, and Azure. Hardware Optimization...CloudFull timeLocal areaImmediate start
- Anthropic is seeking product-minded backend engineers to design, build, and own backend services for Claude across AWS, GCP, and Azure... ...supporting multiple CSP platforms. You will collaborate across inference, product API, systems, and security teams, implementing CI/CD...CloudSenior
$148.2k - $300.96k
ByteDance in Seattle is seeking engineers to join the Inference Infrastructure team, focusing on large-scale AI workloads. As a part of a hyper-scale environment, you'll design... ...a PhD in a relevant field with experience in cloud infrastructure and container technologies....Cloud- ...the financial world. The role: SoFi’s Senior Staff AI Engineer is a hands‑on AI engineering role in... ...to ensure high‑throughput, low‑latency inference across diverse hardware footprints. Operational... ...and agentic systems. Experience with cloud platforms (AWS, Azure, or GCP) and...CloudSeniorRemote work
- Snowflake is seeking AI-native thinkers for the AI Research team to advance LLM inference systems and optimization. You will work on high-performance, adaptive inference across distributed serving, GPU kernels, and system co-design, collaborating with researchers and product...Senior
- Apple seeks an engineer to build tooling, automation, and analysis capabilities for the AI inference platform, focusing on benchmarking, capacity projection models, and data pipelines that inform infrastructure teams and capacity planners. You will design real-time performance...Senior
$180k - $225k
...About the Role As a Senior AI Native Software Engineer, you orchestrate a fleet of AI agents to architect, build, and deploy production‑grade systems... ...Understanding of distributed systems tradeoffs and cloud‑based infrastructure design Proficiency in customer discovery...CloudSeniorFlexible hours$140k - $180k
...WashingtonValorem Reply Azure SI, US - Data + AI /Full Time /HybridValorem Reply is an... ...the way their clients do business. As a Senior AI Engineer, you will understand how AI is... ...testing, and operations experienceDeveloping cloud software services and an understanding of...CloudSeniorFull time$152k - $241.5k
...technology powers everything from generative AI to autonomous systems, and we continue to... ..., and tools that enable researchers and engineers to develop the next generation of AI/ML... ...working with Kubernetes and cloud-native infrastructureStrong understanding...CloudSeniorFull time- ...Position Summary We are seeking a highly experienced Senior AI Solutions Engineer to design, develop, and deploy production-grade AI and Generative... ...-quality data ingestion, processing, and retrieval. Cloud & DevOps Deploy AI solutions on AWS, Azure, or GCP....CloudSenior
- ...for patients. BlinkRx is the world’s first pharma-to-patient cloud that offers a digital concierge service for patients who... ...historically has resisted innovation. Join us!We are hiring a Senior AI Security Engineer II to lead the security, governance, and risk management of...CloudSenior
- BrickRed Systems LLC in Bellevue, WA is seeking a Senior Software Engineer specializing in Lakehouse and Applied AI. You will own end-to-end solutions from discovery... ...-on experience with Databricks, PySpark, Python, cloud infrastructure, and GenAI/LLM technologies, plus...CloudSenior
$500 per month
The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers... ...reliability Have significant software engineering experience, with a strong background in... ...’re interested in this work We think AI systems like the ones we’re building have...CloudSeniorWork at officeHome officeRelocation packageFlexible hours$170.9k - $231.2k
Arm is building the next generation of AI platforms for developers to build Cloud to Car and Cloud to Edge solutions in the Automotive... ...technology in their solutions.Job Overview:As a Senior Machine Learning DevOps Engineer, you will design and build the ML DevOps...CloudSeniorWork at officeLocal areaRelocation$500 per month
The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers and enterprise companies across AWS, GCP... ...execution, capacity management, and day-to-day operations Our engineers are extremely high leverage: we simultaneously drive multiple...CloudSeniorWork at officeHome officeRelocation packageFlexible hours- Bill & Melinda Gates Foundation in Seattle seeks a Senior AI Engineer to design, build, and deploy AI solutions that empower global staff. You... ...role emphasizes hands-on coding with Python, AI tooling, and cloud services, with a 50% in-office hybrid schedule. You will...CloudSeniorWork at office
$122k - $240.5k
Position Summary Agentic AI is moving from experimentation... .... We're growing a team of engineers who want to work at the center... ...data, AI, network, and hybrid cloud infrastructure. These solutions... ...From entry-level employees to senior leaders, we believe there’s always...CloudSeniorWork at officeLocal areaVisa sponsorshipShift work$144.1k - $216.1k
...solutions for automation and AI use by developers across our enterprise... ...for a versatile and dedicated Senior AI Developer who focuses on... ...deploying production scale cloud solutions; or equivalent experience.Experience with prompt engineering and agent-based workflows for...CloudSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Cloud AI Inference Engineer. Be the first to apply!
- senior devops cloud engineer Seattle, WA
- senior aws cloud engineer Seattle, WA
- cloud network engineer Seattle, WA
- google cloud architect Seattle, WA
- senior cloud network engineer Seattle, WA
- principal cloud computing engineer Seattle, WA
- cloud solutions architect Seattle, WA
- cloud engineer Seattle, WA
- lead cloud architect Seattle, WA
- google cloud engineer Seattle, WA



