Engineering Manager, Cloud Inference AWS
Gravity Engineering Services Pvt Ltd.
About the Role We are seeking an experienced Engineering Manager to lead the Cloud Inference team for AWS. You will lead your team to scale and optimize Claude to serve the massive audiences of developers and enterprise companies using AWS. You will own the end-to-end product of Claude on AWS, including API, load balancing, inference, capacity and operations. Your team will ensure our LLMs meet rigorous performance, safety and security standards and enhance our core infrastructure for packaging, testing, and deploying inference technology across the globe. Your work will increase the scale at which Anthropic operates and accelerate our ability to reliably launch new frontier models and innovative features to customers across all platforms. Responsibilities: Set technical strategy and oversee development of Claude on AWS across all layers of the technical stack. Collaborate across teams and companies to deeply understand product, infrastructure, operations and capacity needs, identifying potential solutions to support frontier LLM serving Work closely with cross-functional stakeholders across companies to align on goals and drive outcomes Create clarity for the team and stakeholders in an ambiguous and evolving environment Take an inclusive approach to hiring and coaching top technical talent, and support a high performing team Design and run processes (e.g. postmortem review, incident response, on‑call rotations) that help the team operate effectively and never fail the same way twice You may be a good fit if you: Have 10+ years of experience in high‑scale, high‑reliability software development , particularly infrastructure or capacity management Have 5+ years of engineering management experience Experience recruiting, scaling, and retaining engineering talent in a high growth environment Have experience scaling products, resources and operations to accommodate rapid growth Are deeply interested in the potential transformative effects of advanced AI systems and are committed to ensuring their safe development Excel at building strong relationships and strategy with stakeholders across engineering, product, finance, and sales Have experience working with external partners to align goals and deliver impact Enjoy working in a fast‑paced, early environment; comfortable with adapting priorities as driven by the rapidly evolving AI space Have excellent written and verbal communication skills Demonstrated success building a culture of belonging and engineering excellence Are motivated by developing AI responsibly and safely Are willing and able to travel frequently between Seattle and the SF Bay Area Strong candidates may also have experience with: Experience with machine learning infrastructure like GPUs, TPUs, or Trainium , as well as supporting networking infrastructure like NCCL Experience as a Product Manager Experience with deployment and capacity management automation Security and privacy best practice expertise #J-18808-Ljbffr Gravity Engineering Services Pvt Ltd.
- ...enterprise initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers... ...growing. We are hiring an Engineering Manager to lead one of our teams that work... ...of Microsoft Azure, Google Cloud, or AWS What we offer colleagues Distributed...Amazon Web ServiceWork at officeWork from home
- ...ubiquitous. We combine a powerful orchestration engine with a seamless consumer app to unlock... ...We are hiring a Senior Engineering Manager, Cloud Infrastructure, to own and evolve the... ...experience is a plus, but strong engineers on AWS or GCP who are excited to go deep on...Amazon Web ServiceFull timeWork at officeRemote workShift work2 days per week
$155k - $410k
...safeguard sensitive data. In cloud security at PwC, you will be... ...Fields of Study Computer Engineering,Computer Applications,... ...Security,Information Technology,Management Information Systems Preferred... ...cloud security programs across AWS, Azure, or GCP environments,...Amazon Web ServiceFull timeTemporary workH1b- A leading open-source software provider is looking for an Engineering Manager in San Francisco. In this role, you will lead a team working with major cloud partners like Amazon and Google, focusing on optimizing Ubuntu infrastructure. You will need strong technical leadership...SuggestedRemote job
- ...correctly, and the tooling that lets our engineers ship with confidence. You'll lead a team... ...roadmap. What You'll Do Team Leadership Manage a team of 4–6 engineers across Infrastructure... ..., Objection.js, PostgreSQL Infra & Ops: AWS, Temporal, Twilio, Stripe AI & Tooling:...Amazon Web ServiceLive inWork at officeWorldwideFlexible hours
$210k - $230k
...Francisco. The Role Comity is looking for an Engineering Manager to lead our Platform Software... ...traditional relational databases as well as cloud-based data warehouses. Experience with machine... ...stack (Python, PostgreSQL, Snowflake, AWS) is a plus. Location This role will be...Amazon Web Service- ...Senior Cloud, AI & Data Security Engineer We are seeking an enthusiastic and passionate... ...and services across AWS, Azure, and AI/ML platforms... ...practices, provide assurance to management and auditors, and ensure... ...environments, and inference endpoints Knowledge of...Amazon Web Service
$300 per month
...across energy, manufacturing, data center construction, and cloud services. If you want to do the most meaningful work of... ...to meet the industry's most high value workloads. As a Senior Engineering Manager, you will lead the team responsible for the architecture, delivery...Temporary work$330k
...to build the world's best deep learning cloud, join us. Note: This position requires... ...from home day is currently Tuesday. Engineering at Lambda is responsible for building and... ...internal tooling for system deployment, management and maintenance. What you’ll do...Full timeTemporary workWork at officeLocal areaRemote workWork from homeFlexible hours$248k - $279k
...Lead and grow one or more teams of engineers building data infrastructure that processes... ...data infrastructure Strong people management skills including hiring,... ...Flink, Airflow, Dagster, SQL, etc.) Cloud infrastructure knowledge (AWS, GCP, Azure) or containerization (Docker...Amazon Web ServiceFull timeWork at officeRelocationRelocation package- ...Scientific Data and AI Cloud purpose-built for biopharma... ...hiring a Director of Engineering to lead the Lakehouse... ...expert, you with lead, manage and grow a team 8+ engineers... ...data quality, schema inference, anomaly detection, and... ...Cloud-native fluency: AWS, GCP, or Azure,...Amazon Web ServiceImmediate startFlexible hours
$199k
...About The Role As an Engineering Manager on Chime’s Data Platform, leading the Data Storage team, you will own the group that... ...analytical workloads. Have extensive experience in cloud‑based data ecosystems, such as AWS (S3, DynamoDB, Redshift, Snowflake, EMR), GCP (BigQuery...Amazon Web ServiceFull timeWork at officeLocal areaRemote workNight shift$320k - $405k
...team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to... ...we do. What You'll Do We are hiring an Engineering Manager to lead our Cloud Security team, whose remit is to build and maintain secure...Work at officeVisa sponsorshipFlexible hours$180k - $250k
...We're looking for a hands‑on Engineering Manager to lead and grow our engineering team as we scale our AI‑powered cloud optimization platform. You'll play a key leadership role... ...infrastructure expertise, particularly with AWS, GCP, or Azure Solid understanding of AI/ML...Amazon Web ServiceFull timeWork at officeMonday to Friday- ...Responsibilities We’re looking for a Founding Engineering Manager to join a fast-growing AI infrastructure company at a pivotal moment. You’ll... ...including people who came up through Google, Meta, Cruise, and AWS and have chosen to stay The culture here is intentional: high...Amazon Web ServiceContract work
$175k - $300k
...any idea that you have for growing your company into reality. Engineering Manager @ Clay As a Software Engineering Manager, you will lead and... ...the ability to learn new technologies quickly. Experience with AWS services (Aurora, Elasticache, ECR, ECS, Lambda, OpenSearch),...Amazon Web ServiceLocal area$190k - $237.5k
...mental healthcare for the better. About Engineering at Headway Building a new mental healthcare... ...React, Remix, Next.js Infrastructure : AWS (Fargate, ECS, S3, and more), Spark and... ...: Github, PagerDuty Vulnerability Management : Snyk, Semgrep About these roles At Headway...Amazon Web ServiceTemporary workImmediate startWork from homeFlexible hours$230k - $280k
...is looking for a Principal Data Platform Engineer to lead the buildout of a modern, scalable... ...and Compliance to design a low-latency, cloud-native data architecture using best-in-class... ...Cloud-native architecture expertise (AWS, GCP, or Azure) Track record of designing...Amazon Web ServiceRemote work- ...hosted on Amazon Web Services (AWS) across multiple availability... ...processes, and tooling. As the Sr. Manager of Infrastructure Platform and... ...with architects and product engineering Build a world-class... ...operation of scalable, self-service Cloud infrastructure platforms (e.g....Amazon Web Service
- ...VP of Engineering We are hiring a VP of Engineering to lead Neon's engineering team... ...growth startups. Proven experience managing and scaling engineering teams.... ...engineering and collaboration tools: Cloud platforms (AWS) Development frameworks and languages...Amazon Web ServiceFull timeTemporary workLive inNight shift
$207k - $301k
Google Inc. is seeking a Software Engineering Manager II for its Cloud Security and Privacy division in San Francisco. In this role, you will lead a team responsible for managing projects across various domains, contributing to the evolution of Google Cloud's infrastructure...$185k - $210k
Engineering Manager, Buying & Optimization Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help transform the antiquated... ..., APIs, and relational databases. Familiarity with Python, AWS, Airflow, and queuing systems. Data driven decision making:...Amazon Web ServiceWork at office2 days per week- Engineering Manager Company: Flux Location: San Francisco, CA, USA Job Type: In‑Office, Senior Level Flux is taking the hard out... ...service reliability, and data pipelines. Infrastructure: cloud platforms (GCP/AWS), containerization, CI/CD, observability. AI/ML...Amazon Web ServiceWork at officeLocal area
- .... As a Lead Infrastructure Engineer at JPMorgan Chase within the Infrastructure... ...Lead end-to-end cloud networking architecture for enterprise platforms across AWS, Azure, and/or GCP, including... ...plans. Own technical risk management for cloud networking and solution...Amazon Web Service
- ...Principal Software Engineer For Backend Development Our client... ...learning, model training, and inference workflows, with a focus on... ...~ Experience working with cloud providers (preferably AWS) and DevOps tools such as Kubernetes for managing scalable infrastructures....Amazon Web ServiceRemote workFlexible hours
$237k - $288k
...manufacturing, data center construction, and cloud services. If you want to do the... ...build with us at Crusoe. Senior Engineering Manager, Compute San Francisco, Sunnyvale (On-site... ...at an IaaS cloud provider (AWS, GCP, Azure, CoreWeave, or similar) Experience...Amazon Web ServiceTemporary work$245k - $295k
...center construction, and cloud services. If you want... ...We are seeking a Senior Manager, Infrastructure Platform Engineering to lead a team building core... ...cloud platforms (GCP, AWS, or Azure) — orchestration... ..., AI training, and inference workloads Working knowledge...Amazon Web ServiceTemporary workImmediate start$150k - $180k
...Collaborate with machine learning engineers, frontend engineers and product managers to develop our core products and expand... ...pace. As a Software Engineer, Cloud you will: Build products that... ...plus: Go, Python, Kubernetes, GCP, AWS, Azure. Individuals who are eager...Amazon Web ServiceWork experience placementWork at officeFlexible hours- ...Platform Engineer Phonic is a product and research lab focused on... ...real-time voice AI platform - cloud infrastructure, deployment pipelines... ...cloud infrastructure - GCP, AWS, or Azure - and containerized... ...serving, GPU workloads, or inference optimization Strong proficiency...Amazon Web ServiceWork at office
$197.3k - $225.1k
Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible... ..., technical program managers, and product managers to... ...AI technologies such as AWS Ultraclusters, Huggingface... ...responsible AI solutions on cloud platforms (e.g. AWS,...Amazon Web ServiceFull timePart timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Cloud Inference AWS. Be the first to apply!
- cloud support engineer San Francisco, CA
- principal cloud engineer San Francisco, CA
- cloud engineer San Francisco, CA
- senior devops cloud engineer San Francisco, CA
- senior aws cloud engineer San Francisco, CA
- senior cloud data engineer San Francisco, CA
- cloud network engineer San Francisco, CA
- informatica cloud developer San Francisco, CA
- cloud operations engineer San Francisco, CA
- google cloud architect San Francisco, CA



