Senior Staff Engineer, AI Inference Systems
$320kAnthropic
Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to next-generation AI systems. The ideal candidate will have experience with machine learning infrastructure, distributed systems, and optimizing performance in a high-scale environment. The role requires a Bachelor’s degree and offers a competitive salary range of $320,000 to $485,000 per year. #J-18808-Ljbffr Anthropic
$168k - $270.25k
NVIDIA is seeking a Senior Engineer in New York to design and build automation for NVIDIA Inference Microservices. You will create pipelines for AI models validated across cloud and on-prem environments... ...experience in distributed systems, microservices, and strong...Senior- Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure. Candidates...SeniorWorldwide
$237k - $337k
Google is seeking a Senior Staff Engineer to lead the development of products in their data and analytics portfolio in New York. The role involves... ...in software development, specifically in Generative AI and machine learning. The position offers a base salary range...Senior- A leading global e-commerce platform is seeking a Senior Staff Software Engineer, Machine Learning, to drive AI/ML strategies that enhance the connection between buyers and sellers. The role involves both technical leadership and mentorship within a research-focused team...SeniorFlexible hours
$180k - $350k
Hume AI is seeking talented researchers and engineers interested in working with our AI research team to build state-of-the-art speech... ...this role, you will build out software systems that support distributed model training, inference, and benchmarking as well as massive-...SeniorVisa sponsorshipWork visa$227.2k - $417k
Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning and Product teams to enhance their inference platforms. Candidates should have experience...Flexible hours- ...professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and...Senior
$268k - $368.5k
...automation that lets product engineers build securely by default, without... ...the data; and iterate. As a Senior Staff Software Engineer, Product... ...leaders to influence system design, threat models, and architecture... ...the latest enterprise AI tools, to help you work smarter...SeniorWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week- Magnitude Consulting is seeking a Staff Software Engineer for an innovative AI healthcare startup in New York City. This position offers the opportunity... ...for AI solutions. The role includes developing scalable systems and AI-powered workflows, with a competitive equity...Senior
$160k - $240k
Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications... ...engineering experience, expertise in distributed systems, and a strong understanding of performance optimization...Senior- Ember Grey is seeking a Senior Staff Mechanical Engineer in New York, NY to work on advanced manufacturing technologies. This senior-level role involves designing and implementing high-precision machine systems while collaborating with multidisciplinary teams across various...Senior
$180k - $220k
...network of outstanding restaurants. As a Senior Backend Engineer, you’ll be responsible for designing,... ...aligned with business goals Contribute to system architecture and implement scalable,... ...Experience productionizing generative AI features (e.g. retrieval-augmented generation...SeniorFull timeLive outFlexible hours$155k - $225k
...The Role We’re looking for a seasoned Senior/Staff Backend Engineer to join us as we continue to build Fora... ...-facing website, content and supplier systems, internal admin tools, and external... ...industry faces. We believe advancements in AI, bold investments in our platforms,...SeniorFull timePart timeWork at officeWork from home- Capital One seeks a Senior Lead AI Engineer to help build Gen AI platform services and responsible AI systems. You will collaborate with engineers, researchers, and product managers... ...foundation model training and large model inference. You will leverage AWS, Huggingface,...Senior
$214.2k - $252k
...understanding in healthcare. Our AI‑powered platform was purpose‑... ...of AI across health systems. We are a growing team of practicing... ..., technologists, and engineers working together to empower people... ...experienced and highly motivated Senior or Staff Infrastructure Security...SeniorHourly payFull timeFlexible hours$200k - $240k
...business owners are the primary engine of wealth creation in the... ...visibility into the business, and a system for acting on what they see.... ...to power our backend and AI infrastructure. Our core systems... ...at least 10 years, given the seniority of the position). You should come...SeniorRemote workHome officeDay shift$200k - $300k
...geofencing SDKs, maps APIs, and AI-enabled solutions for... ...role We're looking for Product Engineers to build features across backend... ...two molds, technically: either Staff level expertise in one stack,... ...code screen, coding round, and system design round. If those go well...SeniorFull timeWork at officeRemote work- ...in New York, NY is seeking a Staff Engineer to solve cross-team technical... ...lead execution, and champion AI-augmented development practices... ...own delivery of high-impact systems, set coding standards, drive AI tool adoption, and mentor senior engineers while partnering...
- ...in life, and the American healthcare system is completely broken - poor outcomes,... ...led metabolic health clinic. We’re an AI‑native digital health system matching... ...reward it. About the Role We are hiring a Senior or Staff Data Engineer to become the first dedicated data...SeniorFull timeWork at officeRemote work2 days per week3 days per week
- Scale AI is seeking a Senior Staff Forward Deployed AI Engineer based in New York City. You will act as a technical bridge between Scale AI's AI capabilities and... ...in the successful integration and deployment of AI systems in production environments. #J-18808-Ljbffr Scale...Senior
$225k - $350k
About Hypha Hypha is an AI-native platform transforming asset management across... ...inefficiencies Role Overview As a Senior / Staff Frontend Engineer at Hypha, you’ll own the experience layer... ...helping define the standards and systems that keep the frontend fast, cohesive...Senior$160k - $270k
...Role As a key member of our engineering team, you will have a significant... ...of applications and systems we build across multiple platforms... ...use artificial intelligence (AI) tools to support parts of the... ...processed, please contact us. Seniority level Not Applicable...SeniorFull timeWork at officeLocal areaFlexible hours$241k - $338k
...large-scale initiative bringing frontier AI models, massive compute, and frontier experimental... ...roof. We're building a general‑purpose system to accelerate scientific discovery,... ...our compute capacity, AI research and engineering, and state‑of‑the‑art technology for measuring...SeniorWorldwideRelocation package$175k - $250k
.... As the only vertically integrated AI infrastructure company built from the... ...Crusoe Cloud is seeking a Sr. to Senior Staff level Solutions Engineer to work closely with our most strategic... ...) on Kubernetes—especially for inference and model training workflows. Hands...SeniorFull timeTemporary workWork at office$218k - $273k
Scale AI is the data foundation for AI, helping organizations build and deploy... ...into reliable, production-grade systems that drive real economic value. Our... ...many customers. About the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General Agents team, you...SeniorFull timeContract workFor contractorsFor subcontractorWork at office- A prominent AI organization is seeking a Senior Staff Software Engineer to shape the technical direction of its Claude API. This high-impact role involves leading... ...experience with strong expertise in distributed systems and a proven ability to influence and lead technical...SeniorFlexible hours
$248.4k - $310.5k
A leading AI technology firm is seeking a Staff Software Engineer for their Enterprise GenAI platform. The ideal candidate will have over 7 years of experience... ...-versed in software engineering and large-scale systems. Responsibilities include owning new product areas...Senior- Stripe in New York, NY, is seeking a Senior Staff Engineer for the Merchant Experience team. This role... ..., ensuring quality and integration of AI technologies. Ideal candidates have 10-... ...knowledge of both frontend and backend systems. This position supports hybrid work,...Senior
$288k - $321k
Gusto is seeking a Staff Machine Learning Engineer (MLE) in New York City to design and develop a scalable AI platform. The role involves leading technical strategy, collaborating... ...have over 12 years of experience in AI/ML systems deployment, strong Python skills, and a...SeniorRemote job- A leading AI infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-source projects. Ideal candidates will have over 5 years of experience in writing high-quality code and familiarity with...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff Engineer, AI Inference Systems. Be the first to apply!
- assistant chief engineer New York, NY
- technology administrator New York, NY
- project engineer assistant project manager New York, NY
- staff security engineer New York, NY
- engineering aide New York, NY
- senior staff systems engineer New York, NY
- staff design engineer New York, NY
- research assistant engineering New York, NY
- staff data engineer New York, NY
- assistant engineering manager New York, NY

