Staff Software Engineer, AI Inference Deployment
$320kAnthropic
Anthropic is seeking a Staff + Senior Software Engineer to design and build deployment infrastructure for inference code. You'll work with a team to ensure rapid, safe production of AI systems. The role requires 5+ years of experience in deployment infrastructure and proficiency with Python or Rust. The mission is to enhance deployment efficiency while navigating resource constraints in production environments. This role offers an annual compensation range from $320,000 to $485,000. #J-18808-Ljbffr Anthropic
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, AI Inference Deployment in New York, NY vacancy
$405k
Staff+ Software Engineer, Inference Runtime Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle,... ...reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...cost low by ensuring new models and deployment targets pay only for their own...SuggestedRemote jobVisa sponsorship$320k
Staff + Senior Software Engineer, Inference Deployment About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group...SuggestedVisa sponsorshipShift work$320k
Staff + Senior Software Engineer, Inference About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The team is a rapidly growing group of researchers, engineers... ...and operate production‑grade deployment pipelines for releasing new...SuggestedWorldwideVisa sponsorship$405k
...trust is essential to ensuring AI benefits the world broadly. We’re looking for a Staff+ Engineer to anchor our Enterprise... ...Partner other teams such as Inference and Platform for foundational... ...security, privacy, and responsible deployment Mentor and develop Staff‑level...SuggestedWork at officeVisa sponsorshipFlexible hours$405k
...seeking an exceptional Senior Staff Software Engineer to join the Claude... ...companies of all sizes to build AI applications with our industry... ...closely with Research, Inference, Platform, Infrastructure,... ...security, and responsible deployment. Mentor and develop Staff‑...SuggestedVisa sponsorship$252k - $315k
...that makes enterprise AI seamless. We are... ...looking for a Senior or Staff Infrastructure Engineer to act as a primary... ...retrieval and inference engines. You won't just... ...'ll be defining the deployment standards for Agentic... ...years of full‑time software engineering experience...Full time- Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that... ...Candidates should have a Bachelor's degree and significant software engineering experience, particularly with distributed...Worldwide
$165k - $330k
...powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...help build the platform engineers turn to ship AI products.... ...to architect, build, and deploy high‑scale production AI... ...working across product, software development, performance...Work experience placementFlexible hours$201k - $264k
Role Overview As a Staff Software Engineer on the Core Infrastructure team at... ...requests across our global legal AI platform. You'll work in... ...reproducible, auditable deployments Mentor engineers and raise... ...that routes millions of daily inference requests while maintaining...Relocation package$320k
Anthropic is searching for a Software Engineer for the Launch Engineering team based in New York. This role involves managing deployment orchestration to ensure automated and efficient movements of validated inference builds into production. Successful candidates will...- Overview Advanced Content Engineering (ACE) is seeking a Staff Software Engineer to lead the... ...production constantly, AI‑assisted development is... ...clusters, OpenSearch/Vespa deployments, DynamoDB tables, networking... ...cost governance for inference workloads as custom model...Temporary workWork at officeFlexible hours2 days per week3 days per week
- ...build the next generation of AI platforms powering advanced NLP... ...for a Site Reliability Engineer to join the Model Serving team... ...responsible for developing, deploying, and operating the AI platform... ...influence latency and throughput of inference. Strong understanding or...Full timeWork experience placementWork at officeLocal areaRemote workHome office
$320k - $405k
...interpretable, and steerable AI systems. We want... ...researchers, engineers, policy experts,... ..., training, and inference to understand workload... ...Significant software engineering experience... ...DNS/service‑mesh deployments) Familiarity with... ..., we expect all staff to be in one of our...Work at officeVisa sponsorshipFlexible hours- ...confidential computing space to identify a Staff Engineer (IC) who can take deep technical... ...confidential computing infrastructure for secure AI and data workloads. This is a hands‑on... ..., and scalability Drive real‑world deployment readiness and operational robustness of...
Harrison Clarke
New York, NY7 hours ago - ...small‑to‑medium businesses hire their first AI employee. Our AI teammates are built using intelligent, agentic workflows deployed on a proprietary platform. We deliver... ...processes alongside human teams. Staff Software Engineer We're looking for a Staff/Principal Software...Full timeRemote work
Infinity Constellation
New York, NY6 hours ago - ...We're building the future of AI‑driven defense - helping companies detect and defend... ...strong founding team includes software engineers, AI researchers, security engineers, and... ...You will own features from concept to deployment. Bring product thinking to engineering...Full time
Stealth Cybersecurity AI Startup
New York, NY2 days ago $165k - $330k
A leading AI company in New York is seeking an Infrastructure Software Engineer to develop and maintain components of their ML inference platform. Responsibilities include implementing Kubernetes deployments, enhancing monitoring systems, and developing infrastructure components...$130k - $250k
...Join to apply for the Staff Software Engineer role at Peregrine Join to apply for the Staff Software... ...you will collaborate directly with our deployment team and users as we iterate to solve... ...insights directly into each article, started with the help of AI. #J-18808-Ljbffr...Full timeWork at officePeregrine Corporation
New York, NY7 hours ago$250k
Edge AI is a production requirement across automotive, robotics... ...it doesn't exist. Every team deploying models on edge devices... .... The Opportunity Build the software and tooling layer that makes... ...models are doing in the field. Inference latency, memory pressure, thermal...$190k - $261.25k
...we are passionate about enabling data and AI teams to solve the world's toughest... ...insights to improve their business. Founded by engineers — and customer obsessed — we leap at... ...Familiarity with service‑oriented architecture, deployment pipelines, and system observability...Databricks
New York, NY7 hours ago$185k - $235k
Senior/ Staff Software Engineer (Ruby/Full-Stack)- hybrid Job type: Full Time · Department: Core Engineering... ...development, from concept through to deployment, ensuring our platform remains robust,... ...outcomes. At Healthie, we are AI-enabled and AI-accelerated in how we build...Full timeWork at officeRemote work3 days per week$188k - $250k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...We are seeking a highly experienced Staff Software Engineer to lead our efforts in building,... ...development teams follow best practices for deployments. Required Qualifications 7+ years of...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hours$500 per month
...We’re looking for experienced engineers to build Anthropic’s cache... ...across GCP, AWS, first-party deployments, and other environments Optimize... ...Significant experience as a software engineer building and... ...source projects Note: Prior AI/ML infrastructure experience...Work at officeHome officeRelocation packageFlexible hours$162k - $190k
...Application Delivery team owns the shared software delivery platform (CI/CD, artifact management) and deployment workflows used by hundreds of engineers across News, Cooking, Games and Audio... ...software. As the Times leans into AI‑assisted and agentic development, Application...Local areaFlexible hours$180k - $250k
...early-stage, venture-backed AI healthcare startup transforming... ...that combines modern software engineering with AI to streamline complex... ...team, they're looking for a Staff Software Engineer to play a... ...decisions from architecture through deployment and ongoing iteration. Help...- ...perform, and win. We started as an AI-powered coaching platform... ...through implementation, deployment, and support Design and build... ...reviews, documentation, and engineering best practices Partner closely... ...expect 10+ years of professional software engineering experience. You...Work at office3 days per week
SIRO Limited
New York, NY6 hours ago $202.4k - $278.3k
...intelligence and search built on proven AI, AlphaSense delivers insights... ...Team: Our diverse Product & Engineering team values innovation,... ...Role: We are looking for a Staff Software Engineer to join the Expert... ...problems. Test, review and deploy code quickly. We deploy over...Remote jobLocal area$240k - $270k
...architecture. Hence, we are growing the engineering team and looking for... ...Design and implement new software features to support our fast... ...software Experience building and deploying robust and secure web... ...product launch included a set of AI tools such asforecasting capabilities...Full timeContract workFor contractorsFor subcontractorWork at officeLocal areaRelocationFlexible hoursSigma Computing
New York, NY1 day ago$170k - $240k
...Description At Commure, we're building the AI Operating System for healthcare, the... ...care is immediate. We move fast, deploy daily, and take full ownership from early... ...administrative processes. We're looking for a Staff Software Engineer who takes ownership end-to-end, moves...Work at officeImmediate startCommure
New York, NY4 days ago- ...driver. We are looking for researchers and software engineers who are passionate about developing... ...evaluation, using deep learning and Gen AI. Lead the development of cutting edge... ...years of hands‑on experience building and deploying machine learning products in production...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, AI Inference Deployment. Be the first to apply!
Related searches
- software integrator New York, NY
- software quality assurance specialist New York, NY
- mid-level software developer New York, NY
- software trainer New York, NY
- quantitative software engineer New York, NY
- ultimate software New York, NY
- software sales executive New York, NY
- software applications developer New York, NY
- remote software sales New York, NY
- senior c# .net software developer New York, NY