Senior Software Engineer, Inference
$190k - $225kFull-time
AssemblyAI
Responsibilities
- Design and ship customer-facing APIs for new model capabilities from prototype through launch and iteration.
- Scale inference infrastructure for more than 1 million API users.
- Productionize research techniques into reliable, low-latency, customer-ready systems.
- Partner with researchers, Applied teams, and customers to guide product and research direction.
- Contribute to backend services, inference infrastructure, SDKs, and internal tooling.
Requirements
- Strong backend engineering experience building and supporting machine learning infrastructure and/or production customer-facing APIs.
- Curiosity about AI/ML and sufficient understanding of model behavior to make sound engineering decisions.
- Ability to operate effectively amid ambiguous and shifting research and product timelines.
- Strong collaboration skills across research, applied engineering, and customer-facing stakeholders.
Benefits
- U.S. salary range of $190,000–$225,000 base pay.
- High-ownership, fast-moving environment at a small growth-stage AI company.
- Equal-opportunity workplace with an emphasis on inclusion and diverse backgrounds.
Vacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Inference in New York, NY vacancy
$190k - $225k
...next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2... ...you to apply! About the role: We're hiring a Software Engineer to help turn cutting-edge AI research into products our customers...SeniorFull timeAssemblyai, Inc.
New York, NY1 day ago$184k - $287.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize the GPU-accelerated software that powers today's most sophisticated AI applications. Our team is responsible...Senior- ...at every step of the attack chain. We're hiring a team of engineers to help us scale this from a sharp early product into... ...shipping them without exposing weights Tuning high-throughput inference pipelines that generate structured training data at scale Building...SeniorFull time
Latent Defense
New York, NY1 day ago $225k - $300k
...training data to Fortune 500s like Siemens extracting decades of engineering records, Datalab is where businesses turn to when extraction... ...document-understanding systems. That includes building core inference workflows, creating intuitive UI for complex parsing tasks, and...SeniorFull timeDatalab
New York, NY1 day ago$139k - $220k
...at About the Role We are seeking Senior Software Engineers who specialize across the pillars of Observability to... ...platforms and workloads (e.g., large-scale training and inference, GPU-based infrastructure, MLOps tooling) is a plus....SeniorPermanent employmentFull timeTemporary workCasual workWork at officeRemote workFlexible hoursCoreweave
New York, NY1 day ago$160k - $240k
Senior Software Engineer - AI Inference Location New York Business Area Engineering and CTO Ref # 10050779 Description & Requirements Our team: Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference...SeniorTemporary workFor contractorsWork experience placement$229.9k - $262.4k
...to build world-class applied science and engineering teams to deliver our industry leading capabilities... ..., develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model...SeniorFull timePart timeLocal areaCapital One
New York, NY2 days ago- ...Software Engineer As a Software Engineer, you'll work directly with our Head of Engineering and product team to build the agentic platform... ...agentic infrastructure that supports production-level inference, evaluation, and monitoring Work across the stack to integrate...SeniorTemporary workFlexible hours
Baton, Inc.
New York, NY4 days ago - ...Moody's AI Engineer At Moody's, we unite the brightest minds to... ...Competencies ~5+ years of software engineering experience... ...intelligent data products as a senior contributor within the Digital... ...interfaces, data pipelines, and inference pipelines that support real-time...Senior
Hackajob
New York, NY2 days ago $160k - $200k
...Senior Software Engineer The chemical industry is a $5.2 trillion market that powers 96% of all manufactured goods—from everyday items to advanced... ...-obsessed: Takes the time to understand customer needs, infer patterns, and implement solutions to support clients. AI...SeniorWork at office10 hours per week2 days per weekShelfcycle
New York, NY5 days ago$147.2k - $224.3k
...ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard... ...deep expertise across hardware, software and AI R&D. About Tavily... ...Role We are looking for a Senior Software Engineer to design and...SeniorFull timeContract workTemporary workWork at officeImmediate startRemote workFlexible hoursNebius
New York, NY1 day ago$200k - $400k
...environments. ML Infra: GPU and model‑serving platforms for LLM inference with multi‑provider routing and support for on‑prem/air‑... ...and accurately. About the Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production infrastructure...SeniorFull timeWork at officeLocal areaDecagon
New York, NY1 day ago- ...Senior Software Engineer, Applied AI Take2 AI is hiring a Senior Software Engineer, Applied AI with deep experience applying agentic AI solutions... ...~ Have shipped multi-agent AI solutions with real-time inference to live users at scale ~ Designed and implemented agent...SeniorWork at office
Take2
New York, NY4 days ago $145k - $182k
...Make Your Mark: We're looking for a Senior AI/ML Engineer to design, build, and optimize data... ..., and efficiency. Collaborate with software engineers to integrate machine learning... ...Implement and maintain APIs for model inference. Infrastructure and Environment...SeniorTemporary workWork at officeShift work3 days per weekBlackline Systems Inc
New York, NY4 days ago- ...About We're looking for an experienced infrastructure engineer to help build Stream, a new conversational interface. You will... ...Architect a high-uptime, low-maintenance, and reliable distributed inference system Lead observability and oncall Achieve very low...SeniorSummer work
Sandbar Inc
New York, NY4 days ago - Additional Information All your information will be kept confidential according to EEO guidelines.SeniorFull time
Z Living
New York, NY1 day ago $180k - $250k
...Senior Software Engineer, Agents London, England, United Kingdom; New York, New York, United States; San Francisco, California, United States... ...they need for experimentation, training, and production inference, with security, observability, and control built in. We...SeniorWork at officeWork from homeFlexible hours2 days per weekLightning AI
New York, NY2 days ago$216k - $270k
...platform providing APIs for knowledge retrieval, inference, evaluation, and more. We are seeking a strong Senior Full-Stack Engineer to help us build, scale, and refine our... .... The ideal candidate is deeply grounded in software engineering best practices and experienced...SeniorFull timeScale Ai, Inc.
New York, NY1 day ago- ...company, and they are into creating new hiring culture. They are looking for a software expert who can do majolica by programming. Job Description Job Title: Senior Software Engineer Job Level : Senior Level Job Location: New York, NY Industry: Start Up...SeniorFull time
Raパートナーズ
New York, NY1 day ago - ...on our preferred Apple platforms. We’re looking for talented engineers to help maintain that pledge. Heed our call. We are the Kodiaks... ...PLUSES Porting and optimization experience in Win32 game software for OS X Xcode or Clang experience OpenGL 2.1 and OpenGL...SeniorFull timeContract work
Demo Instance
New York, NY1 day ago - ...the help of high-throughput, growth-minded builders to make it happen. About the role What you'll do As an early engineering hire at Fortuna, you'll play a huge role in shaping the direction and culture of the company. We work fully in-person 5 days a week...SeniorFull timeWork at office
Fortuna Health
New York, NY1 day ago $180k - $300k
...Description Software Engineer, Consensus - Anza Who We Are Anza is a Solana R&D lab pushing the boundaries of blockchain performance and scalability. Anza was founded by experienced executives and core engineers solving the toughest problems in Web3. Crypto ecosystems...SeniorFull timeWorldwideFlexible hoursAnza, Inc.
New York, NY1 day ago- DCS is searching for a performance-driven Senior Software Engineer to support US Army programs. A focus on either Analytical, Financial, logistics, engineering, technical support and/or management of advanced networks for military vehicles and equipment. We're seeking...SeniorFull time
Dcs Corporation
New York, NY1 day ago - ...challenge the status quo, and help game creators thrive on their own terms, read on. About the Role Neon is seeking a Senior Software Engineer who will help lead the development of one of our key work streams. As a design-minded engineer, you'll bring ideas to life...SeniorFull timeWork at officeFlexible hours
Neon Company Ltda
New York, NY1 day ago - ...the AI layer for professional services and software implementation. Think of us as the brain behind the best solution engineers, forward-deployed engineers, and onboarding... ...categories of the decade. Role Overview As a Senior Software Engineer, Product at Auctor, you'll...SeniorFull timeNight shift
Auctor Corporation
New York, NY1 day ago - ...your help adding fuel to the fire. About the Role Polymarket is launching perpetual futures and we're looking for Senior Backend Engineers to own the core systems that make it run. This is backend exchange engineering in the truest sense: low-latency order matching...SeniorFull time
Polymarket
New York, NY1 day ago - ...Homebrew Capital. Built by an obsessive team from MIT, Ramp, Brex, Google, Dropbox, Apple, and more. About the Role As a Senior Software Engineer focused on Payments at Warp, you'll build and own the financial infrastructure that powers Warp. Core ledgering, US and...SeniorFull timeWork at officeFlexible hours
Warp
New York, NY1 day ago - ...Learn about us and our openings here: About the role As a senior software engineer you will report to the CTO and be a core member of our engineering and product team. In this role you’ll lead complex technical projects, mentor junior team members, improve velocity...SeniorFull timeTemporary workWork experience placement
Assembly
New York, NY1 day ago $195k - $235k
...us, check out our blog ! The impact As a member of the engineering team, you will own projects from end-to-end, making decisions... ...understanding customers’ needs. Who you are ~5+ years of full-time software engineering experience, ideally full-stack ~ Expert...SeniorFull timeMethod Financial
New York, NY1 day ago$166.6k - $250.9k
...The year is 1969. The location: Stuttgart, West Germany. Engineers are pacing with strained expressions. They are looking over the Porsche... ..., analyze tradeoffs, make critical decisions, and deliver software that works today and is sustainable for tomorrow. Champion...SeniorFull timeImmediate startMercury
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Inference. Be the first to apply!
Related searches
- software developer positions New York, NY
- senior software engineer remote New York, NY
- software engineer contract New York, NY
- software qa engineer New York, NY
- IT software developer New York, NY
- cybersecurity software engineer New York, NY
- part time software developer remote New York, NY
- junior software developer internship New York, NY
- junior software engineer New York, NY
- software system engineer New York, NY