Senior Backend Engineer — AI Platform & LLM Infra
$190k - $261.25kMenlo Ventures
A leading data and AI firm is seeking a skilled engineer to build LLM infrastructure that powers trillions of tokens weekly. The ideal candidate will have over 8 years in backend or infrastructure engineering, with strong skills in Scala, Go, or Python. Responsibilities include improving the efficiency of distributed AI workloads and collaborating with various teams. Databricks offers a competitive salary range of $190,000 to $261,250 USD, plus additional benefits. #J-18808-Ljbffr Menlo Ventures
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer — AI Platform & LLM Infra in New York, NY vacancy
- ...Technical Staff to take ownership of system design and production challenges. The role includes scaling AWS infrastructure, building backend services and APIs, and collaborating with clients on healthcare workflows. Ideal candidates are experienced in Python, Go, and...Senior
Anterior, Inc.
New York, NY2 days ago - ...Vbeyond Corporation is seeking a Senior Backend Engineer in the United States with a focus on distributed systems and production-grade design.... ...include designing microservices at scale and integrating advanced LLM APIs. Expertise in PostgreSQL and Docker deployments is also...Senior
VBeyond
New York, NY20 hours ago $161k - $194k
...t r y ) Software Engineering New York, NY About... ...energy's complexity meets AI's potential. We were... ...the role As a senior backend software engineer... ...Tapestry's Agentic Data Platform you will build a data... ...design and implement LLM-enabled semantic ingestion...SeniorFull timeFlexible hoursX: The Moonshot Factory
New York, NY4 days ago- ...Smartsheet Inc. is seeking an AI Platform Engineer to lead the design of the core infrastructure for AI experiences. Candidates should have 8+ years of software engineering experience, particularly with LLMs, along with strong Python skills and experience with prompt...SeniorFull timeRemote work
Smartsheet
New York, NY4 days ago - ...NationGraph is seeking a Senior Infrastructure and Backend Engineer to own the systems that facilitate rapid growth driven by AI capabilities. You will work closely with the CTO, shaping engineering leadership in our innovative startup environment. This role involves developing...Senior
NationGraph
New York, NY2 days ago - ...A global payments platform startup is seeking a Senior Engineer to join their early team. This role involves reviewing AI-generated backend code, owning production reliability, and making critical infrastructure decisions. Candidates should have over 5 years of backend...Senior
Cartpanda
New York, NY4 days ago - A leading AI innovation firm is seeking a Senior Backend Engineer to develop reliable and secure APIs for their PDF document processing platform. The role emphasizes collaboration with cross-functional teams and offers a flexible work environment in the United States....SeniorRemote workFlexible hours
Kensho
New York, NY5 days ago - ...Highlevel is seeking a Senior Software Engineer to join their WordPress team. In this role, you will shape the experience of their platform by addressing complex frontend and backend challenges. You will have a strong impact on the growth and stability of the platform...Senior
High Level Services
New York, NY2 days ago - ...A leading automation platform is seeking a Senior Software Engineer to build backend systems that influence large customer automation adoption. This role involves working with Python, Django, and AWS in a mid-senior level capacity. The ideal candidate has over 6 years...SeniorRemote work
Crossing Hurdles
New York, NY4 days ago $175k - $235k
...DFINITY is seeking a Senior Backend Software Engineer in San Francisco to develop innovative AI-driven software applications on the Internet Computer. This role emphasizes backend system development using modern technologies like Rust and TypeScript, collaborating closely...SeniorFramework Ventures
New York, NY4 days ago- ...An innovative AI technology company in the United States is seeking a Senior Software Engineer to develop and maintain scalable server architectures for AI Agent solutions... ...should have at least 5 years of experience in backend systems, a relevant degree, and familiarity...SeniorRemote work
Cresta
New York, NY4 days ago $205k - $270k
...A tech company specializing in AI solutions is searching for a Senior Software Engineer to enhance backend server solutions for their AI Agent technologies. The ideal candidate will have over 5 years of experience in backend system architecture and cloud services, strong...SeniorRemote workCresta
New York, NY4 days ago$170k - $200k
...Alumni Ventures is seeking a Senior Backend Engineer focused on AI. This remote position offers a salary of US $170k–200k with equity options. You will design and build shared AI infrastructure, ensuring reliability and performance of AI systems. The ideal candidate has...SeniorRemote workAlumni Ventures
New York, NY2 days ago- ...looking for At Ideaware we’re looking for a Platform Engineer – Senior Tech (Platform) to work for one of our international clients, building core backend systems that power player data,... ...progression, rewards, and leaderboards Leverage AI‑assisted workflows to accelerate...SeniorRemote workFlexible hours
Idea-Ware LLC
New York, NY4 days ago - ...We are looking for a Senior Backend Engineer to join our Legal Tech... ...the next generation of AI-driven litigation ecosystem... ..., and cutting-edge LLM/AI innovation. You’ll... ...verbal‑intelligence platform that brings AI into the... ...practical experience with AI infra, such as: RAG, Agentic...SeniorRemote work
Verbit
New York, NY4 days ago $100 per hour
...Overview Join as a Backend Engineer and help rebuild payments for the $1tn distribution... ..., and leverage cutting-edge LLM technology to transform how... ...’re solving. Who Thrives Here AI-Native: You already use Cursor... ...+, PostgreSQL, Sidekiq, Redis Infra: AWS, Docker, Terraform, CI/CD...SeniorRemote workFlexible hoursMAP SSG Inc
New York, NY4 days ago$175k - $225k
...Senior Backend Engineer In person 5 days/week in San Francisco, Boston, MA, New York. We are looking... ...LangChain's observability and evals platform. You will work on the core services... ...developers to monitor and evaluate their AI applications at scale. While the focus...SeniorWork at officeFlexible hoursLangChain
New York, NY3 days ago$174k - $206k
...United States or Canada. We are seeking a senior backend software engineer to help build and evolve our next-generation Censys Platform. In this role, you’ll develop scalable microservices... ...is no problem for you. Open to using AI to amplify their skills and strengthen...SeniorRemote workWorldwideFlexible hoursCensys
New York, NY1 day ago$145.4k - $195k
...leading entertainment company is seeking a Backend Engineer to design and build backend services that support their streaming platforms. The role requires 5+ years of experience in... ...should be proficient in AWS services and AI-assisted development tools. Join a dynamic...Senior$140k - $160k
...Backend Platform Engineer Boston or NYC Layer Health was founded in 2023 by... ...School. We are building an AI layer that can accurately and... ...everywhere in healthcare. Our LLM-powered platform is solving... ...engineering team on ongoing infra improvements such as end to...Work at officeLayer Health
New York, NY3 days ago$160k - $210k
...Location Type Remote Department Engineering Compensation $160K – $210K... ...created the first truly converged AI workspace, unifying tasks,... ...team focused on core platform capabilities. Uphold the highest... ...Experience working with and designing Backend for Frontend (BFF) patterns....SeniorFull timeWork experience placementRemote workVisa sponsorshipWork visaFlexible hoursClickUp Project Management
New York, NY4 days ago- ...interior design industry through cutting‑edge AI and computer vision technology. With our LiDAR‑... ...concentration in the US and Europe. We are looking for a Senior Backend Engineer to help us build and maintain the internal platform and tooling, supporting business scalability...SeniorWorldwide
Occipital Inc
New York, NY4 days ago $182.3k - $220k
...integrated healthcare platform that connects... ...The Role: As a Senior Software Engineer on the Commerce Team,... ...ll build and maintain backend services that ensure... ...collaboration with product, infra and other development... ...artificial intelligence (AI), to assist with...SeniorLocal areaFlexible hoursRo
New York, NY1 day ago$200k - $250k
...Senior/Staff Backend Engineer (Platform & AI Systems) Recruiting from Scratch is a premier talent firm that focuses... ...modernization to AWS) Develop LLM-powered features for document... ...heavy domains (bonus: legal, fintech, infra, or ops platforms) Preferred...SeniorH1bWork at officeRemote workVisa sponsorship3 days per weekRecruiting from Scratch
New York, NY3 days ago- ...mLabs is seeking a Staff Software Engineer specializing in Backend and AI Infrastructure to work remotely from the US. This role will lead crucial projects involving the core agent runtime and backend systems for high-frequency trading. Responsibilities include developing...SeniorRemote work
MLabs
New York, NY3 days ago $10k
...SQLs come from it. Web Engineering owns this surface and the... ...it. You'll build the platforms that let 9+ marketing teams... ...Kirby Prototyper (AI-assisted landing page creation... ..., and we’re hiring two backend product engineers to... ...%. ~ Comfort with AI/LLM-augmented engineering....SeniorFull timeWork at officeHome officeRelocation packageFlexible hoursRAMP
New York, NY4 days ago$195.8k - $265k
...Senior Backend Product Software Engineer, Bridge FSS & Dash Dropbox 29 July 2025... ...Dropbox is evolving. AI is no longer a differentiator... ...Dropbox’s AI platform and product surface... ..., embeddings, or LLM-based UX patterns. Proven... ...(frontend, backend, infra, ML platform)....SeniorImmediate startRemote workDropbox
New York, NY4 days ago- A leading healthcare technology company is seeking a Senior Backend AI Engineer in New York City. You will design and operate AI systems for a groundbreaking care orchestration platform. Ideal candidates have over 5 years of experience in backend systems, proficiency in...SeniorRemote work
- ...Senior Software Engineer - Backend & AI Infra Focus CVector's mission is to bring real time economic optimization and AI prediction to every energy... ...play a critical role in evolving CVector's core backend platform. You will work on time-series data systems, AI-...SeniorLive inWork at office
CVector Energy
New York, NY3 days ago - ...Senior Backend Engineer (C#) - AI Data Platform About the Role What if your C# expertise could directly shape the infrastructure powering the next generation of AI? We're looking for a Senior Backend Engineer to design and build the data pipelines, annotation...SeniorHourly payOngoing contractContract workFreelanceRemote workFlexible hours
Alignerr
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer — AI Platform & LLM Infra. Be the first to apply!
Related searches
- entry level back-end developer New York, NY
- backend python developer New York, NY
- back end developer internship summer New York, NY
- remote back end developer New York, NY
- java developer backend New York, NY
- back-end developer New York, NY
- senior backend developer New York, NY
- backend software engineer New York, NY
- lead backend developer New York, NY
- client platform engineer New York, NY