Senior AI Platform Engineer Model Routing & Infra
$220k - $300kHarvey
Harvey is looking for an experienced AI Platform Engineer to join their team in New York. In this role, you will design and build platform-level systems that improve all of Harvey's agent-powered products. You should have over 5 years of backend systems experience, with a focus on AI/ML engineering, and the ability to navigate ambiguity while owning your work. The position offers a competitive salary range of $220,000 - $300,000, reflecting the value of expertise in AI systems. #J-18808-Ljbffr
- ...is a leading technology platform in the financial... ...combining proprietary AI, deep domain expertise,... ...are seeking a Software Engineer, AI/ML (Infrastructure... ...retrieval pipelines, and model integrations. Your work... ...state management, tool routing, retries, failure handling...Senior
$216k - $270k
...As a Software Engineer on the ML Infrastructure team,... ...will design and build platforms for scalable, reliable,... ...integrate and optimize models for production and research... ...with LLM serving and routing fundamentals (e.g. rate... ...is to develop reliable AI systems for the world's...SeniorFull time- ...Smartsheet Inc. is seeking an AI Platform Engineer to lead the design of the core infrastructure for AI experiences. Candidates should have 8+ years of software engineering experience, particularly with LLMs, along with strong Python skills and experience with prompt...SeniorFull timeRemote work
- ...TwinThread in Jersey City, NJ is looking for a Senior Lead Software Engineer to enhance and deliver market-leading technology products. This role involves architecting cloud infrastructure optimized for AI workloads and developing secure, high-quality code. Applicants...Senior
- ...Accrete is seeking a Senior DevOps Engineer in New York to design and manage scalable cloud infrastructure. This senior role involves automating... ...has over 5 years of experience, expertise in cloud platforms like AWS, and a strong background in CI/CD processes. The position...SeniorFlexible hours
$110k - $140k
...accessible for enterprises and AI innovators around the world.... ...skilled and experienced AI Platform Engineer to own the strategy and execution... ...and curate open‑source models — Llama, Mistral, Qwen, DeepSeek... ...model lifecycle: versioning, A/B routing, quantization tradeoffs, and...SeniorWork at officeImmediate startRemote workFlexible hours$124k - $177k
...per week Role Overview We are looking for a Senior AI Platform Security Engineer who lives on GCP and can own the security architecture... ...architectures. Experience with Cribl Stream or similar log routing technologies integrated with Elasticsearch....SeniorLocal area3 days per week$171k - $260k
...Senior Lead Software Engineer - AI Platform engineer Jersey City, NJ, United States Job Information Job Identification... ...of cloud computing delivery models (IaaS, PaaS, SaaS) and deployment models... ..., IaaS, Storage, Security, and routing/switching technologies. Preferred Qualifications...SeniorFull timeFor contractors$121.4k - $168k
...Engine is seeking a Senior Software Engineer specializing in DevOps/Infrastructure. This remote role focuses... ...plane and partnering with embedded infra engineers. The ideal candidate has 8+... ...equity. Employees enjoy a hybrid work model and various benefits designed for...SeniorRemote work$120k - $200k
BIP is seeking experienced AI Systems Engineers in New York to develop AI infrastructure solutions. The ideal candidates have over 8 years... .... This role includes responsibilities like enhancing model routing frameworks, collaborating on AI standards, and ensuring security...SeniorRemote job$240k - $330k
...Framework Ventures is seeking a Senior Engineering Manager for Infra and Platform to lead teams in building sophisticated distributed systems. The ideal candidate will have over 7 years of software development experience, with a strong background in engineering management...SeniorFlexible hours- ...About the Job We are looking for an experienced AI Model Engineer with deep expertise in kernel development, model optimization, fine‑tuning, and GPU acceleration. The engineer will extend the inference framework to support inference and fine‑tuning for language models...SeniorRemote work
- ...Neurawork GmbH & Co. KG sucht einen erfahrenen Engineer zur Entwicklung unserer AI-Agent-Plattform für regulierte Branchen. Du wirst an einer performanceorientierten Lösung arbeiten und maßgeblich an der Architektur beteiligt sein. Voll-remote ist möglich, allerdings ist...SeniorRemote work
$250.8k - $286.2k
...Capital One National Association in New York is hiring a Sr. Lead AI Engineer to create responsible AI solutions. The candidate will deliver AI-powered products, support complex AI systems, and contribute to the long-term roadmap of AI technology. A Bachelor’s degree and...Senior- ...Softswiss is looking for a Senior Python Developer to join its AI Software Delivery team. The role involves designing AI-enabled solutions, including RAG systems and MCP integrations. Candidates should have a minimum of 7 years of professional experience, deep Python...Senior
- ...A technology consulting firm in Jersey City seeks an AI Operations Platform Consultant with extensive experience in deploying and managing large... ...in Triton Inference Server, TensorRT-LLM, and optimizing models for production. This role is oriented towards maintaining operational...Senior
$160k - $240k
...Bloomberg in New York is looking for a Senior Software Engineer specializing in AI Platform Engineering. This role involves developing cloud-native solutions to support Bloomberg Law’s sophisticated legal tech platform, focusing on automation and analytics. The ideal...Senior- ...Provectus is seeking a senior hands-on engineer to take ownership of a sophisticated AI platform in production. This role entails maintaining and extending a complex system... .... This position offers a remote-first work model, annual performance bonuses, and comprehensive...SeniorRemote work
- ...Capital One National Association in New York is seeking a Distinguished AI Engineer to lead the development of a Generative AI Platform. You will partner with cross-functional teams to design frameworks and products that redefine customer interactions. The ideal candidate...Senior
- ...A leading AI procurement firm is seeking a Senior AI Platform Engineer to build and scale their core platform. The role requires strong backend development skills, proficiency in Node.js and React, and experience with AI systems. You'll work alongside founding engineers...SeniorRemote work
- ...Halogen Engineering Group, Inc is seeking an experienced Platform Engineer to advise and support the design of AI-enabling infrastructure. This role requires a strong technical background and a passion for AI. Ideal candidates will have at least 12 years of experience...Senior
- ...A leading healthcare AI company in New Jersey is seeking a skilled engineer to build the core platform infrastructure that powers healthcare AI products. You will design scalable... ...opportunity for real impact in healthcare with a hybrid or remote work model. #J-18808-Ljbffr...SeniorFull timeRemote work
$150k - $220k
...Feedinkoo is seeking a Product Engineer to join their remote team. This role involves designing and implementing AI-powered interfaces that save providers documentation time. The ideal candidate has a strong background in modern web architecture and experience working...SeniorRemote workWork from homeFlexible hours- ...Improvado is seeking a Senior AI Engineer to join our Platform Team in the United States. In this role, you will own critical parts of our data extraction and pipeline infrastructure, working with modern AI tooling to scale our platform and solve infrastructure challenges...SeniorRemote work
- ...Supernal is seeking a Senior AI Platform Engineer to lead software delivery for AI Employee implementations. As part of this remote role, you will design and build core software systems while ensuring technical delivery and client success. The ideal candidate has at least...SeniorRemote work
$160k - $240k
...Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems...Senior- ...A technology transformation firm in New York seeks a Senior Platform Engineer to build core infrastructure for their AI systems. The role includes designing complex workflows, collaborating closely with customers, and evolving their proprietary toolkit, Mosaic. Candidates...Senior
- ...CVS Health in Kentucky is seeking a Senior Manager for AI LaunchPad. This role involves leading AI and software engineering teams and defining a robust strategy for CVS Health's AI platform. You will be responsible for ensuring cross-functional alignment and driving operational...SeniorFull time
$170k - $230k
...Athelas is looking for professionals to join their Air AI team focused on building AI solutions that integrate directly into clinical workflows. You will leverage cutting-edge technologies to deliver intelligent, automated experiences for clinicians and patients. The...Senior- ...Chainalysis Inc. is looking for a full-stack engineer to design and implement an AI-driven agent platform. You will own the full lifecycle of system development, from frontend to backend, ensuring robust performance and security. Candidates should have experience with...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Platform Engineer Model Routing & Infra. Be the first to apply!
- senior ai engineer New York, NY
- ai ml engineer New York, NY
- ai engineer remote New York, NY
- ai engineer New York, NY
- ai prompt engineer New York, NY
- ai developer New York, NY
- ai research engineer New York, NY
- machine learning ai engineer New York, NY
- client platform engineer New York, NY
- platform engineer New York, NY

