Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Platform Engineer Model Routing & Infra

$220k - $300k

Harvey

Harvey is looking for an experienced AI Platform Engineer to join their team in New York. In this role, you will design and build platform-level systems that improve all of Harvey's agent-powered products. You should have over 5 years of backend systems experience, with a focus on AI/ML engineering, and the ability to navigate ambiguity while owning your work. The position offers a competitive salary range of $220,000 - $300,000, reflecting the value of expertise in AI systems. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Platform Engineer Model Routing & Infra in New York, NY vacancy
  •  ...is a leading technology platform in the financial...  ...combining proprietary AI, deep domain expertise,...  ...are seeking a Software Engineer, AI/ML (Infrastructure...  ...retrieval pipelines, and model integrations. Your work...  ...state management, tool routing, retries, failure handling... 
    Senior

    Murphy Talent Group

    New York, NY
    2 days ago
  • $216k - $270k

     ...As a Software Engineer on the ML Infrastructure team,...  ...will design and build platforms for scalable, reliable,...  ...integrate and optimize models for production and research...  ...with LLM serving and routing fundamentals (e.g. rate...  ...is to develop reliable AI systems for the world's... 
    Senior
    Full time

    Scale AI

    New York, NY
    9 days ago
  •  ...Smartsheet Inc. is seeking an AI Platform Engineer to lead the design of the core infrastructure for AI experiences. Candidates should have 8+ years of software engineering experience, particularly with LLMs, along with strong Python skills and experience with prompt... 
    Senior
    Full time
    Remote work

    Smartsheet

    New York, NY
    6 days ago
  •  ...TwinThread in Jersey City, NJ is looking for a Senior Lead Software Engineer to enhance and deliver market-leading technology products. This role involves architecting cloud infrastructure optimized for AI workloads and developing secure, high-quality code. Applicants... 
    Senior

    Aumni

    Jersey City, NJ
    2 days ago
  •  ...Accrete is seeking a Senior DevOps Engineer in New York to design and manage scalable cloud infrastructure. This senior role involves automating...  ...has over 5 years of experience, expertise in cloud platforms like AWS, and a strong background in CI/CD processes. The position... 
    Senior
    Flexible hours

    Accrete.AI

    New York, NY
    3 days ago
  • $110k - $140k

     ...accessible for enterprises and AI innovators around the world....  ...skilled and experienced AI Platform Engineer to own the strategy and execution...  ...and curate open‑source models — Llama, Mistral, Qwen, DeepSeek...  ...model lifecycle: versioning, A/B routing, quantization tradeoffs, and... 
    Senior
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Vultr

    New York, NY
    6 days ago
  • $124k - $177k

     ...per week Role Overview We are looking for a Senior AI Platform Security Engineer who lives on GCP and can own the security architecture...  ...architectures. Experience with Cribl Stream or similar log routing technologies integrated with Elasticsearch.... 
    Senior
    Local area
    3 days per week

    New York Life

    New York, NY
    2 days ago
  • $171k - $260k

     ...Senior Lead Software Engineer - AI Platform engineer Jersey City, NJ, United States Job Information Job Identification...  ...of cloud computing delivery models (IaaS, PaaS, SaaS) and deployment models...  ..., IaaS, Storage, Security, and routing/switching technologies. Preferred Qualifications... 
    Senior
    Full time
    For contractors

    Aumni

    Jersey City, NJ
    2 days ago
  • $121.4k - $168k

     ...Engine is seeking a Senior Software Engineer specializing in DevOps/Infrastructure. This remote role focuses...  ...plane and partnering with embedded infra engineers. The ideal candidate has 8+...  ...equity. Employees enjoy a hybrid work model and various benefits designed for... 
    Senior
    Remote work

    Engine Co.

    New York, NY
    6 days ago
  • $120k - $200k

    BIP is seeking experienced AI Systems Engineers in New York to develop AI infrastructure solutions. The ideal candidates have over 8 years...  .... This role includes responsibilities like enhancing model routing frameworks, collaborating on AI standards, and ensuring security... 
    Senior
    Remote job

    BIP

    New York, NY
    3 days ago
  • $240k - $330k

     ...Framework Ventures is seeking a Senior Engineering Manager for Infra and Platform to lead teams in building sophisticated distributed systems. The ideal candidate will have over 7 years of software development experience, with a strong background in engineering management... 
    Senior
    Flexible hours

    Framework Ventures

    New York, NY
    6 days ago
  •  ...About the Job We are looking for an experienced AI Model Engineer with deep expertise in kernel development, model optimization, fine‑tuning, and GPU acceleration. The engineer will extend the inference framework to support inference and fine‑tuning for language models... 
    Senior
    Remote work

    Framework Ventures

    New York, NY
    6 days ago
  •  ...Neurawork GmbH & Co. KG sucht einen erfahrenen Engineer zur Entwicklung unserer AI-Agent-Plattform für regulierte Branchen. Du wirst an einer performanceorientierten Lösung arbeiten und maßgeblich an der Architektur beteiligt sein. Voll-remote ist möglich, allerdings ist... 
    Senior
    Remote work

    Neurawork GmbH & Co. KG

    New York, NY
    5 days ago
  • $250.8k - $286.2k

     ...Capital One National Association in New York is hiring a Sr. Lead AI Engineer to create responsible AI solutions. The candidate will deliver AI-powered products, support complex AI systems, and contribute to the long-term roadmap of AI technology. A Bachelor’s degree and... 
    Senior

    Capital One National Association

    New York, NY
    2 days ago
  •  ...Softswiss is looking for a Senior Python Developer to join its AI Software Delivery team. The role involves designing AI-enabled solutions, including RAG systems and MCP integrations. Candidates should have a minimum of 7 years of professional experience, deep Python... 
    Senior

    Softswiss

    New York, NY
    2 days ago
  •  ...A technology consulting firm in Jersey City seeks an AI Operations Platform Consultant with extensive experience in deploying and managing large...  ...in Triton Inference Server, TensorRT-LLM, and optimizing models for production. This role is oriented towards maintaining operational... 
    Senior

    Robotics Technologies LLC

    Jersey City, NJ
    2 days ago
  • $160k - $240k

     ...Bloomberg in New York is looking for a Senior Software Engineer specializing in AI Platform Engineering. This role involves developing cloud-native solutions to support Bloomberg Law’s sophisticated legal tech platform, focusing on automation and analytics. The ideal... 
    Senior

    Bloomberg

    New York, NY
    2 days ago
  •  ...Provectus is seeking a senior hands-on engineer to take ownership of a sophisticated AI platform in production. This role entails maintaining and extending a complex system...  .... This position offers a remote-first work model, annual performance bonuses, and comprehensive... 
    Senior
    Remote work

    Provectus

    New York, NY
    6 days ago
  •  ...Capital One National Association in New York is seeking a Distinguished AI Engineer to lead the development of a Generative AI Platform. You will partner with cross-functional teams to design frameworks and products that redefine customer interactions. The ideal candidate... 
    Senior

    Capital One National Association

    New York, NY
    3 days ago
  •  ...A leading AI procurement firm is seeking a Senior AI Platform Engineer to build and scale their core platform. The role requires strong backend development skills, proficiency in Node.js and React, and experience with AI systems. You'll work alongside founding engineers... 
    Senior
    Remote work

    Negotiateai Inc.

    New York, NY
    5 days ago
  •  ...Halogen Engineering Group, Inc is seeking an experienced Platform Engineer to advise and support the design of AI-enabling infrastructure. This role requires a strong technical background and a passion for AI. Ideal candidates will have at least 12 years of experience... 
    Senior

    Halogen Engineering Group, Inc

    New York, NY
    2 days ago
  •  ...A leading healthcare AI company in New Jersey is seeking a skilled engineer to build the core platform infrastructure that powers healthcare AI products. You will design scalable...  ...opportunity for real impact in healthcare with a hybrid or remote work model. #J-18808-Ljbffr... 
    Senior
    Full time
    Remote work

    Neurex AI Limited

    New York, NY
    3 days ago
  • $150k - $220k

     ...Feedinkoo is seeking a Product Engineer to join their remote team. This role involves designing and implementing AI-powered interfaces that save providers documentation time. The ideal candidate has a strong background in modern web architecture and experience working... 
    Senior
    Remote work
    Work from home
    Flexible hours

    Feedinkoo

    New York, NY
    3 days ago
  •  ...Improvado is seeking a Senior AI Engineer to join our Platform Team in the United States. In this role, you will own critical parts of our data extraction and pipeline infrastructure, working with modern AI tooling to scale our platform and solve infrastructure challenges... 
    Senior
    Remote work

    Improvado

    New York, NY
    3 days ago
  •  ...Supernal is seeking a Senior AI Platform Engineer to lead software delivery for AI Employee implementations. As part of this remote role, you will design and build core software systems while ensuring technical delivery and client success. The ideal candidate has at least... 
    Senior
    Remote work

    Infinity

    New York, NY
    3 days ago
  • $160k - $240k

     ...Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems... 
    Senior

    Bloomberg

    New York, NY
    2 days ago
  •  ...A technology transformation firm in New York seeks a Senior Platform Engineer to build core infrastructure for their AI systems. The role includes designing complex workflows, collaborating closely with customers, and evolving their proprietary toolkit, Mosaic. Candidates... 
    Senior

    Percepta

    New York, NY
    2 days ago
  •  ...CVS Health in Kentucky is seeking a Senior Manager for AI LaunchPad. This role involves leading AI and software engineering teams and defining a robust strategy for CVS Health's AI platform. You will be responsible for ensuring cross-functional alignment and driving operational... 
    Senior
    Full time

    Hispanic Alliance for Career Enhancement

    Brooklyn, NY
    2 days ago
  • $170k - $230k

     ...Athelas is looking for professionals to join their Air AI team focused on building AI solutions that integrate directly into clinical workflows. You will leverage cutting-edge technologies to deliver intelligent, automated experiences for clinicians and patients. The... 
    Senior

    Athelas

    New York, NY
    2 days ago
  •  ...Chainalysis Inc. is looking for a full-stack engineer to design and implement an AI-driven agent platform. You will own the full lifecycle of system development, from frontend to backend, ensuring robust performance and security. Candidates should have experience with... 
    Senior

    Chainalysis Inc.

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Platform Engineer Model Routing & Infra. Be the first to apply!