Senior AI Platform Engineer: LLM Runtime & Orchestration
MICASA GLOBAL
Micasa Global is seeking a Principal Engineer / Forward Deployed Engineer to architect and build the execution layer powering enterprise AI Agent platforms. You will own LLM runtime services, agent orchestration, distributed systems, model routing, tool execution, and production AI infrastructure. The role emphasizes hands-on development of long-running, asynchronous workloads, scalable APIs, and secure cloud-native AI services at enterprise scale. #J-18808-Ljbffr MICASA GLOBAL
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Platform Engineer: LLM Runtime & Orchestration in New York, NY vacancy
- Qualitate is building the AI-native primary intelligence platform for enterprises, investment firms... ...in real time. The Senior Applied AI Engineer will shape the LLM and retrieval systems at the... ...Moderator. You will own the orchestration layer, optimize latency, and...Senior
$178k - $267k
AlphaSense is looking for a passionate software engineer to join their AI & Search mission in New York. In this role, you'll architect and implement... ...and Django, and familiarity with Kubernetes and cloud platforms. The compensation range is $178,000 - $267,000 USD, plus...Senior$110 - $130 per hour
...client, an investment firm, is seeking a Senior AI Platform Engineer to join their team in New York, NY!... ...capabilities. You will design the runtime and platform services that allow AI... ..., tool/function calling or workflow orchestration. Experience with asynchronous...SeniorEleven Recruiting
New York, NY2 days ago$175k
...SummaryAssured Guaranty is seeking a Senior AI Software Engineer to build production-grade... ...data, and existing platforms. This is a builder role—... ...platform services (orchestration, identity, logging, monitoring... ...experienceExperience building production LLM-based applications (...SeniorAssured Guaranty
New York, NY5 days ago$200k - $230k
...of mission-critical, AI-powered technology and... ...DescriptionDirector, AI Platform EngineeringLocations:... ...Learning, and advanced orchestration on top of our... ...Director of AI Platform Engineering to lead the design, development... ...-agent orchestration, LLM integration,...SuggestedOngoing contractFull timeCasual workWork at officeWorldwideFlexible hoursSS&C Technologies
New York, NY3 days ago$123k - $215.25k
...benefitsJob Function: Engineering &... ...and data capabilities, platforms, and services globally... ...design, and enterprise AI platforms on behalf of... ...including cloud-based LLM platforms such as AWS... ...agents, including agent runtimes, orchestration frameworks, tool integrations...SeniorAmerican Express
New York, NY2 days ago$150k - $220k
...Description Senior AI Engineer Full-time Remote Exclusive... ...collaborate with engineering and platform stakeholders to ship... ...on named agents, including orchestration patterns, hand-offs, planning... ...working directly on LLMs or LLM-powered agents ~ Deep Python...SeniorFull timeRemote workNextDeavor
New York, NY14 hours ago$229.9k - $262.4k
...creating responsible and reliable AI systems, changing banking for... ...-class applied science and engineering teams to deliver our industry... ...customers. Our AI models and platforms empower teams across Capital One... ...and introduce state-of-the-art LLM optimization techniques to...SeniorFull timePart timeLocal areaCapital One
New York, NY1 day ago- Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in New York, focusing on Agentic AI, guardrails, memory, and evaluation. You... ...associates. You will design and deploy AI components, optimize LLM inference, and contribute to governance, observability,...Senior
$100k - $143k
...per week Role OverviewAs a Senior Associate - Full-Stack AI Engineer, you will independently design and deliver platform capabilities and... ...orchestrationframeworks, developer tooling, runtime services, and governance... ..., memory, and workflow orchestration.Design and implement...SeniorLocal area3 days per weekNew York Life Insurance Company
New York, NY1 day ago- SIDRAM TECHNOLOGIES is seeking a Senior Application Security Engineer with hands-on Python development, automation and deep expertise in AI/ML, LLMs and secure software design. The role... ...frameworks, and a track record of mitigating AI/LLM risks within production systems. The...SeniorFull time
- ...Description Job Description Senior Software Engineer - Build Production-Grade AI Agents New York, NY... ...Agent memory and orchestration layers Inter-agent communication... ...Safeguards for LLM failure modes and... ...applications, automation platforms, or agentic systems in...Senior
Liberty Personnel Services, Inc
New York, NYa month ago - Capital One is seeking a Sr. Lead AI Engineer (FM Hosting, LLM Inference) to advance responsible AI across banking. You will partner with engineers, researchers, and product teams to design and scale AI-powered experiences and infrastructure. The role focuses on foundation...Senior
- RaceDog Technologies seeks an exceptional Python Backend + AI/ML Engineer specializing in Agentic AI to join our advanced technology... ...will architect autonomous AI agents, multi-agent workflows, LLM orchestration pipelines, and scalable Python backends. The ideal candidate...SeniorFull time
- ...We are looking for a Senior AI Engineer to own and scale the... ...responsible for production LLM features and the... ...safe to roll back Orchestrate runs through Hatchet... ...including edge or serverless runtimes such as Cloudflare... ...Ruby Labs offers the platform to make it happen....SeniorFor contractorsRemote workFlexible hours
$123k - $215.25k
...benefitsJob Function: Engineering & ArchitectureSchedule... ...and data capabilities, platforms, and services globally... ..., and enterprise AI platforms on behalf of... ...solutions, including LLM, RAG, agentic, and multimodal... ...(e.g., RAG), orchestration layers, and evaluation...SeniorAmerican Express
New York, NY2 days ago$102.5k - $210.6k
...Overview: As an Applied AI Platform Engineer III, you will... ...policy-as-code, container orchestration, IaC, and CI/CD at platform... ...instrumentation for LLM integration (OpenAI,... ...-plane and agent-runtime patterns: model/LLM gateway... ...-level employees to senior leaders, we believe...Visa sponsorshipFlexible hoursDeloitte
New York, NY1 day ago$180k - $240k
Head of AI Platform Engineering Job Details: Location: New York, NY (Hybrid/... ...including model gateways, agent runtimes, orchestration frameworks, tool... ...coaching, and developing senior technical talent.Strong hands... ...with agentic AI systems, LLM platforms, model gateways,...Yoh
New York, NY4 days ago- ...Sr Cloud AI Platform Engineer Contract Hybrid in NYC Must be local. This is not a Full... ...and skills are a good match. As a Senior Engineer, you will help build and enhance... ...preferred. ~ Familiarity with API/LLM gateways ~ Experience with observability...SeniorContract workLocal area
PRI Technology
New York, NY17 days ago $229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) Overview: At Capital One, we are creating responsible and reliable... ..., and more. Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability...SeniorFull timePart timeLocal areaCapital One
New York, NY1 day ago- ...Overview Sr. Lead AI Engineer (FM Hosting, LLM Inference). At Capital One, we are creating responsible and reliable AI systems that are changing... ...deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private...SeniorLocal area
Capital One
New York, NY1 day ago - ...the US. We combine an AI-powered, conversational... ...highly technical Staff Platform Engineer to lead the platform and... ...the secure, multi-tenant runtime that makes delegated AI... ...end to end. Treat the LLM and its tools as... ...best practices, mentor senior and mid-level engineers...Remote work
Felix
New York, NY2 days ago - As the Lead AI Engineer for our next-generation TCO Agent Platform, you will serve as the technical lead... ...the development, orchestration, and governance of an ecosystem... .... You will also have a Senior Software Engineer under... ...-service communication LLM Governance & Tokenomics...
- Bloomberg is building core AI infrastructure to host, deploy, and serve ML models with... ..., and governance. The AI Inference platform leverages KServe and open-source tools to... ...decisions across the platform, mentoring engineers and collaborating with cross-functional teams...Senior
- Harvey, Inc. is building a pioneering AI platform for professional services in the United States. The AI Platform team develops foundation model routing, context management, and evaluation infrastructure to power Harvey's agents. You will design platform-level abstractions...Senior
$160k - $240k
Senior Software Engineer - Data and Platform Tools - Bloomberg Connects Location New York... ...computer vision, generative AI, and agentic systems. We... ...behind our LLM-based and agentic features... ...Containerized workloads and orchestration· Real, current use of AI-...SeniorTemporary workFor contractorsWork experience placementBloomberg
New York, NY1 day ago- Traba is seeking a skilled engineer to develop AI products that enhance our staffing marketplace. You will work on implementing frontier models to automate processes across our platform. With over 5 years of experience in full-stack development, you should have strong...Senior
- Altana is the network for trusted trade. Our AI-powered product network empowers governments and businesses to... ...global economy while keeping trade flowing. The Engineering team is responsible for building platforms, APIs, services, workflows, and architectures for our...SeniorRemote job
- Capital One is seeking an AI Engineer 4 to design, develop, test, and deploy AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation,...Senior
- ...Job Title: Principal AI Engineer – Agentic AI / LLM Location: New York City, NY Work Arrangement... ...engineering, RAG, LLM applications, agent orchestration, data pipelines, evaluation,... ...LangSmith, Langfuse, or equivalent platforms. • Optimize AI applications for:...Full timeH1bVisa sponsorship3 days per week
ApTask
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Platform Engineer: LLM Runtime & Orchestration. Be the first to apply!
Related searches
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer New York, NY
- client platform engineer New York, NY
- platform engineering manager New York, NY