Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer - Agent Frameworks & Intelligent Systems

Programmers.io

Role Summary




We are looking for a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems that can reason, plan, and act autonomously. The role requires strong Python engineering expertise and hands-on experience with modern agent frameworks, along with a solid understanding of data platforms and scalable architectures.




Key Responsibilities




Agent & AI System Development




Design and build agent-based systems using frameworks such as LangChain, LangGraph, or similar
Develop intelligent components capable of reasoning, planning, and executing tasks autonomously
Implement advanced cognitive patterns such as ReAct (Reasoning + Acting)
LLM Capabilities & Enhancements




Develop and integrate memory, tool usage, and context management capabilities (MCP)
Build systems that leverage tool calling, chaining, and orchestration of LLM workflows
Collaborate with prompt engineers to enhance model responses and performance
Engineering & Development




Write high-quality, scalable code using Python (including async programming)
Build and maintain APIs and microservices for AI/agent-based applications
Ensure systems are efficient, reliable, and production-ready
Guardrails & Responsible AI




Design and implement guardrails and safety mechanisms for LLM-driven systems
Ensure robust handling of edge cases, failure scenarios, and unintended outputs
Data & Platform Integration




Work with modern data platforms such as:
Snowflake
Databricks
Lakehouse architectures
Integrate AI solutions with enterprise data pipelines and systems




Skills: Digital : Artificial Intelligence(AI)~Digital : Snowflake~Digital : Databricks~AI Agents
Experience Required: 8-10
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer - Agent Frameworks & Intelligent Systems in New York, NY vacancy
  •  ...marketing agency is seeking an Associate Director, AI Engineer in New York to develop innovative AI products. The...  ...demands strong Python skills and experience with LLM frameworks, focusing on designing multi-agent systems and collaborating with teams to deliver high-quality... 
    Suggested

    Dentsu Aegis Network

    New York, NY
    5 days ago
  • thecompany.com is seeking engineers to build and productionize AI systems that go beyond demos, including...  ...conversational AI, RAG pipelines, and agent architectures on AWS Bedrock...  ...and deploy production-grade LLM apps, orchestrate agent frameworks like LangChain, LangGraph, or... 
    Suggested
    Remote job

    United States Digital Space LLC

    New York, NY
    4 days ago
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously...  ..., hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions... 
    Suggested

    2T Consulting

    New York, NY
    5 days ago
  • $152k - $241.5k

     ...into the unlimited potential of AI to define the next era of...  ...passionate about building reliable systems software for cloud-scale GPU infrastructure...  ...looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence team and build agent-side systems that collect GPU... 
    Suggested
    Full time
    Local area
    Remote work

    Nvidia

    New York, NY
    2 days ago
  • $180k - $250k

     ...client, an early-stage AI startup, are...  ...Founding Applied AI Engineer to join their team...  ...and build the intelligence layer that powers...  ...personalisation, recommendation systems and external APIs,...  ...evaluation frameworks. ~Define what is...  ...systems, with pre-LLM or hybrid systems... 
    Suggested
    Full time

    Alldus International Consulting Ltd

    New York, NY
    more than 2 months ago
  • $200k - $300k

     ...Job Description Job Description Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow Snapshot...  ...agent behavior. Create scalable testing and evaluation frameworks incorporating A/B testing, regression testing,... 
    Permanent employment
    Full time
    Relocation
    Visa sponsorship

    HireNow Staffing

    New York, NY
    3 days ago
  • Scale AI is shaping the future of enterprise AI with frontier agents deployed across diverse workflows. You will design, evaluate, and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, and traditional ML, working directly with... 

    Front Door Defense

    New York, NY
    3 days ago
  • $132k - $198.07k

     ...Machine Learning Engineer III - AI Agent Engineer will oversee...  ...sophisticated machine learning systems. They will...  ...(RAG), orchestration frameworks, and enterprise integrations...  ..., and optimize intelligent agents capable of planning...  ...Generative AI, LLM, RAG, Copilot, or Agentic... 
    Traineeship
    Local area
    Remote work

    Mount Sinai Health System

    New York, NY
    17 days ago
  • $165k - $260k

    Senior Applied AI Engineer - Artificial Intelligence Location New York Business Area Engineering...  ...low latency since 2009. We build AI systems to help process and organize the...  ...Language Model training and fine-tuning frameworks such as PyTorch, Huggingface or... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  •  ...Markets - GenAI / Agentic Systems, Infosys...  ...Services Consultant with AI experience to design...  ...with experience in LLM application development, agent orchestration, and data...  ...workflows using frameworks such as LangChain /...  ...applicationsImplement prompt engineering, evaluation... 
    Full time
    Temporary work
    Work experience placement

    Infosys Technologies

    New York, NY
    1 day ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been...  ...build. Team Description: The Intelligent Foundations and Experiences (IFX)... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago
  • We are seeking an experienced AI Engineer with strong expertise in...  ...record of building scalable AI systems and working in agile, distributed...  ...solutions Build and deploy LLM-based and agentic AI applications...  ...Expertise ML Libraries & Frameworks: TensorFlow, PyTorch, Keras,... 

    Veriipro

    New York, NY
    7 days ago
  • $197.3k - $225.1k

    Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been...  .... Team Description: The Intelligent Foundations and Experiences (... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $286.2k

     ...degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a...  ...and supporting complex AI systems. We prefer demonstrated...  ...and ML technologies such as LLM inference, similarity search...  ...banking for good. Our Intelligent Foundations and Experiences... 
    Full time

    Capital One

    New York, NY
    4 days ago
  •  ...is seeking a Senior Staff Security Engineer focused on AI Security in New York. You will be the...  ...at the intersection of artificial intelligence and security, guiding guardrails...  ...tooling. You will design controls for LLM-integrated systems, own the AI security across the... 

    P2P

    New York, NY
    5 days ago
  •  ...experience in AI development to...  ...build advanced QA Agents. This role is ideal for a QA engineer/developer who...  ...QA agents using frameworks such as LangChain...  ...strategies for LLM-powered test...  ...analysis, and intelligent reporting. Integrate...  ..., CI/CD systems, test management... 
    Contract work

    Accord Technologies Inc

    New York, NY
    3 days ago
  •  ...0 million customers.As an AI Agents Applied Research/Engineering Lead in our The Digital Team...  ...end-to-end lifecycle of LLM-based agents: defining research...  ...; building production systems that perform under real-...  ...governance, and evaluation frameworks.Implement privacy, safety,... 

    JP Morgan Chase

    New York, NY
    1 day ago
  • $139k - $243k

    As a Lead DevOps Engineer reporting to the AVP - Systems and Network Administration, you'll play a critical role in building and operating intelligent automation platforms, AI agents, and orchestration frameworks that support mission-critical systems, engineering workflows... 
    Full time
    Temporary work
    Work at office
    Home office
    Flexible hours
    3 days per week

    NASDAQ OMX

    New York, NY
    1 day ago
  • $153k - $204k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...more at .What You'll Do:The Systems Engineering team owns the host software stack...  ...build and operate the test framework that qualifies every server...  ....Explore AI-native testing — LLM-driven log triage, failure classification... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Live in
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  •  ...Title: Senior AI Engineer - Agentic Systems Location: Plano, TX / NY-NJ / Columbus...  ...role focuses on multi-turn agents, tool calling, RAG, orchestration, evaluation, LLM serving, and secure...  ...building evaluation and regression frameworks. Optimize inference... 
    Contract work

    Emcube Technologies Inc

    New York, NY
    2 days ago
  •  ...Merciv is building the intelligence layer for...  ...landscape — internal systems, social signals, industry...  ...This is applied AI at its most...  ...preprocessing, feature engineering, model training,...  ...Architect RAG systems and LLM integrations that...  ...AI systems, multi‑agent orchestration, NLP... 
    Immediate start
    Home office
    Visa sponsorship
    Flexible hours
    3 days per week

    Merciv

    New York, NY
    5 days ago
  • Recruiting from Scratch is partnering with an early-stage AI healthcare startup in New York to build end-to-end ML systems for medical coding and revenue cycle workflows. We’re seeking a Founding AI Engineer to own core AI systems from data ingestion to production deployment... 
    Work at office

    Recruiting from Scratch

    New York, NY
    2 days ago
  •  ...with cross-functional teams in NYC, building agents that automate real-world knowledge-work tasks. You will become an expert in using AI to accomplish critical jobs and work closely with engineers or deployed intelligence teams to push agents into production. We seek... 

    getbasis.ai

    New York, NY
    3 days ago
  • $182k - $242k

     ...Essential Cloud for AI. Built for...  ...a Software and AI Engineer, IT Systems, you’ll design and develop AI agents and first-party applications...  ...that bring intelligence, automation, and great...  ...from agentics frameworks (using iPaas platforms...  ...Node.js and Go.AI/LLM Experience: Solid... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $185k - $200k

     ...Danaher Business System which makes...  ...The Senior Legal Engineer is responsible...  ...and deploying AI-powered solutions...  ...and agentic AI frameworks. Develop and optimize...  ...) to power intelligent search and...  ...applications using LLM APIs,...  ...architecture, agent/tool-use development... 
    Full time
    Contract work
    Remote work
    Work from home
    Flexible hours

    Danaher Corporation

    New York, NY
    4 days ago
  • $123k - $215.25k

     ...benefitsJob Function: Engineering &...  ...American Express, AI is reshaping the...  ...increasingly on agentic AI: intelligent systems capable of understanding...  ..., retrieval and agent orchestration to...  ...technologies and frameworks for large-scale...  ...practices for LLM and agentic systems... 
    Worldwide
    Visa sponsorship

    American Express

    New York, NY
    1 day ago
  • $157.04k - $235.56k

     ...highly experienced Senior AI/AML Engineering hands on senior...  ...enterprise-grade GenAI and agent-based solutions. This...  ..., and scaling LLM-powered systems using modern agent frameworks, including ADK (Agent...  ...including artificial intelligence, for our legitimate business... 
    Full time

    Citigroup

    New York, NY
    1 day ago
  • $142.32k - $213.48k

     ...ProfessionalCompany: CitiGenerative AI Engineer At Citi, we are...  ...challenges with intelligent solutions. We...  ...), and agentic frameworks. You will be...  ...commercial production systems, not just proofs-...  ..., and advanced LLM/agentic frameworks...  ...build intelligent agents that automate complex... 
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours

    Citigroup

    New York, NY
    2 days ago
  •  ...Number: 25-00639Title: AI EngineerLocation:...  ...Job Title: AI Engineer - Azure AI Foundry & LLM SolutionsLocation:...  ...optimize AI models and intelligent agents using Azure AI Foundry...  ...) and multi-agent systems into real-world...  ...Proficiency in Python and ML frameworks such as PyTorch or... 

    HAN Staffing

    New York, NY
    3 days ago
  • $160k - $310k

     ...Permanent Senior AI Software Engineer (New York City)...  ...how artificial intelligence is used to...  ...Generative AI (GenAI) systems, integrating diverse...  ...datasets for agent-based applicationsCollaborate...  ...emerging tools, frameworks, and...  ...learning, GenAI, or LLM-based solutionsStrong... 
    Permanent employment

    Apollo Solutions

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer - Agent Frameworks & Intelligent Systems. Be the first to apply!