Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

Temporary

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in New York, NY vacancy
  • $70 - $75 per hour

     ...Location: New York (Need to come to office for F2F Round and work from office 3 days a week) Requirement ID: 93120-1 Title: AI/LLM Engineer - Agent Frameworks & Intelligent Systems Experience Required: 8-10 Years Pay Range: $70 - $75/hr Duration: 6 months... 
    Suggested
    Work at office
    3 days per week

    Artech

    New York, NY
    3 days ago
  • $197.3k - $225.1k

    Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    10 hours ago
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested
    Temporary work

    2T Consulting

    New York, NY
    25 days ago
  • $197.3k - $225.1k

    Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $229.9k - $286.2k

     ...Requirements: We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related discipline, plus at...  ...experience developing AI and ML technologies such as LLM inference, similarity search and VectorDBs, guardrails, and... 
    Suggested
    Full time

    Capital One

    New York, NY
    18 days ago
  • $350k

     ...Description Our client is a 15-person consumer AI company building an agentic travel...  ...one conversation. We are hiring an AI Engineer to own the conversational intelligence...  ...software engineer • Experience shipping LLM-powered ranking, retrieval, or recommendation... 
    Full time
    H1b

    Our Client

    New York, NY
    10 hours ago
  • $150k - $195k

     ...ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as...  ...Bring Technical: ~3+ years building LLM/agent applications, with experience designing... 
    Full time
    Live in
    Work at office
    Flexible hours

    LangChain

    New York, NY
    10 hours ago
  •  ...StatusNeo is a global AI-native transformation firm helping enterprises design, engineer, and govern AI-led systems with trust at the core. We work with global...  ...and deploy production-ready Generative AI and LLM-powered applications. Build scalable Retrieval... 
    Full time

    Statusneo

    New York, NY
    10 hours ago
  •  ...Job description Rengo AI is building the intelligence layer for fund management — starting...  .... The Role As a Founding AI Engineer , you will build the core system that...  ...over portfolio + market context 5. LLM Systems for Financial Reliability Design... 
    Full time
    Shift work

    Decircle

    New York, NY
    10 hours ago
  • $135k - $200k

     ...missing children, and more. The Role Forward Deployed AI Engineers work directly with customers owning Gen AI strategy and...  ...stakes projects with clients. A day’s work may include building LLM workflows on a large scale, interacting with customers to understand... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package
    Flexible hours

    Palantir Technologies

    New York, NY
    10 hours ago
  • $180k - $240k

     ...Forward Deployed Software Engineer — US / NYC About Indicium AI Indicium AI was Anthropic’s first European launch partner, a Preferred Anthropic...  ...platforms, real-time context retrieval systems, and LLM evaluation architectures. This is a high-agency "builder... 
    Full time
    Flexible hours

    Indicium Ai

    New York, NY
    10 hours ago
  • $175k - $275k

     ...changing that. We're building the agentic AI platform designed exclusively for healthcare...  ...Overview We're looking for an AI Engineer to help build the agentic platform at the...  ...in Python ~ Direct experience shipping LLM-powered or agentic systems in production -... 
    Full time
    Work at office

    Translucent Inc

    New York, NY
    10 hours ago
  • $150k - $275k

     ...cracks. Joyful Health is building the AI-powered financial operating system for healthcare...  ...a talented and ambitious machine learning engineer with 5+ years of experience building...  ...strategies and fine-tuning approaches to optimize LLM behavior for healthcare billing workflows... 
    Full time
    Private practice
    Work at office
    3 days per week

    Joyful Health

    New York, NY
    10 hours ago
  •  ...We build AI agents that actually work in enterprise environments — not prototypes, not demos. We need engineer's who can own the entire agent stack: a production frontend, a robust backend...  ..., a memory architecture that scales, and LLM integrations that are model-agnostic and... 
    Full time
    Temporary work

    Trilagen

    New York, NY
    10 hours ago
  • $107.25k - $214.5k

     ...building the next layer of that platform: AI that can reason across everything we know...  ...trust. We're looking for an Agentic AI Engineer who has already shipped production AI...  ...LoRA, PEFT or similar techniques LLM observability and drift detection Evaluation... 
    Full time

    Catapult Sports

    New York, NY
    10 hours ago
  •  ...Founding AI Engineer (AI + Production) New York City (5 days on-site) · Top of market + equity + benefits TL;DR: Build AI that accelerates...  .... What You've Done ~3–8 years building production ML/LLM systems—RAG, fine-tuning, evals, agent orchestration. You've... 
    Full time
    Immediate start
    Weekend work

    Everstar

    New York, NY
    10 hours ago
  •  ...one of the hardest problems in enterprise AI: AI models are generic but company processes...  ...London. We're a deeply technical team of engineers, AI researchers, and strategists with a...  ...Engineers who have built complex, production LLM-based systems, and want to work directly... 
    Full time

    Edra

    New York, NY
    10 hours ago
  • $90k - $95k

     ...globally. The Role Are you someone who builds AI agents and thinks about how to automate...  ...you. We're looking for a full-time AI Engineer to help shape and execute Fanatics' AI...  ...problems. Familiarity with the modern AI stack: LLM APIs, MCP, agent frameworks (Claude Agent... 
    Full time
    Temporary work
    Work at office

    Fanatics Inc

    New York, NY
    10 hours ago
  • $149.6k - $184k

     ...build with us. The Role Ro is building a team focused on shipping LLM-powered products across the patient experience, clinical operations, and internal tooling. We're hiring an AI Engineer to join a new team we're building from the ground up alongside a Senior... 
    Full time
    Internship
    Local area

    Weight Loss, Better Sex, Fuller Hair, Improved Skin And More...

    New York, NY
    10 hours ago
  • $200k - $300k

    About Farsight Farsight is the agentic AI platform for financial services, currently...  ...Menlo Ventures, supercharged by scalable engineering and AI skills from companies including Amazon...  ...experience deploying machine learning or LLM systems in production. Experience... 
    Full time
    Local area
    Remote work

    Farsight Ai

    New York, NY
    10 hours ago
  •  ...Patlytics:   Patlytics is the fastest-growing AI-native patent intelligence platform,...  ...scale. Our advanced LLMs and generative AI engine—custom-built for intellectual property—...  ...Design, implement, and iterate on multi-step LLM pipelines for patent claim analysis,... 
    Full time
    Immediate start
    Remote work

    Patlytics

    New York, NY
    10 hours ago
  • $155k - $200k

     ...can be part of the disciplined collaboration and transcendent thinking as an AI Engineer at Capstone Investment Advisors here. Responsibilities and Impact: Design and implement AI/ML/LLM-driven models, tools, workflows, and agents Develop, integrate, and... 
    Minimum wage
    Full time

    Capstone Investment Advisors

    New York, NY
    10 hours ago
  • $160k - $220k

     ...THE MISSION Nolla is building AI doctors so that top-quality healthcare is accessible...  ...Catalyst. THE ROLE This is an AI engineering role, not an ML engineering role. You won...  ..., evals, tool calling, RAG, common LLM APIs. You have opinions on when each tool... 
    Full time
    Flexible hours

    Nolla Health

    New York, NY
    10 hours ago
  •  ...We're looking for an experienced AI Engineer to join Optiver's Applied AI and Platform Engineering team. In this role, you' ll design,...  ...~ Experience designing, deploying, and operating production LLM applications, with practical knowledge of model evaluation, prompt... 
    Full time
    Work at office

    Optiver

    New York, NY
    10 hours ago
  •  ...FinTechSelling Points Drive innovation in AI systems in a hybrid work environment....  ...into impactful solutions.Mentor and guide engineering teams, fostering growth and enhancing technical...  ...remote flexibility.Utilize expertise in LLM systems, document intelligence, and ML... 
    Work at office
    Remote work

    Green Key Resources

    New York, NY
    1 day ago
  • $136k - $207.08k

     ...Technology organization, we're building the AI behind dentsu's next-generation platform — frontier AI and real production engineering applied to media, creative, strategy, audiences...  ...and unstructured dataExperience in LLM orchestration libraries (e.g., LangChain, LlamaIndex... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week

    Dentsu

    New York, NY
    9 hours ago
  • $143k - $210k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers...  ...Learn more at .What You'll Do:The Field Engineering organization at CoreWeave supports the...  ....- Experience diagnosing failures in LLM applications and fixing the underlying cause... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $342.7k

     ...Cisco, and we are building best-in-class AI capabilities into our platform, security and...  .... We are looking for a Distinguished Engineer with outstanding technical leadership in the...  ...AI technology and Large Language Models (LLM).Demonstrated experience in leading impactful... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    CISCO Systems

    New York, NY
    4 days ago
  • Role/Responsibilities:We are seeking a NLP engineer for a NLP research team within Point72. The ideal candidate has a track record of developing...  ...derive alphaPost-training models for specific tasksBenchmarking LLM approaches internal tasksWe believe the investment world offers... 
    Worldwide

    Point72

    New York, NY
    1 day ago
  •  ...everything across a business—until generative AI. Today, AI is the number one driver of...  ...change.You Are:As a Snowflake Advanced AI Engineer, you will design, build, and operationalize...  ...working with language models like LLM's APIs and optimizing their usage for specific... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!