Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai/Llm Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms. Roles and Responsibilities Agent & AI System Development Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks. Build intelligent components capable of reasoning, planning, and autonomous task execution. Implement agentic patterns such as ReAct (Reasoning + Acting). Develop multi-step LLM workflows and agent orchestration. LLM Capabilities & Enhancements Implement memory, tool usage, context management, and MCP capabilities. Develop solutions using tool calling, chaining, and workflow orchestration. Work with prompt engineering teams to improve LLM response quality and performance. Optimize LLM applications for scalability, reliability, and cost. Software Engineering Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming. Build and maintain APIs and microservices for AI and agent-based applications. Integrate AI services with enterprise applications and backend systems. Develop production-ready solutions with appropriate testing, monitoring, and error handling. Guardrails & Responsible AI Design and implement guardrails and safety mechanisms for LLM-powered applications. Handle edge cases, failures, hallucinations, and unintended model outputs. Implement appropriate validation, security, and access controls for AI systems. Data & Platform Integration Integrate AI solutions with modern data platforms, including Snowflake and Databricks. Work with Lakehouse architectures and enterprise data pipelines. Enable LLM applications to securely access and leverage enterprise data. Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures. Required Technical Skills 5+ years of experience in software engineering, AI/ML engineering, or a related field. Strong hands-on experience with Python and asynchronous programming. Experience building LLM and generative AI applications. Strong experience with LangChain, LangGraph, or similar agent frameworks. Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP. Experience developing REST APIs and microservices. Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms. Strong understanding of scalable, production-ready software architectures. Knowledge of LLM guardrails, responsible AI, security, and failure handling. Strong problem-solving, communication, and collaboration skills. Preferred Skills Experience with multi-agent systems and agent orchestration. Knowledge of vector databases and RAG architectures. Experience with cloud platforms such as AWS, Azure, or GCP. Familiarity with LLM observability, evaluation, and performance optimization. Experience deploying AI applications in enterprise production environments. 2T Consulting

Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Ai/Llm Engineer in New York, NY vacancy
  • $197.3k - $225.1k

    Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    17 hours ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Customization and Finetuning) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    10 hours ago
  • A leading tech firm in New York is seeking a Senior AI Engineer to join its Equities Technology AI group. This role entails managing the design...  ...will have a strong background in Python, experience with LLM frameworks, and a PhD or Master's with substantial work experience... 
    Suggested
    Work experience placement

    Talent Algo

    New York, NY
    2 days ago
  • Capgemini is seeking a GEN AI Developer to design, develop, and deploy end-to-end AI/...  ...LangChain, PyTorch, TensorFlow). You will build LLM-powered solutions, ML pipelines, and AI-...  ..., collaborating with product and engineering teams to translate strategic requirements... 
    Suggested

    Capgemini

    New York, NY
    17 hours ago
  • United States Digital Space LLC is seeking an experienced AI/LLM Engineer to design, build, and deploy production-ready AI agents powered by Large Language Models. You will work on chat and voice AI solutions, integrating tools, and deploying to cloud environments. The... 
    Remote job
    Full time

    United States Digital Space LLC

    New York, NY
    3 days ago
  • $229.9k - $262.4k

     ...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    more than 2 months ago
  •  ...talent. You will build and improve parts of an AI agent runtime, extend tools, and contribute...  .... The role emphasizes Python proficiency, LLM basics, and debugging across async/services, with mentorship from senior BE/DS engineers and ownership of tasks from end to end. #J... 
    Remote job
    Internship

    United States Digital Space LLC

    New York, NY
    4 days ago
  • Mercury in New York is seeking an experienced software engineer to evolve Command, Mercury's LLM-powered financial assistant. You will design and ship new skills for workflows like sending payments, managing invoices, and understanding cash flow, and own end-to-end capabilities... 

    Jobzhr

    New York, NY
    3 days ago
  • thecompany.com is seeking engineers to build and productionize AI systems that go beyond demos, including live traffic and real users. You'll work on conversational...  ...Azure OpenAI. You'll design and deploy production-grade LLM apps, orchestrate agent frameworks like LangChain,... 
    Remote job

    United States Digital Space LLC

    New York, NY
    17 hours ago
  • $200k - $300k

    About Farsight Farsight is the agentic AI platform for financial services, currently...  ...Menlo Ventures, supercharged by scalable engineering and AI skills from companies including Amazon...  ...experience deploying machine learning or LLM systems in production. Experience... 
    Full time
    Local area
    Remote work

    Farsight Ai

    New York, NY
    17 hours ago
  • $149.6k - $184k

     ...build with us. The Role Ro is building a team focused on shipping LLM-powered products across the patient experience, clinical operations, and internal tooling. We're hiring an AI Engineer to join a new team we're building from the ground up alongside a Senior... 
    Full time
    Internship
    Local area

    Weight Loss, Better Sex, Fuller Hair, Improved Skin And More...

    New York, NY
    17 hours ago
  •  ...Patlytics:   Patlytics is the fastest-growing AI-native patent intelligence platform,...  ...scale. Our advanced LLMs and generative AI engine—custom-built for intellectual property—...  ...Design, implement, and iterate on multi-step LLM pipelines for patent claim analysis,... 
    Full time
    Immediate start
    Remote work

    Patlytics

    New York, NY
    17 hours ago
  •  ...about sciemo Sciemo builds AI for consumer goods: technology that helps businesses make...  ...our products. We are looking for an AI Engineer to build and deploy the generative and...  ...Engineer, you will design, build, and ship the LLM and agent systems that power our products.... 
    Full time
    Work at office
    Remote work

    Sciemo

    New York, NY
    17 hours ago
  • $155k - $200k

     ...can be part of the disciplined collaboration and transcendent thinking as an AI Engineer at Capstone Investment Advisors here. Responsibilities and Impact: Design and implement AI/ML/LLM-driven models, tools, workflows, and agents Develop, integrate, and... 
    Minimum wage
    Full time

    Capstone Investment Advisors

    New York, NY
    17 hours ago
  • $150k - $275k

     ...cracks. Joyful Health is building the AI-powered financial operating system for healthcare...  ...a talented and ambitious machine learning engineer with 5+ years of experience building...  ...strategies and fine-tuning approaches to optimize LLM behavior for healthcare billing workflows... 
    Full time
    Private practice
    Work at office
    3 days per week

    Joyful Health

    New York, NY
    17 hours ago
  •  ...We build AI agents that actually work in enterprise environments — not prototypes, not demos. We need engineer's who can own the entire agent stack: a production frontend, a robust backend...  ..., a memory architecture that scales, and LLM integrations that are model-agnostic and... 
    Full time
    Temporary work

    Trilagen

    New York, NY
    17 hours ago
  • $175k - $275k

     ...changing that. We're building the agentic AI platform designed exclusively for healthcare...  ...Role Overview We're looking for an AI Engineer to help build the agentic platform at the...  ...in Python ~ Direct experience shipping LLM-powered or agentic systems in production —... 
    Full time
    Work at office

    Translucent Inc

    New York, NY
    17 hours ago
  •  ...better decisions. Now, we are building an AI-native platform to redefine how teams work...  ...infrastructure. As our first AI Engineer, you will play a pivotal role in architecting...  ...Familiarity with Claude Enterprise or other secure LLM environments. Experience designing... 
    Full time
    Flexible hours

    Quantifi

    New York, NY
    17 hours ago
  • $180k - $240k

    Forward Deployed Software Engineer — US / NYC About Indicium AI Indicium AI was Anthropic’s first European launch partner, a Preferred Anthropic Partner...  ...platforms, real-time context retrieval systems, and LLM evaluation architectures. This is a high-agency "builder... 
    Full time
    Flexible hours

    Indicium Ai

    New York, NY
    17 hours ago
  • $160k - $220k

     ...THE MISSION Nolla is building AI doctors so that top-quality healthcare is accessible...  ...Catalyst. THE ROLE This is an AI engineering role, not an ML engineering role. You won...  ..., evals, tool calling, RAG, common LLM APIs. You have opinions on when each tool... 
    Full time
    Flexible hours

    Nolla Health

    New York, NY
    17 hours ago
  •  ...We're looking for an experienced AI Engineer to join Optiver's Applied AI and Platform Engineering team. In this role, you' ll design,...  ...~ Experience designing, deploying, and operating production LLM applications, with practical knowledge of model evaluation, prompt... 
    Full time
    Work at office

    Optiver

    New York, NY
    17 hours ago
  • $135k - $200k

     ...missing children, and more. The Role Forward Deployed AI Engineers work directly with customers owning Gen AI strategy and...  ...stakes projects with clients. A day’s work may include building LLM workflows on a large scale, interacting with customers to understand... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package
    Flexible hours

    Palantir Technologies

    New York, NY
    17 hours ago
  •  ...Job description Rengo AI is building the intelligence layer for fund management — starting...  .... The Role As a Founding AI Engineer , you will build the core system that...  ...over portfolio + market context 5. LLM Systems for Financial Reliability Design... 
    Full time
    Shift work

    Decircle

    New York, NY
    17 hours ago
  •  ...transform critical institutions with applied AI. We care that industries that power the...  ...together: Forward-deployed expertise in engineering, product, and research Mosaic, our in-...  ...Bonus if you have Hands-on experience with LLM tooling (LangGraph, Mastra, Agents SDK,... 
    Full time

    Percepta

    New York, NY
    17 hours ago
  • $200k - $300k

     ...NPS higher than the iPhone’s, and profitability. The Role AI Engineers at Rilla are redefining how humans interact with machines—using...  .... What We Require Experience building and deploying AI/LLM systems in production Familiarity with tools that power today... 
    Full time
    Relocation package

    Rilla

    New York, NY
    17 hours ago
  • $107.25k - $214.5k

     ...building the next layer of that platform: AI that can reason across everything we know...  ...trust. We're looking for an Agentic AI Engineer who has already shipped production AI...  ...LoRA, PEFT or similar techniques LLM observability and drift detection Evaluation... 
    Full time

    Catapult Sports

    New York, NY
    6 hours ago
  •  ...one of the hardest problems in enterprise AI: AI models are generic but company processes...  ...London. We're a deeply technical team of engineers, AI researchers, and strategists with a...  ...Engineers who have built complex, production LLM-based systems, and want to work directly... 
    Full time

    Edra

    New York, NY
    17 hours ago
  • $90k - $95k

     ...globally. The Role Are you someone who builds AI agents and thinks about how to automate...  ...you. We're looking for a full-time AI Engineer to help shape and execute Fanatics' AI...  ...problems. Familiarity with the modern AI stack: LLM APIs, MCP, agent frameworks (Claude Agent... 
    Full time
    Temporary work
    Work at office

    Fanatics Inc

    New York, NY
    17 hours ago
  •  ...Founding AI Engineer (AI + Production) New York City (5 days on-site) · Top of market + equity + benefits TL;DR: Build AI that accelerates...  .... What You've Done ~3–8 years building production ML/LLM systems—RAG, fine-tuning, evals, agent orchestration. You've... 
    Full time
    Immediate start
    Weekend work

    Everstar

    New York, NY
    17 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai/Llm Engineer. Be the first to apply!