Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in South Richmond Hill, NY vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Springfield Gardens, NY
    5 days ago
  • Innovaccer is seeking an AI Engineer to join the growing AI team and build production-grade AI systems at scale. Collaborate with product,...  ...design, develop, and deploy AI-powered applications including LLM-based solutions, AI agents, and RAG workflows. The ideal candidate... 
    Suggested

    Innovaccer Inc.

    Brooklyn, NY
    2 days ago
  • Integrated Medical Systems, Inc. is seeking an AI Systems Engineer to design, build, and deploy intelligent AI applications that connect with...  ...scalable agents rather than model training, with a focus on MCP, LLM orchestration, APIs, and tool calling. You will implement MCP... 
    Suggested

    RXinsider LTD.

    Brooklyn, NY
    3 days ago
  • St. Jude Children's Research Hospital in Memphis, TN seeks a Senior AI Engineer to lead advanced AI models and secure HPC infrastructure. This hands-on, onsite role focuses on evaluating, fine-tuning, deploying, and benchmarking models, and enforcing safety guardrails for... 
    Suggested

    Thecentermemphis

    Brooklyn, NY
    2 days ago
  • Hawthorne Gardening Co. is looking for an experienced AI Agent Developer to own the AI agent development lifecycle for Scotts Miracle...  ...in Computer Science and extensive experience in software engineering with a strong focus on generative AI technologies. Competitive... 
    Suggested

    Hawthorne Gardening Co.

    Brooklyn, NY
    4 days ago
  • $125k - $150k

     ...actions, and work in the interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power...  ...and API-driven applications. ~ Experience working with LLM APIs or AI frameworks . ~ Exposure to agent frameworks such... 
    Full time
    Work at office
    Local area

    AEG Presents

    Brooklyn, NY
    21 hours ago
  • $165k - $185k

     ...Taulia will revolutionize fintech. About the Job AI is only as smart as the data it consumes. We are seeking an AI Data Engineer to ensure our agent ecosystem is powered by...  ...understand what makes data "searchable" for an AI. LLM & Agent Familiarity: Practical experience... 
    Remote work
    Flexible hours

    Taulia

    Brooklyn, NY
    1 day ago
  • $118.11k

     ...driven decisions. This role sits on MDA's Engineering team, working alongside our BI and Data...  ...problems and turns them into data products, AI agents, and automation, all while...  ...Segment). Experience evaluating and monitoring LLM systems in production. The range of annual... 
    Full time
    Work experience placement
    Remote work
    Flexible hours

    NextGenEnergyJobs

    Brooklyn, NY
    2 days ago
  •  ...We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python...  ...development using Google ADK or Agent SDK. ~ Strong experience with LLM integration, prompt engineering, and agent orchestration. ~... 

    2T Consulting

    Ridgewood, NY
    5 days ago
  • Capgemini in Charlotte, NC, is seeking a Junior AI & Metadata Engineer to design and build AI-enabled metadata extraction capabilities that automate...  ...discovery and evidence generation. You will leverage AI/LLM technologies to analyze enterprise assets, generate... 

    Capgemini

    Brooklyn, NY
    5 days ago
  • Airbnb is seeking an Operations Engineer to apply AI at the forefront of BizTech's observability and automation. You will leverage LLM-powered triage and scripting to improve incident response and data quality while embedding AI into runbooks. In this role you will build... 
    Remote job

    Nubeero Limited

    Brooklyn, NY
    4 days ago
  • $61k - $66.3k

    # Junior AI & Metadata EngineerColumbiaApply for this job* Permanent* Experienced Professionals...  ...)## About The Role* The AI & Metadata Engineer will design and build AI-enabled metadata...  ....* This role will focus on leveraging AI/LLM technologies to analyze enterprise assets... 
    Permanent employment
    Full time
    Local area
    Flexible hours

    Capgemini

    Brooklyn, NY
    5 days ago
  • $115k

    The AI Customer Insights Engineer builds scalable intelligence workflows that help Seeq’s Customer Success organization act earlier, smarter, and more...  ...workflows to accelerate development. Build lightweight LLM-driven synthesis workflows where valuable. Help elevate development... 
    Contract work
    Temporary work
    Internship
    H1b
    Remote work
    Home office
    Work visa

    Seeq

    Brooklyn, NY
    5 days ago
  •  ...Minneapolis, MN URL: Who We Are Collaboration.Ai is a mission-focused, AI-powered software...  ...the team - mentor mid-level and junior engineers through code reviews, architectural...  ...Amazon S3 AI Integration: Python, FastAPI (LLM-powered service touchpoints) Infrastructure... 
    Contract work

    Mosaec

    Brooklyn, NY
    4 days ago
  • Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on. You will work closely with our... 
    Local area

    Salvo Software LLC

    Brooklyn, NY
    3 days ago
  • $120k - $140k

    Select how often (in days) to receive an alert: Senior Gen AI Software Engineer Requisition ID: 49886 Business Unit: Fitch Group Category: Information...  ...Protocol (MCP), AI-enabled search, vector databases, and LLM integration in real-time enterprise environments. Hands-on... 
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch

    Brooklyn, NY
    2 days ago
  • $140k - $170k

     ...Director of Marketing Ops at Customer.io, and I’m looking for a GTM AI Engineer to help take our AI agents from scrappy prototypes to...  ...including some hands‑on database administration. Familiarity with LLM-based application development: prompt engineering, tool/function... 
    Local area
    Remote work

    Mosaec

    Brooklyn, NY
    3 days ago
  •  ...Joining our team means engaging with expansive engineering teams across Latin America, Philippines...  ...in multiple industries. Position Title: AI-Native Software Engineer Category:...  ..., or customer data. Understanding of AI/LLM concepts and how AI can be integrated into... 

    Lean Solutions Group

    Brooklyn, NY
    4 days ago
  • Apple Inc. in Cupertino, CA, is seeking engineers for the Xcode Intelligence Foundations team....  ...integrate Xcode with intelligent tools and LLM-assisted experiences to empower developers...  ...while addressing ethical considerations of generative AI. #J-18808-Ljbffr Apple Inc.

    Apple Inc.

    Brooklyn, NY
    2 days ago
  • Midi Health is seeking a senior AI/ML engineer to design, build, and ship LLM-powered features across clinical workflows. You will drive evaluation, safety, and integration with patient, clinician, and operations teams in a hybrid environment in the SF Bay Area. The role... 

    Jobzhr

    Brooklyn, NY
    1 day ago
  • $170k - $210k

     ...believe high-trust teams are built in person and scaled remotely. AI-native engineering. We expect every engineer to be fluent with modern AI coding...  ...and evaluation. What You Will Do Design, build, and ship LLM-powered features end-to-end: prompt design, retrieval, tool... 
    Work at office
    Remote work
    Shift work
    2 days per week

    Jobzhr

    Brooklyn, NY
    1 day ago
  •  ...possible through innovation. We’re looking for a highly skilled AI Engineer to design and implement advanced AI solutions that transform...  ...science, Engineering, or related discipline. Project experience in LLM fine‑tuning, reinforcement learning, multi‑agent systems, and... 
    Full time
    Work at office
    3 days per week

    ServiceLink IP Holding Company, LLC

    Brooklyn, NY
    5 days ago
  •  ...driven team and would love for you to join us. AI is a core part of how Dscout operates....  ...under the hood. As an AI Data Engineer you will be at the intersection of ML systems...  ...data modeling frameworks Familiarity with LLM evaluation and observability tooling Exposure... 
    Local area
    Remote work
    Flexible hours
    Shift work

    Neura Market

    Brooklyn, NY
    3 days ago
  •  ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic...  ...We're looking for an Applied AI Engineer to take our growing collection of foundation...  ...time voice AI pipelines (STT, TTS, streaming LLM) Production RAG systems beyond toy... 
    Full time

    Norbert Health

    Brooklyn, NY
    more than 2 months ago
  •  ...Build Your Future The director is a hands-on engineering leader responsible for engineering teams...  ...architected, and increasingly powered by AI-driven capabilities. The incumbent will...  ...and automation (e.g., agentic workflows, LLM-powered tooling, intelligent process... 
    For contractors
    Live in
    Work at office
    Local area

    Relha LLC

    Brooklyn, NY
    4 days ago
  • $8k

     ...an exciting new, fully FUNDED opportunity for a Senior Applied AI Engineer - Software Engineering on our largest PRIME contract. Our team...  ...modern software engineering practices Architect and implement LLM-powered workflows, retrieval-augmented generation (RAG) pipelines... 
    Permanent employment
    Contract work
    Temporary work
    Immediate start
    Flexible hours

    Visionist, Inc.

    Brooklyn, NY
    1 day ago
  • Visionist, Inc. is seeking a Senior Applied AI Engineer - Software Engineering to join our fully funded opportunity on a large PRIME contract...  ..., engineers, and mission stakeholders. You will architect LLM-powered workflows, RAG pipelines, and AI agent capabilities; build... 
    Contract work

    Visionist, Inc.

    Brooklyn, NY
    1 day ago
  • Salesforce is hiring AI Builders as part of our New Grad cohort. You’ll be embedded with...  .... You’ll work in a builder pod with engineers, product and sales, delivering real impact...  ...React, TypeScript, GraphQL, Python, and AI/LLM concepts, ready to grow quickly in a fast-... 

    Jobzhr

    Brooklyn, NY
    3 days ago
  • $81.26k - $98.47k

     ...Position Responsibilities Develop and integrate AI-enabled features within the Veeva CRM/Vault CRM ecosystem — including LLM-based solutions using industry standard...  ...or via AWS Bedrock under the direction of the engineering manager. Support the implementation of AI/ML... 
    Hourly pay
    Full time
    Temporary work
    Part time
    Summer work
    Live in
    Remote work
    Flexible hours
    Shift work

    Bristol-Myers Squibb

    Brooklyn, NY
    3 days ago
  • $215k - $275k

     ...with clients who are ready to accelerate AI-enabled digital product development. We imagine...  ...and purpose. By blending design, product engineering, analytics, and automation, we build the...  ...designing and delivering GenAI, LLM, RAG, or agentic AI systems beyond proof... 
    Temporary work

    Slalom Build

    Brooklyn, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!