Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Rockaway Park, NY vacancy
  • CertiK seeks a Blockchain Security Expert on the AI Track to pioneer LLM-driven AI agents for security audits. You will work with the security team to bridge research and practice, building tools that automatically analyze smart contracts for vulnerabilities and improve... 
    Suggested

    DaParrot Ltd

    Brooklyn, NY
    1 day ago
  • $125k - $150k

     ...actions, and work in the interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power...  ...and API-driven applications. ~ Experience working with LLM APIs or AI frameworks . ~ Exposure to agent frameworks such... 
    Suggested
    Full time
    Work at office
    Local area

    AEG Presents

    Brooklyn, NY
    3 days ago
  • $118.11k

     ...driven decisions. This role sits on MDA's Engineering team, working alongside our BI and Data...  ...problems and turns them into data products, AI agents, and automation, all while...  ...Segment). Experience evaluating and monitoring LLM systems in production. The range of annual... 
    Suggested
    Full time
    Work experience placement
    Remote work
    Flexible hours

    NextGenEnergyJobs

    Brooklyn, NY
    4 days ago
  •  ...Role Summary: The Junior AI/ML Engineer contributes to the design, build, and delivery of end-to-end AI/ML solutions under the guidance of...  ...inference services Components of agentic solutions combining LLM and other systems Write clean, maintainable, and testable code... 
    Suggested
    Internship

    Stellantis NV

    Brooklyn, NY
    5 days ago
  •  ...sensitive, detail rich, and critical to national security. As an AI/Machine Learning Engineer, you will work directly with mission users to capture these...  .... You will design and implement solutions that may include LLM powered workflows, agent based automation, or hybrid... 
    Suggested
    Temporary work

    Optimus Technology, Inc

    Brooklyn, NY
    1 day ago
  •  ...seeking an Artificial Intelligence and Machine Learning Engineer to design and deliver agentic AI prototypes for national security applications. You will...  ...workflows, and multi-agent patterns, with knowledge of LLM platforms and prompt engineering to ensure reliability and... 
    Remote job

    Booz Allen Hamilton

    Brooklyn, NY
    3 days ago
  •  ...Required Qualifications 6+ years of hands‑on experience in data engineering and analytics roles. Strong proficiency in SQL and experience...  ...Learning concepts, including model development, large language model (LLM) implementation, and statistical analysis for predictive and... 
    Permanent employment
    Contract work
    Local area

    Machine Intelligence Technologies, LLC

    Brooklyn, NY
    4 days ago
  •  ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic...  ...We're looking for an Applied AI Engineer to take our growing collection of foundation...  ...time voice AI pipelines (STT, TTS, streaming LLM) Production RAG systems beyond toy... 
    Full time

    Norbert Health

    Brooklyn, NY
    more than 2 months ago
  •  ...Artificial intelligence and Machine learning (AI & ML) targeting towards applications in...  ...by the AM CoE. We are seeking a AI & Data Engineer to join the AM CoE's Market Intelligence...  ...Data Engineer will: Build and maintain AI/LLM tools and data pipelines that process large... 

    ASTM International

    Brooklyn, NY
    5 days ago
  • $165k - $185k

     ...Taulia will revolutionize fintech. About the Job AI is only as smart as the data it consumes. We are seeking an AI Data Engineer to ensure our agent ecosystem is powered by...  ...what makes data "searchable" for an AI. LLM & Agent Familiarity: Practical experience preparing... 
    Remote work
    Flexible hours

    Taulia

    Brooklyn, NY
    3 days ago
  •  ...driven team and would love for you to join us. AI is a core part of how Dscout operates....  ...under the hood. As an AI Data Engineer you will be at the intersection of ML systems...  ...data modeling frameworks Familiarity with LLM evaluation and observability tooling Exposure... 
    Local area
    Remote work
    Flexible hours
    Shift work

    Neura Market

    Brooklyn, NY
    5 days ago
  •  ...difference at Ochsner Health and discover your future today! The Lead AI Engineer leads the design, engineering, delivery, and operation of the...  ...strongly preferred. Preferred Qualifications Experience with LLM and generative AI applications - RAG, prompting, evaluation,... 
    Work experience placement
    Local area
    Immediate start
    Shift work

    Koitecc Solutions

    Brooklyn, NY
    5 days ago
  • $130k - $150k

    AI Systems Engineer Founded in 1994, Integrated Medical Systems, Inc. (IMS) is one of the nation’s leading distributors serving the alternate-...  ...action. You’ll work heavily with Model Context Protocol (MCP), LLM orchestration, APIs, tool calling, enterprise data, and... 
    Flexible hours

    RXinsider LTD.

    Brooklyn, NY
    5 days ago
  • $55 per hour

     ...Freelance AI Trainer - Civil Engineering & Python 1 day ago – Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Mind Rift

    Brooklyn, NY
    1 day ago
  •  .... Our culture values innovation, ownership, and engineering excellence. Role Overview We are seeking a highly skilled AI Developer with a strong backend and machine learning...  ...to design, train, optimize, and deploy LLM models in on-prem and offline environments. This... 
    Work at office
    Local area

    Salvo Software LLC

    Brooklyn, NY
    5 days ago
  •  ...POSITION SUMMARY Flexjet is seeking a detail-oriented AI Data Engineer to build and maintain data infrastructure that powers machine learning and AI systems. In this role, you will work closely with data scientists, ML engineers, and software teams to ensure high-quality... 

    LV Aero, LLC

    Brooklyn, NY
    16 hours ago
  • $102.45k - $174.24k

    Select how often (in days) to receive an alert: Applied AI Engineer/Full stack App Development Engineer 35619 We are Farmers - where ambition...  ..., Retrieval-Augmented Generation (RAG), autonomous agents, and LLM API orchestration. Assesses when AI adds value versus when... 
    Work at office
    Flexible hours
    Shift work

    Farmers Group Inc.

    Brooklyn, NY
    3 days ago
  • $97k - $158k

     ...analytical workforce. Responsible for ensuring the efficient flow of information and the seamless execution of tasks, enabling analysts, engineers, and scientists to focus on their core mission. Distinctly different from the Contract Senior Intelligence Analyst who focuses on... 
    Contract work
    Local area

    Kinsley Power Systems

    Brooklyn, NY
    4 days ago
  • $55 per hour

    An innovative AI consultancy is seeking a Freelance AI Trainer to leverage expertise in Civil Engineering and Python. This remote, part-time role involves designing practical engineering problems and evaluating AI solutions. The ideal candidate has a relevant degree, strong... 
    Remote job
    Part time
    Freelance

    Mindrift

    Brooklyn, NY
    5 days ago
  •  ...Key Responsibilities: Design robust test scenarios to validate AI agent behavior and performance. nalyze Product Requirement Documents (PRDs) to extract testing requirements and ensure comprehensive coverage. Conduct performance testing of AI systems... 
    Local area

    Macpower Digital Assets Edge

    Brooklyn, NY
    1 day ago
  • $120k - $160k

     ...Benefits: ~401(k) ~ Employee discounts ~ Paid time off AI-First Solution Engineer Our client is seeking an AI-First Solution Engineer to help design and build modern digital solutions across its growing insurance business. This is a hands... 

    Highbridge Consulting LLC

    Brooklyn, NY
    3 days ago
  • KLA invites an AI Engineer to join the LS-SWIFT algorithms group in Milpitas, CA, focusing on computer vision and AI-enabled semiconductor inspection technology. You will work with PhDs and engineers to advance next-generation ML/DL solutions in production environments.... 

    KLA-Belgium

    Brooklyn, NY
    3 days ago
  • ## AI Engineer: DevOps & Application SupportApplylocations: USA, Louisville, KYtime type: Full timeposted on: Posted Todayjob requisition id: REQ-26497At GE Appliances, a Haier company, we come together to make “good things, for life.” As the fastest-growing appliance company... 
    Work at office
    Flexible hours

    GE Appliances

    Brooklyn, NY
    3 days ago
  • Diamondback Energy, Inc. seeks an AI Developer to join its new AI team in Texas. You will design, build, and deploy AI-powered applications and autonomous workflows leveraging Claude, Azure OpenAI, Snowflake, and Databricks. The role spans data pipelines, agent orchestration... 

    Diamondback Energy, Inc.

    Brooklyn, NY
    3 days ago
  • S27a is seeking a Data Engineer to design and scale data infrastructure powering AI-driven products. You will build distributed pipelines, manage large datasets across cloud environments, and enable experimentation and model development at scale. The role emphasizes Python... 
    Remote job

    S27a

    Brooklyn, NY
    3 days ago
  • Artificial Intelligence (Generative AI) Engineer San Francisco Bay Area (on-site) or USA (remote) Job Type Full Time About the Company Beehive AI provides a generative AI platform designed specifically for an organization’s unique qualitative data. With self-learning language... 
    Full time
    Remote work

    Beehive AI, Inc.

    Brooklyn, NY
    3 days ago
  • ## AI Agent DeveloperApplylocations: USA-Remotetime type: Full timeposted on: Posted...  ...business and technology stakeholders, bring engineering discipline to everything you ship, and...  ...Hands-on experience building or deploying AI/LLM agents in production — including prompt... 
    Work at office
    Remote work
    3 days per week

    Hagerty Insurance Agency

    Brooklyn, NY
    3 days ago
  • $7.8k

    Artificial intelligence (AI) Engineer Intern 7,800 $ Important: if an employer asks you to log into their system via iCloud or Google, send a code, an SMS or Telegram password, run some code, or install software - refuse. These are signs of fraud. Who We Are is the Real... 
    Work experience placement
    Internship

    Talanto

    Brooklyn, NY
    1 day ago
  • Position Summary Base-2 Solutions is seeking an AI/ML Engineer who designs, creates, tests, and productizes AI/ML algorithms to solve business challenges. The AI/ML models they create should be capable of learning and making predictions as defined by the business logic... 

    RPMGlobal

    Brooklyn, NY
    2 days ago
  •  ...users become paying customers — at scale, not one deal at a time. This role blends a GTM engineer with an SDR. You'll manage close to a thousand accounts. Your job: build the AI agents, intent signals, and automated flows that convert and onboard the majority of that... 
    Local area
    Remote work
    Shift work
    2 days per week
    3 days per week

    Lansweeper NV

    Brooklyn, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!