Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Maspeth, NY vacancy
  • Innovaccer is seeking an AI Engineer to join the growing AI team and build production-grade AI systems at scale. Collaborate with product,...  ...design, develop, and deploy AI-powered applications including LLM-based solutions, AI agents, and RAG workflows. The ideal candidate... 
    Suggested

    Innovaccer Inc.

    Brooklyn, NY
    1 day ago
  • Innovaccer in San Francisco is seeking a Senior AI Researcher to design, develop, and deploy...  ...complex problems at scale, including LLM-based solutions, AI agents, retrieval-...  ...workflows. You will collaborate with product, engineering, and data teams, run rigorous experiments... 
    Suggested

    Uncover

    Brooklyn, NY
    4 days ago
  • Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products. You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and... 
    Suggested

    Apple Inc.

    Brooklyn, NY
    12 hours ago
  • Zachary Piper Solutions seeks an AI/ML Document Processing Developer to design and build document ingestion pipelines leveraging AI/ML and LLMs. You will transform unstructured documents into structured data to support business processes and validation workflows. The role... 
    Suggested

    Zachary Piper Solutions

    Brooklyn, NY
    4 days ago
  • Talener is seeking an AI Software Engineering Manager to lead a high-impact team in Hoboken, NJ, focused on building a greenfield AI platform for...  ...ideal candidate will have strong technical expertise in AI/LLM systems and leadership experience in engineering. This is a... 
    Suggested
    Full time

    Talener

    Hoboken, NJ
    1 day ago
  • Goliath Partners Inc. in San Francisco is seeking a Founding AI Engineer (Hybrid) to help build the core intelligence powering its enterprise...  ...decisions. You will work directly with the founders to move LLM and agent-based technology beyond prototypes, delivering reliable... 

    Goliath Partners Inc.

    Brooklyn, NY
    4 days ago
  • $118.11k - $178.65k

     ...driven decisions. This role sits on MDA's Engineering team, working alongside our BI and Data...  ...problems and turns them into data products, AI agents, and automation, all while...  ...Segment). Experience evaluating and monitoring LLM systems in production. The range of annual... 
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Samsara

    Brooklyn, NY
    5 days ago
  •  ...driven team and would love for you to join us. AI is a core part of how Dscout operates....  ...under the hood. As an AI Data Engineer you will be at the intersection of ML systems...  ...data modeling frameworks Familiarity with LLM evaluation and observability tooling Exposure... 
    Local area
    Remote work
    Flexible hours
    Shift work

    Neura Market

    Brooklyn, NY
    1 day ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    1 day ago
  • $61k - $66.3k

    # Junior AI & Metadata EngineerColumbiaApply for this job* Permanent* Experienced Professionals...  ...)## About The Role* The AI & Metadata Engineer will design and build AI-enabled metadata...  ....* This role will focus on leveraging AI/LLM technologies to analyze enterprise assets... 
    Permanent employment
    Full time
    Local area
    Flexible hours

    Capgemini

    Brooklyn, NY
    4 days ago
  •  ...seeking an Artificial Intelligence and Machine Learning Engineer to design and deliver agentic AI prototypes for national security applications. You will...  ...workflows, and multi-agent patterns, with knowledge of LLM platforms and prompt engineering to ensure reliability and... 
    Remote job

    Booz Allen Hamilton

    Brooklyn, NY
    12 hours ago
  • $120k - $140k

    Select how often (in days) to receive an alert: Senior Gen AI Software Engineer Requisition ID: 49886 Business Unit: Fitch Group Category: Information...  ...Protocol (MCP), AI-enabled search, vector databases, and LLM integration in real-time enterprise environments. Hands-on... 
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch

    Brooklyn, NY
    1 day ago
  • Reports to: Director, Software Engineering Location: Remote - United States Position Summary...  ...simplify governance, and we are building AI-powered product experiences across RAG pipelines...  ...strong software engineer with practical LLM application experience and a genuine... 
    Temporary work
    Casual work
    Local area
    Remote work
    Worldwide
    Flexible hours

    Matcha

    Brooklyn, NY
    1 day ago
  • Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on. You will work closely with our... 
    Local area

    Salvo Software LLC

    Brooklyn, NY
    2 days ago
  •  ...Required Qualifications 6+ years of hands‑on experience in data engineering and analytics roles. Strong proficiency in SQL and experience...  ...Learning concepts, including model development, large language model (LLM) implementation, and statistical analysis for predictive and... 
    Permanent employment
    Contract work
    Local area

    Machine Intelligence Technologies, LLC

    Brooklyn, NY
    1 day ago
  • $165k - $185k

     ...Taulia will revolutionize fintech. About the Job AI is only as smart as the data it consumes. We are seeking an AI Data Engineer to ensure our agent ecosystem is powered by...  ...what makes data "searchable" for an AI. LLM & Agent Familiarity: Practical experience preparing... 
    Remote work
    Flexible hours

    Taulia

    Brooklyn, NY
    12 hours ago
  •  ...The Assistant Vice President, Red Team & AI Security supports the planning, execution...  ...documentation.Coordinate with defensive, engineering, risk, and business stakeholders to ensure...  ...adversarial testing of AI and LLM systems, including prompt injection, data... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    5 days ago
  •  ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic...  ...We're looking for an Applied AI Engineer to take our growing collection of foundation...  ...time voice AI pipelines (STT, TTS, streaming LLM) Production RAG systems beyond toy... 
    Full time

    Norbert Health

    Brooklyn, NY
    more than 2 months ago
  •  ...Build Your Future The director is a hands-on engineering leader responsible for engineering teams...  ...architected, and increasingly powered by AI-driven capabilities. The incumbent will...  ...and automation (e.g., agentic workflows, LLM-powered tooling, intelligent process... 
    For contractors
    Live in
    Work at office
    Local area

    Relha LLC

    Brooklyn, NY
    3 days ago
  • Salesforce is hiring AI Builders as part of our New Grad cohort. You’ll be embedded with...  .... You’ll work in a builder pod with engineers, product and sales, delivering real impact...  ...React, TypeScript, GraphQL, Python, and AI/LLM concepts, ready to grow quickly in a fast-... 

    Jobzhr

    Brooklyn, NY
    2 days ago
  • Visionist, Inc. is seeking a Senior Applied AI Engineer - Software Engineering to join our fully funded opportunity on a large PRIME contract...  ..., engineers, and mission stakeholders. You will architect LLM-powered workflows, RAG pipelines, and AI agent capabilities; build... 
    Contract work

    Visionist, Inc.

    Brooklyn, NY
    12 hours ago
  • $10k

    Description: Columbia Technology Partners is seeking an AI/ML Engineer to support mission‑critical intelligence operations within a fast-paced...  ...Design, develop, and implement AI/ML capabilities including LLM‑powered workflows, agentic automation, and hybrid AI solutions... 
    Temporary work
    For contractors
    Local area

    Columbia Technology Partners, Inc

    Brooklyn, NY
    1 day ago
  • $136k - $253k

     ...(TRSS) is looking for you! About The Role As a Generative AI and Machine Learning Engineer, you will be responsible for supporting product development...  ..., NER, summarization and topic modeling Familiarity with LLM training and efficient finetuning (PEFT, LoRA, Quantization... 
    Contract work
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    latitude

    Brooklyn, NY
    3 days ago
  • $130k - $150k

    AI Systems Engineer Founded in 1994, Integrated Medical Systems, Inc. (IMS) is one of the nation’s leading distributors serving the alternate-...  ...action. You’ll work heavily with Model Context Protocol (MCP), LLM orchestration, APIs, tool calling, enterprise data, and... 
    Flexible hours

    RXinsider LTD.

    Brooklyn, NY
    2 days ago
  •  ...sensitive, detail rich, and critical to national security. As an AI/Machine Learning Engineer, you will work directly with mission users to capture these...  ...You will design and implement solutions that may include LLM powered workflows, agent based automation, or hybrid... 
    Temporary work

    Optimus Technology, Inc

    Brooklyn, NY
    12 hours ago
  •  ...Here's what you will be doing: Develop and deploy AI chatbot/agent solutions for enterprise use cases Integrate LLM-based agents with structured and unstructured...  ...clustering Perform data preprocessing, feature engineering, and model evaluation Integrate ML outputs into... 
    Remote job
    Internship

    Stie Yai

    Brooklyn, NY
    3 days ago
  • $25 per hour

    The Nuclear Company is the fastest growing AI tech-startup in the nuclear and energy...  ...people use to build power plants. As an AI/ML Engineer Intern on the Platform Integration & AI/...  ...learning and agent capabilities inside NOS: LLM-driven workflows, retrieval-augmented... 
    Bi-weekly pay
    Permanent employment
    Full time
    Contract work
    For contractors
    For subcontractor
    Summer work
    Internship
    Summer internship
    Work at office
    Relocation

    The Nuclear Company

    Brooklyn, NY
    1 day ago
  • $142.32k - $213.48k

     ...scale few can match. From deploying advanced AI to helping shape global markets, we build...  ...President-level Machine Learning Systems Engineer with extensive ML Ops experience to join...  ...Generative AI: RAGAs, DsPy, Large Language Models (LLM)MLOps & ML Lifecycle Management:Platforms:... 
    Full time

    Citigroup

    Jersey City, NJ
    2 days ago
  • Columbia Technology Partners, Inc. is seeking an AI/ML Engineer to support mission-critical intelligence operations within a fast-paced national...  ...complex workflows, design AI-enabled solutions, and integrate LLM-powered processes while ensuring secure deployment. You will... 

    Columbia Technology Partners, Inc

    Brooklyn, NY
    1 day ago
  • $170k - $200k

    Our client is seeking an AI Software Engineer Manager to help lead the development of a greenfield AI platform that will serve as a centralized...  ...for an experienced engineering manager with expertise in AI/LLM technologies, Python development, and cloud-native architectures... 
    2 days per week
    3 days per week

    Talener

    Hoboken, NJ
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!