Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Union City, NJ vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Edgewater, NJ
    3 days ago
  • $160k - $200k

     ...Senior AI/ML Engineer Fort Lee, New Jersey, United States Cross River builds the infrastructure behind the world's most innovative financial...  ...agentic AI systems Experience with debugging traces of LLM calls to identify errors/optimizations Experience with... 
    Suggested

    Cross River

    Fort Lee, NJ
    1 day ago
  • $21 - $25 per hour

     ...21, 2026. Position Purpose:  We are seeking a motivated AI Engineering intern to support the development and implementation of an AI-...  ...in AI/ML workflows. Development Framework & Tools: Core LLM Frameworks: Using LangChain or LlamaIndex for orchestrating LLM... 
    Suggested
    Hourly pay
    Temporary work
    Internship
    Work at office
    Immediate start

    Veolia

    Paramus, NJ
    more than 2 months ago
  •  ...AI Engineer Required Skills & Experience Must Haves: • 3+ years of hands-on Python development experience with strong Object-Oriented...  ...fundamentals • Experience building and deploying Generative AI, RAG, and LLM-based solutions in production environments • Strong knowledge... 
    Suggested

    Insight Global

    Jersey City, NJ
    5 days ago
  •  ...LLM / Agentic AI / Full-Stack AI Engineering Level Senior Individual Contributor Target / alternate titles LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer; RAG Engineer Core keywords LLM, GenAI... 
    Suggested

    Echo IT Solutions

    Jersey City, NJ
    4 days ago
  • $80k - $90k

     ...AI Engineer Benefits: 401(k), Bonus based on performance, Training & development Key Responsibilities Apply AI/ML technologies...  ...Exposure to AI/ML concepts, including machine learning pipelines or LLM based systems. Familiarity with embeddings, vector databases... 

    Triunity Software

    Jersey City, NJ
    5 days ago
  • $90k - $120k

     ...AI Engineer Must Have Technical/Functional Skills: Strong hands-on Python knowledge Hands-on experience in developing API Development...  ...Processing, AI enabled workflows using python Knowledge of LLM, Prompt Engineering, RAG Architecture, Agentic AI Basic... 
    Work experience placement

    Tata Consultancy Services

    Jersey City, NJ
    4 days ago
  • $125k - $150k

     ...actions, and work in the interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power...  ...and API-driven applications. ~ Experience working with LLM APIs or AI frameworks . ~ Exposure to agent frameworks such... 
    Full time
    Work at office
    Local area

    AEG Presents

    Brooklyn, NY
    4 days ago
  •  ...pioneer in the fusion of life sciences and AI computer science as an AI-enabled...  .... AlphaLife Sciences is seeking an AI Engineer Leader to drive AI innovation for new projects...  ...technical guidance, and help turn cutting-edge AI/LLM technologies into practical solutions that... 
    Full time
    Visa sponsorship

    Alphalife Sciences

    Jersey City, NJ
    1 day ago
  •  ...Note: Korean language proficiency - Must Job Title: AI Engineer Location: Englewood Cliffs, NJ Onsite Experience level...  ..., Azure OpenAI, AWS Bedrock, Google Vertex AI, or similar LLM platforms. Strong knowledge of RAG (Retrieval-Augmented Generation... 

    Gandiva Insights

    Englewood Cliffs, NJ
    1 day ago
  • Agentic AI DeveloperLocation - Weehawken, NJ (5 days WFO)Duration: Long termIn-person interview mandatoryKey responsibilities:Develop...  ...Anthropic etc..Proficiency in Python or similar languageExperience with LLM-based framework (LangChain, LangGraph)Knowledge of vector... 

    United Software Group

    Weehawken, NJ
    3 days ago
  •  ...Job Description Job Title: Senior Python & AI Engineer Experience: 5+ Years Location: New Jersey Job Summary We are...  ...on experience with Prompt Engineering . Experience with LLM application development and integration . Knowledge of model... 

    VeeRteq Solutions Inc.

    Newark, NJ
    2 days ago
  •  ...AI and Data Engineer Use GitHub Copilot as a hands-on engineering environment to analyze existing code, design and implement production-quality...  ...AI agents that plan and execute multi-step workflows using LLM reasoning, structured prompts, context and memory, retrieval,... 

    Artech

    Jersey City, NJ
    3 days ago
  •  ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic...  ...We're looking for an Applied AI Engineer to take our growing collection of foundation...  ...time voice AI pipelines (STT, TTS, streaming LLM) Production RAG systems beyond toy... 

    Norbert Health

    Brooklyn, NY
    5 days ago
  •  ...Description Job Description Job Description Role: Senior AI Software Engineer (Agentic AI / AI Agents) Location: Hybrid Duration: 12+...  ..., ChromaDB, or Azure AI Search . Experience deploying LLM applications using  OpenAI, Azure OpenAI, AWS Bedrock,... 

    TMS LLC

    Jersey City, NJ
    2 days ago
  •  ...for this role. JOB DESCRIPTION As an Lead Software Engineer at JPMorganChase within Enterprise Technology, you will...  ...scalable large language model systems and agentic AI platforms for enterprise use cases leveraging LLM Suite. You will design cloud-native solutions, establish... 

    J.P. Morgan

    Jersey City, NJ
    2 days ago
  • $180k - $200k

     ...Applied AI Engineer The New York Mets are seeking an Applied AI Engineer to build and ship production-grade AI capabilities that improve...  ...production services. ~ Demonstrated experience building LLM-powered applications in production (prompt/program design, structured... 
    Local area
    Relocation

    MLB - New York Mets

    Corona, NY
    1 day ago
  • $60k

     ...Associate AI Engineer Kickstart your career in AI! We're looking for Associate AI Engineers to join our Central AI team. This role is...  ...reasoning, or dynamic context handling). Experience integrating LLM APIs to build AI-powered features and workflows. Why You'll... 
    Temporary work
    Internship
    Work at office
    Flexible hours

    Internet Brands

    Newark, NJ
    4 days ago
  •  ...Principal Software Engineer If you are looking for a game-changing career, working for one of the world's leading financial...  ...Engineer at JPMorganChase within the Corporate Sector – AI/ML & Data Platforms for LLM Suite, you will lead a specialized technical area,... 

    Hackajob

    Jersey City, NJ
    3 days ago
  • Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on. You will work closely with our... 
    Local area

    Salvo Software LLC

    Brooklyn, NY
    6 days ago
  •  ...Role:- Senior Product Architect Location: Jersey City(Hybrid) Detailed JD Generative AI LLM expertise - building applications using LLMs, prompt engineering, and retrieval-based architectures (RAG) Agentic AI capabilities - designing AI systems that can... 

    Yantran LLC

    Jersey City, NJ
    1 day ago
  •  ...AI/ML Engineer Location: Mason, OH / Woodland Hills, CA Duration: Fulltime Job Description: Skills Desired: • Python (Expert...  ...workflows • Generative AI & LLMs o Prompt engineering for LLM-based applications • Document Processing o Document extraction... 
    Full time

    JConnect Infotech

    Passaic, NJ
    5 days ago
  • $100k

     ...full stack developers, Python/Java developers, data analysts/data engineers/data scientists, machine learning engineers for full time...  ...software development life cycle, knowledge of statistics, gen AI, LLM, Python, computer vision, data visualization tools, excellent written... 
    Full time
    H1b

    SynergisticIT

    Jersey City, NJ
    1 day ago
  •  ...We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python...  ...development using Google ADK or Agent SDK. ~ Strong experience with LLM integration, prompt engineering, and agent orchestration. ~... 

    2T Consulting

    Fort Lee, NJ
    3 days ago
  • $118.11k - $178.65k

     ...driven decisions. This role sits on MDA's Engineering team, working alongside our BI and Data...  ...problems and turns them into data products, AI agents, and automation, all while...  ...). Experience evaluating and monitoring LLM systems in production. The range of annual... 
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Samsara

    Brooklyn, NY
    4 days ago
  •  ...driven team and would love for you to join us. AI is a core part of how Dscout operates....  ...under the hood. As an AI Data Engineer you will be at the intersection of ML systems...  ...data modeling frameworks Familiarity with LLM evaluation and observability tooling Exposure... 
    Local area
    Remote work
    Flexible hours
    Shift work

    Neura Market

    Brooklyn, NY
    6 days ago
  • $165k - $185k

     ...Taulia will revolutionize fintech. About the Job AI is only as smart as the data it consumes. We are seeking an AI Data Engineer to ensure our agent ecosystem is powered by...  ...what makes data "searchable" for an AI. LLM & Agent Familiarity: Practical experience preparing... 
    Remote work
    Flexible hours

    Taulia

    Brooklyn, NY
    4 days ago
  • AI and Data Engineer Use GitHub Copilot as a hands-on engineering environment to analyze existing code, design and implement production-quality...  ...operate AI agents that plan and execute multi-step workflows using LLM reasoning, structured prompts, context and memory, retrieval,... 

    Artech

    Jersey City, NJ
    3 days ago
  • $61k - $101k

     ...formal training or certification in software engineering and 7+ years of applied experience. We need deep, hands-on experience with LLM inference systems such as vLLM, TensorRT-...  ...designing and leading adoption of agentic AI-enabled development practices across teams,... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    13 days ago
  • $61k - $101k

     ...formal training or certification in software engineering concepts, along with 10+ years of applied experience. We require 8+ years of AI/ML engineering experience, with strong...  ...demonstrated success designing and deploying LLM and GNN solutions on AWS at enterprise... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    13 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!