Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Little Falls, NJ vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Montclair, NJ
    2 days ago
  • $21 - $25 per hour

     ...21, 2026. Position Purpose:  We are seeking a motivated AI Engineering intern to support the development and implementation of an AI-...  ...in AI/ML workflows. Development Framework & Tools: Core LLM Frameworks: Using LangChain or LlamaIndex for orchestrating LLM... 
    Suggested
    Hourly pay
    Temporary work
    Internship
    Work at office
    Immediate start

    Veolia

    Paramus, NJ
    more than 2 months ago
  •  ...AI/ML Engineer II 130,000 - 160,000 Remote / Flexible Full-Time Our client is building an AI-native healthcare software platform that...  ..., OpenAI, Google) behind a unified abstraction. Implement LLM- and ML-powered workflows, including clinical documentation, audio... 
    Suggested
    Full time
    Remote work
    Flexible hours

    Blackbird Recruiting

    Clifton, NJ
    14 hours ago
  • $100 per hour

    DescriptionAI Engineer (Application Design & Rapid Deployment)Role OverviewAs an AI Engineer, you will serve as one of our "Tiger Team" engineers: a highly versatile, full...  ...frameworks (e.g., Ragas, TruLens, or custom LLM-as-a-judge pipelines) to measure accuracy, latency... 
    Suggested
    Temporary work
    Immediate start
    Flexible hours

    Internet Brands

    Newark, NJ
    4 days ago
  • $182k - $242k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers...  ...at .About the Role:As a Software and AI Engineer, IT Systems, you’ll design and develop AI...  ...backend services in Node.js and Go.AI/LLM Experience: Solid familiarity with Generative... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Livingston, NJ
    14 hours ago
  • Talener is seeking an AI Software Engineering Manager to lead a high-impact team in Hoboken, NJ, focused on building a greenfield AI platform for...  ...ideal candidate will have strong technical expertise in AI/LLM systems and leadership experience in engineering. This is a... 
    Full time

    Talener

    Hoboken, NJ
    4 days ago
  •  ...capabilities, then consider a career in Advisory.KPMG is currently seeking a Senior Associate, AI Engineer to join our Advisory Services practice.Responsibilities:Develop GenAI / LLM applications and integrations using foundational models under the guidance of senior team... 
    H1b
    Local area

    KPMG

    Short Hills, NJ
    2 days ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  • $60k

     ...Associate AI Engineer Kickstart your career in AI! We're looking for Associate AI Engineers to join our Central AI team. This role is...  ...reasoning, or dynamic context handling). Experience integrating LLM APIs to build AI-powered features and workflows. Why You'll... 
    Temporary work
    Internship
    Work at office
    Flexible hours

    Nolo

    Newark, NJ
    14 hours ago
  •  ...Position: AI Engineer Location: NY/NJ (Remote with Occasion Travel ) Type: Full time Job Description-: Role Overview...  ...Design, develop, and deploy production-ready Generative AI and LLM-powered applications. Build scalable Retrieval-Augmented Generation... 
    Full time
    Remote work

    Apetan Consulting llc

    Newark, NJ
    4 days ago
  • $125k - $145k

     ...Employee Resource Groups (ERGs)About the RoleWe're hiring an AI Automation Engineer to grow into one of the most interesting roles in our...  ...hackathons, or coursework. You've built something that uses an LLM and learned why it's harder than it looks.Practical AWS experience... 
    Full time
    Internship

    OUTFRONT Media

    Fairfield, Essex County, NJ
    3 days ago
  • $120k - $145k

     ...FamiliaritywithsettingupandconfiguringapplicationswithAzureSSOorGoogleSSO(SAML,OIDC,OAuth2.0) AI Systems Engineering & Operations Hands-onexperiencedeploying,configuring,andadministeringlargelanguagemodel(LLM) platformsincludingAnthropicClaude(claude.ai,ClaudeAPI,ClaudeCode)... 
    Full time
    Part time
    Flexible hours

    WebMD

    Newark, NJ
    1 day ago
  • $120k - $202.5k

     ...Cyber Data & Analytics (CyberDNA) team is seeking a Senior AI Security Automation Engineer to help shape the next generation of cybersecurity data,...  ...production-grade Generative AI and Large Language Model (LLM) based solutions, including agentic workflows, intelligent... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work
    2 days per week

    State Street Bank

    Clifton, NJ
    3 days ago
  • $79.4k - $125.6k

     ...is not offering visa sponsorship for this position.Job SummaryAt this time, only current PSEG employees are being considered. The AI Engineer role combines hands-on AI engineering and LLMOps responsibilities to help establish scalable, secure, and production-ready AI... 
    Permanent employment
    Local area
    Remote work
    Work from home
    Flexible hours
    3 days per week

    Public Service Enterprise Group

    Newark, NJ
    2 days ago
  • $175k - $200k

     ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant...  ...early partner adoption. Both need a senior engineering owner, and both need to grow into the...  ...systems, with at least 2 years building LLM-backed systems that real users depend on.... 
    Full time
    Internship

    OUTFRONT Media

    Fairfield, Essex County, NJ
    3 days ago
  •  ...content. The team is seeking a Senior, Staff or Principal AI Search and Recommendation Engineer to lead the architecture and development of next-...  ...powered search, recommendation, and discovery platforms.Build LLM-driven user experiences that understand user intent and deliver... 

    Robert Half

    Oakland, NJ
    2 days ago
  •  ...organization, apply now.We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).Distinguished AI EngineerEnterprise AI Architecture / LLM Platforms / Advanced AI SystemsRole purposeSet the architecture,... 
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...scale few can match. From deploying advanced AI to helping shape global markets, we build...  ...President-level Machine Learning Systems Engineer with extensive ML Ops experience to join...  ...Generative AI: RAGAs, DsPy, Large Language Models (LLM)MLOps & ML Lifecycle Management:Platforms:... 
    Full time

    Citigroup

    Jersey City, NJ
    4 days ago
  • $80k - $90k

     ...AI Engineer Benefits: 401(k), Bonus based on performance, Training & development Key Responsibilities Apply AI/ML technologies such...  ...to AI/ML concepts, including machine learning pipelines or LLM based systems. Familiarity with embeddings, vector databases... 

    Triunity Software

    Jersey City, NJ
    4 days ago
  •  ...Distinguished AI Engineer Duration: 12 months Pay Rate: $71/HR on C2C This role requires working onsite 4 days per week, and a F...  ...Responsibilities Define target-state architecture for AIRP, LLM platforms, model hubs, AI gateways, RAG services, agent... 

    Anveta

    Jersey City, NJ
    2 days ago
  • $65 - $70 per hour

     ...Gen-AI Engineer Location: NJ/NY Area Experience Required: 6-8 years Positions: 4 End Customer Industry: Financial...  ...teams to design and implement Gen-AI use cases, integrate LLM-based solutions with enterprise applications, and ensure scalable... 

    SysMind Tech

    Jersey City, NJ
    2 days ago
  • $35k

     ...Job Description Core Skill Set: Python (advanced, production-grade coding) Generative AI (LLMs, prompt engineering, fine-tuning, RAG) Agent development using frameworks such as ADK, LangGraph, LangChain Additional Relevant Skills: Experience... 
    Full time
    For contractors
    Shift work

    Photon

    Passaic, NJ
    4 hours ago
  •  ...Certified 8(a), and HUBZone company. Job Overview: The AI Platform Engineer builds, hardens, and helps operate the enterprise GenAI/agentic...  ...scale. This role owns the platform “foundations”—including LLM gateway & model routing, vector/knowledge base infrastructure... 
    Full time
    Remote work
    Flexible hours

    Cinteot

    Newark, NJ
    11 days ago
  • $110.7k - $372.9k

     ...navigate or afford the care they need. Deloitte has a new AI-first effort, backed by $1B in committed investment...  ...first months, not into a lab. As an Agentic AI Engineer, you will design, build, and operationalize the LLM- and SLM-powered systems behind real healthcare... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    3 days ago
  • $142.32k - $213.48k

     ...Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for...  ...Stack AI Engineering: Build full‑stack applications integrating LLM‑driven workflows and AI coding tools (e.g., Devin, GitHub... 
    Full time

    Citigroup

    Jersey City, NJ
    6 days ago
  •  ...pioneer in the fusion of life sciences and AI computer science as an AI-enabled...  .... AlphaLife Sciences is seeking an AI Engineer Leader to drive AI innovation for new projects...  ...technical guidance, and help turn cutting-edge AI/LLM technologies into practical solutions that... 
    Full time
    Visa sponsorship

    Alphalife Sciences

    Jersey City, NJ
    14 hours ago
  •  ...Broadridge team.Broadridge is hiring! We are seeking a Professional Engineer with advanced engineering and technical leadership position...  ...operational support, and continuous improvement through automation and AI-assisted engineering practices.ResponsibilitiesDesign, develop,... 
    Full time
    Local area

    Broadridge

    Newark, NJ
    14 hours ago
  • $175k - $215k

     ...the right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-...  ...is a hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize... 
    Full time
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    4 days ago
  •  ...Position: Senior AI Engineers Location: Hoboken, NJ***Onsite*** Duration: 1 Years Agentic Development & AI-Augmented...  ...(MCP) servers and tool schemas that are legible and safe for LLM agents to use Define human-in-the-loop checkpoints, autonomy... 
    Contract work

    Inherent Technologies

    Hoboken, NJ
    4 days ago
  •  ...organization, apply now. We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United...  .... Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems     Role purpose Set... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Jersey City, NJ
    29 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!