Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Cliffside Park, NJ vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Ridgefield, NJ
    3 days ago
  • $21 - $25 per hour

     ...21, 2026. Position Purpose:  We are seeking a motivated AI Engineering intern to support the development and implementation of an AI-...  ...in AI/ML workflows. Development Framework & Tools: Core LLM Frameworks: Using LangChain or LlamaIndex for orchestrating LLM... 
    Suggested
    Hourly pay
    Temporary work
    Internship
    Work at office
    Immediate start

    Veolia

    Paramus, NJ
    more than 2 months ago
  • Talener is seeking an AI Software Engineering Manager to lead a high-impact team in Hoboken, NJ, focused on building a greenfield AI platform for...  ...ideal candidate will have strong technical expertise in AI/LLM systems and leadership experience in engineering. This is a... 
    Suggested
    Full time

    Talener

    Hoboken, NJ
    5 days ago
  • $106.9k - $200.6k

     ...better working world. The opportunity We are seeking an AI Systems Engineer to own the delivery, model-serving, routing, and...  ...), logs (Loki), traces (Tempo/Jaeger), dashboards (Grafana), LLM debugging and evaluation (LangSmith/Langfuse), and SLA/alert... 
    Suggested
    Full time
    Summer holiday
    Flexible hours

    EY

    Secaucus, NJ
    2 days ago
  • $160k - $200k

     ...Responsibilities:Build complex multi-agent AI agents that are highly scalableWork with...  ...with debugging traces of LLM calls to identify errors/optimizationsExperience...  ...scalable AI workflowsProficiency in prompt engineering and optimization techniquesSome UI/UX experience... 
    Suggested

    Cross River

    Fort Lee, NJ
    4 days ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    6 hours ago
  • $144k - $374k

     ...opportunity We are seeking a senior, hands-on Distinguished Engineer to lead the delivery of AI-native systems into highly regulated industries such as...  ...stacks (e.g., agentic systems, orchestration frameworks, LLM‑backed services). ~ Proven ability to operate in... 
    Full time
    Temporary work
    Summer holiday
    Immediate start
    Flexible hours

    EY

    Secaucus, NJ
    2 days ago
  •  ...organization, apply now.We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).Distinguished AI EngineerEnterprise AI Architecture / LLM Platforms / Advanced AI SystemsRole purposeSet the architecture,... 
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Jersey City, NJ
    3 days ago
  • $150k - $210k

     ...impactful internal and external partnerships to deliver measurable business value.About the Position - Embodied AI EngineerWe are seeking an exceptional Embodied AI Engineer to build the foundation of LG's vision of theZero-labor Home. This hybrid role offers a unique... 
    Full time
    Temporary work
    For contractors
    Local area
    Immediate start

    LG Electronics

    Englewood Cliffs, NJ
    1 day ago
  • $90k - $153k

     ...The Assistant Vice President, Red Team & AI Security supports the planning, execution...  ...documentation. Coordinate with defensive, engineering, risk, and business stakeholders to...  ...Support adversarial testing of AI and LLM systems, including prompt injection, data... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    1 day ago
  •  ...technologies (e.g., transformer models, prompt engineering, model fine-tuning) - Experience...  ...Strong knowledge of: - vLLM - OpenShift AI - Prometheus - Grafana - Aqua...  ...Information Retrieval frameworks for LLM inferencing - Working knowledge of Linux... 

    3B Staffing LLC

    Jersey City, NJ
    4 days ago
  •  ...interview at the client's Jersey City location is mandatory. Only USCs/GCs are eligible Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished / Principal Technical Leader Target /... 

    United Software Group

    Jersey City, NJ
    5 days ago
  •  ...LLM / Agentic AI / Full-Stack AI Engineering Level - Senior Individual Contributor Target / alternate titles - LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer; RAG Engineer Core keywords -... 

    Echo IT Solutions

    Jersey City, NJ
    4 days ago
  •  ...AI/ML Engineer II 130,000 - 160,000 Remote / Flexible Full-Time Our client is building an AI-native healthcare software platform that...  ..., OpenAI, Google) behind a unified abstraction. Implement LLM- and ML-powered workflows, including clinical documentation, audio... 
    Full time
    Remote work
    Flexible hours

    Blackbird Recruiting

    Clifton, NJ
    1 day ago
  • $65 - $70 per hour

     ...Gen-AI Engineer Location: NJ/NY Area Experience Required: 6-8 years Positions: 4 End Customer Industry: Financial...  ...teams to design and implement Gen-AI use cases, integrate LLM-based solutions with enterprise applications, and ensure scalable... 

    SysMind Tech

    Jersey City, NJ
    3 days ago
  • $142.32k - $213.48k

     ...scale few can match. From deploying advanced AI to helping shape global markets, we build...  ...President-level Machine Learning Systems Engineer with extensive ML Ops experience to join...  ...Generative AI: RAGAs, DsPy, Large Language Models (LLM)MLOps & ML Lifecycle Management:Platforms:... 
    Full time

    Citigroup

    Jersey City, NJ
    6 hours ago
  • $80k - $90k

     ...AI Engineer Benefits: 401(k), Bonus based on performance, Training & development Key Responsibilities Apply AI/ML technologies such...  ...to AI/ML concepts, including machine learning pipelines or LLM based systems. Familiarity with embeddings, vector databases... 

    Triunity Software

    Jersey City, NJ
    5 days ago
  • $155k - $215k

    We’re hiring AI & LLM Applications Scientists to help augment and accelerate ICR scientists’ workloads, improving both quality and productivity...  ..., open‑source LLMs, multimodal models), including prompt engineering, evaluation, and workflow integration. A strong technical... 

    InVitro Cell Research, LLC

    Englewood, NJ
    3 days ago
  • InVitro Cell Research, LLC is seeking an AI & LLM Applications Scientist to augment scientific workflows and accelerate research in aging...  ...You will partner with bench scientists, data scientists, and engineers to design AI-enabled studies, prototype tools, and deploy... 

    InVitro Cell Research, LLC

    Englewood, NJ
    3 days ago
  • $155k - $215k

    Initial Therapeutics, Inc. in Englewood, NJ is seeking an AI & LLM Applications Scientist to enhance ICR scientists’ productivity through AI and language models. Ideal candidates will possess deep AI knowledge and experience integrating these tools into research workflows... 

    Initial Therapeutics, Inc.

    Englewood, NJ
    1 day ago
  • $110.7k - $372.9k

     ...navigate or afford the care they need. Deloitte has a new AI-first effort, backed by $1B in committed investment...  ...first months, not into a lab. As an Agentic AI Engineer, you will design, build, and operationalize the LLM- and SLM-powered systems behind real healthcare... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    4 days ago
  • $142.32k - $213.48k

     ...Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for...  ...Stack AI Engineering: Build full‑stack applications integrating LLM‑driven workflows and AI coding tools (e.g., Devin, GitHub... 
    Full time

    Citigroup

    Jersey City, NJ
    7 days ago
  • $100 per hour

    DescriptionAI Engineer (Application Design & Rapid Deployment)Role OverviewAs an AI Engineer, you will serve as one of our "Tiger Team" engineers: a highly versatile, full...  ...frameworks (e.g., Ragas, TruLens, or custom LLM-as-a-judge pipelines) to measure accuracy, latency... 
    Temporary work
    Immediate start
    Flexible hours

    Internet Brands

    Newark, NJ
    6 hours ago
  •  ...VERSANT, is building the next generation of AI-powered equity research for individual...  ...company. Job Description Senior AI Engineer We're looking for a highly capable...  ...This role is for engineers who enjoy turning LLM and agentic AI capabilities into reliable... 
    Full time
    Work at office
    Local area

    Versant Media

    Englewood Cliffs, NJ
    9 days ago
  • $175k - $215k

     ...the right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-...  ...is a hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize... 
    Full time
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    6 hours ago
  •  ...Position: Senior AI Engineers Location: Hoboken, NJ***Onsite*** Duration: 1 Years Agentic Development & AI-Augmented...  ...(MCP) servers and tool schemas that are legible and safe for LLM agents to use Define human-in-the-loop checkpoints, autonomy... 
    Contract work

    Inherent Technologies

    Hoboken, NJ
    4 days ago
  •  ...organization, apply now. We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United...  .... Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems     Role purpose Set... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Jersey City, NJ
    a month ago
  •  ...infrastructure that powers the next generation of enterprise AI — and we need the best minds in LLM inference to help us do it. This is your opportunity to...  ...and optimizes AI at scale.As a Principal Software Engineer at JPMorganChase within the AI/ML Data Platform team,... 

    JP Morgan Chase

    Jersey City, NJ
    1 hour ago
  • $60k

    DescriptionAssociate AI Engineer Kickstart your career in AI! We're looking for Associate AI Engineers to join our Central AI team. This role...  ..., or dynamic context handling). Experience integrating LLM APIs to build AI-powered features and workflows.Why You'll Love... 
    Temporary work
    Internship
    Work at office
    Flexible hours

    Internet Brands

    Newark, NJ
    3 days ago
  • $210k - $260k

     ...impossible to change. We collapse it into a single AI-native platform that business users can operate without writing a ticket, while engineering teams retain the governance and security...  ...take the decisions that matter - LLM selection, agentic architecture, RAG design... 
    Full time
    Local area
    Home office

    Brown Brothers Harriman

    Jersey City, NJ
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!