Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Elizabeth, NJ vacancy
  • Talener is seeking an AI Software Engineering Manager to lead a high-impact team in Hoboken, NJ, focused on building a greenfield AI platform for...  ...ideal candidate will have strong technical expertise in AI/LLM systems and leadership experience in engineering. This is a... 
    Suggested
    Full time

    Talener

    Hoboken, NJ
    3 days ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    Suggested
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  •  ...organization, apply now.We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).Distinguished AI EngineerEnterprise AI Architecture / LLM Platforms / Advanced AI SystemsRole purposeSet the architecture,... 
    Suggested
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Jersey City, NJ
    1 day ago
  • $52 - $57 per hour

     ...Requirements/Must Have: Strong full-stack software engineering background (front-end, back-end, APIs, data layer)...  ...ability. Direct, hands-on experience building AI agents or agentic workflows (e.g., using LLM orchestration frameworks, tool-calling/function-calling... 
    Suggested

    Cynet Systems

    Iselin, NJ
    4 days ago
  • $142.32k - $213.48k

     ...scale few can match. From deploying advanced AI to helping shape global markets, we build...  ...President-level Machine Learning Systems Engineer with extensive ML Ops experience to join...  ...Generative AI: RAGAs, DsPy, Large Language Models (LLM)MLOps & ML Lifecycle Management:Platforms:... 
    Suggested
    Full time

    Citigroup

    Jersey City, NJ
    3 days ago
  •  ...- 1 Customer: Telecommunication Industry Position: Gen AI Engineer (Agentic AI/Python/GCP-Google ADK preferred) Onsite/Hybrid work...  ...Science, SQL, Python, Pandas, Deep Learning, Machine Learning, LLM, Data Structures, BERT Transformers, NLP, PyTorch, PySpark.... 
    Local area
    Remote work

    Danta Technologies

    Hoboken, NJ
    4 days ago
  • $58.26 - $66.26 per hour

     ...AI Engineer Genesis10 is currently seeking an AI Engineer for a contract position with a Global Financial Institution located in Jersey...  ...scientist executing end-to-end Gen AI projects ~ Experience with LLM Models (Llama, Mixtral, Mistral) ~ Experience with various... 
    Hourly pay
    Contract work

    Genesis10

    Jersey City, NJ
    5 days ago
  • $90k - $120k

     ...Development in Python using FastAPI/ Flask framework - Working experience in Data Processing, AI enabled workflows using python - Knowledge of LLM, Prompt Engineering, RAG Architecture, Agentic AI. - Basic knowledge of Hybrid prompting technique... 
    Work experience placement

    Tata Consultancy Services

    Jersey City, NJ
    2 days ago
  • $80k - $90k

     ...Bonus based on performance ~ Training & development Role:- AI Engineer Key Responsibilities Apply AI/ML technologies such as...  ...Exposure to AI/ML concepts, including machine learning pipelines or LLM based systems. Familiarity with embeddings, vector databases... 
    Internship

    Triunity Software

    Hoboken, NJ
    17 hours ago
  •  ...Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished / Principal Technical Leader Target / alternate titles Distinguished Engineer - AI; Principal AI Engineer; AI Platform... 

    VBeyond

    Jersey City, NJ
    18 hours ago
  •  ...AI Engineers - Agentic Development & AI-Augmented Engineering Responsibilities Design and implement "loop engineering" workflows...  ...(MCP) servers and tool schemas that are legible and safe for LLM agents to use Define human-in-the-loop checkpoints,... 
    Contract work

    Omni Inclusive

    Hoboken, NJ
    4 days ago
  •  ...AI Engineer Location: Charlotte, NC Onsite: 3 days a week Status: Anything is fine Contract: 6 months-18 months Interview process: 1 and...  ...Details: A hands-on AI engineer who can quickly build LLM-powered automation solutions for messy enterprise data and guide... 
    Contract work
    3 days per week

    RIT Solutions

    Summit, NJ
    4 days ago
  •  ...Cloud-Native Automation And AI Agent Workflows Developer Design, develop, and support...  ...and AI agent workflows using Python, and LLM orchestration frameworks (LangChain / LangGraph...  ..., ECS/Fargate, CloudWatch). Reasoning Engines: Experience with frontier models like GPT-... 

    Kasmo Global

    Edison, NJ
    3 days ago
  • $110.7k - $372.9k

     ...navigate or afford the care they need. Deloitte has a new AI-first effort, backed by $1B in committed investment...  ...first months, not into a lab. As an Agentic AI Engineer, you will design, build, and operationalize the LLM- and SLM-powered systems behind real healthcare... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for...  ...Stack AI Engineering: Build full‑stack applications integrating LLM‑driven workflows and AI coding tools (e.g., Devin, GitHub... 
    Full time

    Citigroup

    Jersey City, NJ
    5 days ago
  • $175k - $215k

     ...the right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-...  ...is a hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize... 
    Full time
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    3 days ago
  • $182k - $242k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers...  ...at .About the Role:As a Software and AI Engineer, IT Systems, you’ll design and develop AI...  ...backend services in Node.js and Go.AI/LLM Experience: Solid familiarity with Generative... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Livingston, NJ
    4 days ago
  • $100 per hour

    DescriptionAI Engineer (Application Design & Rapid Deployment)Role OverviewAs an AI Engineer, you will serve as one of our "Tiger Team" engineers: a highly versatile, full...  ...frameworks (e.g., Ragas, TruLens, or custom LLM-as-a-judge pipelines) to measure accuracy, latency... 
    Temporary work
    Immediate start
    Flexible hours

    Internet Brands

    Newark, NJ
    3 days ago
  •  ...pioneer in the fusion of life sciences and AI computer science as an AI-enabled...  .... AlphaLife Sciences is seeking an AI Engineer Leader to drive AI innovation for new projects...  ...technical guidance, and help turn cutting-edge AI/LLM technologies into practical solutions that... 
    Full time
    Visa sponsorship

    Alphalife Sciences

    Jersey City, NJ
    1 day ago
  •  ...infrastructure that powers the next generation of enterprise AI — and we need the best minds in LLM inference to help us do it. This is your opportunity to...  ...and optimizes AI at scale.As a Principal Software Engineer at JPMorganChase within the AI/ML Data Platform team,... 

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  •  ...organization, apply now. We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United...  .... Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems     Role purpose Set... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Jersey City, NJ
    28 days ago
  • $102.5k - $188.9k

     ...reignite your professional career. Role Overview: As an Applied AI Engineer III, you will actively engage in your engineering craft, taking...  ...agentic applications, with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open-source models), RAG pipelines... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    14 hours ago
  •  ...world's leading financial institutions, you've come to the right place.As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite, you will lead a specialized technical area, driving impact across teams,... 

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  • $141 - $180 per hour

     ...details.The Vice President, Global Red Team & AI Security Operations leads enterprise-wide...  ...reduction in partnership with defensive, engineering, and governance teams.Key...  ...Technology RiskLead adversarial testing of AI and LLM systems (e.g., prompt injection, tool misuse... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    1 day ago
  • As an Lead Software Engineer at JPMorganChase within Enterprise Technology, you will lead the architecture and hands...  ...scalable large language model systems and agentic AI platforms for enterprise use cases leveraging LLM Suite. You will design cloud-native solutions,... 

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  • $88.6k - $181.9k

    Position Summary As an Applied AI Engineer II, you will actively engage in your engineering craft, taking a hands-on approach to building...  ...agentic applications, with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open-source models), RAG... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    2 days ago
  • $160k - $200k

     ...DescriptionWe're looking for a senior Platform engineer for GenAI Infrastructure to help build and...  ..., and the supporting data stores that our AI agents rely on. This role partners with...  ...with AWS Bedrock, AgentCore, or any GenAI/LLM platform work.Experience operating Neo4j,... 
    Temporary work
    Work at office
    Remote work

    Bessemer Trust

    Woodbridge, NJ
    2 days ago
  •  ...capabilities, then consider a career in Advisory.KPMG is currently seeking a Senior Associate, AI Engineer to join our Advisory Services practice.Responsibilities:Develop GenAI / LLM applications and integrations using foundational models under the guidance of senior team... 
    H1b
    Local area

    KPMG

    Short Hills, NJ
    1 day ago
  • $210k - $260k

     ...impossible to change. We collapse it into a single AI-native platform that business users can operate without writing a ticket, while engineering teams retain the governance and security...  ...take the decisions that matter - LLM selection, agentic architecture, RAG design... 
    Full time
    Local area
    Home office

    Brown Brothers Harriman

    Jersey City, NJ
    4 days ago
  •  ...26801285Reference Number: 25-01624Title: AI/ML EngineerLocation: Iselin, NJ, 08830Posted...  ...(***) ***-****Company: HAN Staffing Al/ML Engineer 7+ years hands-on experience with ML Model...  ...is plus Exposure with Transformers, LLM's Cloud ML Platforms(Azure AI, AWS SageMaker... 

    HAN Staffing

    Iselin, NJ
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!