Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Staten Island, NY vacancy
  • Innovaccer is seeking an AI Engineer to join the growing AI team and build production-grade AI systems at scale. Collaborate with product,...  ...design, develop, and deploy AI-powered applications including LLM-based solutions, AI agents, and RAG workflows. The ideal candidate... 
    Suggested

    Innovaccer Inc.

    Brooklyn, NY
    4 days ago
  • A technology company based in Berkeley Heights, New Jersey, seeks an experienced software engineer for LLM-powered applications. The role involves designing agent architectures, developing RAG pipelines for payments workloads, and integrating classical ML models. Ideal... 
    Suggested

    LTM

    Berkeley Heights, NJ
    4 days ago
  • Talener is seeking an AI Software Engineering Manager to lead a high-impact team in Hoboken, NJ, focused on building a greenfield AI platform for...  ...ideal candidate will have strong technical expertise in AI/LLM systems and leadership experience in engineering. This is a... 
    Suggested
    Full time

    Talener

    Hoboken, NJ
    4 days ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    Suggested
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  •  ...organization, apply now.We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).Distinguished AI EngineerEnterprise AI Architecture / LLM Platforms / Advanced AI SystemsRole purposeSet the architecture,... 
    Suggested
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Jersey City, NJ
    2 days ago
  • Hawthorne Gardening Co. is looking for an experienced AI Agent Developer to own the AI agent development lifecycle for Scotts Miracle...  ...in Computer Science and extensive experience in software engineering with a strong focus on generative AI technologies. Competitive... 

    Hawthorne Gardening Co.

    Brooklyn, NY
    1 day ago
  •  ...2F interview at the client's Jersey City location is mandatory. Only USCs/GCs are eligible Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished / Principal Technical Leader Target / alternate titles... 

    Kasmo Global

    Jersey City, NJ
    3 days ago
  •  ...LLM / Agentic AI / Full-Stack AI Engineering Level - Senior Individual Contributor Target / alternate titles - LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer; RAG Engineer Core keywords -... 

    ECHO IT SOLUTIONS INC .

    Jersey City, NJ
    22 hours ago
  • $142.32k - $213.48k

     ...scale few can match. From deploying advanced AI to helping shape global markets, we build...  ...President-level Machine Learning Systems Engineer with extensive ML Ops experience to join...  ...Generative AI: RAGAs, DsPy, Large Language Models (LLM)MLOps & ML Lifecycle Management:Platforms:... 
    Full time

    Citigroup

    Jersey City, NJ
    4 days ago
  •  ...AI Engineers - Agentic Development & AI-Augmented Engineering Responsibilities Design and implement "loop engineering" workflows...  ...(MCP) servers and tool schemas that are legible and safe for LLM agents to use Define human-in-the-loop checkpoints,... 
    Contract work

    Omni Inclusive

    Hoboken, NJ
    5 days ago
  • $80k - $90k

     ...AI Engineer Benefits: 401(k), Bonus based on performance, Training & development Key Responsibilities Apply AI/ML technologies such...  ...to AI/ML concepts, including machine learning pipelines or LLM based systems. Familiarity with embeddings, vector databases... 

    Triunity Software

    Jersey City, NJ
    4 days ago
  •  ...I engineer Location: charlotte, NC Onsite: 3 days a week Status: anything is fine...  ...have 1 other interview) Must have: AI automation, document ingestion, structuring...  ...hands-on AI engineer who can quickly build LLM-powered automation solutions for messy... 
    Contract work
    3 days per week

    RIT Solutions, Inc.

    Summit, NJ
    3 days ago
  • $52 - $57 per hour

     ...Requirements/Must Have: Strong full-stack software engineering background (front-end, back-end, APIs, data layer)...  ...ability. Direct, hands-on experience building AI agents or agentic workflows (e.g., using LLM orchestration frameworks, tool-calling/function-calling... 

    Cynet Systems

    Iselin, NJ
    5 days ago
  • $125k - $150k

     ...actions, and work in the interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power...  ...and API-driven applications. ~ Experience working with LLM APIs or AI frameworks . ~ Exposure to agent frameworks such... 
    Full time
    Work at office
    Local area

    Brooklyn Sports & Entertainment

    Brooklyn, NY
    4 days ago
  •  ...- 1 Customer: Telecommunication Industry Position: Gen AI Engineer (Agentic AI/Python/GCP-Google ADK preferred) Onsite/Hybrid work...  ...Science, SQL, Python, Pandas, Deep Learning, Machine Learning, LLM, Data Structures, BERT Transformers, NLP, PyTorch, PySpark.... 
    Local area
    Remote work

    Danta Technologies

    Hoboken, NJ
    5 days ago
  • $58.26 - $66.26 per hour

     ...AI Engineer Genesis10 is currently seeking an AI Engineer for a contract position with a Global Financial Institution located in Jersey...  ...scientist executing end-to-end Gen AI projects ~ Experience with LLM Models (Llama, Mixtral, Mistral) ~ Experience with various... 
    Hourly pay
    Contract work

    Genesis10

    Jersey City, NJ
    6 days ago
  • $90k - $120k

     ...Development in Python using FastAPI/ Flask framework - Working experience in Data Processing, AI enabled workflows using python - Knowledge of LLM, Prompt Engineering, RAG Architecture, Agentic AI. - Basic knowledge of Hybrid prompting technique... 
    Work experience placement

    Tata Consultancy Services

    Jersey City, NJ
    3 days ago
  • $142.32k - $213.48k

     ...Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for...  ...Stack AI Engineering: Build full‑stack applications integrating LLM‑driven workflows and AI coding tools (e.g., Devin, GitHub... 
    Full time

    Citigroup

    Jersey City, NJ
    2 days ago
  • $110.7k - $372.9k

     ...navigate or afford the care they need. Deloitte has a new AI-first effort, backed by $1B in committed investment...  ...first months, not into a lab. As an Agentic AI Engineer, you will design, build, and operationalize the LLM- and SLM-powered systems behind real healthcare... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    3 days ago
  • $100 per hour

    DescriptionAI Engineer (Application Design & Rapid Deployment)Role OverviewAs an AI Engineer, you will serve as one of our "Tiger Team" engineers: a highly versatile, full...  ...frameworks (e.g., Ragas, TruLens, or custom LLM-as-a-judge pipelines) to measure accuracy, latency... 
    Temporary work
    Immediate start
    Flexible hours

    Internet Brands

    Newark, NJ
    4 days ago
  • $175k - $215k

     ...the right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-...  ...is a hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize... 
    Full time
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    4 days ago
  •  ...pioneer in the fusion of life sciences and AI computer science as an AI-enabled...  .... AlphaLife Sciences is seeking an AI Engineer Leader to drive AI innovation for new projects...  ...technical guidance, and help turn cutting-edge AI/LLM technologies into practical solutions that... 
    Full time
    Visa sponsorship

    Alphalife Sciences

    Jersey City, NJ
    1 day ago
  •  ...infrastructure that powers the next generation of enterprise AI — and we need the best minds in LLM inference to help us do it. This is your opportunity to...  ...and optimizes AI at scale.As a Principal Software Engineer at JPMorganChase within the AI/ML Data Platform team,... 

    JP Morgan Chase

    Jersey City, NJ
    5 days ago
  •  ...organization, apply now. We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United...  .... Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems     Role purpose Set... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Jersey City, NJ
    29 days ago
  • $141 - $180 per hour

     ...details.The Vice President, Global Red Team & AI Security Operations leads enterprise-wide...  ...reduction in partnership with defensive, engineering, and governance teams.Key...  ...Technology RiskLead adversarial testing of AI and LLM systems (e.g., prompt injection, tool misuse... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    2 days ago
  • $102.5k - $188.9k

     ...reignite your professional career. Role Overview: As an Applied AI Engineer III, you will actively engage in your engineering craft, taking...  ...agentic applications, with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open-source models), RAG pipelines... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    1 day ago
  •  ...world's leading financial institutions, you've come to the right place.As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite, you will lead a specialized technical area, driving impact across teams,... 

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  •  ...scale, come make a difference at Fiserv.Job TitleLead AI EngineerAbout Your RoleAs a Lead AI Engineer, you will play a critical role in advancing AI-driven...  ...Google Cloud Platform 3+ years of experience building LLM-powered applications or agents in production with platforms... 
    Full time
    Work at office
    Visa sponsorship
    Monday to Friday

    Fiserv

    Berkeley Heights, NJ
    12 hours ago
  •  ...TitleAI Accelerated Senior Java EngineerAbout your role:As an AI Accelerated Senior Java Engineer you will be an elite software builder who delivers high-...  ...advanced Generative AI and Large Language Model (LLM) developer tools into their daily workflow. Far beyond writing... 
    Full time
    Contract work
    Temporary work
    For contractors
    H1b
    Work at office
    Local area
    Monday to Friday

    Fiserv

    Berkeley Heights, NJ
    1 day ago
  • $160k - $200k

     ...DescriptionWe're looking for a senior Platform engineer for GenAI Infrastructure to help build and...  ..., and the supporting data stores that our AI agents rely on. This role partners with...  ...with AWS Bedrock, AgentCore, or any GenAI/LLM platform work.Experience operating Neo4j,... 
    Temporary work
    Work at office
    Remote work

    Bessemer Trust

    Woodbridge, NJ
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!