Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Fort Lee, NJ vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Cliffside Park, NJ
    3 days ago
  • $21 - $25 per hour

     ...21, 2026. Position Purpose:  We are seeking a motivated AI Engineering intern to support the development and implementation of an AI-...  ...in AI/ML workflows. Development Framework & Tools: Core LLM Frameworks: Using LangChain or LlamaIndex for orchestrating LLM... 
    Suggested
    Hourly pay
    Temporary work
    Internship
    Work at office
    Immediate start

    Veolia

    Paramus, NJ
    more than 2 months ago
  •  ...2F interview at the client's Jersey City location is mandatory. Only USCs/GCs are eligible Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished / Principal Technical Leader Target / alternate titles... 
    Suggested

    Kasmo Global

    Jersey City, NJ
    4 days ago
  • $90k - $120k

     ...Development in Python using FastAPI/ Flask framework - Working experience in Data Processing, AI enabled workflows using python - Knowledge of LLM, Prompt Engineering, RAG Architecture, Agentic AI. - Basic knowledge of Hybrid prompting technique... 
    Suggested
    Work experience placement

    Tata Consultancy Services

    Jersey City, NJ
    4 days ago
  •  ...LLM / Agentic AI / Full-Stack AI Engineering Level Senior Individual Contributor Target / alternate titles LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer; RAG Engineer Core keywords LLM, GenAI... 
    Suggested

    ECHO IT SOLUTIONS INC .

    Jersey City, NJ
    2 days ago
  •  ...VERSANT, is building the next generation of AI-powered equity research for individual...  ...company. Job Description Senior AI Engineer We're looking for a highly capable...  ...This role is for engineers who enjoy turning LLM and agentic AI capabilities into reliable... 
    Full time
    Work at office
    Local area

    Versant Media

    Englewood Cliffs, NJ
    24 days ago
  •  ...pioneer in the fusion of life sciences and AI computer science as an AI-enabled...  .... AlphaLife Sciences is seeking an AI Engineer Leader to drive AI innovation for new projects...  ...technical guidance, and help turn cutting-edge AI/LLM technologies into practical solutions that... 
    Full time
    Visa sponsorship

    Alphalife Sciences

    Jersey City, NJ
    1 day ago
  • $184k - $230k

     ...Senior AI Engineer page is loaded## Senior AI Engineerlocations: 3 Odell Plazatime type: Full timeposted on: Posted Todayjob requisition...  ...experiences. You have the opportunity to work with complex AI/ML/LLM-based solutions in a fast-paced, rapidly evolving landscape, answering... 
    Shift work

    Montefiore Hudson Valley Collaborative

    Yonkers, NY
    18 hours ago
  •  ...per week, and a F2F interview at the client's Jersey City location is mandatory. Only USCs/GCs are eligible AI Foundation Model Engineer LLM / Agentic AI / Full-Stack AI Engineering Level Senior Individual Contributor Target / alternate... 

    United Software Group

    Jersey City, NJ
    5 days ago
  •  ...'s leading financial institutions, you've come to the right place. As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite , you will lead a specialized technical area, driving impact across teams, technologies... 

    J.P. Morgan

    Jersey City, NJ
    2 days ago
  •  ...JPMC is hiring to join the growing Asset and Wealth Management AI Engineering team. We are executing like a startup and building next-...  ...solutions through data analysis, developing cutting-edge ML and LLM models, and deploying these models to production environments... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    2 days ago
  •  ...and commitment to the goals of Jesuit Education. Department: Enterprise AI Position Summary: Reporting to the Assistant Vice President of Enterprise AI, the AI/Machine Learning Engineer supports the advancement of the University’s enterprise AI strategy by designing... 
    Temporary work
    Flexible hours

    Fordham University

    Bronx, NY
    3 days ago
  • $61k - $101k

     ...formal training or certification in software engineering and 7+ years of applied experience. We need deep, hands-on experience with LLM inference systems such as vLLM, TensorRT-...  ...designing and leading adoption of agentic AI-enabled development practices across teams,... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    8 days ago
  •  ...organizational structuresand developing AI agents equipped with the latest tools and...  ...Conduct and guide research on prompt engineering techniques to improve the performance of...  ...services field, exploring and utilizing LLM orchestration and agentic AI libraries.... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    1 hour ago
  • $61k - $101k

     ...Requirements: We require formal software engineering training or certification, along with 5+...  ...We need hands-on experience building LLM-powered applications, including agentic architectures...  ...We require advanced proficiency with AI-assisted development tools, including... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    7 days ago
  • $18 - $50 per hour

     ...university graduation and completion of the program Position Overview: Siemens Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial Intelligence and Digital Thread initiatives within the Capital PreSales... 
    Remote job
    Hourly pay
    Full time
    Internship
    Local area

    Siemens

    Bronx, NY
    5 days ago
  •  ...Life Good for Everyone. Role SummaryADX is hiring a Senior AI FDE (Forward Deployed Engineer) for a unique enterprise AI transformation role focused on...  ..., TypeScript, and SQL.Hands-on experience building LLM-based applications or agent systems, including prompt/context... 
    Full time
    Temporary work
    For contractors
    Local area
    Immediate start

    LG Electronics

    Englewood Cliffs, NJ
    6 days ago
  • $160k - $200k

     ...Responsibilities:Build complex multi-agent AI agents that are highly scalableWork with...  ...with debugging traces of LLM calls to identify errors/optimizationsExperience...  ...scalable AI workflowsProficiency in prompt engineering and optimization techniquesSome UI/UX experience... 

    Cross River

    Fort Lee, NJ
    4 days ago
  •  ...rewarding opportunity for you to take your software engineering career to the next level. We are building a next generation, AI-driven Global Financial Crimes Strategic...  ...pipelines, supervised and unsupervised ML models, and LLM risk explainability that operate at scale... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    12 days ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    5 days ago
  •  ...Tiger Analytics is seeking a highly skilled Senior AI Engineer to join our dynamic team. In this role, you will design, develop, and implement cutting-edge AI solutions that drive business value for our clients. You will leverage advanced machine learning techniques,... 
    Remote work

    Tiger Analytics

    Jersey City, NJ
    5 days ago
  •  ...Software Engineer IIIWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As...  ...Enterprise Technology, you will help design and deliver agentic AI platforms and large language model-enabled services for enterprise... 

    Hackajob

    Jersey City, NJ
    3 days ago
  •  ...The Assistant Vice President, Red Team & AI Security supports the planning, execution...  ...documentation.Coordinate with defensive, engineering, risk, and business stakeholders to ensure...  ...adversarial testing of AI and LLM systems, including prompt injection, data... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    4 days ago
  • $150k - $210k

     ...impactful internal and external partnerships to deliver measurable business value.About the Position - Embodied AI EngineerWe are seeking an exceptional Embodied AI Engineer to build the foundation of LG's vision of theZero-labor Home. This hybrid role offers a unique... 
    Full time
    Temporary work
    For contractors
    Local area
    Immediate start

    LG Electronics

    Englewood Cliffs, NJ
    6 days ago
  • $149k - $205k

     ...week and work remotely one day. A member of our recruitment team will provide more details. Vice President - Technical AI Foundation Model Engineer Role Summary The VP, Technical AI Foundation Model Engineer is responsible for designing, building, deploying,... 
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG Bank, Ltd.

    Jersey City, NJ
    4 days ago
  • $150k - $205k

     ...AI Application DeveloperEversheds Sutherland's US Innovation Team is seeking an experienced...  ..., including large language model (LLM) integrations, retrieval-augmented generation...  ...large language models (LLMs), prompt engineering, fine-tuning, and orchestration frameworks... 
    Work at office
    Remote work

    Eversheds Sutherland LLP

    Astoria, NY
    4 days ago
  • $67 - $71 per hour

     ...Software Engineer Python Global Financial Firm located in RUTHERFORD, NJ has an immediate...  ...monitoring, and iteration. ~ Exposure to ML/DL/LLM algorithms, model architectures, and...  ...business-like banking, risk management. Experience with AI Dev tools such as Copilot.... 
    Contract work
    Immediate start

    Axelon

    Rutherford, NJ
    3 days ago
  •  ...this role. JOB DESCRIPTION We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III - AI/ML Engineer at JPMorganChase within the AI For Technology group, you serve as a seasoned member of... 

    J.P. Morgan

    Jersey City, NJ
    2 days ago
  •  ...to get employed and settle down in the USA. Required skills: Bachelors degree or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, IT. Highly motivated, self-learner, and technically inquisitive. Experience in programming... 
    H1b

    SynergisticIT

    West New York, NJ
    4 days ago
  •  ...Software Engineer III - AI/ML EngineerWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III - AI/ML Engineer at JPMorgan Chase within the AI For Technology group, you serve as a seasoned... 

    Hackajob

    Jersey City, NJ
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!