Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Roselle Park, NJ vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Hillside, NJ
    4 days ago
  • $143k - $210k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers...  ...Learn more at .What You'll Do:The Field Engineering organization at CoreWeave supports the...  ....- Experience diagnosing failures in LLM applications and fixing the underlying cause... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Livingston, NJ
    4 days ago
  • $182k - $242k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers...  ...at .About the Role:As a Software and AI Engineer, IT Systems, you’ll design and develop AI...  ...backend services in Node.js and Go.AI/LLM Experience: Solid familiarity with Generative... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Livingston, NJ
    2 days ago
  • $100 per hour

    DescriptionAI Engineer (Application Design & Rapid Deployment)Role OverviewAs an AI Engineer, you will serve as one of our "Tiger Team" engineers: a highly versatile, full...  ...frameworks (e.g., Ragas, TruLens, or custom LLM-as-a-judge pipelines) to measure accuracy, latency... 
    Suggested
    Temporary work
    Immediate start
    Flexible hours

    Internet Brands

    Newark, NJ
    1 day ago
  • $60k

    DescriptionAssociate AI Engineer Kickstart your career in AI! We're looking for Associate AI Engineers to join our Central AI team. This role...  ..., or dynamic context handling). Experience integrating LLM APIs to build AI-powered features and workflows.Why You'll Love... 
    Suggested
    Temporary work
    Internship
    Work at office
    Flexible hours

    Internet Brands

    Newark, NJ
    4 days ago
  • $160k - $200k

     ...DescriptionWe're looking for a senior Platform engineer for GenAI Infrastructure to help build and...  ..., and the supporting data stores that our AI agents rely on. This role partners with...  ...with AWS Bedrock, AgentCore, or any GenAI/LLM platform work.Experience operating Neo4j,... 
    Temporary work
    Work at office
    Remote work

    Bessemer Trust

    Woodbridge, NJ
    5 days ago
  •  ...scale, come make a difference at Fiserv.Job TitleLead AI EngineerAbout Your RoleAs a Lead AI Engineer, you will play a critical role in advancing AI-driven...  ...Google Cloud Platform 3+ years of experience building LLM-powered applications or agents in production with platforms... 
    Full time
    Work at office
    Visa sponsorship
    Monday to Friday

    Fiserv

    Berkeley Heights, NJ
    1 day ago
  • $109k - $182.4k

     ...make a difference at Fiserv.Job TitleAI - Cyber Security Engineer - IIAbout your role:As an Advisor II, AI - Software Engineering, you will design, build, and...  ...equivalent cloud certifications.Familiarity with OWASP LLM Top 10, MITRE ATT&CK, MITRE ATLAS, and the National... 
    Full time
    Temporary work
    H1b
    Work at office
    Monday to Friday

    Fiserv

    Berkeley Heights, NJ
    5 days ago
  •  ...26801285Reference Number: 25-01624Title: AI/ML EngineerLocation: Iselin, NJ, 08830Posted...  ...(***) ***-****Company: HAN Staffing Al/ML Engineer 7+ years hands-on experience with ML Model...  ...is plus Exposure with Transformers, LLM's Cloud ML Platforms(Azure AI, AWS SageMaker... 

    HAN Staffing

    Iselin, NJ
    2 days ago
  • $75 - $85 per hour

     ...Job Title : AI DevOps Engineer Location : Iselin, NJ or Charlotte, NC Pay Rate: $75-85/hr Job Description : An AI DevOps Engineer...  ...operations and troubleshooting problems. Skills : LLM ( Claude/ OpenAI) with focus on reasoning/agentic use cases... 

    Axelon

    Iselin, NJ
    1 day ago
  • $140k - $170k

     ...Fortegra is building AI-enabled systems for commercial insurance. Our document-intelligence...  ...tools change. We're hiring an engineer to build and improve these production systems...  ...Applied-AI judgment. You understand common LLM failure modes and how context, data... 
    Full time
    Temporary work

    Fortegra

    Woodbridge, NJ
    2 days ago
  • $176.4k - $327.6k

     ...Executive Director, Semantic and Knowledge Engineering, the Associate Director, Semantic and...  ...services, and semantic APIs. The role enables AI, analytics, enterprise search,...  ...Experience supporting generative AI, agentic AI, LLM-powered products, RAG/GraphRAG, vector databases... 
    Full time
    Remote work
    Relocation
    Home office

    Novartis

    East Hanover, NJ
    1 day ago
  •  ...AI/LLM Solutions DeveloperStrong experience with AWS cloud services. Hands-on experience with Amazon Bedrock for developing and deploying...  ...scalable GenAI applications. Collaborate with multiple engineering teams to integrate AI capabilities into enterprise platforms.... 

    Insight Global

    Newark, NJ
    18 hours ago
  •  ...AI & Systems Engineer Position at WebMDWebMD is the most recognized and trusted brand of health information and the leading provider of health...  ...deploying, configuring, and administering large language model (LLM) platforms including Anthropic Claude (claude.ai, Claude API,... 
    Work at office

    WebMD

    Newark, NJ
    3 days ago
  • Job ID: 24580073Reference Number: 25-00062Title: AI EngineerLocation: Iselin, NJ, 08830Posted Date: 2025-01-27Company: HAN StaffingAI Engineer

    HAN Staffing

    Iselin, NJ
    2 days ago
  • $175k - $200k

     ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant...  ...early partner adoption. Both need a senior engineering owner, and both need to grow into the...  ...systems, with at least 2 years building LLM-backed systems that real users depend on.... 
    Full time
    Internship

    OUTFRONT Media

    Fairfield, Essex County, NJ
    5 days ago
  •  ...80063Reference Number: 26-00404Title: GEN AI DEVELOPERLocation: Iselin, NJ, 08830Posted...  ...Company: HAN Staffing The Mid-Senior Applied AI Engineer is responsible for designing,developing,...  ...pipelines, containerization, and robust LLM monitoring (observability, prompt drift,... 

    HAN Staffing

    Iselin, NJ
    2 days ago
  •  ...involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleAI EngineerAbout your role:As an AI Engineer you will apply advanced machine learning and statistical techniques to detect, prevent, and respond to cyber threats. You will... 
    Full time
    Temporary work
    H1b
    Work at office
    Monday to Friday

    Fiserv

    Berkeley Heights, NJ
    2 days ago
  • Job ID: 21305149Reference Number: 24-00163Title: AI engineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-08Company: HAN StaffingAI

    HAN Staffing

    Iselin, NJ
    2 days ago
  •  ...with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI Engineer to join our team in Edison, New Jersey (US-NJ), United States (US).As a GenAI Engineer with NTT DATA, you will be at the... 
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Edison, NJ
    1 day ago
  • Join to apply for the Junior AI-Assisted Software Engineer role at SS&C Technologies Join to apply for the Junior AI-Assisted Software Engineer role at SS&C Technologies Get AI-powered advice on this job and more exclusive features. As a leading financial services and healthcare... 
    Full time
    Casual work
    Local area
    Flexible hours

    SS&C Technologies

    Union, NJ
    1 day ago
  • $18 - $50 per hour

     ...university graduation and completion of the program Position Overview: Siemens Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial Intelligence and Digital Thread initiatives within the Capital PreSales... 
    Remote job
    Hourly pay
    Full time
    Internship
    Local area

    Siemens

    Elizabeth, NJ
    2 hours ago
  • $120k - $145k

     ...AISystemsEngineering&Operations  ~Hands-onexperiencedeploying,configuring,andadministeringlargelanguagemodel(LLM) platformsincludingAnthropicClaude(claude.ai,ClaudeAPI,ClaudeCode)andGoogleGemini acrossenterpriseenvironments ~ExperiencearchitectingandadministeringMCP(... 
    Full time
    Part time
    Work at office
    Flexible hours

    WebMD

    Newark, NJ
    13 days ago
  •  ...We are seeking a driven AI & Innovation Engineer to spearhead the design and deployment of artificial intelligence solutions within our Property...  ...unstructured sources (documents, images, telematics). Develop LLM-powered tools for policy document analysis, FNOL automation,... 

    Connvertex Technologies Inc.

    Edison, NJ
    3 days ago
  •  ...Broadridge team.Broadridge is hiring! We are seeking a Professional Engineer with advanced engineering and technical leadership position...  ...operational support, and continuous improvement through automation and AI-assisted engineering practices.ResponsibilitiesDesign, develop,... 
    Full time
    Local area

    Broadridge

    Newark, NJ
    2 days ago
  •  ...Certified 8(a), and HUBZone company. Job Overview: The AI Platform Engineer builds, hardens, and helps operate the enterprise GenAI/agentic...  ...scale. This role owns the platform “foundations”—including LLM gateway & model routing, vector/knowledge base infrastructure... 
    Full time
    Remote work
    Flexible hours

    Cinteot

    Newark, NJ
    4 days ago
  • Generative AI Developer - remote , European Union , B2B contract Codertal is hiring a Generative AI Developer for a remote opportunity...  ...will collaborate closely with AI researchers, designers, and engineering teams to bring generative AI concepts to production... 
    Daily paid
    Contract work
    Remote work
    Flexible hours

    Codertal

    Union, NJ
    1 day ago
  •  ...If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleLead AI Transformation EngineerAbout Your RoleAs a Lead AI Transformation Engineer, you will play a critical role in advancing AI-driven engineering practices and establishing technical... 
    Full time
    Work at office
    Visa sponsorship

    Fiserv

    Berkeley Heights, NJ
    2 days ago
  •  ...find new areas of inspiration and expand your capabilities, then consider a career in Advisory.KPMG is currently seeking a Manager, AI Engineer to join our Advisory Services practice.Responsibilities:End-to-end design and development of AI/ML solutions, leveraging cloud AI... 
    H1b
    Local area

    KPMG

    Short Hills, NJ
    3 days ago
  • Job ID: 24293199Reference Number: 24-01180Title: Gen AI Application EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-11-22Contact: Deepak KumarContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Key Responsibilities: • Develop back... 

    HAN Staffing

    Iselin, NJ
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!