Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Verona, NJ vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Little Falls, NJ
    2 days ago
  • $143k - $210k

     ...Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...more at  What You'll Do: The Field Engineering organization at CoreWeave supports the clients...  .... - Experience diagnosing failures in LLM applications and fixing the underlying... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Livingston, NJ
    8 days ago
  • $182k - $242k

     ...Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...About the Role: As a Software and AI Engineer, IT Systems, you'll design and develop AI...  ...backend services in Node.js and Go. AI/LLM Experience: Solid familiarity with Generative... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Livingston, NJ
    9 days ago
  •  ...2F interview at the client's Jersey City location is mandatory. Only USCs/GCs are eligible Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished / Principal Technical Leader Target / alternate titles... 
    Suggested

    Kasmo Global

    Jersey City, NJ
    3 days ago
  • $90k - $120k

     ...Development in Python using FastAPI/ Flask framework - Working experience in Data Processing, AI enabled workflows using python - Knowledge of LLM, Prompt Engineering, RAG Architecture, Agentic AI. - Basic knowledge of Hybrid prompting technique... 
    Suggested
    Work experience placement

    Tata Consultancy Services

    Jersey City, NJ
    3 days ago
  •  ...LLM / Agentic AI / Full-Stack AI Engineering Level Senior Individual Contributor Target / alternate titles LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer; RAG Engineer Core keywords LLM, GenAI... 

    ECHO IT SOLUTIONS INC .

    Jersey City, NJ
    1 day ago
  •  ...pioneer in the fusion of life sciences and AI computer science as an AI-enabled...  .... AlphaLife Sciences is seeking an AI Engineer Leader to drive AI innovation for new projects...  ...technical guidance, and help turn cutting-edge AI/LLM technologies into practical solutions that... 
    Full time
    Visa sponsorship

    Alphalife Sciences

    Jersey City, NJ
    16 hours ago
  •  ...Senior AI Engineer Location: Either Columbia, MD or Lisle, IL Onsite: 4 days a week Contract: 6-9 months to perm (they want to definitely...  ...environments. The team is developing AI solutions leveraging LLM technologies, RAG architectures, and agent frameworks to support... 
    Permanent employment
    Contract work
    Immediate start

    RIT Solutions

    Summit, NJ
    4 days ago
  • $60k

     ...Associate AI EngineerKickstart your career in AI! We're looking for Associate AI Engineers to join our Central AI team. This role is perfect for someone smart and innovative...  ...dynamic context handling). Experience integrating LLM APIs to build AI-powered features and... 
    Temporary work
    Internship
    Work at office
    Flexible hours

    Nolo

    Newark, NJ
    1 day ago
  •  ...'s leading financial institutions, you've come to the right place. As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite , you will lead a specialized technical area, driving impact across teams, technologies... 

    J.P. Morgan

    Jersey City, NJ
    1 day ago
  •  ...per week, and a F2F interview at the client's Jersey City location is mandatory. Only USCs/GCs are eligible AI Foundation Model Engineer LLM / Agentic AI / Full-Stack AI Engineering Level Senior Individual Contributor Target / alternate... 

    United Software Group

    Jersey City, NJ
    4 days ago
  • $120k - $145k

     ...any other basis protected by law. Position Overview The AI & Systems Engineer is a hybrid infrastructure and AI operations role responsible...  ..., configuring, and administering large language model (LLM) platforms including Anthropic Claude (claude.ai, Claude API,... 
    Full time
    Part time
    Work at office
    Flexible hours

    WebMD

    Newark, NJ
    1 day ago
  •  ...JPMC is hiring to join the growing Asset and Wealth Management AI Engineering team. We are executing like a startup and building next-...  ...solutions through data analysis, developing cutting-edge ML and LLM models, and deploying these models to production environments... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    1 day ago
  • $61k - $101k

     ...formal training or certification in software engineering and 7+ years of applied experience. We need deep, hands-on experience with LLM inference systems such as vLLM, TensorRT-...  ...designing and leading adoption of agentic AI-enabled development practices across teams,... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    7 days ago
  • $61k - $101k

     ...Requirements: We require formal software engineering training or certification, along with 5+...  ...We need hands-on experience building LLM-powered applications, including agentic architectures...  ...We require advanced proficiency with AI-assisted development tools, including... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    6 days ago
  •  ...organizational structuresand developing AI agents equipped with the latest tools and...  ...Conduct and guide research on prompt engineering techniques to improve the performance of...  ...services field, exploring and utilizing LLM orchestration and agentic AI libraries.... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    4 days ago
  • $175k - $200k

     ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant...  ...early partner adoption. Both need a senior engineering owner, and both need to grow into the...  ...systems, with at least 2 years building LLM-backed systems that real users depend on.... 
    Internship

    OUTFRONT Media

    Fairfield, Essex County, NJ
    1 day ago
  •  ...Certified 8(a), and HUBZone company. Job Overview: The AI Platform Engineer builds, hardens, and helps operate the enterprise GenAI/agentic...  ...scale. This role owns the platform “foundations”—including LLM gateway & model routing, vector/knowledge base infrastructure... 
    Full time
    Remote work
    Flexible hours

    Cinteot

    Newark, NJ
    12 days ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  •  ...rewarding opportunity for you to take your software engineering career to the next level. We are building a next generation, AI-driven Global Financial Crimes Strategic...  ...pipelines, supervised and unsupervised ML models, and LLM risk explainability that operate at scale... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    11 days ago
  • $50k - $75k

     ...learning experiences. We are transforming Medscape into a daily-use, AI-powered clinical companion, helping clinicians stay up to date,...  .... This centralized role is a hybrid between an analyst and an engineer, focusing on prototyping, tool implementation, and process... 
    Full time
    Part time
    Flexible hours

    WebMD

    Newark, NJ
    10 days ago
  • $165k - $242k

     ...Senior Software Engineer, Developer ExperienceLivingston, NJ / New York, NY / Sunnyvale, CA...  ..., WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...Experience with or strong technical interest in LLM-integrated developer tooling, such as... 
    Permanent employment
    Full time
    Casual work
    Work at office

    CoreWeave

    Livingston, NJ
    16 hours ago
  • $145k - $165k

     ...who share these values.The Senior Software Engineer plays a central role within the Software...  ...sacrificing quality, and actively integrates AI tooling into their development workflow....  ...and integrate AI capabilities, including LLM APIs and AI-assisted features, into scalable... 
    Full time
    Work at office
    Local area
    Monday to Friday

    Lowenstein Sandler

    Roseland, NJ
    4 days ago
  • $109k - $204k

     ...Software Engineer II, Developer ExperienceCoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools,...  ...platform services that power them.Familiarity with LLM-integrated developer tooling, such as MCP... 
    Permanent employment
    Full time
    Casual work
    Work at office

    CoreWeave

    Livingston, NJ
    16 hours ago
  •  ...language processing, document understanding, and LLM-enabled applications. You will collaborate...  ...concept to deployment. You will help raise engineering standards and mentor others while shipping real solutions. As an Applied AI/ML - Vice President in the Wholesale... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    2 days ago
  •  ...The Assistant Vice President, Red Team & AI Security supports the planning, execution...  ...documentation.Coordinate with defensive, engineering, risk, and business stakeholders to ensure...  ...adversarial testing of AI and LLM systems, including prompt injection, data... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    3 days ago
  •  ...Software Engineer IIIWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As...  ...Enterprise Technology, you will help design and deliver agentic AI platforms and large language model-enabled services for enterprise... 

    Hackajob

    Jersey City, NJ
    2 days ago
  •  ...every US time zone, as well as select offices in the US and internationally. Who You Are You are a Senior Software Engineer who is both AI-native and product-minded. You love taking an ambiguous customer problem, turning it into a clear plan, and shipping a real... 
    Full time
    Remote work

    GrabJobs

    Newark, NJ
    4 days ago
  •  ...Tiger Analytics is seeking a highly skilled Senior AI Engineer to join our dynamic team. In this role, you will design, develop, and implement cutting-edge AI solutions that drive business value for our clients. You will leverage advanced machine learning techniques,... 
    Remote work

    Tiger Analytics

    Jersey City, NJ
    4 days ago
  •  ..., and construction/facilities. We are a Woman-owned, SBA Certified 8(a), and HUBZone company. About the job Job Overview: The AI Data Engineer is responsible for building and operating high‑quality, governed, and AI‑ready data pipelines that power enterprise GenAI and... 

    SCALIS

    Newark, NJ
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!