Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Middle Village, NY vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Jackson Heights, NY
    5 days ago
  • Innovaccer is seeking an AI Engineer to join the growing AI team and build production-grade AI systems at scale. Collaborate with product,...  ...design, develop, and deploy AI-powered applications including LLM-based solutions, AI agents, and RAG workflows. The ideal candidate... 
    Suggested

    Innovaccer Inc.

    Brooklyn, NY
    2 days ago
  • Integrated Medical Systems, Inc. is seeking an AI Systems Engineer to design, build, and deploy intelligent AI applications that connect with...  ...scalable agents rather than model training, with a focus on MCP, LLM orchestration, APIs, and tool calling. You will implement MCP... 
    Suggested

    RXinsider LTD.

    Brooklyn, NY
    3 days ago
  • Talener is seeking an AI Software Engineering Manager to lead a high-impact team in Hoboken, NJ, focused on building a greenfield AI platform for...  ...ideal candidate will have strong technical expertise in AI/LLM systems and leadership experience in engineering. This is a... 
    Suggested
    Full time

    Talener

    Hoboken, NJ
    2 days ago
  •  ...constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth Management team, you are an integral part of an agile team that works to enhance... 
    Suggested
    For contractors

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  • $90k - $153k

     ...The Assistant Vice President, Red Team & AI Security supports the planning, execution...  ...documentation. Coordinate with defensive, engineering, risk, and business stakeholders to...  ...Support adversarial testing of AI and LLM systems, including prompt injection, data... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    3 days ago
  • Hawthorne Gardening Co. is looking for an experienced AI Agent Developer to own the AI agent development lifecycle for Scotts Miracle...  ...in Computer Science and extensive experience in software engineering with a strong focus on generative AI technologies. Competitive... 

    Hawthorne Gardening Co.

    Brooklyn, NY
    4 days ago
  • St. Jude Children's Research Hospital in Memphis, TN seeks a Senior AI Engineer to lead advanced AI models and secure HPC infrastructure. This hands-on, onsite role focuses on evaluating, fine-tuning, deploying, and benchmarking models, and enforcing safety guardrails for... 

    Thecentermemphis

    Brooklyn, NY
    2 days ago
  • $125k - $150k

     ...actions, and work in the interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power...  ...and API-driven applications. ~ Experience working with LLM APIs or AI frameworks . ~ Exposure to agent frameworks such... 
    Full time
    Work at office
    Local area

    AEG Presents

    Brooklyn, NY
    16 hours ago
  • $65 - $70 per hour

     ...Gen-AI Engineer Location: NJ/NY Area Experience Required: 6-8 years Positions: 4 End Customer Industry: Financial...  ...teams to design and implement Gen-AI use cases, integrate LLM-based solutions with enterprise applications, and ensure scalable... 

    SysMind Tech

    Jersey City, NJ
    5 days ago
  •  ...interview at the client's Jersey City location is mandatory. Only USCs/GCs are eligible Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished / Principal Technical Leader Target /... 

    United Software Group

    Jersey City, NJ
    2 days ago
  •  ...technologies (e.g., transformer models, prompt engineering, model fine-tuning) - Experience...  ...Strong knowledge of: - vLLM - OpenShift AI - Prometheus - Grafana - Aqua...  ...Information Retrieval frameworks for LLM inferencing - Working knowledge of Linux... 

    3B Staffing LLC

    Jersey City, NJ
    1 day ago
  •  ...LLM / Agentic AI / Full-Stack AI Engineering Level - Senior Individual Contributor Target / alternate titles - LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer; RAG Engineer Core keywords -... 

    Echo IT Solutions

    Jersey City, NJ
    1 day ago
  •  ...organization, apply now. We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United...  .... Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems     Role purpose Set... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT America

    Jersey City, NJ
    2 days ago
  • $80k - $90k

     ...AI Engineer Benefits: 401(k), Bonus based on performance, Training & development Key Responsibilities Apply AI/ML technologies such...  ...to AI/ML concepts, including machine learning pipelines or LLM based systems. Familiarity with embeddings, vector databases... 

    Triunity Software

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...scale few can match. From deploying advanced AI to helping shape global markets, we build...  ...President-level Machine Learning Systems Engineer with extensive ML Ops experience to join...  ...Generative AI: RAGAs, DsPy, Large Language Models (LLM)MLOps & ML Lifecycle Management:Platforms:... 
    Full time

    Citigroup

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for...  ...Stack AI Engineering: Build full‑stack applications integrating LLM‑driven workflows and AI coding tools (e.g., Devin, GitHub... 
    Full time

    Citigroup

    Jersey City, NJ
    5 hours ago
  • $170k - $200k

    Our client is seeking an AI Software Engineer Manager to help lead the development of a greenfield AI platform that will serve as a centralized...  ...for an experienced engineering manager with expertise in AI/LLM technologies, Python development, and cloud-native architectures... 
    2 days per week
    3 days per week

    Talener

    Hoboken, NJ
    1 day ago
  • $175k - $215k

     ...the right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-...  ...is a hands-on production role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize... 
    Full time
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    2 days ago
  • $110.7k - $372.9k

     ...navigate or afford the care they need. Deloitte has a new AI-first effort, backed by $1B in committed investment...  ...first months, not into a lab. As an Agentic AI Engineer, you will design, build, and operationalize the LLM- and SLM-powered systems behind real healthcare... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    1 day ago
  •  ...infrastructure that powers the next generation of enterprise AI — and we need the best minds in LLM inference to help us do it. This is your opportunity to...  ...and optimizes AI at scale.As a Principal Software Engineer at JPMorganChase within the AI/ML Data Platform team,... 

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  • As an Lead Software Engineer at JPMorganChase within Enterprise Technology, you will lead the architecture and hands...  ...scalable large language model systems and agentic AI platforms for enterprise use cases leveraging LLM Suite. You will design cloud-native solutions,... 

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  • $88.6k - $181.9k

    Position Summary As an Applied AI Engineer II, you will actively engage in your engineering craft, taking a hands-on approach to building...  ...agentic applications, with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open-source models), RAG... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    1 day ago
  • $210k - $260k

     ...impossible to change. We collapse it into a single AI-native platform that business users can operate without writing a ticket, while engineering teams retain the governance and security...  ...take the decisions that matter - LLM selection, agentic architecture, RAG design... 
    Full time
    Local area
    Home office

    Brown Brothers Harriman

    Jersey City, NJ
    3 days ago
  • $102.5k - $188.9k

     ...reignite your professional career. Role Overview: As an Applied AI Engineer III, you will actively engage in your engineering craft, taking...  ...agentic applications, with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open-source models), RAG pipelines... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    4 days ago
  •  ...world's leading financial institutions, you've come to the right place.As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite, you will lead a specialized technical area, driving impact across teams,... 

    JP Morgan Chase

    Jersey City, NJ
    1 day ago
  • $141 - $180 per hour

     ...details.The Vice President, Global Red Team & AI Security Operations leads enterprise-wide...  ...reduction in partnership with defensive, engineering, and governance teams.Key...  ...Technology RiskLead adversarial testing of AI and LLM systems (e.g., prompt injection, tool misuse... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    5 hours ago
  • $151.4k - $311k

    Position Summary Director, Applied AI Engineering Role Overview: As a Director, Applied AI Engineering, you will shape and own the engineering...  ...agentic applications, with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open-source models), RAG... 
    Work at office
    Local area
    Visa sponsorship
    3 days per week

    Deloitte

    Jersey City, NJ
    2 days ago
  • $176.72k - $265.08k

     ...Applications Development, ProfessionalCompany: CitiLead Applied AI Engineer, Banking Technology - C14 (SVP Level) (Hybrid)Role OverviewWe...  ...perception, reasoning, planning, execution), integrating multiple LLM providers (OpenAI, Anthropic, Google).Full‑Stack AI Engineering... 
    Full time

    Citigroup

    Jersey City, NJ
    2 days ago
  • $106.9k - $200.6k

     ...better working world. The opportunity We are seeking an AI Systems Engineer to own the delivery, model-serving, routing, and...  ...), logs (Loki), traces (Tempo/Jaeger), dashboards (Grafana), LLM debugging and evaluation (LangSmith/Langfuse), and SLA/alert... 
    Full time
    Summer holiday
    Flexible hours

    EY

    Hoboken, NJ
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!