Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Floral Park, Nassau County, NY vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Little Neck, NY
    1 day ago
  • $145.06k - $296.05k

     ...About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal...  .... Responsibilities include but are not limited to: LLM Application Development Design, build, and maintain AI-powered... 
    Suggested
    Full time
    Work at office

    Within

    Long Island City, NY
    1 day ago
  • $156.4k - $301k

     ...an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within...  ...Engineering Execution Develop and implement AI and LLM-powered applications leveraging Retrieval-Augmented... 
    Suggested
    Summer holiday
    Local area
    Flexible hours

    EY

    Jericho, NY
    1 day ago
  •  ...opportunities with international clients.We're looking for backend engineers with strong Python experience who enjoy building reliable,...  ...architectures.CI/CD.Serverless architectures.Infrastructure as Code.AI/LLM integrations.German language skills.Benefits That Move You... 
    Suggested
    Remote work
    Worldwide

    Pearster

    Floral Park, Nassau County, NY
    4 days ago
  •  ...AI Prompt Engineer and RPA Implementation Specialist Work Location: Long Island City, NY Duration: 12+ Months Contract Position Summary: Interview Mode: Video and Face to Face Required Technical Skills Microsoft.NET Framework expertise, particularly... 
    Suggested
    Contract work
    Work at office

    InterSources

    Long Island City, NY
    2 days ago
  •  ...capital markets firms, we develop flexible tools, technology, and innovation that deliver a competitive edge. Our globally distributed engineering teams focus on adaptable technology and open architecture to build highly sophisticated trading solutions that can automate and... 
    Work experience placement
    Flexible hours

    FlexTrade

    Great Neck, NY
    5 days ago
  •  ...efficient, well-tested, and reusable Python code following software engineering best practices. Develop and maintain cloud-native...  ...support knowledge sharing and team collaboration. Utilize AI-assisted development tools such as Cursor, Claude Code, or GitHub... 

    Techvilla Solutions

    Bayside, NY
    3 days ago
  •  ...and commitment to the goals of Jesuit Education. Department: Enterprise AI Position Summary: Reporting to the Assistant Vice President of Enterprise AI, the AI/Machine Learning Engineer supports the advancement of the University’s enterprise AI strategy by designing... 
    Temporary work
    Flexible hours

    Fordham University

    Bronx, NY
    2 days ago
  • EY seeks a Senior in Applied AI to build and deploy AI solutions that drive value for private equity clients and their portfolio companies. You will work embedded with senior practitioners, delivering hands-on AI initiatives and using AI as your primary working method... 

    EY

    Jericho, NY
    4 days ago
  • $105.4k - $207.8k

     ...want to build the data foundations that power the next generation of AI-enabled cyber defense?If yes, then Deloitte’s Cyber team could be the place for you.We are looking for a hands-on Data Engineer to build and operate the governed data foundations powering cyber risk... 
    Local area
    Visa sponsorship

    Deloitte

    Jericho, NY
    5 days ago
  •  ..., we develop the flexible tools, technology and innovation that deliver our clients a competitive edge. Our globally distributed engineering teams focus on adaptable technology and open architecture to develop highly sophisticated trading solutions that can automate and... 
    Flexible hours

    FlexTrade

    Great Neck, NY
    3 days ago
  • $189.2k - $372.9k

    Position Summary At Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help clients turn AI ambition into enterprise...  ...Solution Development Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows... 
    Local area
    Visa sponsorship

    Deloitte

    Jericho, NY
    2 days ago
  • $50 per hour

     ...cutting-edge technology and innovation. Our campus is a hub for engineering excellence, where we tackle some of the world's most...  ...demonstrated interpersonal and time management skillsets- Proficient in AI prompting as it applies to this position and practice. - Must be... 
    Full time
    Temporary work
    Work experience placement
    For subcontractor
    Casual work
    Local area
    Flexible hours

    Lockheed Martin

    Uniondale, NY
    3 days ago
  • Position Summary At Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help clients turn AI ambition into enterprise...  ...Solution Development Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows... 
    Local area
    Shift work

    Deloitte

    Jericho, NY
    1 day ago
  •  ...Senior Software EngineerWe are seeking a Senior Software Engineer to support a project focused on building backend applications and data pipelines that combine machine learning algorithms with real-world user data. The work will help optimize the delivery of SEO link... 
    Full time
    Contract work
    Remote work

    Lifted, an Upwork Company™

    Floral Park, Nassau County, NY
    4 days ago
  •  ...Software Engineer IIGrand Rapids, MI / Uniondale, NY/ Austin, TX / Atlanta, GA (Onsite 4 days per week)About AcrisureAcrisure Enterprise...  ...workflows, and team practices that increase delivery speed and quality.AI-assisted engineering. Uses AI-assisted engineering workflows... 
    Temporary work

    Acrisure LLC

    Uniondale, NY
    4 days ago
  •  ...we develop the flexible tools, technology, and innovation that deliver our clients a competitive edge. Our globally distributed engineering teams focus on adaptable technology and open architecture to develop highly sophisticated trading solutions that can automate and... 
    Contract work
    Flexible hours

    FlexTrade

    Great Neck, NY
    3 days ago
  •  ...production issues, perform root cause analysis, and contribute to incident resolution. Collaborate with product teams, architects, QA engineers, SRE teams, and other stakeholders in an Agile environment. Required Skills Strong hands-on experience with Java and Spring Boot... 

    PB consulting

    Bayside, NY
    4 days ago
  •  ...Senior Full-Stack Engineering And Architecture RoleThis is a hands-on, senior-level full-stack engineering and architecture role responsible...  ...AD B2C)); security reviews and penetration testingFluency with AI-assisted / agentic development tools (e.g., GitHub Copilot)Nice... 
    Work experience placement
    Local area
    Shift work

    HealthCare Partners of Nevada

    Garden City, NY
    4 days ago
  • Android DeveloperLocation: Jamaica, NY Duration: 2- 3 years ContractRequirements:60 months of experience in Android Apps Development.60 months of experience in JAVA programming Language12 months of experience in third party SDK, libraries and APIs36 months of experience...
    Remote work

    InterSources

    Jamaica, NY
    4 days ago
  •  ...and testable code. • Experience with unit testing and UI testing frameworks (e.g., XCTest, XCUITest). • Excellent problem-solving skills and attention to detail. • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).... 

    RIT Solutions, Inc.

    Great Neck, NY
    2 days ago
  •  ...Staff Software Engineer The Staff Engineer is responsible for leading our technical foundation, initially collaborating with the Money - Finance engine teams to drive innovation, with the opportunity to work with other teams as well, taking on a mentoring role, designing... 
    Flexible hours

    Pacifica Continental

    Floral Park, Nassau County, NY
    5 days ago
  • Long Term Contract - On Site for Six Months, then HybridDevelop secure, web-centric applications for employees and external stakeholders using a variety of frameworks, especially Ruby on Rails.Work with business users to assist in developing application requirements and...
    Long term contract

    Norgate Technology

    Fresh Meadows, NY
    3 days ago
  • $10 per hour

     ...DevOps EngineerWe are looking for a DevOps Engineer with proven experience in designing, implementing, and maintaining cloud infrastructure in Azure. The ideal candidate will have strong skills in Docker, Kubernetes and CI/CD pipelines. This role requires advanced English... 
    For contractors
    Remote work

    Pearster

    Floral Park, Nassau County, NY
    4 days ago
  •  ...developers, data analysts/data scientists, data engineers, machine learning engineers for full time...  ...experience. For data science/data analyst/AI/machine learning positions preferred...  ...aptitude knowledge of statistics, gen AI, LLM, Sagemaker, Python, computer vision, data... 
    Full time
    Remote work

    SynergisticIT

    Corona, NY
    1 day ago
  • $122k - $240.5k

     ...on 12/31/2026.The Team:Deloitte’s Cyber Engineering is a new team that is spearheading the buildout...  ..., deploying, implementing, or supporting AI, Generative AI, or Agentic AI solutions...  ...experience building and deploying GenAI/LLM-powered solutions in client or production... 
    Local area

    Deloitte

    Jericho, NY
    5 days ago
  •  ...and contribute to solution design and best practices. Required Qualifications ~ Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent professional experience. ~5+ years of Salesforce CPQ development experience. ~ Hands-... 

    PB consulting

    Oakland Gardens, NY
    3 days ago
  •  ...Python Required Experience Job Description: We are looking for excellent aptitude towards python and data engineering to help us create dynamic software applications for our clients. In this role, you will be responsible for writing and testing... 
    Full time
    Remote work
    Monday to Friday

    Gain America

    Hicksville, NY
    2 days ago
  • ALL US VISA'S ARE ACCEPTED NEED ONLY LOCAL PROFILES TO NY / NJ WHO CAN GO FOR AN IN-PERSON INTERVIEW Below are the must-haves: Experience: 10-12 years of hands-on minimum Location: NYC, In-Office (3 days a week, Mon, Tue, Wed)   Should be comfortable with using...
    Work at office
    Local area
    3 days per week

    Longfinch Technologies

    Great Neck, NY
    3 days ago
  • Job Title: SAP MM Consultant Job Location: Queens borough, NY (Onsite) Job Type: Contract Job Description: The consultant should possess the experience and qualifications for this subject area and specifically have experience and qualifications...
    Contract work

    Trinity Technology Solutions

    Jamaica, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!