Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Little Neck, NY vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Oakland Gardens, NY
    1 day ago
  • Innovaccer is seeking an AI Engineer to join the growing AI team and build production-grade AI systems at scale. Collaborate with product,...  ...design, develop, and deploy AI-powered applications including LLM-based solutions, AI agents, and RAG workflows. The ideal candidate... 
    Suggested

    Innovaccer Inc.

    Brooklyn, NY
    3 days ago
  • $145.06k - $296.05k

     ...About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal...  .... Responsibilities include but are not limited to: LLM Application Development Design, build, and maintain AI-powered... 
    Suggested
    Full time
    Work at office

    Within

    Long Island City, NY
    1 day ago
  • Hawthorne Gardening Co. is looking for an experienced AI Agent Developer to own the AI agent development lifecycle for Scotts Miracle...  ...in Computer Science and extensive experience in software engineering with a strong focus on generative AI technologies. Competitive... 
    Suggested

    Hawthorne Gardening Co.

    Brooklyn, NY
    5 days ago
  • $125k - $150k

     ...actions, and work in the interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power...  ...and API-driven applications. ~ Experience working with LLM APIs or AI frameworks . ~ Exposure to agent frameworks such... 
    Suggested
    Full time
    Work at office
    Local area

    Brooklyn Sports & Entertainment

    Brooklyn, NY
    3 days ago
  • SpaceXAI in Palo Alto, CA seeks a Member of Technical Staff (X.AI LLC) to advance AI research and practical deployments. You will stabilize...  ...cutting-edge techniques, collaborate with AI researchers and engineers, and contribute to projects spanning machine learning, data... 
    Remote work

    Neura Market

    Brooklyn, NY
    3 days ago
  •  ...Joining our team means engaging with expansive engineering teams across Latin America, Philippines...  ...in multiple industries. Position Title: AI-Native Software Engineer Category:...  ...catalog, or customer data. Understanding of AI/LLM concepts and how AI can be integrated... 

    Lean Solutions Group

    Brooklyn, NY
    13 hours ago
  •  ...driven team and would love for you to join us. AI is a core part of how Dscout operates....  ...under the hood. As an AI Data Engineer you will be at the intersection of ML systems...  ...data modeling frameworks Familiarity with LLM evaluation and observability tooling Exposure... 
    Local area
    Remote work
    Flexible hours
    Shift work

    Neura Market

    Brooklyn, NY
    3 days ago
  • $118.11k - $178.65k

     ...driven decisions. This role sits on MDA's Engineering team, working alongside our BI and Data...  ...problems and turns them into data products, AI agents, and automation, all while...  ...Segment). Experience evaluating and monitoring LLM systems in production. The range of annual... 
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Samsara

    Brooklyn, NY
    1 day ago
  • $120k - $140k

    Select how often (in days) to receive an alert: Senior Gen AI Software Engineer Requisition ID: 49886 Business Unit: Fitch Group Category: Information...  ...Protocol (MCP), AI-enabled search, vector databases, and LLM integration in real-time enterprise environments. Hands-on... 
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch

    Brooklyn, NY
    3 days ago
  •  ...Minneapolis, MN URL: Who We Are Collaboration.Ai is a mission-focused, AI-powered software...  ...the team - mentor mid-level and junior engineers through code reviews, architectural...  ...Amazon S3 AI Integration: Python, FastAPI (LLM-powered service touchpoints) Infrastructure... 
    Contract work

    Mosaec

    Brooklyn, NY
    1 day ago
  • Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on. You will work closely with our... 
    Local area

    Salvo Software LLC

    Brooklyn, NY
    4 days ago
  • Airbnb is seeking an Operations Engineer to apply AI at the forefront of BizTech's observability and automation. You will leverage LLM-powered triage and scripting to improve incident response and data quality while embedding AI into runbooks. In this role you will build... 
    Remote job

    Nubeero Limited

    Brooklyn, NY
    5 days ago
  • $61k - $66.3k

    # Junior AI & Metadata EngineerColumbiaApply for this job* Permanent* Experienced Professionals...  ...)## About The Role* The AI & Metadata Engineer will design and build AI-enabled metadata...  ....* This role will focus on leveraging AI/LLM technologies to analyze enterprise assets... 
    Permanent employment
    Full time
    Local area
    Flexible hours

    Capgemini

    Brooklyn, NY
    1 day ago
  •  ...We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python...  ...development using Google ADK or Agent SDK. ~ Strong experience with LLM integration, prompt engineering, and agent orchestration. ~... 

    2T Consulting

    Glen Oaks, NY
    1 day ago
  • $165k - $185k

     ...Taulia will revolutionize fintech. About the Job AI is only as smart as the data it consumes. We are seeking an AI Data Engineer to ensure our agent ecosystem is powered by...  ...what makes data "searchable" for an AI. LLM & Agent Familiarity: Practical experience preparing... 
    Remote work
    Flexible hours

    Taulia

    Brooklyn, NY
    2 days ago
  •  ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic...  ...We're looking for an Applied AI Engineer to take our growing collection of foundation...  ...time voice AI pipelines (STT, TTS, streaming LLM) Production RAG systems beyond toy... 
    Full time

    Norbert Health

    Brooklyn, NY
    more than 2 months ago
  • Visionist, Inc. is seeking a Senior Applied AI Engineer - Software Engineering to join our fully funded opportunity on a large PRIME contract...  ..., engineers, and mission stakeholders. You will architect LLM-powered workflows, RAG pipelines, and AI agent capabilities; build... 
    Contract work

    Visionist, Inc.

    Brooklyn, NY
    2 days ago
  •  ...Build Your Future The director is a hands-on engineering leader responsible for engineering teams...  ...architected, and increasingly powered by AI-driven capabilities. The incumbent will...  ...and automation (e.g., agentic workflows, LLM-powered tooling, intelligent process... 
    For contractors
    Live in
    Work at office
    Local area

    Relha LLC

    Brooklyn, NY
    5 days ago
  • $156.4k - $301k

     ...an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within...  ...Engineering Execution Develop and implement AI and LLM-powered applications leveraging Retrieval-Augmented... 
    Summer holiday
    Local area
    Flexible hours

    EY

    Jericho, NY
    1 day ago
  • $136k - $253k

     ...(TRSS) is looking for you! About The Role As a Generative AI and Machine Learning Engineer, you will be responsible for supporting product development...  ..., NER, summarization and topic modeling Familiarity with LLM training and efficient finetuning (PEFT, LoRA, Quantization... 
    Contract work
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Latitude

    Brooklyn, NY
    5 days ago
  • $130k - $150k

    AI Systems Engineer Founded in 1994, Integrated Medical Systems, Inc. (IMS) is one of the nation’s leading distributors serving the alternate-...  ...action. You’ll work heavily with Model Context Protocol (MCP), LLM orchestration, APIs, tool calling, enterprise data, and... 
    Flexible hours

    RXinsider LTD.

    Brooklyn, NY
    4 days ago
  •  ...About the Role We’re building next-generation AI systems that help military planners...  ...defense applications. As an Applied AI Research Engineer, you’ll focus on human machine teaming and...  .... Experience with PyTorch and modern LLM tooling (Transformers, vLLM, Hugging Face,... 
    Remote work
    Relocation package
    Flexible hours

    Code Metal, Inc.

    Brooklyn, NY
    1 day ago
  • Responsibilities architect comprehensive end-to-end AI systems lead deployment of AI systems...  ...of evaluation frameworks mentor engineers at various levels through technical guidance...  ...including vector databases, embedding models, LLM APIs, and orchestration frameworks... 

    Jobtailor

    Brooklyn, NY
    5 days ago
  • $25 per hour

    The Nuclear Company is the fastest growing AI tech-startup in the nuclear and energy...  ...people use to build power plants. As an AI/ML Engineer Intern on the Platform Integration & AI/...  ...learning and agent capabilities inside NOS: LLM-driven workflows, retrieval-augmented... 
    Bi-weekly pay
    Permanent employment
    Full time
    Contract work
    For contractors
    For subcontractor
    Summer work
    Internship
    Summer internship
    Work at office
    Relocation

    The Nuclear Company

    Brooklyn, NY
    3 days ago
  •  ...opportunities with international clients.We're looking for backend engineers with strong Python experience who enjoy building reliable,...  ...architectures.CI/CD.Serverless architectures.Infrastructure as Code.AI/LLM integrations.German language skills.Benefits That Move You... 
    Remote work
    Worldwide

    Pearster

    Floral Park, Nassau County, NY
    4 days ago
  • $150k - $220k

     ...AI Engineer In the next 30 years, the world will transform every part of the built environment to be climate positive green infrastructure. But today's renewable energy development process can't move fast enough to meet global goals. Paces exists to change that. We... 
    Work at office

    PACES

    Brooklyn, NY
    2 days ago
  •  ...AI Prompt Engineer and RPA Implementation Specialist Work Location: Long Island City, NY Duration: 12+ Months Contract Position Summary: Interview Mode: Video and Face to Face Required Technical Skills Microsoft.NET Framework expertise, particularly... 
    Contract work
    Work at office

    InterSources

    Long Island City, NY
    2 days ago
  •  ...healthcare and scientific discovery to powering AI and the technologies people rely on every...  ...internal AI knowledge platform that lets engineers ask natural-language questions across GPU...  ...evaluation. Practical experience with LLM prompting, structured generation, tool calling... 
    Worldwide

    Jobzhr

    Brooklyn, NY
    4 days ago
  •  ...Senior Full Stack Developer to design, build, and deploy scalable AI agents and applications leveraging Large Language Models (LLMs)....  ...and observability. Role emphasizes end-to-end agent development, LLM orchestration, tooling integration, and collaboration with backend... 

    Uncover

    Brooklyn, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!