Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in Glen Oaks, NY vacancy
  • Innovaccer is seeking an AI Engineer to join the growing AI team and build production-grade AI systems at scale. Collaborate with product,...  ...design, develop, and deploy AI-powered applications including LLM-based solutions, AI agents, and RAG workflows. The ideal candidate... 
    Suggested

    Innovaccer Inc.

    Brooklyn, NY
    4 days ago
  • $145.06k - $296.05k

     ...About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal...  .... Responsibilities include but are not limited to: LLM Application Development Design, build, and maintain AI-powered... 
    Suggested
    Full time
    Work at office

    Within

    Long Island City, NY
    14 hours ago
  • $156.4k - $301k

     ...an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within...  ...Engineering Execution Develop and implement AI and LLM-powered applications leveraging Retrieval-Augmented... 
    Suggested
    Summer holiday
    Local area
    Flexible hours

    EY

    Jericho, NY
    2 days ago
  • Hawthorne Gardening Co. is looking for an experienced AI Agent Developer to own the AI agent development lifecycle for Scotts Miracle...  ...in Computer Science and extensive experience in software engineering with a strong focus on generative AI technologies. Competitive... 
    Suggested

    Hawthorne Gardening Co.

    Brooklyn, NY
    1 day ago
  • $118.11k

     ...driven decisions. This role sits on MDA's Engineering team, working alongside our BI and Data...  ...problems and turns them into data products, AI agents, and automation, all while...  ...Segment). Experience evaluating and monitoring LLM systems in production. The range of annual... 
    Suggested
    Full time
    Work experience placement
    Remote work
    Flexible hours

    NextGenEnergyJobs

    Brooklyn, NY
    4 days ago
  •  ...driven team and would love for you to join us. AI is a core part of how Dscout operates....  ...under the hood. As an AI Data Engineer you will be at the intersection of ML systems...  ...data modeling frameworks Familiarity with LLM evaluation and observability tooling Exposure... 
    Local area
    Remote work
    Flexible hours
    Shift work

    Neura Market

    Brooklyn, NY
    4 days ago
  •  ...We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python...  ...development using Google ADK or Agent SDK. ~ Strong experience with LLM integration, prompt engineering, and agent orchestration. ~... 

    2T Consulting

    Glen Oaks, NY
    2 days ago
  • $120k - $140k

    Select how often (in days) to receive an alert: Senior Gen AI Software Engineer Requisition ID: 49886 Business Unit: Fitch Group Category: Information...  ...Protocol (MCP), AI-enabled search, vector databases, and LLM integration in real-time enterprise environments. Hands-on... 
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch

    Brooklyn, NY
    4 days ago
  • Midi Health is seeking a senior AI/ML engineer to design, build, and ship LLM-powered features across clinical workflows. You will drive evaluation, safety, and integration with patient, clinician, and operations teams in a hybrid environment in the SF Bay Area. The role... 

    Jobzhr

    Brooklyn, NY
    3 days ago
  •  ...Joining our team means engaging with expansive engineering teams across Latin America, Philippines...  ...in multiple industries. Position Title: AI-Native Software Engineer Category:...  ..., or customer data. Understanding of AI/LLM concepts and how AI can be integrated into... 

    Lean Solutions Group

    Brooklyn, NY
    1 day ago
  • Airbnb is seeking an Operations Engineer to apply AI at the forefront of BizTech's observability and automation. You will leverage LLM-powered triage and scripting to improve incident response and data quality while embedding AI into runbooks. In this role you will build... 
    Remote job

    Nubeero Limited

    Brooklyn, NY
    1 day ago
  • $61k - $66.3k

    # Junior AI & Metadata EngineerColumbiaApply for this job* Permanent* Experienced Professionals...  ...)## About The Role* The AI & Metadata Engineer will design and build AI-enabled metadata...  ....* This role will focus on leveraging AI/LLM technologies to analyze enterprise assets... 
    Permanent employment
    Full time
    Local area
    Flexible hours

    Capgemini

    Brooklyn, NY
    2 days ago
  •  ...Minneapolis, MN URL: Who We Are Collaboration.Ai is a mission-focused, AI-powered software...  ...the team - mentor mid-level and junior engineers through code reviews, architectural...  ...Amazon S3 AI Integration: Python, FastAPI (LLM-powered service touchpoints) Infrastructure... 
    Contract work

    Mosaec

    Brooklyn, NY
    2 days ago
  • $170k - $210k

     ...believe high-trust teams are built in person and scaled remotely. AI-native engineering. We expect every engineer to be fluent with modern AI coding...  ...and evaluation. What You Will Do Design, build, and ship LLM-powered features end-to-end: prompt design, retrieval, tool... 
    Work at office
    Remote work
    Shift work
    2 days per week

    Jobzhr

    Brooklyn, NY
    3 days ago
  • Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on. You will work closely with our... 
    Local area

    Salvo Software LLC

    Brooklyn, NY
    14 hours ago
  • $165k - $185k

     ...Taulia will revolutionize fintech. About the Job AI is only as smart as the data it consumes. We are seeking an AI Data Engineer to ensure our agent ecosystem is powered by...  ...what makes data "searchable" for an AI. LLM & Agent Familiarity: Practical experience preparing... 
    Remote work
    Flexible hours

    Taulia

    Brooklyn, NY
    3 days ago
  •  ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic...  ...We're looking for an Applied AI Engineer to take our growing collection of foundation...  ...time voice AI pipelines (STT, TTS, streaming LLM) Production RAG systems beyond toy... 
    Full time

    Norbert Health

    Brooklyn, NY
    more than 2 months ago
  • Director, AI Engineering (Corporate) We are Lennar Lennar is one of the nation's leading homebuilders, dedicated to making an impact and creating...  ...the adoption of AI and automation (e.g., agentic workflows, LLM‑powered tooling, intelligent process automation) across the... 
    For contractors
    Live in
    Work at office
    Local area

    Lennar USA

    Brooklyn, NY
    1 day ago
  • Visionist, Inc. is seeking a Senior Applied AI Engineer - Software Engineering to join our fully funded opportunity on a large PRIME contract...  ..., engineers, and mission stakeholders. You will architect LLM-powered workflows, RAG pipelines, and AI agent capabilities; build... 
    Contract work

    Visionist, Inc.

    Brooklyn, NY
    3 days ago
  • $25 per hour

    The Nuclear Company is the fastest growing AI tech-startup in the nuclear and energy...  ...people use to build power plants. As an AI/ML Engineer Intern on the Platform Integration & AI/...  ...learning and agent capabilities inside NOS: LLM-driven workflows, retrieval-augmented... 
    Bi-weekly pay
    Permanent employment
    Full time
    Internship
    Relocation

    The Nuclear Company

    Brooklyn, NY
    4 days ago
  •  ...About the Role We’re building next-generation AI systems that help military planners...  ...defense applications. As an Applied AI Research Engineer, you’ll focus on human machine teaming and...  .... Experience with PyTorch and modern LLM tooling (Transformers, vLLM, Hugging Face,... 
    Remote work
    Relocation package
    Flexible hours

    Code Metal, Inc.

    Brooklyn, NY
    2 days ago
  • $130k - $150k

    AI Systems Engineer Founded in 1994, Integrated Medical Systems, Inc. (IMS) is one of the nation’s leading distributors serving the alternate-...  ...action. You’ll work heavily with Model Context Protocol (MCP), LLM orchestration, APIs, tool calling, enterprise data, and... 
    Flexible hours

    RXinsider LTD.

    Brooklyn, NY
    14 hours ago
  • $136k - $253k

     ...(TRSS) is looking for you! About The Role As a Generative AI and Machine Learning Engineer, you will be responsible for supporting product development...  ..., NER, summarization and topic modeling Familiarity with LLM training and efficient finetuning (PEFT, LoRA, Quantization... 
    Contract work
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Latitude

    Brooklyn, NY
    1 day ago
  • Responsibilities architect comprehensive end-to-end AI systems lead deployment of AI systems...  ...of evaluation frameworks mentor engineers at various levels through technical guidance...  ...including vector databases, embedding models, LLM APIs, and orchestration frameworks... 

    Jobtailor

    Brooklyn, NY
    1 day ago
  • $105.4k - $207.8k

     ...want to build the data foundations that power the next generation of AI-enabled cyber defense?If yes, then Deloitte’s Cyber team could be the place for you.We are looking for a hands-on Data Engineer to build and operate the governed data foundations powering cyber risk... 
    Local area
    Visa sponsorship

    Deloitte

    Jericho, NY
    1 day ago
  • $189.2k - $372.9k

    Position Summary At Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help clients turn AI ambition into enterprise...  ...Solution Development Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows... 
    Local area
    Visa sponsorship

    Deloitte

    Jericho, NY
    3 days ago
  •  ...healthcare and scientific discovery to powering AI and the technologies people rely on every...  ...internal AI knowledge platform that lets engineers ask natural-language questions across GPU...  ...evaluation. Practical experience with LLM prompting, structured generation, tool calling... 
    Worldwide

    Advanced Micro Devices

    Brooklyn, NY
    14 hours ago
  • Thomson Reuters in the United States is seeking a Senior AI Engineer to architect and deliver AI agent systems end-to-end, spanning multi-...  ...integrations. You will build production-grade AI agents on top of modern LLM APIs and agent SDKs, contributing to observability and quality... 

    Relha LLC

    Brooklyn, NY
    3 days ago
  • $130.9k - $268.7k

    Role Overview: As an Associate Director, Applied AI Engineering, you will set the engineering vision and technical direction for the firm’s...  ...and agentic applications, with hands‑on GenAI experience across LLM integration (OpenAI, Anthropic, or open‑source models), RAG... 
    Work at office
    Local area

    Relha LLC

    Brooklyn, NY
    2 days ago
  • Position Summary At Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help clients turn AI ambition into enterprise...  ...Solution Development Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows... 
    Local area
    Shift work

    Deloitte

    Jericho, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!