Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM Engineer

2T Consulting

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI/LLM Engineer in South Ozone Park, NY vacancy
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Suggested

    2T Consulting

    Forest Hills, NY
    4 days ago
  • $145.06k - $296.05k

     ...About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal...  .... Responsibilities include but are not limited to: LLM Application Development Design, build, and maintain AI-powered... 
    Suggested
    Full time
    Work at office

    Within

    Long Island City, NY
    1 day ago
  • Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products. You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and... 
    Suggested

    Apple Inc.

    Brooklyn, NY
    5 days ago
  • Goliath Partners Inc. in San Francisco is seeking a Founding AI Engineer (Hybrid) to help build the core intelligence powering its enterprise...  ...decisions. You will work directly with the founders to move LLM and agent-based technology beyond prototypes, delivering reliable... 
    Suggested

    Goliath Partners Inc.

    Brooklyn, NY
    4 days ago
  • $118.11k - $178.65k

     ...driven decisions. This role sits on MDA's Engineering team, working alongside our BI and Data...  ...problems and turns them into data products, AI agents, and automation, all while...  ...Segment). Experience evaluating and monitoring LLM systems in production. The range of annual... 
    Suggested
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Samsara

    Brooklyn, NY
    5 days ago
  •  ...driven team and would love for you to join us. AI is a core part of how Dscout operates....  ...under the hood. As an AI Data Engineer you will be at the intersection of ML systems...  ...data modeling frameworks Familiarity with LLM evaluation and observability tooling Exposure... 
    Local area
    Remote work
    Flexible hours
    Shift work

    Neura Market

    Brooklyn, NY
    1 day ago
  • $120k - $140k

    Select how often (in days) to receive an alert: Senior Gen AI Software Engineer Requisition ID: 49886 Business Unit: Fitch Group Category: Information...  ...Protocol (MCP), AI-enabled search, vector databases, and LLM integration in real-time enterprise environments. Hands-on... 
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch

    Brooklyn, NY
    1 day ago
  •  ...seeking an Artificial Intelligence and Machine Learning Engineer to design and deliver agentic AI prototypes for national security applications. You will...  ...workflows, and multi-agent patterns, with knowledge of LLM platforms and prompt engineering to ensure reliability and... 
    Remote job

    Booz Allen Hamilton

    Brooklyn, NY
    5 days ago
  • Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on. You will work closely with our... 
    Local area

    Salvo Software LLC

    Brooklyn, NY
    2 days ago
  •  ...Minneapolis, MN URL: Who We Are Collaboration.Ai is a mission-focused, AI-powered software...  ...eval and observability layer that keeps LLM quality measurable; and the ingestion...  ...has measurable quality, cost, and latency Engineer data pipelines — robust ingestion of documents... 

    Neura Market

    Brooklyn, NY
    5 days ago
  •  ...Required Qualifications 6+ years of hands‑on experience in data engineering and analytics roles. Strong proficiency in SQL and experience...  ...Learning concepts, including model development, large language model (LLM) implementation, and statistical analysis for predictive and... 
    Permanent employment
    Contract work
    Local area

    Machine Intelligence Technologies, LLC

    Brooklyn, NY
    22 hours ago
  • $165k - $185k

     ...Taulia will revolutionize fintech. About the Job AI is only as smart as the data it consumes. We are seeking an AI Data Engineer to ensure our agent ecosystem is powered by...  ...what makes data "searchable" for an AI. LLM & Agent Familiarity: Practical experience preparing... 
    Remote work
    Flexible hours

    Taulia

    Brooklyn, NY
    5 days ago
  •  ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic...  ...We're looking for an Applied AI Engineer to take our growing collection of foundation...  ...time voice AI pipelines (STT, TTS, streaming LLM) Production RAG systems beyond toy... 
    Full time

    Norbert Health

    Brooklyn, NY
    more than 2 months ago
  •  ...Build Your Future The director is a hands-on engineering leader responsible for engineering teams...  ...architected, and increasingly powered by AI-driven capabilities. The incumbent will...  ...and automation (e.g., agentic workflows, LLM-powered tooling, intelligent process... 
    For contractors
    Live in
    Work at office
    Local area

    Relha LLC

    Brooklyn, NY
    3 days ago
  • $81.26k - $98.47k

     ...Position Responsibilities Develop and integrate AI-enabled features within the Veeva CRM/Vault CRM ecosystem — including LLM-based solutions using industry standard...  ...or via AWS Bedrock under the direction of the engineering manager. Support the implementation of AI/ML... 
    Hourly pay
    Full time
    Temporary work
    Part time
    Summer work
    Live in
    Remote work
    Flexible hours
    Shift work

    Bristol-Myers Squibb

    Brooklyn, NY
    2 days ago
  • Visionist, Inc. is seeking a Senior Applied AI Engineer - Software Engineering to join our fully funded opportunity on a large PRIME contract...  ..., engineers, and mission stakeholders. You will architect LLM-powered workflows, RAG pipelines, and AI agent capabilities; build... 
    Contract work

    Visionist, Inc.

    Brooklyn, NY
    5 days ago
  • Salesforce is hiring AI Builders as part of our New Grad cohort. You’ll be embedded with...  .... You’ll work in a builder pod with engineers, product and sales, delivering real impact...  ...React, TypeScript, GraphQL, Python, and AI/LLM concepts, ready to grow quickly in a fast-... 

    Jobzhr

    Brooklyn, NY
    2 days ago
  • $156.4k - $301k

     ...an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within...  ...Engineering Execution Develop and implement AI and LLM-powered applications leveraging Retrieval-Augmented... 
    Summer holiday
    Local area
    Flexible hours

    EY

    Jericho, NY
    4 days ago
  • $130k - $150k

    AI Systems Engineer Founded in 1994, Integrated Medical Systems, Inc. (IMS) is one of the nation’s leading distributors serving the alternate-...  ...action. You’ll work heavily with Model Context Protocol (MCP), LLM orchestration, APIs, tool calling, enterprise data, and... 
    Flexible hours

    RXinsider LTD.

    Brooklyn, NY
    2 days ago
  • $136k - $253k

     ...(TRSS) is looking for you! About The Role As a Generative AI and Machine Learning Engineer, you will be responsible for supporting product development...  ..., NER, summarization and topic modeling Familiarity with LLM training and efficient finetuning (PEFT, LoRA, Quantization... 
    Contract work
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Latitude

    Brooklyn, NY
    3 days ago
  •  ...Here's what you will be doing: Develop and deploy AI chatbot/agent solutions for enterprise use cases Integrate LLM-based agents with structured and unstructured...  ...clustering Perform data preprocessing, feature engineering, and model evaluation Integrate ML outputs into... 
    Remote job
    Internship

    Stie Yai

    Brooklyn, NY
    3 days ago
  • $25 per hour

    The Nuclear Company is the fastest growing AI tech-startup in the nuclear and energy...  ...people use to build power plants. As an AI/ML Engineer Intern on the Platform Integration & AI/...  ...learning and agent capabilities inside NOS: LLM-driven workflows, retrieval-augmented... 
    Bi-weekly pay
    Permanent employment
    Full time
    Contract work
    For contractors
    For subcontractor
    Summer work
    Internship
    Summer internship
    Work at office
    Relocation

    The Nuclear Company

    Brooklyn, NY
    1 day ago
  •  ...sensitive, detail rich, and critical to national security. As an AI/Machine Learning Engineer, you will work directly with mission users to capture these...  ...You will design and implement solutions that may include LLM powered workflows, agent based automation, or hybrid... 
    Temporary work

    Optimus Technology, Inc

    Brooklyn, NY
    5 days ago
  • Consultant Machine Learning & Knowledge Graph Engineer Data Science is all about breaking new...  ...engineering, product, and platform teams to enable AI atscale.scaleML solutions across Dell's...  ...deep learning, machine learning, and LLM‑based solutions. Advanced Python... 

    Dell GmbH

    Brooklyn, NY
    5 days ago
  •  ...Inc., seeks an experienced Independent Contractor for full-stack AI applications to support development, enhancement, and deployment...  ...per week. You will build internal tools and dashboards, implement AI features such as LLM integrations, #J-18808-Ljbffr Munchkin, Inc.
    Contract work
    For contractors

    Munchkin, Inc.

    Brooklyn, NY
    3 days ago
  • Ambarella, a world leader in edge AI semiconductors, is seeking an experienced DFT engineer to join our team in Kentucky. You will drive DFT implementation from RTL to post-production for a multi-million gate Computer Vision SoC, delivering robust patterns and test strategies... 

    VisLab (an Ambarella Inc. company)

    Brooklyn, NY
    1 day ago
  • $75k - $85k

    This role supports the engineering, deployment, and operation of internal AI applications built on an established Python and Angular codebase and AWS-native architecture...  ...Understanding of prompt engineering and structured LLM interactions Experience integrating applications... 
    Full time
    Temporary work
    Flexible hours

    Tecolote

    Brooklyn, NY
    4 days ago
  •  .... Our culture values innovation, ownership, and engineering excellence. Role Overview We are seeking a highly skilled AI Developer with a strong backend and machine learning...  ...to design, train, optimize, and deploy LLM models in on-prem and offline environments. This... 
    Work at office
    Local area

    Salvo Software LLC

    Brooklyn, NY
    2 days ago
  • The Nuclear Company, a fast-growing AI startup in the nuclear and energy space, seeks a 12-week AI/ML Engineer Intern in its Platform Integration & AI/Data squad. You’ll work on NOS, building LLM-driven workflows, retrieval-augmented generation, and agents with production... 
    Internship
    Relocation

    The Nuclear Company

    Brooklyn, NY
    1 day ago
  • $102.45k - $174.24k

    Select how often (in days) to receive an alert: Applied AI Engineer/Full stack App Development Engineer 35619 We are Farmers - where ambition...  ..., Retrieval-Augmented Generation (RAG), autonomous agents, and LLM API orchestration. Assesses when AI adds value versus when... 
    Work at office
    Flexible hours
    Shift work

    Farmers Group Inc.

    Brooklyn, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM Engineer. Be the first to apply!