Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Python AI Engineer

EPAM Systems, Inc.

We are looking for a Lead Python AI Engineer to build robust, AI-powered API services and agentic workflows. In this role, you will bridge the gap between traditional backend systems and modern language models, focusing on secure and scalable LLM interactions with internal systems, vector databases, and external tools via orchestration frameworks. We treat LLMs not as magic, but as components in a secure, scalable distributed system. If you take pride in API reliability, graceful failure handling, and production-grade AI integration, we'd love to talk to you. Req# Responsibilities End-to-End Ownership: Own API contracts and service reliability end-to-end. AI edge cases must fail gracefully without compromising system integrity Rigorous Systems Engineering: Integrate LLMs with a strong engineering foundation-baking in evaluation, comprehensive observability, robust fallback handling, and cost awareness Reusable Frameworks: Build reliable, reusable orchestration frameworks and logic designed for downstream developer consumption Design and build scalable backend API services and advanced LLM orchestration layers Implement and maintain complex RAG (Retrieval-Augmented Generation) pipelines, covering document ingestion, chunking, embedding, and retrieval optimization Develop and connect agent tools using LangChain, LangGraph, and potentially MCP (Model Context Protocol) Ensure top-tier security, privacy, enterprise-grade observability, and comprehensive test coverage across all backend workflows Contribute actively to architecture decisions and engineering standards within your pod Collaborate cross-functionally with frontend engineers, data engineers, and infrastructure teams Requirements Backend Experience: 7+ years of backend engineering with a heavy focus on microservices and distributed systems, using Python for high-performance backend services and cloud-native APIs Cloud & Infrastructure: Hands-on experience with AWS, Docker, ECS/EKS, and RESTful APIs Security First: Proven experience with secure coding practices and strong authentication/authorization (auth/authz) fundamentals Agentic Frameworks: Practical, hands-on experience with frameworks such as LangChain, LlamaIndex, or LangGraph AI SDK Integration: 1-2+ years of hands-on experience integrating AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent) in production environments AI Observability & Evaluation: Familiarity with AI evaluation tooling or real-time APM platforms (e.g., LangSmith, Langfuse, Arize) RAG Pipelines: Practical experience working with vector databases (e.g., Amazon Kendra, OpenSearch), advanced embedding strategies, and retrieval systems Nice to have Frontend Fluency: 1-2+ years of experience with React and TypeScript Scale & Deployment: Experience deploying applications to EKS environments at scale Interoperability & Security: Knowledge of agent interoperability patterns (MCP) and identity/security domain models (IAM, CIAM) Secondary Languages: Professional proficiency in Java, Node.js, or Go

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Python AI Engineer in New York, NY vacancy
  • We are hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it transitions from a Confluence-focused RAG chatbot into a broader, agentic knowledge system. Today, our platform supports Confluence/GitHub ingestion... 
    Suggested

    EPAM Systems

    New York, NY
    1 day ago
  • $60 - $68 per hour

     ...Job Title: Python Developer/AI Engineer Duration: 18 Month W2 Contract  Location:NYC/Jersey City  Required Pay Scale: $60-$68/hour Job Description...  ...platforms, applications, and supporting infrastructure. Lead technical delivery and collaborate with cross-functional... 
    Suggested
    Full time
    Contract work
    Internship

    Matlen Silver

    New York, NY
    3 days ago
  • Location: New York; USAWork type: RemoteSeniority: SeniorPrimary skill: Python.CorePosted: 2026-11-05We are hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it transitions from a Confluence-focused RAG... 
    Suggested
    Temporary work

    EPAM Systems

    New York, NY
    2 days ago
  • $60 - $68 per hour

    Python/AI Engineer 18 Month W2 Contract NYC- Hyrbird 3 days onsite $60-$68/hour Python Developer/ AI Engineer Project Details Develop core Agent Runtime capabilities and reusable platform services. Build agent orchestration, memory management, context management... 
    Suggested
    Contract work
    Internship

    The Matlen Silver Group, Inc.

    New York, NY
    5 days ago
  • A leading software development company in New York is seeking an entry-level Python engineer to join their team in the Brooklyn office. The role involves working on the AI inference pipeline that powers sophisticated OCR and computer vision products. Candidates should have... 
    Suggested
    Full time
    Work at office

    Mathpix

    New York, NY
    14 hours ago
  • Tecdata Engineering busca un Senior Software Engineer / AI Engineer con experiencia en Python, IA generativa y agentes. El trabajo es 100% remoto y se ofrece un salario anual de hasta 39.000 € brutos. Se requiere al menos 5 años de experiencia y un perfil orientado a backend... 
    Remote job

    Tecdata

    New York, NY
    2 days ago
  •  ...into a high-impact role where you'll own end-to-end delivery of AI-native solutions embedded directly within client environments. As...  ...real business problems, not just build prototypes. Join EPAM to engineer solutions that matter. From AI to cloud transformation, you'll... 

    EPAM Systems

    New York, NY
    2 days ago
  • $176.72k - $265.08k

     ...TechnologyCompany: CitiThe Applied AI and Agents Factory brings together ambitious engineers to turn advanced AI capabilities...  ...adopted across Citi.The Lead / Staff Forward Deployed Engineer...  ...and multi-agent workflows using Python, graph-based state engines (e.g.,... 
    Full time

    Citigroup

    New York, NY
    2 days ago
  •  ...Job Description Job Description Lead Clinical Automation & AI Systems Engineer   Department: Clinical Operations & Technology Engineering  Reports...  ...software development experience (proficient in Python and/or modern TypeScript).  Solid understanding of... 
    Remote work
    Day shift

    Generation Next Fertility

    New York, NY
    22 days ago
  • $30 per hour

     ...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week Engagement: Contract with potential for long-term engagement Eligibility... 
    Contract work
    Immediate start
    Remote work
    Visa sponsorship

    NextGen Coding Company

    New York, NY
    1 day ago
  • Aircall is seeking a Forward‑Deployed Engineer to own end‑to‑end delivery of low‑code AI solutions connecting AI Agents with CRMs, help desks, and communications tools. You will design, implement, and operationalize workflows, drive team upskilling, and build reusable... 

    Aircall

    New York, NY
    14 hours ago
  • Ajaia is seeking a Senior AI Engineer to lead the technical build of AI systems across client engagements and internal products. You will shape architecture, set engineering standards, and ship production-ready solutions across web frontends, services, LLM integrations,... 
    Remote job

    AJAIA

    New York, NY
    14 hours ago
  • $210k - $250k

     ...Job Description Founding AI Engineer New York City, NY | In-Person | $210,000–$250,000 Base + Equity About the Company Shields...  ...backend systems: Build and maintain backend APIs using Python, Django, and/or FastAPI, along with AWS infrastructure, collaborating... 

    Shields Group Search

    New York, NY
    28 days ago
  • NextGen Coding Company in New York City is seeking an AI Software Engineer focused on Python-driven document intelligence. You will build cloud-based ingestion pipelines, OCR workflows, and indexing to enable LLMs to reason over large volumes of documents. You’ll work... 

    NextGen Coding Company

    New York, NY
    3 days ago
  • NextGen Coding Company in New York City seeks an AI Software Engineer to design and implement production systems for large-scale document intelligence...  ...search for AI models. The role emphasizes building robust Python pipelines and cloud-based processing. The candidate should... 

    NextGen Coding Company

    New York, NY
    3 days ago
  • $176k

     ...Current PhD, AI Engineering Internship Program - Summer 2027 Key Role Details This is a full...  ...experience or academic work programming with Python, Go, Scala, or Java. Preferred...  ...engineering teams to deliver our industry leading capabilities with breakthrough product experiences... 
    Full time
    Part time
    Summer work
    Internship
    Local area

    Capital One

    New York, NY
    4 days ago
  • Topselection ищет опытного backend-разработчика для разработки Java-сервисов на Spring Boot и AI-модулей на Python с FastAPI. В обязанности входит интеграция LLM, внешних API и инструментов MCP, а также реализация RAG и семантического поиска по документам. Требуется уверенное... 

    Topselection

    New York, NY
    2 days ago
  • $300k

     ...industries, and partner with leading global research organizations...  ...quantitative researchers, and engineers who work together to examine the...  ...or pushing the boundaries of AI research from concept to production...  ...languages: C / C++ / Python / CUDA and other low-level GPU... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    4 days ago
  • $300k

     ...industries, and partner with leading global research organizations...  ...quantitative researchers, and engineers who work together to examine the...  ...fluid mix of skills including AI/ML expertise, engineering pragmatism...  ...languages: C / C++ / Python / CUDA and other low-level GPU... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    4 days ago
  • $80.42k - $106.05k

     ...possible. Join us and help the world’s leading organizations unlock the value of technology...  ...APIs and web applications including Python, AI, SQL, NodeJS, AWS, NLP & Search ML. ~...  ...., GitHub Copilot, ChatGPT) to improve engineering productivity and code quality ~... 
    Permanent employment
    Full time
    Local area
    Flexible hours

    Capgemini

    New York, NY
    10 days ago
  •  ...Job Description AI Engineer (Hybrid - New York, NY / Mountain View, CA) \n \n Optomi, in partnership with a leading business management consulting and professional services network...  ...hands-on experience in AI development, Python, and Generative AI, with experience using... 

    Optomi

    New York, NY
    7 hours ago
  •  ...Careers at Snaga — the world's first AI-first companyAI ML · Platform Engineering# AI EngineerBuild the agents and the runtime behind them: planning, tool...  ...tenant.## Your toolsDeno/TypeScript on the platform, Python where models need it, MCP for tools, A2A between agents... 
    Full time
    Local area
    Remote work

    SnagA Inc.

    New York, NY
    5 days ago
  •  ...building a developer-friendly cloud platform for AI-native, full-stack applications. We seek a senior content engineer who can teach through code, tutorials, demos,...  ...full-stack experience with Node.js/TypeScript, Python, PostgreSQL, and Docker. #J-18808-Ljbffr Render

    Render

    New York, NY
    2 days ago
  •  ...Responsibilities Build an outbound engine covering lead sourcing, enrichment, scoring, and personalized...  ..., and nurture triggers Create an AI-assisted content pipeline for outbound...  ...engineering, agent frameworks, and RAG Strong Python and/or TypeScript skills Experience... 

    Rwazi, Inc.

    New York, NY
    3 days ago
  • $5,000 - $6,000 per month

     ...Senior / Staff Engineer: AI Agents & Production Reliability Job Description Location: Remote, Canada, Argentina, Brazil and the United Kingdom...  ...Cursor), including running several agents in parallel. Strong Python and TypeScript; event-driven services; MongoDB or Postgres.... 
    Full time
    Contract work
    For contractors
    Work at office
    Remote work

    Trivium LLC

    New York, NY
    1 day ago
  • Applied AI EngineerNYC, hybridWe're partnered with a leading quantitative investment and technology firm that is building...  ...and looking to hire an AI Engineer to help drive the initiative.This...  ...engineering fundamentalsExpert-level Python development experienceExperience... 
    For contractors

    Selby Jennings

    New York, NY
    3 days ago
  •  ...Responsibilities Design and build agentic AI applications that can reason, plan,...  ...production environments. Partner with engineering, data, security, product, and business teams...  ...automation. Qualifications Strong Python development experience and software engineering... 

    The Phoenix Group

    New York, NY
    3 days ago
  •  ...Senior Agentic AI Engineer Embedded Engineering Engagement We are hiring Senior Agentic AI Engineers to join a high-impact engineering...  ...experience, or equivalent demonstrated depth. ~ Strong Python and/or comparable systems/backend programming experience. ~... 
    Remote work

    Flowmentum, Inc.

    New York, NY
    4 days ago
  •  ...AI/ML Engineer | Hedge Fund | New York We are currently working with a leading hedge fund who are looking to hire an experienced AI/ML Engineer to join their growing technology...  ...LLM or Generative AI applications. Strong Python development skills. Experience working with... 

    Cititec

    New York, NY
    3 days ago
  • $350k

     ...Senior AI Engineer sought to join a small, exceptionally fast-moving engineering team building an AI-native consumer platform. There is...  ...retrieval failures in production. ~ Experience with TypeScript or Python and AI-assisted development workflows. ~ The ability to move... 
    Full time

    IT Recruitment Solutions

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Python AI Engineer. Be the first to apply!