Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Python AI Engineer

EPAM Systems, Inc.

We are looking for a Lead Python AI Engineer to build robust, AI-powered API services and agentic workflows. In this role, you will bridge the gap between traditional backend systems and modern language models, focusing on secure and scalable LLM interactions with internal systems, vector databases, and external tools via orchestration frameworks. We treat LLMs not as magic, but as components in a secure, scalable distributed system. If you take pride in API reliability, graceful failure handling, and production-grade AI integration, we'd love to talk to you. Req# Responsibilities End-to-End Ownership: Own API contracts and service reliability end-to-end. AI edge cases must fail gracefully without compromising system integrity Rigorous Systems Engineering: Integrate LLMs with a strong engineering foundation-baking in evaluation, comprehensive observability, robust fallback handling, and cost awareness Reusable Frameworks: Build reliable, reusable orchestration frameworks and logic designed for downstream developer consumption Design and build scalable backend API services and advanced LLM orchestration layers Implement and maintain complex RAG (Retrieval-Augmented Generation) pipelines, covering document ingestion, chunking, embedding, and retrieval optimization Develop and connect agent tools using LangChain, LangGraph, and potentially MCP (Model Context Protocol) Ensure top-tier security, privacy, enterprise-grade observability, and comprehensive test coverage across all backend workflows Contribute actively to architecture decisions and engineering standards within your pod Collaborate cross-functionally with frontend engineers, data engineers, and infrastructure teams Requirements Backend Experience: 7+ years of backend engineering with a heavy focus on microservices and distributed systems, using Python for high-performance backend services and cloud-native APIs Cloud & Infrastructure: Hands-on experience with AWS, Docker, ECS/EKS, and RESTful APIs Security First: Proven experience with secure coding practices and strong authentication/authorization (auth/authz) fundamentals Agentic Frameworks: Practical, hands-on experience with frameworks such as LangChain, LlamaIndex, or LangGraph AI SDK Integration: 1-2+ years of hands-on experience integrating AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent) in production environments AI Observability & Evaluation: Familiarity with AI evaluation tooling or real-time APM platforms (e.g., LangSmith, Langfuse, Arize) RAG Pipelines: Practical experience working with vector databases (e.g., Amazon Kendra, OpenSearch), advanced embedding strategies, and retrieval systems Nice to have Frontend Fluency: 1-2+ years of experience with React and TypeScript Scale & Deployment: Experience deploying applications to EKS environments at scale Interoperability & Security: Knowledge of agent interoperability patterns (MCP) and identity/security domain models (IAM, CIAM) Secondary Languages: Professional proficiency in Java, Node.js, or Go

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Python AI Engineer in New York, NY vacancy
  • We are looking for a Lead Python AI Engineer to build robust, AI-powered API services and agentic workflows. In this role, you will bridge the gap between traditional backend systems and modern language models, focusing on secure and scalable LLM interactions with internal... 
    Suggested

    EPAM Systems

    New York, NY
    4 days ago
  • RaceDog Technologies in New York, NY seeks a seasoned Java & Python Developer with AWS and LangChain/Sierra expertise to build high-performance...  ...will architect Java Spring Boot microservices, develop Python AI pipelines, and integrate cloud-native AWS architectures onsite in... 
    Suggested

    RaceDog Technologies

    New York, NY
    2 days ago
  • RaceDog Technologies seeks an exceptional Python Backend + AI/ML Engineer specializing in Agentic AI to join our advanced technology team on a full-...  ...with LangChain/AutoGPT and agent architectures. Apply to lead production-grade AI systems. #J-18808-Ljbffr RaceDog Technologies
    Suggested
    Full time

    RaceDog Technologies

    New York, NY
    2 days ago
  • ClickHouse is seeking a Senior Software Engineer specializing in the AI & ML ecosystem to own and evolve core...  .... You’ll build production-grade Python connectors and SDKs, enabling Data Scientists...  ...pipelines and feature stores. You’ll lead design and performance improvements... 
    Suggested

    Clickhouse

    New York, NY
    2 days ago
  • Position Summary: We are seeking an exceptionally skilled and experienced Python Backend + AI/ML Engineer specializing in Agentic AI frameworks to join our advanced technology team on a full-time onsite basis in New York or Atlanta, via Racedog Technologies. In this critical... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Immediate start

    RaceDog Technologies

    New York, NY
    2 days ago
  • $30 per hour

     ...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week Engagement: Contract with potential for long-term engagement Eligibility... 
    Contract work
    Immediate start
    Remote work
    Visa sponsorship

    NextGen Coding Company

    New York, NY
    2 days ago
  • Montefiore Health System is looking for a Senior AI Engineer in Yonkers, New York. This role will...  ...experiences. Responsibilities include leading the design and development of ML/AI...  ...BS in Data Analytics, and expertise in Python and relevant ML libraries. #J-18808-Ljbffr... 

    Montefiore Health System

    New York, NY
    2 days ago
  • Turing is hiring a Principal AI Engineer to lead enterprise-scale Agentic AI implementations for Fortune 500 clients. The role focuses on designing and deploying autonomous, tool-calling AI systems with reliability at scale. The candidate will provide technical leadership... 

    SIDRAM TECHNOLOGIES

    New York, NY
    2 days ago
  •  ...AI / Forward Deployed Engineer Must have 4+ years of professional experience after graduation. We...  ...Forward Deployed Engineering searches with leading investment firms and have already...  ...engineering background, ideally with Python as a primary language. Hands-on experience... 

    Long Ridge Partners

    New York, NY
    1 day ago
  • $180k - $220k

    EvolutionIQ in New York, NY, is seeking a seasoned Software Engineer to build a multi-tenant enterprise SaaS application aimed at transforming...  ...should have over 5 years of experience, particularly in Python and relational database design. This role offers flexible compensation... 
    Flexible hours

    EvolutionIQ

    New York, NY
    2 days ago
  • Ande Company is seeking a Lead Full-Stack Engineer in New York to design, develop, and deploy AI-powered enterprise applications. You will bridge robust backend systems with AI integrations, build scalable Node.js services, and craft responsive React interfaces, guiding... 

    Ande Company

    New York, NY
    2 days ago
  • Aircall is seeking a Forward‑Deployed Engineer to own end‑to‑end delivery of low‑code AI solutions connecting AI Agents with CRMs, help desks, and communications tools. You will design, implement, and operationalize workflows, drive team upskilling, and build reusable... 

    Aircall

    New York, NY
    1 day ago
  • $220k

     ...CPGR Growth Leader - AI Engineering, Strategic Accounts Fractal is a strategic AI partner to Fortune 500 companies, with a vision to power...  ...this insight into focused account and pursuit plans. Lead executive briefings, innovation sessions, modernization assessments... 
    Hourly pay
    Full time
    Local area

    Fractal

    New York, NY
    4 days ago
  •  ...AI / Forward Deployed Engineer Requires 4+ years of full-time professional experience after completing...  ...Forward Deployed Engineering searches with leading investment firms and have already...  ...engineering background, ideally with Python as a primary language. Hands-on... 
    Full time
    H1b
    Visa sponsorship

    Long Ridge Partners

    New York, NY
    14 days ago
  • $126.82k - $149.2k

     ...discover what you excel at—all from Day One.Job DescriptionThe AI Red Team Lead Engineer leads the execution and evolution of offensive security...  ...hosting environmentsProficiency in one or more languages (e.g., Python, PowerShell, Go, C/C++, Shell)Ability to translate research... 
    Full time
    Local area
    3 days per week

    US Bank

    New York, NY
    5 days ago
  •  ...the data foundation powering AI and self-serve analytics at scale...  ...Data and Analytics (MDA) Engineering team, you will shape the technical...  ...data and sound reasoning. Lead complex, cross-team initiatives...  .... Ship high-quality Python and SQL, increasingly by directing... 
    Remote work

    ContentBuffer

    New York, NY
    2 days ago
  •  ...TECHNOLOGIES is seeking a Senior Application Security Engineer with hands-on Python development, automation and deep expertise in AI/ML, LLMs and secure software design. The role...  ...full-time employment and opportunities to lead secure SDLC #J-18808-Ljbffr SIDRAM... 
    Full time

    SIDRAM TECHNOLOGIES

    New York, NY
    2 days ago
  • $55 per hour

    A leading AI consultancy is seeking experienced Civil Engineers with Python skills to freelance as AI Trainers. This remote role involves designing and evaluating AI solutions geared towards real-world engineering problems. Candidates should possess strong analytical ability... 
    Remote job
    Freelance

    Mindrift

    New York, NY
    1 day ago
  • $55 per hour

     ...of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI...  ...across the globe. The Role We are seeking experienced Civil Engineers with Python skills to train and evaluate AI models on realistic civil engineering... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Mindrift

    New York, NY
    1 day ago
  •  ...and tools.* Develop RAG and LLM-based solutions using Python and LangChain/LangGraph.* Integrate AI solutions with enterprise applications and data...  ...testing, monitoring, security, and production-grade engineering practices.* Work with AI Scientists to productionize... 
    Work experience placement

    Virtusa

    New York, NY
    4 days ago
  •  ...AI Builder (AI Solutions Engineer) | Brillio About Brillio Brillio is one of the fastest-growing digital technology service providers, helping...  ...automation Prompt engineering Full-stack development Python React / Next.js APIs and integrations LangGraph,... 
    Full time

    Brillio

    New York, NY
    2 days ago
  • $180k - $250k

     ...AI Engineer – Agentic AI / LLM Systems New York | Series A Startup $180–$250k + Equity...  ...Develop production-grade systems in Python Implement RAG pipelines, multi-agent...  ...building next-generation AI systems backed by leading investors, working on problems at the... 
    Full time
    Work at office
    Visa sponsorship

    Stott and May

    New York, NY
    3 days ago
  •  ...Applied AI Engineer NYC, hybrid We're partnered with a leading quantitative investment and technology firm that is building out a new generation of AI-powered...  ...software engineering fundamentals Expert-level Python development experience Experience building and... 
    For contractors

    Selby Jennings

    New York, NY
    4 days ago
  •  ...Responsibilities Design and build agentic AI applications that can reason, plan,...  ...production environments. Partner with engineering, data, security, product, and business teams...  ...automation. Qualifications Strong Python development experience and software engineering... 
    Full time

    The Phoenix Group

    New York, NY
    1 day ago
  •  ...technologies, and skillsets, every day. We are looking for: AI Engineer - Dataiku (5-Day Onsite - NYC) Location: New York City, NY (...  ...AI/ML pipelines. Technical Stack: Strong proficiency in Python, SQL, and working with modern cloud data platforms and... 
    Full time
    Work at office

    Greymatter Innovationz

    New York, NY
    5 days ago
  •  ..., fixed income, FX, and commodities is looking for a Senior Al Engineer. Their collaborative team combines deep expertise in finance...  ...or related quantitative field Strong programming skills in Python and experience with ML frameworks (PyTorch, TensorFlow, scikit-... 
    Full time

    Entec Partners

    New York, NY
    5 days ago
  •  ...portfolio companies to scope, build, and ship AI agents against real operational data, as...  ...the core platform. Half forward-deployed engineer, half platform builder. What You’ll...  ...daily. Technical Fluency: Strong in Python and/or TypeScript, comfortable across the... 
    Full time

    Alldus

    New York, NY
    3 days ago
  • $350k

     ...Senior AI Engineer sought to join a small, exceptionally fast-moving engineering team building an AI-native consumer platform. There is...  ...retrieval failures in production. ~ Experience with TypeScript or Python and AI-assisted development workflows. ~ The ability to move... 
    Full time

    IT Recruitment Solutions

    New York, NY
    1 day ago
  • $200k - $400k

     ...Founding Engineer (AI) Union Square NYC FTE Comp range of $200K – $400K plus up to 2% equity Why candidates should join Bootstrapped...  ...and operating data- intensive production systems, ideally Python- based. Soft skills Comfortable taking risks and being... 
    Full time
    Work experience placement

    Hillview Consulting Solutions

    New York, NY
    1 day ago
  •  ...Role:- Applied AI Engineer – GenAI / LLMOps Location: New York, NY 10019 Duration: Contract – 12 Months Extension: Possible Work...  ...other engineering teams. Key Technologies / Keywords Python | GenAI | LLM | RAG | Agentic AI | LLMOps | Vector Search | Re... 
    Contract work

    PTR Global

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Python AI Engineer. Be the first to apply!