Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python AI Engineer

EPAM Systems, Inc.

We are hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it transitions from a Confluence-focused RAG chatbot into a broader, agentic knowledge system. Today, our platform supports Confluence/GitHub ingestion chunking pgvector RAG retrieval FastAPI serving. In our next growth phase, we are expanding toward hybrid retrieval (vector + sparse + graph), multi-source ingestion, robust evaluation pipelines, agent infrastructure, and shared chat platform primitives. If you are passionate about building scalable, reliable, and production-grade AI infrastructure rather than just chasing demo behavior, we want to hear from you. Req.# Responsibilities Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability Create comprehensive observability and operational feedback loops using OpenTelemetry, PrometheGrafana, Docker/Helm, and GitHub Actions Ingestion infrastructure across current and future content sources Full-stack observability across application, pipeline, database, and model-serving behavior Cost, latency, throughput, and failure-mode management for AI-heavy workloads Release workflows that validate AI behavior changes, not just code compilation Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform Requirements Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments Experience building CLI tools using Python, Golang, or Rust Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows Systems Understanding: Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems Strong skills across metrics, tracing, dashboards, alerting, and log analysis Experience with ingestion, ETL, or content-processing pipelines at scale An innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery Nice to have Experience with Qdrant, Neo4j, or other vector/graph infrastructure Prior experience supporting RAG, search, evaluation, or agent platforms Background in enterprise or highly regulated environments Familiarity with enterprise tooling such as Vault, Splunk, Artifactory, or ECR Comfort leveraging AI-assisted engineering workflows in day-to-day work

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Python AI Engineer in New York, NY vacancy
  • Location: New York; USAWork type: RemoteSeniority: SeniorPrimary skill: Python.CorePosted: 2026-11-05We are hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it transitions from a Confluence-focused RAG... 
    Suggested
    Temporary work

    EPAM Systems

    New York, NY
    3 days ago
  • Location: New York; USAWork type: RemoteSeniority: LeadPrimary skill: Python.AIPosted: 2026-10-16We are looking for a Lead Python AI Engineer to build robust, AI-powered API services and agentic workflows. In this role, you will bridge the gap between traditional backend... 
    Suggested
    Temporary work

    EPAM Systems

    New York, NY
    4 days ago
  • A leading software development company in New York is seeking an entry-level Python engineer to join their team in the Brooklyn office. The role involves working on the AI inference pipeline that powers sophisticated OCR and computer vision products. Candidates should... 
    Suggested
    Full time
    Work at office

    Mathpix

    New York, NY
    2 days ago
  • $30 per hour

     ...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week Engagement: Contract with potential for long-term engagement Eligibility... 
    Suggested
    Contract work
    Immediate start
    Remote work
    Visa sponsorship

    NextGen Coding Company

    New York, NY
    3 days ago
  • $55 per hour

    A leading AI consultancy is seeking experienced Civil Engineers with Python skills to freelance as AI Trainers. This remote role involves designing and evaluating AI solutions geared towards real-world engineering problems. Candidates should possess strong analytical ability... 
    Suggested
    Remote job
    Freelance

    Mindrift

    New York, NY
    2 days ago
  • $176k

     ...Current PhD, AI Engineering Internship Program - Summer 2027 Key Role Details This is a full-time paid internship program spanning twelve...  ...least 1 year of experience or academic work programming with Python, Go, Scala, or Java. Preferred Qualifications Experience... 
    Full time
    Part time
    Summer work
    Internship
    Local area

    Capital One

    New York, NY
    12 hours ago
  • $55 per hour

    Freelance AI Trainer - Civil Engineering & Python 1 day ago - Be among the first 25 applicants Get AI‑powered advice on this job and more exclusive features. This opportunity is only for candidates currently residing in the specified country. Your location may affect... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Mindrift

    New York, NY
    2 days ago
  • $300k

     ...of traders, quantitative researchers, and engineers who work together to examine the global...  ...inference systems, or pushing the boundaries of AI research from concept to production, you'...  ...mix of programming languages: C / C++ / Python / CUDA and other low-level GPU languages.... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    5 days ago
  • $300k

     ...of traders, quantitative researchers, and engineers who work together to examine the global...  ...require a fluid mix of skills including AI/ML expertise, engineering pragmatism, statistics...  ...mix of programming languages: C / C++ / Python / CUDA and other low-level GPU languages.... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    5 days ago
  • $152k - $241.5k

    We are looking for a software engineer with a strong background in parallel processing and GPU architecture to push the limits of performance at the intersection of AI, high-performance computing, and financial markets. In this role, you will dive deep into parallel algorithms... 
    Full time

    Nvidia

    New York, NY
    1 day ago
  • Role/Responsibilities:We are seeking a NLP engineer for a NLP research team within Point72. The ideal candidate has a track record of developing...  ...disciplineExperience in NLP, particularly LLMs.Proficient in Python, SQL and general software engineering principles (github,... 
    Worldwide

    Point72

    New York, NY
    2 days ago
  • $200k

     ...We're looking for an experienced AI Engineer to join Optiver's Applied AI and Platform Engineering team. In this role, you'll design, build...  ..., evaluation frameworks, and agentic research pipelines—using Python and modern AI frameworks integrated with internal systems,... 
    Work at office

    Optiver

    New York, NY
    3 days ago
  • $160 per hour

    Solomon Page has been retained to find an AI-focused Software Engineer for a mid-sized VC firm in NYC that is looking to build the data and software...  ...accountable for, rather than only prototypes.Strong Python skills and comfort with SQL, databases, APIs, and data pipelines... 
    Work at office

    Solomon Page

    New York, NY
    2 days ago
  •  ...Careers at Snaga — the world's first AI-first companyAI ML · Platform Engineering# AI EngineerBuild the agents and the runtime behind them: planning, tool...  ...tenant.## Your toolsDeno/TypeScript on the platform, Python where models need it, MCP for tools, A2A between agents... 
    Full time
    Local area
    Remote work

    SnagA Inc.

    New York, NY
    1 day ago
  • Job-ID29346346Reference26-02005Title: Senior Agentic AI Engineer (Palantir Foundry and AIP) Location: Remote Target Start Date: ASAP (...  ...including building CI/CD pipelines for production deployments Strong Python and SQL Experience working directly with client stakeholders,... 
    Contract work
    Immediate start
    Remote work

    ConsultNet

    New York, NY
    1 day ago
  • $120k - $165k

     ...and shape the future of our communities. This is a Software Engineering position at the Director level, which is part of the job family...  ...Risk Technology Director, you will lead the development of Python-based AI applications and frameworks that empower business teams to... 
    Temporary work

    Morgan Stanley

    New York, NY
    3 days ago
  • $130k - $180k

     ...continuous improvement.Role and Responsibilities:We are seeking an AI Engineer to drive innovation and automation across Prospect’s...  ...Expertise: 3-5 years of professional development experience. Strong Python, SQL, Docker, Retrieval-Augmented Generation, and data... 
    Daily paid
    Permanent employment
    Work at office

    Prospect Capital

    New York, NY
    2 days ago
  • $123k - $215.25k

     ...annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeShift: DayWorkplace...  ...and data insights.At American Express, AI is reshaping the future of commerce and...  ...AI.Core engineering stackLanguages: Python, Go, TypeScriptCloud and infrastructure:... 
    Visa sponsorship

    American Express

    New York, NY
    12 hours ago
  • $195k - $225k

     ...DescriptionPosition SummaryWe are pioneering a new AI development team dedicated to...  ...entrepreneurial and deeply technical AI Engineer to be a foundational member of this team....  ...software engineering fundamentals, including:Python proficiency and modern backend... 
    Full time

    Horizon Media

    New York, NY
    4 days ago
  • $101.49k - $140k

     ...opportunity to join our team as a High Performance Computing (HPC) AI Engineer. The High Performance Computing (HPC) AI Engineer will...  ...channel networkingExperience with scripting languages such as Bash, Python, or LuaPreferred Qualifications:- Experience supporting AI-... 
    Full time

    NYU Langone Medical Center

    New York, NY
    2 days ago
  •  ...team.KPMG is currently seeking a Senior Engineer to join our Audit Technology Organization...  ...implement core components of our generative AI solutions, focusing on building robust,...  ...is required Strong programming skills in Python and hands-on experience with AI/ML frameworks... 
    Local area

    KPMG

    New York, NY
    2 days ago
  •  ...Title : Senior Python Engineer Duration: 6 Months Location: Remote Required experience • Python ETL • Customer has an existing, working, framework and the candidate would need to copy the framework but this requires deep knowledge of how Python... 
    Remote work

    3B Staffing LLC

    New York, NY
    1 day ago
  • $175k - $215k

     ...right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-...  ...frameworks - Agno, LangChain, LlamaIndex, or comparableStrong Python proficiencyAzure or AWS cloud experienceVector databases - Pinecone... 
    Full time
    Local area

    Brown Brothers Harriman

    New York, NY
    2 days ago
  •  ..., fixed income, FX, and commodities is looking for a Senior Al Engineer.Please ensure you read the below overview and requirements for...  ...related quantitative fieldStrong programming xhyhwjd skills in Python and experience with ML frameworks (PyTorch, TensorFlow, scikit-... 

    Entec Partners

    New York, NY
    1 day ago
  •  ...OON Systems is building AI systems for high stakes workflows. As an AI Engineer, you will work on large language models, NLP systems and other advanced AI technologies...  ...in live workflows Qualifications Strong Python skills and familiarity with production AI systems... 

    OON Systems LLC

    New York, NY
    2 days ago
  •  ...of the world's largest Digital Platform Engineering companies providing a combination of Strategy...  ..., develop, and deploy Generative AI applications using LLMs (OpenAI, Azure OpenAI...  ...multi-step reasoning tasks. xhyhwjd Skills:Python / Node.js / SQLOpenAI, Azure OpenAI,... 

    Photon

    New York, NY
    5 days ago
  •  ...empowering organizations with cutting-edge AI solutions. Our team thrives on innovation...  .... Position Summary As an AI Engineer, you will design and implement advanced AI...  ...Proficiency in programming languages such as Python, Java, or C++. Familiarity with natural... 
    Remote work
    Flexible hours

    TrueGrowth

    New York, NY
    5 days ago
  • $143k - $210k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers...  ...Learn more at .What You'll Do:The Field Engineering organization at CoreWeave supports the...  ..., with strong proficiency in Go or Python.- Experience taking an AI application from... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  •  ...Responsibilities Build an outbound engine covering lead sourcing, enrichment, scoring, and...  ...qualification, and nurture triggers Create an AI-assisted content pipeline for outbound...  ...engineering, agent frameworks, and RAG Strong Python and/or TypeScript skills Experience with... 

    Rwazi, Inc.

    New York, NY
    4 days ago
  • $131k - $271.6k

     ...the design, development, and operation of AI-native enterprise applications within...  ...-embedded delivery teams.You bring solid engineering fundamentals and a growing command of AI...  ...software engineering, with proficiency in Python and hands-on experience in at least one cloud... 
    Permanent employment
    Full time
    Work at office
    Worldwide
    Flexible hours

    SAP

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python AI Engineer. Be the first to apply!