Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Backend AI Engineer

Ankyah Infinity

AI Engineer What You'll Do 1. Model Integration: Deploy and optimize LLMs, embeddings, and RAG pipelines into production applications. 2. AI Microservices: Build scalable Python-based services for knowledge extraction, question answering, and domain-specific reasoning. 3. Evaluation & Monitoring: Implement frameworks to measure precision, recall, latency, and drift; set up alerts for model degradation. 4. Prompt & Context Engineering: Design context windows, prompt templates, and fine-tuning strategies for insurance-specific tasks. 5. Data Pipelines: Collaborate with data scientists to create deterministic, auditable flows from raw documents to model-ready inputs. 6. Security & Compliance: Ensure models are deployed with guardrails, logging, and data isolation to meet SOC2/HIPAA standards. 7. Cross-Functional Collaboration: Partner with product, compliance, and engineering to ship features that balance innovation with reliability. What We're Looking For 1. Experience: 4+ years in applied AI/ML engineering, with production experience (not just prototypes). 2. Core Skills: Deep proficiency with Python, FastAPI/Flask, and ML libraries (Transformers, LangChain, PyTorch/TensorFlow). 3. LLM Expertise: Hands-on experience integrating LLM APIs, fine-tuning, embeddings, or retrieval systems. 4. Cloud & Infra: Familiarity with deploying AI workloads on AWS/Azure/GCP; exposure to vector DBs (Pinecone, Weaviate, FAISS). 5. Evaluation Mindset: Experience building structured evaluation and monitoring for AI systems. 6. Startup DNA: Comfortable with ambiguity and rapid iteration; thrives in lean environments. Nice to Have 1. Background in insurance or financial services data. 2. Experience with orchestration frameworks (LangGraph, Airflow, Prefect). 3. Familiarity with secure deployment patterns (VPC, single-tenant isolation, audit logging). #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Backend AI Engineer in New York, NY vacancy
  •  ...Sunlight Technologies is seeking a core engineer to join their team in New York. The role involves working across the full stack with an emphasis on backend development, designing AI-centric systems, and collaborating closely with product teams. Candidates should possess... 
    Suggested
    Remote work

    Sunlight Technologies

    New York, NY
    13 hours ago
  •  ...A healthcare solutions provider is seeking a Senior Software Engineer to join their team in building core backend services for an AI platform. The ideal candidate should possess strong Python skills and have over 5 years of backend development experience, focusing on implementing... 
    Suggested

    Cotiviti

    New York, NY
    3 days ago
  •  ...mLabs is seeking a Staff Software Engineer specializing in Backend and AI Infrastructure to work remotely from the US. This role will lead crucial projects involving the core agent runtime and backend systems for high-frequency trading. Responsibilities include developing... 
    Suggested
    Remote work

    MLabs

    New York, NY
    2 days ago
  • $40 per hour

    A tech-driven company is seeking a Back End Developer to join their team in training AI models. This remote position demands expertise in programming languages such as Python or JavaScript. Responsibilities include creating coding challenges for AI chatbots and assessing... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    13 hours ago
  •  ...ownership of designing and optimizing APIs. Candidates should have experience in Python and Django, alongside problem-solving abilities. The role offers a permanent remote work culture with an AI-first approach and rapid career progression opportunities. #J-18808-Ljbffr... 
    Suggested
    Permanent employment
    Remote work

    Interview Kickstart

    New York, NY
    3 days ago
  •  ...Framework Ventures is seeking an AI Web3 Backend Engineer proficient in backend engineering, DeFi protocols, and agentic architectures. This role involves architecting the Traia.io AI Agent Marketplace, maintaining multi-agent workflows, and integrating advanced protocols... 
    Contract work
    Remote work

    Framework Ventures

    New York, NY
    3 days ago
  •  ...Sphere Software is looking for a Senior Backend / Integrations Engineer to work on scalable integrations for an enterprise SaaS platform. This remote...  ...to design end-to-end solutions. You will contribute to AI-assisted features and work collaboratively in a dynamic environment... 
    Remote work

    Sphere Software

    New York, NY
    2 days ago
  • $174.1k - $265k

     ...A leading cloud storage service is seeking a Senior Backend Product Software Engineer to design and embed AI-powered experiences within its File Sync and Share platform. This role requires over 8 years of software engineering experience, with at least 1–2 years focused... 
    Remote work

    Dropbox

    New York, NY
    3 days ago
  • $152.41k - $179.3k

     ...Framework Ventures is seeking an AI Tools Engineer to build advanced AI-driven tools that elevate developer workflows. In this role, you'll create and deploy AI agents integrated with tools like GitHub and Slack, collaborating with cross-functional teams. Ideal candidates... 

    Framework Ventures

    New York, NY
    3 days ago
  • $180k - $230k

    HRB, a high-growth technology company, is seeking a Backend Software Engineer to design and build core platform capabilities. The position requires...  ...equity and opportunities for impactful contributions in AI. Onsite collaboration is expected in New York City. #J-18808... 

    HRB

    New York, NY
    1 day ago
  • $76 per hour

     ...Crossing Hurdles is seeking a Software Engineer (AI Tools) to work on backend development and system integrations in a fully remote contract position. The role requires expertise in Python and SQL, along with strong analytical and problem-solving skills. As a contractor... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    Crossing Hurdles

    New York, NY
    3 days ago
  •  ...A leading cloud-native data modeling platform in the United States seeks an experienced backend engineer to join their AI-focused team. Candidates should have over 5 years of experience in C# and .NET, and a strong understanding of REST API design. This fully remote role... 
    Remote work

    SqlDBM

    New York, NY
    3 days ago
  •  ...TRG TECH RESEARCH GROUP Limited is seeking an engineer skilled in Python and data engineering. The ideal candidate will design and build backend microservices, maintain data pipelines, and leverage analytical databases such as ClickHouse and PostgreSQL. This role values... 
    Remote work
    Flexible hours

    TRG TECH RESEARCH GROUP Limited

    New York, NY
    3 days ago
  • $152.41k - $179.3k

     ...A leading cryptocurrency platform seeks a Software Engineer for their AI Tools team. This remote role involves building infrastructure for AI-driven workflows and collaborating across teams to develop impactful AI products. Candidates should be proficient in Python or... 
    Remote work

    Itlearn360

    New York, NY
    3 days ago
  • $170k - $200k

     ...Alumni Ventures is seeking a Senior Backend Engineer focused on AI. This remote position offers a salary of US $170k–200k with equity options. You will design and build shared AI infrastructure, ensuring reliability and performance of AI systems. The ideal candidate has... 
    Remote work

    Alumni Ventures

    New York, NY
    21 hours ago
  • $180k - $225k

    Hypha AI, Inc. in New York, NY is looking for a Backend Engineer, Applied AI to improve and build the core AI systems of our platform. You will design document processing pipelines and work with LLMs to create actionable insights. The ideal candidate has strong backend... 

    Hypha AI, Inc.

    New York, NY
    1 day ago
  • $140k - $190k

    About the role We’re hiring a Senior Backend and AI Engineer to help build and scale a global trade compliance platform powered by AI. You’ll play a key role in designing backend architecture, shipping production‑grade features, and integrating AI capabilities into real... 
    Remote job
    Work at office

    Kala Talent

    New York, NY
    2 days ago
  •  ...The Company Standard Practice AI is building the next generation of foundational tools...  ...Deliver end-to-end improvements to backend logic, APIs, and workflows Proactively...  ...Requirements ~ Background in CS, Engineering, or other technical field ~0-2 years of... 

    Standard Practice AI

    New York, NY
    1 day ago
  • A leading AI research platform in New York is seeking a Sr. Software Engineer to architect and build intelligent backend infrastructure for autonomous AI research agents. You'll design coordination systems and multi-agent frameworks that enhance financial decision-making... 

    Kepler AI (formerly Keru.ai)

    New York, NY
    1 day ago
  • $186.07k - $218.9k

     ...Framework Ventures is seeking a Software Engineer to join their Platform Product Group. The ideal candidate will have over 5 years of software engineering experience with strong skills in Python, Golang, and micro-services architecture. This role focuses on leveraging... 
    Remote work

    Framework Ventures

    New York, NY
    3 days ago
  • $250k - $300k

     ...technology company is seeking a Forward Deployed Engineer to architect reliable and scalable...  ...ideal candidate will have 5+ years of backend engineering experience and proficiency in...  ...Python, focusing on building and integrating AI designs into production systems. This... 

    3Y Health

    New York, NY
    13 hours ago
  • $180k - $240k

    Arbiter is the AI-powered care orchestration system that unites healthcare. We are launching...  ...at scale. We are looking for expert engineers and leads to join our team and help us...  ...your career. Responsibilities As a Senior Backend AI Engineer, you will design, build, and... 
    Work experience placement
    Remote work

    Arbiter AI

    New York, NY
    4 days ago
  • A leading tech firm in New Jersey is seeking an engineer to design backend systems for a SaaS platform. The role requires a strong proficiency in Python...  ...and Django, experience with AWS, and the ability to enhance AI-generated code. You will be involved in building multi-... 

    Hill Research

    New York, NY
    1 day ago
  • Revion Technologies, based in New York, is seeking an experienced backend developer to build production-grade AI systems for the automotive industry. You will design scalable backend infrastructures and work closely with our ML and product teams, impacting our customers... 

    Revion Technologies

    New York, NY
    3 days ago
  • A leading healthcare technology company is seeking a Senior Backend AI Engineer in New York City. You will design and operate AI systems for a groundbreaking care orchestration platform. Ideal candidates have over 5 years of experience in backend systems, proficiency in... 
    Remote work

    Arbiter AI

    New York, NY
    1 day ago
  • A leading financial tech startup is looking for an AI Engineer to shape its AI tech stack. The ideal candidate has expertise in AI tooling...  ...building data pipelines. Responsibilities include working on backend systems and engaging with AWS Bedrock features. The role... 

    Avantos

    New York, NY
    1 day ago
  • Rippling is hiring a backend engineer in New York, New York, to design, develop, and test backend software systems. This role involves building AI & data-driven products and requires 6+ years of experience across various engineering stack levels. Ideal candidates should... 

    Rippling

    New York, NY
    4 days ago
  • $110k - $145k

    Paramount Pictures is seeking a Software Engineer to develop AI-powered tools, backend services, and platforms within the Global Quality Engineering group. You will enhance engineering efficiency through modern software solutions. Ideal candidates have 2+ years of experience... 

    Paramount Pictures

    New York, NY
    3 days ago
  •  ...Annapurna HR Ltd is seeking AI Builders with a strong full-stack engineering background to work remotely. You'll play a key role in the AI transformation of Accelerant.ai, focusing on building scalable backend services and leveraging AI tools for enhanced productivity.... 
    Remote work

    Annapurna HR Ltd

    New York, NY
    1 day ago
  •  ...Framework Ventures is seeking a Generative AI Engineer to design, build, and operate production LLM systems. The role involves backend services for GenAI features using Python or TypeScript, and requires 5-9 years of experience. Candidates should have practical knowledge... 

    Framework Ventures

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Backend AI Engineer. Be the first to apply!