Backend AI Engineer
Ankyah Infinity
AI Engineer What You'll Do 1. Model Integration: Deploy and optimize LLMs, embeddings, and RAG pipelines into production applications. 2. AI Microservices: Build scalable Python-based services for knowledge extraction, question answering, and domain-specific reasoning. 3. Evaluation & Monitoring: Implement frameworks to measure precision, recall, latency, and drift; set up alerts for model degradation. 4. Prompt & Context Engineering: Design context windows, prompt templates, and fine-tuning strategies for insurance-specific tasks. 5. Data Pipelines: Collaborate with data scientists to create deterministic, auditable flows from raw documents to model-ready inputs. 6. Security & Compliance: Ensure models are deployed with guardrails, logging, and data isolation to meet SOC2/HIPAA standards. 7. Cross-Functional Collaboration: Partner with product, compliance, and engineering to ship features that balance innovation with reliability. What We're Looking For 1. Experience: 4+ years in applied AI/ML engineering, with production experience (not just prototypes). 2. Core Skills: Deep proficiency with Python, FastAPI/Flask, and ML libraries (Transformers, LangChain, PyTorch/TensorFlow). 3. LLM Expertise: Hands-on experience integrating LLM APIs, fine-tuning, embeddings, or retrieval systems. 4. Cloud & Infra: Familiarity with deploying AI workloads on AWS/Azure/GCP; exposure to vector DBs (Pinecone, Weaviate, FAISS). 5. Evaluation Mindset: Experience building structured evaluation and monitoring for AI systems. 6. Startup DNA: Comfortable with ambiguity and rapid iteration; thrives in lean environments. Nice to Have 1. Background in insurance or financial services data. 2. Experience with orchestration frameworks (LangGraph, Airflow, Prefect). 3. Familiarity with secure deployment patterns (VPC, single-tenant isolation, audit logging). #J-18808-Ljbffr
- ...Sunlight Technologies is seeking a core engineer to join their team in New York. The role involves working across the full stack with an emphasis on backend development, designing AI-centric systems, and collaborating closely with product teams. Candidates should possess...SuggestedRemote work
- ...A healthcare solutions provider is seeking a Senior Software Engineer to join their team in building core backend services for an AI platform. The ideal candidate should possess strong Python skills and have over 5 years of backend development experience, focusing on implementing...Suggested
- ...mLabs is seeking a Staff Software Engineer specializing in Backend and AI Infrastructure to work remotely from the US. This role will lead crucial projects involving the core agent runtime and backend systems for high-frequency trading. Responsibilities include developing...SuggestedRemote work
$40 per hour
A tech-driven company is seeking a Back End Developer to join their team in training AI models. This remote position demands expertise in programming languages such as Python or JavaScript. Responsibilities include creating coding challenges for AI chatbots and assessing...SuggestedHourly payRemote workFlexible hours- ...ownership of designing and optimizing APIs. Candidates should have experience in Python and Django, alongside problem-solving abilities. The role offers a permanent remote work culture with an AI-first approach and rapid career progression opportunities. #J-18808-Ljbffr...SuggestedPermanent employmentRemote work
- ...Framework Ventures is seeking an AI Web3 Backend Engineer proficient in backend engineering, DeFi protocols, and agentic architectures. This role involves architecting the Traia.io AI Agent Marketplace, maintaining multi-agent workflows, and integrating advanced protocols...Contract workRemote work
- ...Sphere Software is looking for a Senior Backend / Integrations Engineer to work on scalable integrations for an enterprise SaaS platform. This remote... ...to design end-to-end solutions. You will contribute to AI-assisted features and work collaboratively in a dynamic environment...Remote work
$174.1k - $265k
...A leading cloud storage service is seeking a Senior Backend Product Software Engineer to design and embed AI-powered experiences within its File Sync and Share platform. This role requires over 8 years of software engineering experience, with at least 1–2 years focused...Remote work$152.41k - $179.3k
...Framework Ventures is seeking an AI Tools Engineer to build advanced AI-driven tools that elevate developer workflows. In this role, you'll create and deploy AI agents integrated with tools like GitHub and Slack, collaborating with cross-functional teams. Ideal candidates...$180k - $230k
HRB, a high-growth technology company, is seeking a Backend Software Engineer to design and build core platform capabilities. The position requires... ...equity and opportunities for impactful contributions in AI. Onsite collaboration is expected in New York City. #J-18808...$76 per hour
...Crossing Hurdles is seeking a Software Engineer (AI Tools) to work on backend development and system integrations in a fully remote contract position. The role requires expertise in Python and SQL, along with strong analytical and problem-solving skills. As a contractor...Hourly payContract workFor contractorsRemote work- ...A leading cloud-native data modeling platform in the United States seeks an experienced backend engineer to join their AI-focused team. Candidates should have over 5 years of experience in C# and .NET, and a strong understanding of REST API design. This fully remote role...Remote work
- ...TRG TECH RESEARCH GROUP Limited is seeking an engineer skilled in Python and data engineering. The ideal candidate will design and build backend microservices, maintain data pipelines, and leverage analytical databases such as ClickHouse and PostgreSQL. This role values...Remote workFlexible hours
$152.41k - $179.3k
...A leading cryptocurrency platform seeks a Software Engineer for their AI Tools team. This remote role involves building infrastructure for AI-driven workflows and collaborating across teams to develop impactful AI products. Candidates should be proficient in Python or...Remote work$170k - $200k
...Alumni Ventures is seeking a Senior Backend Engineer focused on AI. This remote position offers a salary of US $170k–200k with equity options. You will design and build shared AI infrastructure, ensuring reliability and performance of AI systems. The ideal candidate has...Remote work$180k - $225k
Hypha AI, Inc. in New York, NY is looking for a Backend Engineer, Applied AI to improve and build the core AI systems of our platform. You will design document processing pipelines and work with LLMs to create actionable insights. The ideal candidate has strong backend...$140k - $190k
About the role We’re hiring a Senior Backend and AI Engineer to help build and scale a global trade compliance platform powered by AI. You’ll play a key role in designing backend architecture, shipping production‑grade features, and integrating AI capabilities into real...Remote jobWork at office- ...The Company Standard Practice AI is building the next generation of foundational tools... ...Deliver end-to-end improvements to backend logic, APIs, and workflows Proactively... ...Requirements ~ Background in CS, Engineering, or other technical field ~0-2 years of...
- A leading AI research platform in New York is seeking a Sr. Software Engineer to architect and build intelligent backend infrastructure for autonomous AI research agents. You'll design coordination systems and multi-agent frameworks that enhance financial decision-making...
$186.07k - $218.9k
...Framework Ventures is seeking a Software Engineer to join their Platform Product Group. The ideal candidate will have over 5 years of software engineering experience with strong skills in Python, Golang, and micro-services architecture. This role focuses on leveraging...Remote work$250k - $300k
...technology company is seeking a Forward Deployed Engineer to architect reliable and scalable... ...ideal candidate will have 5+ years of backend engineering experience and proficiency in... ...Python, focusing on building and integrating AI designs into production systems. This...$180k - $240k
Arbiter is the AI-powered care orchestration system that unites healthcare. We are launching... ...at scale. We are looking for expert engineers and leads to join our team and help us... ...your career. Responsibilities As a Senior Backend AI Engineer, you will design, build, and...Work experience placementRemote work- A leading tech firm in New Jersey is seeking an engineer to design backend systems for a SaaS platform. The role requires a strong proficiency in Python... ...and Django, experience with AWS, and the ability to enhance AI-generated code. You will be involved in building multi-...
- Revion Technologies, based in New York, is seeking an experienced backend developer to build production-grade AI systems for the automotive industry. You will design scalable backend infrastructures and work closely with our ML and product teams, impacting our customers...
- A leading healthcare technology company is seeking a Senior Backend AI Engineer in New York City. You will design and operate AI systems for a groundbreaking care orchestration platform. Ideal candidates have over 5 years of experience in backend systems, proficiency in...Remote work
- A leading financial tech startup is looking for an AI Engineer to shape its AI tech stack. The ideal candidate has expertise in AI tooling... ...building data pipelines. Responsibilities include working on backend systems and engaging with AWS Bedrock features. The role...
- Rippling is hiring a backend engineer in New York, New York, to design, develop, and test backend software systems. This role involves building AI & data-driven products and requires 6+ years of experience across various engineering stack levels. Ideal candidates should...
$110k - $145k
Paramount Pictures is seeking a Software Engineer to develop AI-powered tools, backend services, and platforms within the Global Quality Engineering group. You will enhance engineering efficiency through modern software solutions. Ideal candidates have 2+ years of experience...- ...Annapurna HR Ltd is seeking AI Builders with a strong full-stack engineering background to work remotely. You'll play a key role in the AI transformation of Accelerant.ai, focusing on building scalable backend services and leveraging AI tools for enhanced productivity....Remote work
- ...Framework Ventures is seeking a Generative AI Engineer to design, build, and operate production LLM systems. The role involves backend services for GenAI features using Python or TypeScript, and requires 5-9 years of experience. Candidates should have practical knowledge...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend AI Engineer. Be the first to apply!
- entry level back-end developer New York, NY
- backend python developer New York, NY
- back end developer internship summer New York, NY
- remote back end developer New York, NY
- java developer backend New York, NY
- back-end developer New York, NY
- senior backend developer New York, NY
- backend software engineer New York, NY
- lead backend developer New York, NY
- machine learning ai engineer New York, NY


