Senior Backend AI Engineer (Agentic AI)
Purple Drive
Job Description - Senior Backend AI Engineer (Agentic AI & Distributed Systems)
Primary Skills: Node.js, TypeScript, Go, Backend Engineering, LLM Systems, Agentic AI, Distributed Systems, AWS/GCP, Kubernetes
Position Summary
We are seeking an experienced Senior Backend AI Engineer to design, develop, and operate scalable backend systems and production-grade agentic AI applications.
The ideal candidate will have strong expertise in backend engineering, distributed systems, cloud infrastructure, and modern AI technologies, including Large Language Models (LLMs), agentic workflows, and AI orchestration frameworks.
The candidate will be responsible for building reliable backend services and shared AI capabilities, including agent orchestration, planning, tool execution, memory, Retrieval-Augmented Generation (RAG), model integration, and evaluation frameworks.
This role requires strong technical ownership, architectural decision-making, and the ability to translate complex and ambiguous business problems into reliable, scalable autonomous systems.
Key Responsibilities
1. Backend Engineering & API Development
-
Design, develop, and maintain scalable, high-performance backend services and APIs.
-
Build RESTful APIs and microservices using Node.js, TypeScript, and/or Go.
-
Develop asynchronous processing systems, workflow engines, queues, and event-driven services.
-
Define API contracts and collaborate with frontend and cross-functional engineering teams.
-
Optimize backend applications for performance, scalability, reliability, and security.
2. Agentic AI & LLM Engineering
-
Design, build, and operate production-grade agentic AI systems across multiple products and applications.
-
Develop LLM-powered applications and autonomous agent workflows.
-
Implement agent planning, tool calling, execution, memory management, and multi-step reasoning workflows.
-
Build and maintain agent orchestration frameworks using LangGraph, LangChain, or similar technologies.
-
Develop Retrieval-Augmented Generation (RAG) pipelines for information retrieval and grounding.
-
Integrate LLMs, model gateways, inference services, and external AI tools.
-
Implement evaluation frameworks, observability, monitoring, and safety mechanisms for autonomous systems.
-
Establish appropriate autonomy boundaries, reliability standards, and fallback mechanisms for agentic applications.
3. Distributed Systems & Cloud Infrastructure
-
Design and implement distributed backend systems and event-driven architectures.
-
Develop asynchronous communication and streaming solutions using Apache Kafka and messaging systems.
-
Build and deploy cloud-native applications using AWS and/or Google Cloud Platform (GCP).
-
Work with Docker and Kubernetes for containerization, orchestration, and application deployment.
-
Design scalable and resilient services capable of handling high-volume workloads.
-
Collaborate with DevOps teams to improve infrastructure reliability and deployment automation.
4. Data & Workflow Engineering
-
Design and implement data pipelines and backend workflows supporting AI applications.
-
Work with SQL and NoSQL databases, including PostgreSQL, MongoDB, and Redis.
-
Develop workflow orchestration and scheduling solutions using tools such as Apache Airflow.
-
Implement efficient data storage, retrieval, caching, and processing mechanisms.
-
Ensure data consistency, reliability, and performance across distributed systems.
5. Technical Leadership & Architecture
-
Drive technical direction and architecture decisions for agentic AI initiatives.
-
Own and evolve shared AI capabilities and reusable backend components across products.
-
Lead technical design reviews and evaluate architecture trade-offs involving scalability, reliability, security, autonomy, and cost.
-
Collaborate with multiple engineering teams and influence technical decisions without requiring formal authority.
-
Establish engineering best practices for code quality, testing, deployment, and production operations.
-
Mentor engineers and contribute to technical strategy and engineering standards.
6. AI-Assisted Development & Continuous Delivery
-
Leverage AI-assisted and agentic development tools to accelerate software engineering.
-
Implement automated testing and CI/CD pipelines using Git and modern DevOps tools.
-
Ensure reliable build, deployment, monitoring, and release processes.
-
Continuously evaluate emerging AI frameworks, tools, and technologies.
Required Technical Skills
Backend Development
-
Strong proficiency in Node.js, JavaScript, TypeScript, and/or Go.
-
Experience building scalable REST APIs and microservices.
-
Strong understanding of asynchronous programming and backend architecture.
Agentic AI & LLM Technologies
-
Hands-on experience building LLM-powered applications and agentic workflows.
-
Experience with LangGraph, LangChain, or similar agent orchestration frameworks.
-
Strong understanding of agent planning, tool calling, memory, and multi-step workflows.
-
Experience with RAG, retrieval pipelines, and LLM integration.
-
Knowledge of LLM evaluation, observability, safety, and inference systems.
-
Familiarity with AI-assisted and agentic development workflows.
Distributed Systems & Cloud
-
Strong understanding of distributed systems and event-driven architectures.
-
Experience with Apache Kafka, queues, streaming, and asynchronous processing.
-
Hands-on experience with AWS and/or GCP.
-
Experience with Docker and Kubernetes.
Database Technologies
-
Strong SQL and database fundamentals.
-
Experience with PostgreSQL and/or other relational databases.
-
Experience with NoSQL databases such as MongoDB and Redis.
DevOps & Engineering Practices
-
Experience with Git and version control.
-
Knowledge of CI/CD pipelines and deployment automation.
-
Strong understanding of software testing, debugging, monitoring, and production support.
Required Qualifications
-
Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.
-
7+ years of overall software engineering experience, with 10+ years preferred for senior-level technical ownership.
-
Strong hands-on backend development experience using Node.js, TypeScript, and/or Go.
-
Proven experience designing and building distributed systems and scalable backend applications.
-
Strong practical experience with LLM systems, agentic AI workflows, or advanced ML infrastructure.
-
Experience developing and operating production-grade AI-powered applications.
-
Ability to independently own complex technical initiatives and influence architecture decisions.
-
Excellent problem-solving, communication, and collaboration skills.
Preferred Qualifications
-
Experience building agentic AI systems in fintech or other regulated industries.
-
Experience as a founding engineer or early technical leader in AI-driven products.
-
Demonstrated success delivering technically complex autonomous systems.
-
Contributions to open-source AI or agentic frameworks.
-
Familiarity with model fine-tuning, optimization, and inference pipelines.
-
Experience with workflow orchestration tools such as Apache Airflow.
- ...Role Overview We are looking for a highly experienced Senior Backend AI Engineer – Agentic AI to design, develop, and scale distributed backend systems and production-grade Agentic AI solutions. The ideal candidate will have strong expertise in Node.js, TypeScript...SeniorFull time
$190k
...They are building an AI-powered care orchestration... ...scale. The platform combines agentic AI workflows with a robust backend infrastructure to... ...looking for staff-level engineers to help design, build, and... ...Responsibilities As a Senior Backend AI Engineer, you...SeniorRemote work- ...Job Description Job Description Job Title: Senior AI Engineer – Generative AI & Agentic AI Location: New York or Sunrise, Florida Work Arrangement... ...design. Key Responsibilities Develop production backend services and REST APIs using Python and FastAPI....SeniorContract workH1bWork at office3 days per week
$94.4k - $293.8k
...organizations and businesses with human-centered AI solutions and services to drive... ...and confidence.You AreA Full Stack Agentic AI Engineer leader who focuses on delivering end‑to... ...centered agentic AI systems across frontend, backend, data, and intelligent...SeniorWork experience placementLive inWork at officeLocal area$190k - $235k
...SENIOR APPLIED AI ENGINEER, AGENTIC SYSTEMS Thresh Consulting | Strategy in Action for the AI Era Salary: $190,000 to $235,000 + up to 25% performance-based bonus Location: Hybrid (Denver, Chicago, or NYC preferred), with client travel ABOUT THRESH Thresh...SeniorFull timeAfternoon shift$123k - $215.25k
...annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeShift: DayWorkplace... ...product and design, and enterprise AI platforms on behalf of the company.The Sr... ...AI architectures, including LLM systems, agentic workflows, retrieval strategies, and...Senior- ...Our client, a 3rd-generation management consulting firm. They are now looking to add to their team and are hiring a Senior AI/ML Engineer (Agentic AI | Amazon Bedrock) Summary Design and build enterprise-grade AI agents using Amazon Bedrock, Claude, RAG, and AgentCore...SeniorImmediate start
$286.2k - $326.7k
Senior Staff AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized...SeniorFull timePart timeLocal areaRemote work$123k - $215.25k
...annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeShift: DayWorkplace... ...product and design, and enterprise AI platforms on behalf of the company.The... ...learning solutions, including LLM, RAG, agentic, and multimodal applications. This role...Senior$123k - $215.25k
...annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeShift: DayWorkplace... ...product and design, and enterprise AI platforms on behalf of the company.The AI... ...training, fine-tuning, inference, and agentic workloads using Kubernetes, containers,...Senior$123k - $215.25k
...benefitsJob Function: Engineering & ArchitectureSchedule:... ...insights.At American Express, AI is reshaping the future... ...governance that enable agentic AI systems to operate... ...world.The RoleAs a Senior AI Engineer II -... ...engineering fundamentals across backend systems, APIs, data...SeniorVisa sponsorship- ...Job Description Job Description Job Title: Senior Backend and AI Engineer – Lounge Services Location: New York, NY (Onsite) Duration:... ...solid understanding of distributed systems, LLM systems, agentic workflows, and experience with cloud technologies. Key...Senior
$250k - $315k
...colleges/universities in USA. ~ Compensation: $250,000–$315,000 Base Salary + Performance Bonus + RSUs Job Title: Senior Agentic AI, AI/ML Engineers Employment Type: Full-Time Work Location: Midtown East, NEW YORK CITY Job Description We are looking...SeniorFull timeTemporary workLocal area$172.8k - $359k
...Join EY and help to build a better working world.The opportunityBuild AI agents that carry meaningful work from intent to a verified outcome, not merely produce an impressive response. You will engineer the execution loops, tools, context, permissions, evaluations, and...SeniorSummer holidayWork at officeImmediate startFlexible hours$229.9k - $262.4k
Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create...SeniorFull timePart timeLocal area- ...Job Title: Agentic AI Engineer Location: NYC, NY (Hybrid) Job Summary: We are seeking an Agentic AI Engineer with hands-on experience... ...Agentic AI and a strong foundation of at least 5 years in backend development or data engineering. This role will focus on...
- ...You'll develop the models and agentic architectures that power... ...retailers. This is applied AI at its most impactful. You'll... ...data preprocessing, feature engineering, model training, evaluation,... ...workflows Collaborate with backend engineers to ensure models are...SeniorFull timeImmediate startHome officeVisa sponsorshipFlexible hours3 days per week
- ...We build AI agents that actually work in enterprise environments... ..., not demos. We need engineer's who can own the entire agent... ...production frontend, a robust backend, a properly secured API and identity... ...technical architect and builder of agentic systems running in AWS, OCI,...Temporary work
$94.4k - $266.3k
...Agents Join the elite technical and product engine of the Accenture Google Business Group (... ...shift in technology: the move to Agentic AI and Product-Led Operating Models. As a Google... ...Platform (GCP) Agentic AI Delivery Senior Engineer, you are a new breed of technologist...SeniorFull timeWork experience placementLive inWork at officeLocal areaShift work$229.9k - $262.4k
AI Engineer 5 ((AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized...Full timePart timeLocal area$197.3k - $225.1k
AI Engineer 4 (MLX, Agentic AI, Gen AI platform Services) At Capital One, we are creating responsible and reliable AI systems, changing banking... ...and compliance standards are met Mentor Principal and Senior Associates on scalable design, performance tuning and research...Full timePart timeLocal area$160k - $180k
...Job Title: Senior Agentic AI Security Engineer Location: Chicago IL 60605/ New York City, NY -- 4 days onsite, 1 day remote Perm/FTE role Job Description Role Overview ~ The Sr. Automation Engineer/ Senior Agentic AI Security Engineer serves as...SeniorPermanent employmentFull timeRemote work- ...communicates in the age of AI. Today, clinics miss... ...and an ex-Amazon Alexa engineer who led AI/ML teams at... ...to own foundational backend systems at a critical inflection... ...workflows—including agentic AI workflows with... ...architecture with the CTO and a senior engineer. Onsite...Senior
- ...Job Description Senior AI Software Engineer (Full Stack) At Dioptra, we're transforming the... ...will Design, build, and maintain Agentic AI-powered applications across the full... ...frameworks Architect scalable backend services and user-facing applications...Contract work
- ...AI Engineer – Agentic AI / Generative AI Location: Mountain View, CA or New York, NY (Hybrid – 3 days onsite weekly) Employment Type: Contract (6 months with potential extensions) About the Opportunity Optomi is seeking an experienced AI Engineer for an exciting...Contract work3 days per week
$180k - $250k
...AI Engineer – Agentic AI / LLM Systems New York | Series A Startup $180–$250k + Equity In office (5 days) No visa sponsorship available A fast-growing, venture-backed AI company is hiring AI Engineers to build systems where AI doesn’t just respond, but actually...Full timeWork at officeVisa sponsorship- ...modern technology consultancy engineering the next generation of digital... ...Engineering, Cloud, and Data & AI solutions. Job Summary Pyyne is seeking a Sr. Backend Engineer with experience in Python... ...client Integrate LLMs and agentic workflows into backend services...SeniorWork at office3 days per week
- ...at appgate.com. About the Role We're looking for a senior AI/ML Engineer who will design, build, and operationalize the detection algorithms... ..., and risk aggregation systems that power our autonomous Agentic AI threat detection platform. You'll work at the...SeniorFor contractorsWorldwide
- ...The Role We're looking for a top-tier Backend Engineer to join our tech team and work hand-in-... ...large-scale, distributed systems powering AI-ready web search Develop APIs, data... ...believe in a future of AI agents and the agentic web. These digital entities can create...SeniorRemote workFlexible hours
$159.2k - $301.6k
...future of creativity — where generative AI, intelligent agents, and human imagination work hand in hand. As a Senior Full Stack Engineer, Agentic Product, you will be a key technical... ...agent's entire surface area — including backend services, client SDKs, and platform-specific...SeniorFull timeTemporary workLocal areaWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend AI Engineer (Agentic AI). Be the first to apply!
- remote back end developer New York, NY
- back-end developer New York, NY
- senior backend developer New York, NY
- backend software engineer New York, NY
- backend python developer New York, NY
- java developer backend New York, NY
- machine learning ai engineer New York, NY
- ai engineer New York, NY
- ai prompt engineer New York, NY
- ai developer New York, NY








