Senior Java AI Developer (RAG/LLM)

Donato Technologies, Inc

The client is looking for a Senior Java AI Developer to develop enterprise-scale Generative AI applications. The ideal candidate will possess strong Java backend expertise along with hands-on experience building Retrieval-Augmented Generation (RAG) solutions and integrating enterprise applications with Large Language Models. Required Skills

10+ years of Java development experience

Strong experience with Java 17+ and Spring Boot

Hands-on experience building Retrieval-Augmented Generation (RAG) systems

Experience with Spring AI, LangChain4j, or similar Java AI frameworks

Experience integrating OpenAI, Azure OpenAI, Claude, Gemini, or Llama models

Strong knowledge of vector databases such as Pinecone, Milvus, Weaviate, FAISS, or ChromaDB

Experience implementing semantic search and document retrieval pipelines

Strong REST API and Microservices development experience

Experience with Kafka or other messaging platforms

Experience with Docker, Kubernetes, and OpenShift

Experience with AWS, Azure, or Google Cloud Platform

Strong SQL and NoSQL database experience

Experience with Git, Jenkins, and CI/CD

Experience with Agile development methodologies

Preferred Skills

Banking or financial services experience

Knowledge of AI agents and autonomous workflows

Experience with Spring AI ecosystem

Experience implementing enterprise security standards

Experience with AI governance and monitoring

Knowledge of prompt engineering and model evaluation

Responsibilities

Design and develop enterprise Java-based AI applications

Build scalable RAG architectures using Java and Spring Boot

Integrate LLMs into enterprise applications

Develop document ingestion, indexing, and retrieval pipelines

Build secure APIs for AI services

Optimize retrieval accuracy and response quality

Collaborate with architects, ML engineers, and business teams

Deploy AI services using containerized cloud platforms

Ensure application performance, scalability, and compliance

Provide technical leadership and mentor development teams

Nice to Have:

Experience with LangGraph or AI Agent frameworks

MCP (Model Context Protocol) implementation experience

Knowledge Graph integration

AI observability tools (LangSmith, Arize AI, TruLens)

NVIDIA NIM or enterprise inference platforms

Financial regulatory compliance experience

Exposure to Agentic AI architectures

Donato Technologies Inc. is a trusted IT staffing, consulting, and software development partner headquartered in Dallas, Texas. We support clients across industries by understanding their unique business needs and delivering tailored technology and workforce solutions. Our focus is on connecting the right talent with the right opportunity-ensuring clients receive dependable, skilled professionals and candidates receive meaningful career growth and support. We work closely with small to mid-sized organizations to provide flexible, high-quality services that drive performance, innovation, and long-term success.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Senior Java AI Developer (RAG/LLM) in Delaware, OH vacancy

Senior Python AI Developer(RAG/LLM)
...The client is seeking a highly experienced Senior Python AI Developer with expertise in building enterprise-grade Generative AI applications.... ...designing and implementing Retrieval-Augmented Generation (RAG) solutions, integrating Large Language Models (LLMs), and developing...
Senior
Flexible hours
Donato Technologies, Inc
Delaware, OH
1 day ago
Senior Agentic AI Engineer (Python / TypeScript / Java)
...Python, TypeScript, or Java. ~ Candidate should... ...Extensive experience building AI applications using... ...Retrieval-Augmented Generation (RAG), vector database... ..., function calling, and LLM-based applications.... ...support. ~ Experience developing scalable APIs, microservices...
Senior
Full time
TalentOla
Columbus, OH
1 day ago
Senior Lead AI Security Engineer
Job SummaryAs a Senior Lead AI Security Engineer in our Cybersecurity team... ...and monitoring.Build secure LLM/RAG services and ML pipelines that... ...Python and at least one of: Java, Scala, or TypeScript; experience... ...skillsExperience building developer copilots for AppSec/DevSecOps...
Senior
Work at office
JP Morgan Chase
Columbus, OH
4 days ago
Sr Agentic AI Engineer
...Job Title: Sr Agentic AI Engineer Role Summary: Lead architecture, design, and delivery of Agentic AI and RAG-based solutions, partnering with customers and internal teams... ...in RAG pipelines, embeddings, vector DBs, LLM orchestration, and prompting techniques....
Senior
Full time
TalentOla
Delaware, OH
1 day ago
Senior AI Full stack Software Engineer
$131k - $218.3k
...seeking a highly skilled and experienced Senior AI Full Stack Software Engineer to join... ...at CMM. This role involves designing, developing, and deploying end-to-end AI-powered solutions... ..., and care personalization. LLM & RAG Systems: Skilled in building retrieval-...
Senior
Full time
CoverMyMeds
Columbus, OH
4 hours ago
Senior Software Engineer - Platform & Agentic AI Engineering
$127.6k - $191.4k
Senior Staff Software Engineer - IE07HEWe’re determined to make a difference... ...This requisition hires Senior AI Engineers who will:Design and... ...-agent solutions leveraging RAG, GraphRAG, Agentic AI... ...years in GenAI, multi-agent, or LLM systems.Proven delivery of at least...
Senior
Full time
Temporary work
Work at office
3 days per week
The Hartford Financial Services Group
Columbus, OH
9 hours ago
Senior Principal AI/ML Engineer
$235k
...platforms, data products, and AI capabilities that give... ...Role Summary The Senior AI/ML Engineer is a hands... ...agentic workflows, developing the enterprise knowledge... .... Build and optimize RAG (Retrieval-Augmented Generation... ...scale. Integrate LLM-powered agents with internal...
Senior
Day shift
CBRE
Columbus, OH
1 day ago
Senior Data Scientist
$95.3k - $158.8k
Senior Data ScientistAI for Science, Research Intelligence... ...DiscoveryBuild AI That Helps Advance Human... ...disciplineWhat You'll DoDesign, develop, and deploy advanced... ...exploration.Build and optimize LLM-powered applications,... ...-augmented generation (RAG) systems that connect AI...
Senior
Local area
Worldwide
RELX Group
Delaware, OH
4 days ago
Java AI Lead Software Engineer
...complex backend components, embedding AI-native capabilities (agentic workflows, LLM-powered features) into core product experiences... ....Experience in designing and developing distributed systems using JavaStrong knowledge in Core Java (Java 21+), Spring Boot, React, REST,...
JP Morgan Chase
Columbus, OH
2 days ago
Senior Applied AI Engineer - LLM/ML Platforms
Next Frontier Capital is looking for an Applied AI Engineer-Senior Associate in Columbus, Ohio, to join their Consumer & Community Banking... ...reliable. Responsibilities include providing technical guidance, developing high-quality production code, and driving innovation....
Senior
Next Frontier Capital
Columbus, OH
3 days ago
AI Software Engineering Lead
$115.4k - $192.3k
...the team, This team supports CK AI Service team. The new Lead... ...retrieval-augmented generation (RAG) workflows and API expansion. This... ...RAG) workflowsUnderstanding of:LLM integration and orchestrationEmbeddings... ...resources for software developers seeking to stay updated with the...
Full time
Temporary work
Local area
RELX Group
Delaware, OH
2 days ago
AI Full Stack Java Developer || onsite - W2 Role
...solve technical problems. Develop secure, high-quality production... ...adoption of enterprise-authorized AI-assisted engineering practices... ...stability. Proficiency in Java, Spring Boot, Docker,... ...Experience coaching engineers, senior engineers, or technical leads...
Full time
For contractors
SVATS Inc
Columbus, OH
1 day ago
Senior Java Developer
...necessary. Full Stack Engineer with strong Back End Skills in JAVA / J2EE Enterprise Technology. Spring Stack / RESTFUL Services... ...a talented team of software engineers and product managers to develop products that impact millions of learners and educators every day...
Senior
Remote work
Samprasoft
Columbus, OH
14 hours ago
Senior Java Developer
...adaptability, strong technical expertise, and collaborative spirit, which will align successfully in the organization. Job Title: Java Developer Location: Columbus, OH What's the Job? Consult on complex initiatives with broad impact and large-scale planning...
Senior
Weekly pay
Temporary work
Flexible hours
Experis
Columbus, OH
3 days ago
Full Stack Java Developer - Senior/W2 Contract
...Full Stack Java Developer Senior Location: Columbus, OH- onsite 12+ months Contract on W2 Visa: GC/USC only (No, fake GC please... ...~ React experience approximately 10 20% ~ Experience with AI-assisted development tools any relevant AI tool ~10+...
Senior
Contract work
Stellent IT LLC
Columbus, OH
1 day ago
Senior AI Engineer, Agentic Systems - W2 Role
...Role: Senior AI Engineer, Agentic Systems W2 Role Location: Columbus, OH / Plano, TX (... ...enterprise capabilities as tools or skills for LLM-powered agents. The ideal candidate... ...AI and agentic system environments. ~ Java experience or willingness to work daily within...
Senior
Contract work
For contractors
H1b
SVATS Inc
Columbus, OH
1 day ago
Senior Applications Dev Analyst — Java & Systems Lead
...experienced candidate to analyze and validate system requirements and develop complex applications at OSU Health Plan. The role involves... ...particularly in applications development, and strong skills in Java and related technologies. Comprehensive employee benefits, including...
Senior
Wexner Medical Center
Columbus, OH
23 hours ago
Senior Full Stack Java Developer
...Senior Full Stack Java Developer Anywhere Type: Contract Category: Development Industry: Healthcare Workplace Type: Remote Reference... ...that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening and...
Senior
Hourly pay
Contract work
Local area
Remote work
Eliassen Group
Columbus, OH
3 days ago
Ohio-Based Java Full Stack Developer (Mid-Senior) Contract
Logix Guru is seeking a Mid-Senior Java Full Stack Developer based in Ohio. Candidates should possess 2-3 years of experience with Typescript and frontend libraries like React, AngularJs, and jQuery. Required qualifications include 3 years of hands-on experience with Java...
Senior
Contract work
LogiX-Guru
Columbus, OH
2 days ago
AI Engineering & Platform Leadership Senior Manager - Utilities
...technology and leadership in cloud, data and AI with unmatched industry experience,... ...processes and outcomes.You Are:You are a Senior AI engineering Leader who architects and delivers... ...architecting and delivering enterprise AI/LLM platforms across major cloud and model...
Senior
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Columbus, OH
1 day ago
Ab Initio + Java Developer
...Title:- Ab Initio + Java Developer P.N : 100% Abi Nitio profile will also work Required Skills: Strong hands-on experience with Ab Initio (ETL) this is the most critical skill. Java development experience (preferred). AWS experience, specifically...
VSG Business Solutions LLC
Delaware, OH
1 day ago
Java Full Stack Developer (FSD) with AWS- Wilmington, DE
...Job description Job Description Seeking an experienced Java Full Stack Developer with AWS expertise (Java 70% / AWS 30%). The ideal candidate should have an end-to-end product mindset, including design, development, testing, and deployment. Location: Wilmington...
Contract work
Local area
Hudson Manpower
Delaware, OH
9 hours ago
Core Java Developer
...include critical analysis and architectural design with microservice architectures in highly decoupled environments. Technical aptitude with Java, SpringBoot, ReactJS, Kafka, AWS Lamda/ECS/RDS, workflow design and rules systems experience with BPM toolsets (Camunda)....
TriOptus LLC
Delaware, OH
2 days ago
Senior ETL Developer (Python/R, DataStage) - Remote
A leading IT services provider is looking for a Programmer 5 to develop ETL processes, requiring strong expertise in Python and R, along with IBM DataStage and Cloudpaq experience. This mid-senior level role demands excellent communication skills and the ability to work...
Senior
Full time
Remote work
Expedite Talent Solutions
Delaware, OH
1 day ago
Senior Data Scientist Engineer - SFL Scientific
$128k - $252.5k
...businesses. We are hiring a Senior Data Scientist to... ...with clients to design and develop novel projects and solutions... ...generation of tools, products, and AI services. You will work... ...+ year of experience with LLM/GenAI use cases and developing RAG solutions, tools, and...
Senior
Local area
Deloitte
Columbus, OH
9 hours ago
Senior Software Engineer (full stack) Columbus HQ / Remote
Senior Software Engineer (full stack) Full Time Columbus HQ / Remote As a Senior Full Stack Engineer,... ...Angular view. Nice-to-Haves (Training Provided) AI & Future Tech: Helping build our RAG-based AI agent and integrating LLM-driven features into the UI. Industrial IoT...
Senior
Remote job
Full time
Motion LLC
Columbus, OH
2 days ago
Lead Agentic AI Engineer-US Remote - US-OH,Columbus
...activate science to deliver progress—developing breakthrough solutions that... ...engineering lead for Agentic AI delivery across Supply Planning... ...solutions on Azure AI Foundry — RAG-based knowledge agents,... ...frameworks, and observability for LLM-based systems. Compulsory — must...
Remote work
Worldwide
Hexion
Columbus, OH
9 hours ago
Lead AI Engineer
$129.5k - $186.1k
...seeking an experienced AI Engineer to design, build... ...Development Design, develop, and deploy AI agents that... ...-augmented generation (RAG), and decision logic within... ...JavaScript/TypeScript, Java, or C# ~ Experience... ...services Familiarity with LLM evaluation frameworks,...
Local area
UKG
Columbus, OH
1 day ago
AI Engineer
...Role: AI Engineer Location: Columbus, OH (Onsite) Job Description... ...building and deploying AI/ML solutions, developing LLM-powered applications, and working with modern... ...Anthropic, Llama, etc.) , LangChain , and RAG architectures. ~ Experience building...
Lorven technologies
Columbus, OH
1 day ago
Senior AI Engineer
...Senior AI Engineer This role focuses on the hands-on development of integrations, connectivity... ...and automation solutions end-to-end. Develop agent workflows, prompt patterns, and... ...Proficiency with CI/CD pipelines. Experience in Java, Python, or JavaScript. Preferred...
Senior
Apex Systems Inc Defunct
Columbus, OH
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Java AI Developer (RAG/LLM). Be the first to apply!