Senior Java AI Developer (RAG/LLM)

Donato Technologies, Inc

The client is looking for a Senior Java AI Developer to develop enterprise-scale Generative AI applications. The ideal candidate will possess strong Java backend expertise along with hands-on experience building Retrieval-Augmented Generation (RAG) solutions and integrating enterprise applications with Large Language Models. Required Skills

10+ years of Java development experience

Strong experience with Java 17+ and Spring Boot

Hands-on experience building Retrieval-Augmented Generation (RAG) systems

Experience with Spring AI, LangChain4j, or similar Java AI frameworks

Experience integrating OpenAI, Azure OpenAI, Claude, Gemini, or Llama models

Strong knowledge of vector databases such as Pinecone, Milvus, Weaviate, FAISS, or ChromaDB

Experience implementing semantic search and document retrieval pipelines

Strong REST API and Microservices development experience

Experience with Kafka or other messaging platforms

Experience with Docker, Kubernetes, and OpenShift

Experience with AWS, Azure, or Google Cloud Platform

Strong SQL and NoSQL database experience

Experience with Git, Jenkins, and CI/CD

Experience with Agile development methodologies

Preferred Skills

Banking or financial services experience

Knowledge of AI agents and autonomous workflows

Experience with Spring AI ecosystem

Experience implementing enterprise security standards

Experience with AI governance and monitoring

Knowledge of prompt engineering and model evaluation

Responsibilities

Design and develop enterprise Java-based AI applications

Build scalable RAG architectures using Java and Spring Boot

Integrate LLMs into enterprise applications

Develop document ingestion, indexing, and retrieval pipelines

Build secure APIs for AI services

Optimize retrieval accuracy and response quality

Collaborate with architects, ML engineers, and business teams

Deploy AI services using containerized cloud platforms

Ensure application performance, scalability, and compliance

Provide technical leadership and mentor development teams

Nice to Have:

Experience with LangGraph or AI Agent frameworks

MCP (Model Context Protocol) implementation experience

Knowledge Graph integration

AI observability tools (LangSmith, Arize AI, TruLens)

NVIDIA NIM or enterprise inference platforms

Financial regulatory compliance experience

Exposure to Agentic AI architectures

Donato Technologies Inc. is a trusted IT staffing, consulting, and software development partner headquartered in Dallas, Texas. We support clients across industries by understanding their unique business needs and delivering tailored technology and workforce solutions. Our focus is on connecting the right talent with the right opportunity-ensuring clients receive dependable, skilled professionals and candidates receive meaningful career growth and support. We work closely with small to mid-sized organizations to provide flexible, high-quality services that drive performance, innovation, and long-term success.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Senior Java AI Developer (RAG/LLM) in Delaware, OH vacancy

Senior Python AI Developer(RAG/LLM)
...The client is seeking a highly experienced Senior Python AI Developer with expertise in building enterprise-grade Generative AI applications.... ...designing and implementing Retrieval-Augmented Generation (RAG) solutions, integrating Large Language Models (LLMs), and developing...
Senior
Flexible hours
Donato Technologies, Inc
Delaware, OH
2 days ago
Senior Agentic AI Engineer (Python / TypeScript / Java)
...Python, TypeScript, or Java. ~ Candidate should... ...Extensive experience building AI applications using... ...Retrieval-Augmented Generation (RAG), vector database... ..., function calling, and LLM-based applications.... ...support. ~ Experience developing scalable APIs, microservices...
Senior
Full time
TalentOla
Columbus, OH
1 day ago
Senior AI Engineer - Dover
$204.9k - $280.6k
...Bachelors degree in Computer Science, AI, Electrical Engineering,... ...in Python, Go, Scala, or Java. ~7 years of experience in deploying... ...~ Experience in designing, developing, and supporting complex AI... ...Scala Hardware Support LLM More: At Capital One, we...
Senior
Full time
Capital One
Delaware, OH
4 days ago
Senior Lead AI Security Engineer
Job SummaryAs a Senior Lead AI Security Engineer in our Cybersecurity team... ...and monitoring.Build secure LLM/RAG services and ML pipelines that... ...Python and at least one of: Java, Scala, or TypeScript; experience... ...skillsExperience building developer copilots for AppSec/DevSecOps...
Senior
Work at office
JP Morgan Chase
Columbus, OH
3 days ago
Senior AI Full stack Software Engineer
$131k - $218.3k
...seeking a highly skilled and experienced Senior AI Full Stack Software Engineer to join... ...at CMM. This role involves designing, developing, and deploying end-to-end AI-powered solutions... ..., and care personalization. LLM & RAG Systems: Skilled in building retrieval-...
Senior
Full time
CoverMyMeds
Columbus, OH
9 hours ago
Senior Software Engineer - Platform & Agentic AI Engineering
$127.6k - $191.4k
Senior Staff Software Engineer - IE07HEWe’re determined to make a difference... ...This requisition hires Senior AI Engineers who will:Design and... ...-agent solutions leveraging RAG, GraphRAG, Agentic AI... ...years in GenAI, multi-agent, or LLM systems.Proven delivery of at least...
Senior
Full time
Temporary work
Work at office
3 days per week
The Hartford Financial Services Group
Columbus, OH
4 days ago
Senior Principal AI/ML Engineer
$235k
...platforms, data products, and AI capabilities that give... ...Role Summary The Senior AI/ML Engineer is a hands... ...agentic workflows, developing the enterprise knowledge... .... Build and optimize RAG (Retrieval-Augmented Generation... ...scale. Integrate LLM-powered agents with internal...
Senior
Day shift
CBRE
Columbus, OH
5 days ago
Senior Data Scientist
$95.3k - $158.8k
Senior Data ScientistAI for Science, Research Intelligence... ...DiscoveryBuild AI That Helps Advance Human... ...disciplineWhat You'll DoDesign, develop, and deploy advanced... ...exploration.Build and optimize LLM-powered applications,... ...-augmented generation (RAG) systems that connect AI...
Senior
Local area
Worldwide
RELX Group
Delaware, OH
3 days ago
Remote Senior AI Platform Engineer
$175k - $215k
...stable, profitable, and have developed a loyal customer base (... ...are proud to take an "AI-Enabled" approach in our... ...: We are looking for a Senior AI Platform Engineer to... ...backgrounds Experience with RAG, prompt engineering, context engineering, and LLM evals Experience...
Senior
Summer work
Work at office
Remote work
Flexible hours
GrabJobs
Columbus, OH
5 days ago
Java AI Lead Software Engineer
...complex backend components, embedding AI-native capabilities (agentic workflows, LLM-powered features) into core product experiences... ....Experience in designing and developing distributed systems using JavaStrong knowledge in Core Java (Java 21+), Spring Boot, React, REST,...
JP Morgan Chase
Columbus, OH
1 day ago
AI Software Engineering Lead
$115.4k - $192.3k
...the team, This team supports CK AI Service team. The new Lead... ...retrieval-augmented generation (RAG) workflows and API expansion. This... ...RAG) workflowsUnderstanding of:LLM integration and orchestrationEmbeddings... ...resources for software developers seeking to stay updated with the...
Full time
Temporary work
Local area
RELX Group
Delaware, OH
1 day ago
Senior Agentic AI Software Engineer
$139.8k - $223.7k
...valued. Be you ... be here.Job SummaryThe Senior Agentic Software Engineer will develop financial technology solutions within the rapidly evolving AI world. This includes utilizing/... ...Generative AI, or agentic systems (e.g., LLM-powered applications, LangChain, LangGraph...
Senior
Full time
Temporary work
Work at office
Local area
Immediate start
Remote work
Work visa
Flexible hours
Bread Financial
Columbus, OH
2 days ago
AI Full Stack Java Developer || onsite - W2 Role
...solve technical problems. Develop secure, high-quality production... ...adoption of enterprise-authorized AI-assisted engineering practices... ...stability. Proficiency in Java, Spring Boot, Docker,... ...Experience coaching engineers, senior engineers, or technical leads...
Full time
For contractors
SVATS Inc
Columbus, OH
1 day ago
Full Stack Java Developer - Senior/W2 Contract
...Full Stack Java Developer Senior Location: Columbus, OH- onsite 12+ months Contract on W2 Visa: GC/USC only (No, fake GC please... ...~ React experience approximately 10 20% ~ Experience with AI-assisted development tools any relevant AI tool ~10+...
Senior
Contract work
Stellent IT LLC
Columbus, OH
1 day ago
Senior AI Engineer, Agentic Systems - W2 Role
...Role: Senior AI Engineer, Agentic Systems W2 Role Location: Columbus, OH / Plano, TX (... ...enterprise capabilities as tools or skills for LLM-powered agents. The ideal candidate... ...AI and agentic system environments. ~ Java experience or willingness to work daily within...
Senior
Full time
Contract work
For contractors
H1b
SVATS Inc
Columbus, OH
1 day ago
Remote Senior Software Engineer, Knowledge Engine
...accurate and performant AI applications at... ...with Pinecone's developer-friendly technology... ...Role: We are hiring a senior software engineer... ...unstructured data–to modern LLM-powered... ...Elastic or OpenSearch. RAG & Orchestration: You... ...Go, Rust, C++, Java, or Python. Infrastructure...
Senior
Local area
Remote work
Work from home
Flexible hours
GrabJobs
Columbus, OH
2 days ago
Senior AI-Driven Offensive Security Engineer
...Humana Inc. is seeking a Senior Offensive Security Engineer to build AI-driven red team tooling and run live engagements across networks, web apps, and cloud environments. You will write production-grade software, design agentic workflows, and validate defenses with adversarial...
Senior
Remote work
Humana Inc
Delaware, OH
1 day ago
AI Engineering & Platform Leadership Senior Manager - Utilities
...technology and leadership in cloud, data and AI with unmatched industry experience,... ...processes and outcomes.You Are:You are a Senior AI engineering Leader who architects and delivers... ...architecting and delivering enterprise AI/LLM platforms across major cloud and model...
Senior
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Columbus, OH
9 hours ago
Java Full Stack Developer (FSD) with AWS- Wilmington, DE
...Job description Job Description Seeking an experienced Java Full Stack Developer with AWS expertise (Java 70% / AWS 30%). The ideal candidate should have an end-to-end product mindset, including design, development, testing, and deployment. Location: Wilmington...
Contract work
Local area
Hudson Manpower
Delaware, OH
9 hours ago
Ab Initio + Java Developer
...Title:- Ab Initio + Java Developer P.N : 100% Abi Nitio profile will also work Required Skills: Strong hands-on experience with Ab Initio (ETL) this is the most critical skill. Java development experience (preferred). AWS experience, specifically...
VSG Business Solutions LLC
Delaware, OH
1 day ago
Senior Data Scientist Engineer - SFL Scientific
$128k - $252.5k
...businesses. We are hiring a Senior Data Scientist to... ...with clients to design and develop novel projects and solutions... ...generation of tools, products, and AI services. You will work... ...+ year of experience with LLM/GenAI use cases and developing RAG solutions, tools, and...
Senior
Local area
Deloitte
Columbus, OH
4 days ago
Lead Agentic AI Engineer-US Remote - US-OH,Columbus
...activate science to deliver progress—developing breakthrough solutions that... ...engineering lead for Agentic AI delivery across Supply Planning... ...solutions on Azure AI Foundry — RAG-based knowledge agents,... ...frameworks, and observability for LLM-based systems. Compulsory — must...
Remote work
Worldwide
Hexion
Columbus, OH
4 days ago
AI - Cyber Security Engineer - II
$109k - $182.4k
...IIAbout your role:As an Advisor II, AI - Software Engineering, you... ...Fiserv.What you'll do:Design, develop, and deploy artificial intelligence... ...-augmented generation (RAG), embeddings, and vector databases... ...certifications.Familiarity with OWASP LLM Top 10, MITRE ATT&CK, MITRE...
Full time
Temporary work
H1b
Work at office
Monday to Friday
Fiserv
Columbus, OH
3 days ago
AI Engineer
...Role: AI Engineer Location: Columbus, OH (Onsite) Job Description... ...building and deploying AI/ML solutions, developing LLM-powered applications, and working with modern... ...Anthropic, Llama, etc.) , LangChain , and RAG architectures. ~ Experience building...
Lorven technologies
Columbus, OH
1 day ago
Senior AI Engineer
...Senior AI Engineer Location: Columbus, Ohio (Onsite) Rate - Only on w2 Role Overview... ...automation solutions end-to-end. Develop agent workflows, prompt patterns, and... ...with CI/CD pipelines. Experience in Java, Python, or JavaScript. Preferred Qualifications...
Senior
Tek Leaders Inc
Columbus, OH
28 days ago
Senior AI Engineer - SFL Scientific
$128k - $252.5k
...account executives and data scientists to AI strategists, machine learning specialists,... ...a Deloitte Business, is looking to add a Senior AI Engineer to their vibrant environment.... ...Take the next step in your technical journey—develop your leadership, consulting acumen, and...
Senior
Local area
Visa sponsorship
Deloitte
Columbus, OH
3 days ago
Sr. Applied AI Engineer (Claude/Codex)
...entering a new decade of Data & AI that will reshape work and... ...skills to architect innovative LLM solutions that address complex... ...understand Claude's capabilities, develop evals, and design scalable architectures... ...and frameworks (Python, Java, C, Go, etc.), and mastery of one...
Senior
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Columbus, OH
4 days ago
Senior Lead Software Engineer -Java/AWS/Agentic
As a Senior Lead Software Engineer at JPMorganChase within Employee Experience, you are an... ...end-to-end design and delivery of scalable Java services and APIs, optimizing for performance... ...adoption and governance of approved AI-assisted engineering practices across teams...
Senior
JP Morgan Chase
Columbus, OH
2 days ago
Sr Lead Software Engineer Python
..., design, development, and technical troubleshooting for AI‑enabled applications. Develop secure, high‑quality production code; review and debug SDK... ...output safety (guardrails, moderation) and comprehensive LLM usage logging/monitoring (no prior experience required).....
Senior
Work at office
JPMorgan Chase & Co.
Delaware, OH
6 days ago
AI Platform Engineer (Google Cloud Platform)
$117.2k - $175.8k
...seeks energetic and passionate AI Platform Engineers to build AI... ...needs arise. Responsibilities: Develop value-added features tailored to... ...techniques across various stages of the RAG pipeline, including model fine-... ...is a plus. Experience with LLM orchestration frameworks like...
Full time
Temporary work
Work at office
Remote work
3 days per week
The Hartford Financial Services Group
Columbus, OH
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Java AI Developer (RAG/LLM). Be the first to apply!