Sr Generative AI Platform Engineer | Hybrid Jacksonville, FL

SR GENERATIVE AI PLATFORM ENGINEER | HYBRID – JACKSONVILLE, FL
ARC Group has an immediate opportunity for an Sr Generative AI Platform Engineer with Python and Java development experience! This is a contract position running through March 2027 with potential to extend longer or possibly convert to FTE. This is a hybrid position in Jacksonville, FL, working onsite 2-3 days/week and remotely the other days. This is a fantastic opportunity to join a well-respected healthcare organization with excellent career growth potential.

At ARC Group, we are committed to fostering a diverse and inclusive workplace where everyone feels valued and respected. We believe that diverse perspectives lead to better innovation and problem-solving. As an organization, we embrace diversity in all its forms and encourage individuals from underrepresented groups to apply.

Candidates must currently have PERMANENT US work authorization. Sorry, but we are not considering any candidates from outside companies for this position (no C2C, 3 rd party / brokering).

JOB SUMMARY:
We are seeking an experienced Senior Generative AI / Platform Engineer to lead the architecture, development, and scaling of our client’s next-generation AI orchestration platform. In this role, you will bridge the gap between cutting-edge AI research and robust enterprise infrastructure.

This resource will be responsible for designing advanced Retrieval-Augmented Generation (RAG) pipelines, building resilient AI Agents, implementing cutting-edge interoperability protocols like MCP, and pioneering multi-agent (Agent-to-Agent) collaboration networks.

The ideal candidate possesses deep expertise in Python for AI/LLM orchestration, a strong backend foundation in Java (Spring Boot), and proven experience deploying and managing containerized workloads across a hybrid-cloud topology consisting of on-premises Red Hat OpenShift and Amazon Web Services (AWS).

Core Responsibilities:

• Hybrid Cloud Infrastructure & Deployment: Architect, deploy, and scale GenAI services, vector databases, and model gateways across a hybrid environment utilizing on-premises Red Hat OpenShift and public cloud services in AWS (e.g., EKS, Bedrock, EC2).
• Advanced RAG & Retrieval Optimization: Design and optimize enterprise RAG pipelines.
• Implement advanced retrieval strategies, including hybrid search (vector + lexical) and high-precision reranking workflows (using cross-encoders) to minimize LLM context noise, optimize token usage, and eliminate hallucinations.
• Agentic Systems & Tool Orchestration: Build, deploy, and monitor production-grade AI Agents capable of autonomous planning, tool usage, complex multi-step reasoning, and self-correction.
• Context Integration & Interoperability: Architect scalable integrations between LLMs and enterprise data silos using the Model Context Protocol (MCP), establishing clean, standardized interfaces for tool servers and data sources.
• Multi-Agent Networks (A2A): Design and implement Agent-to-Agent (A2A) collaboration systems, enabling specialized, decoupled agents to communicate, delegate tasks, and negotiate state synchronously or asynchronously.
• Enterprise Integration & Backend Development: Build secure, high-throughput, and fault-tolerant microservices in Java/Spring Boot to serve GenAI features, manage data orchestration, and expose robust endpoints.

Required Technical Experience

• Hybrid Cloud & Container Orchestration: Red Hat OpenShift: Deep hands-on experience deploying, managing, and troubleshooting containerized enterprise applications in an on-premises OpenShift environment (including managing security contexts, routes, and cluster resources).
• AWS Platform: Strong expertise with core AWS infrastructure and AI/ML services (e.g., IAM, VPC, Amazon Bedrock, EKS, RDS). Dual-Stack Mastery (Python & Java): Python: Expert-level proficiency for AI/ML tasks, asynchronous programming, and data engineering. Java: Deep experience building distributed microservices utilizing the Spring Boot ecosystem (Spring Web, Spring Security, Spring Data).
• Generative AI Frameworks: Practical experience with orchestrating frameworks such as LangChain, LlamaIndex, LangGraph, AutoGen, CrewAI, LangChain4j, or Spring AI.
• Advanced RAG Stack: Experience with vector databases (e.g., Pinecone, Qdrant, Milvus, pgvector) alongside dedicated reranking APIs (such as Cohere Rerank, BGE, or open-source cross-encoders).
• Protocols & Standards: Solid understanding of MCP (Model Context Protocol) or experience building universal API layer abstractions for LLM tool utilization. MLOps, DevSecOps & Observability: Familiarity with LLM evaluation frameworks, CI/CD pipelines targeting OpenShift/AWS, and enterprise observability tools (e.g., Prometheus, Grafana, OpenTelemetry, LangSmith).

Preferred Qualifications

• Experience configuring on-prem OpenShift clusters with GPU acceleration (NVIDIA GPU Operator) for local LLM or embedding model hosting.
• Relevant certifications such as Red Hat Certified Specialist in OpenShift or AWS Certified Solutions Architect / Machine Learning Specialty.
• Active contribution to open-source GenAI projects, MCP servers, or multi-agent ecosystem tools.

Required Work Experience:
5+ years related work experience, Professional experience with technical design and coding in the IT industry

Required Education:
Related Bachelor’s degree or additional, related work experience

Would you like to know more about our new opportunity? For immediate consideration, please send your resume directly to John Burke at View email address on us.fitly.work or apply online while viewing all of our open positions at .

ARC Group is a Forbes-ranked a top 20 recruiting and executive search firm working with clients nationwide to recruit the highest quality technical resources. We have achieved this by understanding both our candidate's and client's needs and goals and serving both with integrity and a shared desire to succeed.

At ARC Group, we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.

Position is offered with no fee to candidate.