Software Engineer - Agentic AI (Python/Java)

Title:- Software Engineer Agentic AI (Python/Java)

About the Role

JPMorgan Chase is seeking an experienced Software Engineer Agentic AI to design, develop, and deploy enterprise-grade AI applications powered by autonomous agents and Large Language Models (LLMs). The ideal candidate will have strong software engineering fundamentals with hands-on experience building Agentic AI solutions using modern AI frameworks while developing scalable applications in Python and Java .

This role requires experience in designing intelligent multi-agent systems, integrating enterprise tools, and deploying AI-powered solutions into production environments.

Required Skills (Must Have)

• 8+ years of software development experience with Python or Java .
• Hands-on experience building and deploying Agentic AI applications in enterprise environments.
• Strong experience with:
  • Python
  • Java
  • LangGraph
  • vLLM
• Experience designing and orchestrating multi-agent workflows and autonomous AI systems.
• Hands-on experience integrating LLMs with enterprise applications using APIs and external tools.
• Strong understanding of Retrieval-Augmented Generation (RAG) concepts and retrieval pipelines.
• Experience with REST APIs, microservices architecture, and distributed systems.
• Strong knowledge of prompt engineering, agent orchestration, and tool calling.
• Experience monitoring, troubleshooting, and optimizing AI applications in production.
• Understanding of responsible AI, model governance, security, and enterprise AI best practices.
• Experience working in Agile development environments.

Preferred Skills

• Experience with vector databases such as Pinecone, pgVector, FAISS, or OpenSearch .
• Experience with LLM platforms such as OpenAI, Anthropic Claude, or AWS Bedrock .
• Knowledge of Kubernetes, Docker, and cloud platforms (AWS preferred).
• Experience with CI/CD pipelines, Git, and DevOps practices.
• Familiarity with observability and monitoring tools such as Grafana, Splunk, or Prometheus.

Key Responsibilities

• Design, develop, and deploy enterprise-grade Agentic AI solutions.
• Build intelligent multi-agent workflows using LangGraph .
• Develop scalable AI services using Python or Java .
• Integrate LLMs with enterprise APIs, databases, and business applications.
• Optimize inference performance using vLLM and modern serving frameworks.
• Implement RAG pipelines and AI orchestration workflows.
• Collaborate with cross-functional engineering and product teams to deliver AI-powered capabilities.
• Ensure production readiness through monitoring, testing, security, and performance optimization.
• Follow enterprise engineering standards and AI governance practices.

Required Experience

• 8+ years of software engineering experience.
• 2+ years of hands-on experience building production-grade Agentic AI or LLM-based applications.
• Strong experience with Python, Java, LangGraph, and vLLM.
• Experience deploying AI solutions into production environments.
• Excellent problem-solving and communication skills.