Software Engineer III - GenAI Patterns

Job Description

As a Software Engineer III at JPMorganChase within the Commercial and Investment Bank, you serve as a full-stack software engineer who’s passionate about building AI-powered solutions that perform reliably at enterprise scale. You’ll help shape and deliver production-grade platforms that blend strong software engineering with modern GenAI patterns—retrieval, knowledge libraries, embedding-based search pipelines, and validation frameworks—while operating in a high-compliance environment.

Job Responsibilities

• Build and own end-to-end, full-stack features (UI, APIs, services, data layers) for AI-enabled products used at scale.
• Design and implement knowledge library + retrieval (RAG) capabilities, including embedding generation , indexing strategies, and semantic search pipelines.
• Develop AI content and document-generation solutions , with guardrails and auditability appropriate for regulated workflows.

• Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.

• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.

• Engineer agentic workflows (tool-using/step-based systems) with robust agentic validations (policy checks, workflow constraints, and deterministic controls).
• Implement semantic validations to improve output quality (grounding checks, relevance, duplication detection, hallucination-reduction patterns, and structured evaluation signals).
• Stay current on industry trends in applied AI/ML systems and translate them into pragmatic, maintainable engineering decisions.
• Raise the bar on engineering best practices : testing strategy, reliability, observability, performance, and secure coding patterns.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Strong full-stack engineering fundamentals and a “build it right” mindset (clean APIs, robust services, thoughtful UX).
• Experience building production systems : CI/CD, monitoring/alerting, incident hygiene, performance tuning, and scalability.
• Familiarity with search and retrieval systems (semantic search, vector stores, indexing, ranking, query pipelines) and how they integrate into applications.

• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.

• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.

• Comfort working with LLM-based systems (prompting patterns, structured outputs, evaluation, and guardrails) in real-world environments.
• A high learning mindset —curious, adaptable, and motivated to apply modern best practices thoughtfully rather than chasing hype.
• Ability to collaborate across engineering, product, and risk/compliance partners to deliver safely and responsibly.

Preferred qualifications, capabilities, and skills

• Knowledge of generative AI concepts., prompt engineering, RAG, embeddings, and vector search, LangChain
• Knowledge of model evaluation, guardrails, hallucination reduction
• Experience with Python, Java(spring boot),Open AI, Database(vector/pinecone), AWS
• Knowledge on open source community contribution/start up experience is plus
• Self motivation and Passion is the key driver

About Us

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our  FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

About the Team

J.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.