Prompt Engineer / LLM Specialist, AVP

Discover your opportunity with Mitsubishi UFJ Financial Group (MUFG), one of the world’s leading financial groups. Across the globe, we’re 150,000 colleagues, striving to make a difference for every client, organization, and community we serve. We stand for our values, building long-term relationships, serving society, and fostering shared and sustainable growth for a better world.

With a vision to be the world’s most trusted financial group, it’s part of our culture to put people first, listen to new and diverse ideas and collaborate toward greater innovation, speed and agility. This means investing in talent, technologies, and tools that empower you to own your career.

Join MUFG, where being inspired is expected and making a meaningful impact is rewarded.

The selected colleague will work at an MUFG office or client sites four days per week and work remotely one day. A member of our recruitment team will provide more details.

Prompt Engineer / LLM Specialist

Overview

Join our innovative AI/DX Accelerator Integration team and play a key role in advancing artificial intelligence within the financial services sector. As a Prompt Engineer / LLM Specialist, you will design, optimize, and implement prompts, tools, and guardrails to support robust, compliant, and efficient AI solutions. You will contribute to the development of retrieval-augmented generation (RAG) systems and fine-tune large language models (LLMs), ensuring alignment with industry regulations and best practices for risk management, customer experience, and data security.

Key Responsibilities

Prompting & Evaluation

• Develop and refine prompt architectures tailored to financial use cases, ensuring regulatory compliance and minimizing operational risk.
• Conduct A/B testing and automated evaluations using golden datasets representative of banking and financial scenarios.
• Collaborate with compliance and risk teams to validate prompt effectiveness and safety.

RAG & Safety

• Design advanced retrieval systems (chunking, embeddings, rerankers) for secure and accurate information access in regulated environments.
• Implement policy-aware filters and automated redaction mechanisms for PII/PCI, adhering to FINRA, SEC, and GDPR standards.
• Work closely with cybersecurity and legal teams to ensure data protection and auditability.

Model Operations

• Fine-tune LLMs for financial applications, optimizing for performance, compliance, and cost-effectiveness.
• Implement robust guardrails to mitigate hallucinations and ensure outputs are defensible and grounded in verified sources.
• Monitor and report on model performance, integrating feedback from end-users and compliance teams.

Qualifications

Required

• 3+ years of hands-on experience with LLMs/NLP, including Python and modern machine learning tooling.
• Proven track record in deploying AI solutions within highly regulated environments.
• Strong understanding of data privacy, security, and ethical AI practices.

Preferred

• In-depth familiarity with banking terminology, document types, and regulatory requirements (e.g., BSA/AML, PCI DSS).
• Experience building defensible AI systems with grounding, citations, and dynamic guardrails.
• Demonstrated ability to develop policy-aware retrieval and automated PII/PCI redaction patterns.
• Experience collaborating with compliance, risk, and audit teams in financial institutions.

Success Metrics

• Consistently meet or exceed accuracy and safety targets as defined by financial industry benchmarks.
• Demonstrated reduction in hallucinations and false positives in model outputs.
• Positive user experience and product KPIs, such as improved task success rates and reduced time-to-answer.
• Acceptance of AI artifacts and guardrails by compliance, audit, and risk management teams.
• Full adherence to regulatory standards and industry best practices in all deliverables.

• Bachelor's degree in Computer Science or a closely-related discipline, or an equivalent combination of formal education and experience

• New York / New Jersey: $ 100-171K
• Non–New York / New Jersey: $ 100-156K

[MUFG Benefits Summary](

We will consider for employment all qualified applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws (including (i) the San Francisco Fair Chance Ordinance, (ii) the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, (iii) the Los Angeles County Fair Chance Ordinance, and (iv) the California Fair Chance Act) to the extent that (a) an applicant is not subject to a statutory disqualification pursuant to Section 3(a)(39) of the Securities and Exchange Act of 1934 or Section 8a(2) or 8a(3) of the Commodity Exchange Act, and (b) they do not conflict with the background screening requirements of the Financial Industry Regulatory Authority (FINRA) and the National Futures Association (NFA). The major responsibilities listed above are the material job duties of this role for which the Company reasonably believes that criminal history may have a direct, adverse and negative relationship potentially resulting in the withdrawal of conditional offer of employment, if any.

The above statements are intended to describe the general nature and level of work being performed. They are not intended to be construed as an exhaustive list of all responsibilities duties and skills required of personnel so classified.

We are proud to be an Equal Opportunity Employer and committed to leveraging the diverse backgrounds, perspectives and experience of our workforce to create opportunities for our colleagues and our business. We do not discriminate on the basis of race, color, national origin, religion, gender expression, gender identity, sex, age, ancestry, marital status, protected veteran and military status, disability, medical condition, sexual orientation, genetic information, or any other status of an individual or that individual’s associates or relatives that is protected under applicable federal, state, or local law.