Financial Risk & Safety Specialist (AI Systems)

Financial Expert Opportunity

mpathic is seeking part-time financial experts to support a red-teaming and quality assurance campaign focused on evaluating AI system behavior in consumer-facing financial interactions.

In this role, you will review AI-generated responses and multi-turn conversations to identify risks related to financial guidance, inappropriate agreement, overconfidence, and failure to appropriately communicate uncertainty or limitations.

This is not a financial advising role. Instead, it focuses on evaluation and red teamingspecifically, adversarial thinking and expert judgment applied to AI outputs in simulated scenarios.

What You'll Be Working On

• Reviewing AI-generated financial content and conversations for accuracy, appropriateness, and risk
• Identifying unsafe or misleading financial guidance (e.g., overconfident claims, risk minimization, inappropriate advice)
• Evaluating how AI systems handle uncertainty, disclaimers, and scope of knowledge in consumer-facing contexts
• Assessing whether models appropriately challenge or push back on risky or incorrect user assumptions
• Identifying patterns of sycophancy, over-alignment, or inappropriate agreement
• Evaluating multi-turn conversations for drift, escalation, and policy breakdown over time
• Participating in or reviewing red teaming exercises, including adversarial probing of AI systems to surface failure modes
• Evaluating how models respond under pressure, ambiguity, and escalating user intent
• Supporting quality assurance (QA) of red teaming outputs to ensure consistency and rigor
• Documenting edge cases, failure modes, and emerging risk patterns
• Providing structured written feedback to internal teams
• Collaborating with interdisciplinary teams on AI safety, policy, and evaluation frameworks
• Maintaining strict confidentiality and quality standards

This role requires strong judgment, attention to nuance, and comfort evaluating ambiguous or evolving scenarios.

What We're Looking For

• Professional experience in one or more of the following: finance, investment analysis, or financial advising; banking, wealth management, or asset management; financial risk, compliance, or regulatory roles; corporate finance, accounting, or financial planning
• Strong understanding of financial risk, uncertainty, and decision-making; appropriate vs. inappropriate financial guidance in consumer contexts; how non-experts interpret financial information
• Ability to identify overconfidence, misleading claims, or missing risk disclosures; inappropriate agreement with risky or incorrect user assumptions; failures in escalation, boundary setting, or uncertainty communication
• Strong written communication skills and ability to clearly explain reasoning
• Experience with or interest in red teaming, adversarial testing, or safety evaluation of AI systems; evaluating how systems fail under realistic user behavior
• Comfort working with AI tools and conversational outputs
• Ability to work remotely using Slack and standard productivity tools
• Comfort with ambiguity, iteration, and feedback-driven workflows
• Willingness to sign NDAs and work with sensitive content
• Availability ~10 hours per week for 8 weeks (starting in mid-April), with occasional scheduled meetings

Nice to Have (Not Required)

• Certifications (e.g., CFA, CFP, CPA, FRM)
• Experience in financial compliance or regulatory frameworks (e.g., SEC, FINRA)
• Background in consumer financial protection or financial education
• Experience with fintech, digital finance products, or robo-advisors
• Prior experience with AI evaluation, annotation, or safety work
• Interest in AI, NLP, or responsible technology

Compensation

$30-200/hour, depending on experience and specific project tasks/difficulty