Product Analyst III (AI Context Designer)

Pennymac A Typical Day We are seeking a highly analytical and detail-oriented Product Analyst to act as a "Context Designer" for Pennymac's voice AI and prompt-driven initiatives. While this is a non-engineering role, it requires a strong technical bent. You will focus on driving use case context development by drafting natural language prompts, configuring conversational flows, and refining business requirements across CDL/Sales, Servicing, and Production/MFD. Key Responsibilities Prompt & Flow Design: Act as a "Context Designer" to write, refine, and configure natural language prompts and conversational flows based on defined business logic. Requirements Gathering: Collaborate daily with sales, servicing, and fulfillment teams to capture, define, and negotiate business requirements for AI agent interactions. Knowledge Base Curation: Review and curate operational PDFs and documentation to provide a verified "Source of Truth" for the RAG Vector Database. A/B Testing & Analysis: Execute A/B tests on various prompt configurations and analyze the resulting data to improve accuracy, tone, and resolution rates. Evaluation Support: Assist the Product Owner in defining and documenting the "Golden Dataset" of test scenarios to support automated AI evaluations. Technical Collaboration: Work alongside platform engineers who manage the underlying technical architecture within the AWS tech stack to ensure successful API handshakes and platform functionality. What You’ll Bring 3–5 years of experience as a Product Analyst, Business Analyst, or similar role (targeting Analyst III level). A non-engineer with a strong "technical bent" and the ability to quickly grasp Generative AI concepts (e.g., RAG, LLM orchestration, prompt tuning). Benefits That Bring It Home Comprehensive Medical, Dental, and Vision Paid Time Off Programs including vacation, holidays, illness, and parental leave Wellness Programs, Employee Recognition Programs, and onsite gyms and cafe style dining (select locations) Retirement benefits, life insurance, 401k match, and tuition reimbursement Philanthropy Programs including matching gifts, volunteer grants, charitable grants and corporate sponsorships Competitive salary and bonus opportunities Compensation Salary range: $75,000 - $130,000 Lower in range – Building skills and experience in the role Mid-range – Experience and skills align with proficiency in the role Higher in range – Experience and skills add value above typical requirements of the role Work Model

OFFICE