Senior Business Analyst & Prompt Engineer (AI Skills)

Job-Senior Business Analyst & Prompt Engineer (AI Skills)

Job Location - NYC, NY

Job Type- Full Time

The role

A senior, independent contributor who designs, tests and maintains reusable AI "Skills": structured prompts, instructions and evaluation sets that let AI agents do work across the product development lifecycle. Examples include drafting business intent documents, generating epics and stories, and checking requirements against risk and policy standards. You'll work directly with senior product, technology and risk stakeholders. This is not an engineering role: we want someone who knows how models behave and can reliably get the results the business needs.

Location: New York City, hybrid (3 days a week onsite)

Engagement: Embedded with a technology and operations team at a large global bank

Level: Senior, independent contributor

What you'll do

• Turn business processes (ideation, business case, requirements, design review, testing) into well-defined AI Skills with clear inputs, outputs, quality criteria and escalation points.
• Write, test and refine prompts and instruction sets for large language models, using structured outputs, few-shot examples, role and context framing, and step decomposition.
• Build evaluation sets and rubrics that measure completeness, consistency and accuracy of Skill outputs, and iterate on failures until quality is production-ready.
• Run discovery with senior stakeholders to define what "good" looks like, and document it as business requirements, epics and user stories with acceptance criteria.
• Define where humans approve and where agents proceed on their own, including approval gates, review points and exception handling.
• Work with risk, compliance and control teams so Skills reflect policy, regulatory and audit expectations from the start.
• Maintain a versioned library of Skills with documentation, usage guidance and change history.
• Compare models and model versions on specific tasks, and recommend which suits which job, flagging cost, latency and reliability trade-offs.
• Coach product and business teams on effective use of AI tools.

What we're looking for

Must have

• 8+ years in business analysis, product, process or consulting roles, including 2+ years of hands-on prompt engineering or LLM-based solution design (assumed range; adjust as needed).
• Deep working knowledge of how leading LLMs behave (strengths, failure modes, hallucination, consistency, instruction-following) and how to steer them.
• Strong requirements skills: BRDs, epics, user stories, Gherkin or similar acceptance criteria, process and workflow mapping.
• Proven ability to work independently, influence senior stakeholders, and write clearly.
• Experience in financial services or another regulated industry, and comfort in risk, compliance and control environments.
• A learning mindset: able to describe what you're proud of, what failed and what you learned, and open to being coached and adapting your approach.

Nice to have

• Experience with Gemini or other enterprise LLM platforms, and AI-assisted development tools such as GitHub Copilot/Devin/Kiro/Codex/Claude Code/Cursor
• Familiarity with Jira, Confluence and Figma, and with agent or multi-agent workflow concepts.
• Experience designing LLM evaluation, red-teaming or "LLM-as-judge" validation approaches.
• Exposure to the software or product development lifecycle from idea to release.

Not required

• Software engineering depth. Light Python or API familiarity helps but is not expected.

Success looks like

• A tested library of Skills in use across multiple stages of the lifecycle.
• Measurable improvement in output quality, consistency and cycle time against agreed evaluation criteria.
• Stakeholders who trust the Skills and can adopt them without hand-holding.