Founding Senior AI Engineer

Job Description

Job Description

Founding Senior AI Engineer — Agent Quality & Evaluation

On behalf of an early-stage startup · San Francisco, on-site · Full-time

The build: Our client is building multi-channel marketing agents across SEO, content, social, and search — and they want their first senior AI hire to own the quality and intelligence of those agents end to end. You'll work directly with the founder, shape agent architecture and eval systems, and build the AI team as it scales.

This is a first-senior-hire role. You set the standard for what "good output" even means — and make it measurable.

What you'll do

• Improve agent output and content quality across Reddit, LinkedIn, X, and long-form articles — with evaluation systems that make quality measurable.
  
• Improve SEO and generative engine optimization (GEO) performance.
  
• Design feedback loops so agents learn from real-world results and performance signals at scale.
  
• Own AI infrastructure, agent architecture, model strategy, and the data pipelines behind them.
  
• Hire and lead the AI team as the org grows.
  

What we're looking for

• 3+ years building production ML or AI systems, with recent hands-on shipping of LLM products or agents.
  
• Proven eval design and outcome-signal learning in domains like search, ranking, or recommendations.
  
• Strong TypeScript (Next.js) and Python — you ship end to end and can do the data/eval work yourself.
  
• Sharp judgment about output quality, and the ability to make it measurable and actionable.
  
• Ownership experience in a startup or small team.
  
• Search or ranking background — especially Google or AI answer engines. Bonus: leading AI lab or top research program, marketing/GTM exposure, or RL/recommender systems experience.