Staff Applied AI Engineer

Staff Applied AI Engineer, Agents & Model Adaptation

Do you have the right skills and experience for this role Read on to find out, and make your application.

Compensation: $230,000–$275,000 base + equity

Location: New York City | 5 days onsite

Company: Venture-backed AI startup building sophisticated, real-world AI systems.

The Opportunity

People In AI is partnering with a fast-growing, venture-backed technology company developing advanced AI solutions for complex, data-intensive workflows. With strong commercial momentum and an experienced technical team, the business is investing heavily in its next generation of AI capabilities, with a particular focus on agentic systems, LLM fine-tuning, and model optimization.

They're looking for a Staff Applied AI Engineer to take ownership of critical AI architecture and help build scalable, reliable, production-grade AI systems.

The Role

You'll lead the design, adaptation, evaluation, and deployment of LLM-powered systems, with a particular focus on production AI agents and specialized language models.

A major part of the role involves determining when to leverage frontier models versus fine-tuning and deploying smaller open-weight models, balancing quality, latency, reliability, and cost.

You'll also develop robust agent architectures, establish evaluation frameworks, and build continuous improvement loops that turn real-world feedback into better-performing models.

This is a hands-on Staff-level individual contributor role with significant technical ownership and architectural influence.

What You'll Do

• Own model selection and adaptation strategy across frontier and open-weight LLMs.
• Fine-tune and optimize language models using techniques such as LoRA, QLoRA, supervised fine-tuning, and preference optimization.
• Architect and build production-grade AI agents involving tool calling, orchestration, context management, and structured outputs.
• Develop feedback loops that transform production data and user interactions into training datasets and evaluation benchmarks.
• Build robust evaluation frameworks to measure model quality, hallucinations, accuracy, latency, and cost.
• Design and optimize model-serving infrastructure, including batching, quantization, and inference performance.
• Implement guardrails, observability, and safety measures to support reliable AI deployment.
• Provide technical leadership through architecture decisions, design reviews, and mentorship while remaining hands-on.

What You'll Bring

• Experience in software engineering, applied ML, or a related technical discipline.
• Proven experience designing and deploying ML or LLM systems in production.
• Hands-on experience fine-tuning LLMs , with a strong understanding of training techniques, evaluation, and performance trade-offs.
• Experience building production agentic AI systems that integrate external tools and structured outputs.
• Strong Python and PyTorch skills, alongside familiarity with modern LLM training frameworks.
• Practical experience with model evaluation, inference optimization, and production monitoring.
• Ability to balance model quality, infrastructure complexity, latency, and cost.
• Strong architectural judgment and the ability to influence technical direction at Staff level.
• A pragmatic, experimental mindset and an interest in solving challenging applied AI problems.

Why Join?

• Technical ownership: Set the direction for core AI systems and influence key architectural decisions from day one.
• Cutting-edge applied AI: Work across LLM fine-tuning, agentic systems, model optimization, and production infrastructure.
• Real-world impact: Build AI capabilities that solve meaningful problems and deliver measurable results.
• High-growth environment: Join a well-backed business with strong momentum and significant opportunities for personal and technical growth.
• Hands-on Staff leadership: Drive technical strategy, mentor talented engineers, and stay close to the code.

About People In AI

People In AI is a specialist recruitment partner connecting exceptional AI, machine learning, and engineering talent with ambitious companies building the next generation of intelligent technology. xhyhwjd We work with innovative startups and established technology businesses to help talented engineers and AI specialists find opportunities where they can make a meaningful impact.