Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Applied AI Engineer

$220k - $260k

Handshake

Job Description

Job Description

About Handshake

Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.

About the Role

Frontier data for post-training models is expensive to generate and hard to measure. Labs need stronger evidence that the data they receive is accurate, useful to improve models performance, and worth the cost of producing it.

We’re building an Evals platform to measure and improve the quality of expert human data and synthetic data at scale, making Frontier Model training possible and advancing AI capabilities.

We are looking for exceptional Applied AI engineers who enjoy the ownership from problem definition through production delivery. You’ll work closely with researchers and customers, bring rigor to experimentation, and turn promising ideas into reliable products used at scale.

What you'll do:

You will have a rare opportunity to deeply understand how frontier-grade data is generated and evaluated, and build the products and platform to do this at scale so the data we deliver to labs helps models reason more reliably, use tools effectively, and complete complex real-world tasks.

  • Build a best-in-class evals platform. Work with operators, researchers, and labs to turn ambiguous quality needs into measurable outcomes and reusable products.

  • Design and deploy production agents. Build agentic workflows for generating, reviewing, investigating, and improving data, with sound tool use, orchestration, human oversight, and failure recovery.

  • Make quality measurable. Build graders, programmatic verifiers, and reward signals, calibrated against expert judgment, across LLMs, agents, multimodal models, and RL environments.

  • Own the improvement loop. Develop eval datasets, benchmarks, and agent harnesses; analyze traces, diagnose failure modes, and run experiments until performance moves.

  • Lead and raise the bar. Own projects from concept through rollout with product, design, operations, and research; set technical direction; mentor engineers and drive technical excellence for the team and the entire engineering org.

Who we're looking for:

We’re looking for engineers with 5+ years of experience who bring different perspectives, take ownership, exercise sound judgment, and hold themselves to an exceptionally high standard.

  • A proven product builder. You have substantial experience shipping and operating high-quality software, owning decisions across the stack, and improving products based on how people actually use them.

  • Deep expertise in agentic workflows and applied AI. You’ve built agents in production and understand tool calling, context management, orchestration, retrieval, human review, and the practical tradeoffs that determine reliability.

  • Strong engineering fundamentals. You write excellent Python and can build scalable services, APIs, and data pipelines, with disciplined testing, debugging, and system design.

  • An evaluation-driven approach. You know how to choose meaningful metrics, build representative test sets, assess graders, distinguish real improvements from noise, and iterate until results improve.

  • Fluency in frontier AI. You understand modern models, agent harnesses, benchmarks, evaluation techniques, and how training data and post-training methods influence model behavior.

  • Technical judgment and ownership. You’re comfortable designing systems, making tradeoffs, and moving from an unclear problem to a dependable solution in a fast-moving environment.

  • Collaborative, low-ego communication. You work effectively with engineers, researchers, domain experts, operators, and customers, and make the people around you more effective.

We value demonstrated ability through shipped products, open-source contributions, benchmarks, datasets, or other substantive technical work.

Extra Credit
  • Research or applied experience in reinforcement learning, alignment, model behavior, synthetic data, or human-in-the-loop systems.

  • Experience developing LLM or agent benchmarks, reward models, evaluation methodologies, annotation systems, or data-quality frameworks.

Why join Handshake now:
  • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel

  • Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions

  • Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders

  • Build a massive, fast-growing business with billions in revenue

We offer:

Handshake delivers benefits that help you feel supported and thrive at work and in life. Benefits for full-time US employees include:

  • Equity in a fast-growing company

  • 401(k) match, competitive compensation, and financial coaching

  • Medical, dental, and vision coverage

  • Mental health support and a $500 wellness stipend

  • Paid parental leave, fertility benefits, and parental coaching

  • $2,000 annual learning stipend

  • Flexible PTO, 15 holidays, and 2 flex days

  • Internet, commuting support, and free lunch and gym access in our San Francisco office

  • Team outings and referral bonuses

Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers.

Compensation Range: $220K - $260K

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Applied AI Engineer in San Francisco, CA vacancy
  • $211k - $235k

    About AlembicAlembic is an applied science company building GPU-resident distributed data systems that deliver 10-10...  ...that were previously impossible.The RoleWe're hiring a Senior Software Engineer onto our Applied AI team to build and extend the backend systems that... 
    Senior
    Work at office

    Alembic

    San Francisco, CA
    4 days ago
  • $200k - $260k

     ...use to build their own clinical AI agents. Our mission is to make...  .... About the role Applied AI is where Concurrence meets the real world. Our core engineering team builds the platform. We take...  ...that runs in production. As a Senior Applied AI Engineer, you own... 
    Senior
    Full time
    Work at office
    Flexible hours

    Concurrence

    San Francisco, CA
    13 days ago
  • $157k - $252k

     ...maintaining legacy compliance software - you're building the agentic AI platform defining what trust looks like for the next...  ..., and career updates. Job Summary: Drata is seeking a Senior Applied AI Engineer to drive the quality and effectiveness of our AI systems... 
    Senior
    Full time
    Flexible hours

    Drata

    San Francisco, CA
    10 days ago
  • $250k - $300k

     ...intelligence. As the only vertically integrated AI infrastructure company built from the...  ...models in use today.The work is applied, not academic. The optimizations you build...  ...you will also work directly with customer engineering teams to tailor deployments to their needs... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  •  ...Job Description Job Description Confidential client — a Pre-seed startup (1-10 employees) building AI coworkers for IT teams: a security-focused product where an agent registers as a governed identity in a customer's directory, requests scoped access per task, escalates... 
    Senior
    Full time
    Contract work
    H1b
    Visa sponsorship

    Thomas Talent Network

    San Francisco, CA
    3 days ago
  • $200k - $300k

     ...Job Description Job Description Senior/Staff Applied AI Engineer, Agent Harness Company: Confidential — AI coworkers for IT teams Location: San Francisco, CA - in person, Monday to Friday Compensation: $200,000 - $300,000 base + 1-2% equity Employment... 
    Senior
    Full time
    Contract work
    H1b
    Work at office
    Visa sponsorship
    Monday to Friday

    Transparent Search Group

    San Francisco, CA
    3 days ago
  • $200k - $300k

     ...About the Company Our client is a pre-seed AI startup in San Francisco building AI...  ...Requirements Must-Have ~4+ years of engineering experience ~ Experience with agent frameworks...  ...) Employment: Full-time Level: Senior / Staff Experience: 4+ years Salary... 
    Senior
    Full time
    Contract work
    H1b
    Work at office
    Visa sponsorship
    Monday to Friday

    David Joseph & Company

    San Francisco, CA
    5 days ago
  • $124k - $280k

     ...LevelSenior ManagerJob Description & SummaryThe OpportunityAs an Applied AI Health System Engineer you will lead client-facing AI engineering work within...  ..., and deployment for health sector use cases. As a Senior Manager you will guide large, complex efforts, use sound... 
    Senior
    Full time
    H1b

    PwC

    San Francisco, CA
    2 days ago
  •  ...organizations to safely deploy, monitor, and scale autonomous AI agents with full visibility and governance. Our platform...  ...runtime dynamics. Role Overview We are looking for a Senior Applied AI Engineer to join our on-site Research & Intelligence team in San Francisco... 
    Senior
    Full time

    alterion

    San Francisco, CA
    6 days ago
  • $180k - $240k

     ...from the CRM into Calendly, a note from Calendly into a doc. AI showed up and mostly became an eleventh window to paste into...  ...and feel the outcome every day. About the Role As a Senior Applied AI Engineer, you’ll be responsible for building, refining, and scaling the... 
    Senior
    Full time
    Live in
    Work at office
    Relocation
    Visa sponsorship
    Flexible hours

    sauna.ai

    San Francisco, CA
    6 days ago
  •  ...control layer for agentic software development, helping engineering teams trust the code they ship. AI can generate code faster than people can review and...  ...international expansion. Role Overview As an Applied Gen AI Engineer at CodeRabbit, you'll play a central... 
    Senior
    Remote job
    Full time

    coderabbit

    San Francisco, CA
    6 days ago
  •  ...for all of America. Abby Care is building the leading AI-native platform for family-led care. America is facing a growing...  ...more family caregivers at scale, we’re looking for a Senior Applied AI Engineer to design and build production AI systems that automate complex... 
    Senior
    Remote job
    Full time
    Work experience placement
    Relocation

    abby-care

    San Francisco, CA
    6 days ago
  • Zipporin is seeking an exceptional Senior Full-Stack AI Product Engineer to join our team in San Francisco on a hybrid basis. In this role, you will lead the architecture and deployment of intelligent, user-facing AI applications, transforming cutting-edge generative AI... 
    Senior
    Temporary work

    Zipporin

    San Francisco, CA
    4 days ago
  •  ...improvements Interest in building the layer that turns model capability into systems that work for users Python/TypeScript and modern AI tooling Experience with evaluations, fine-tuning, and prompt design Ability to own systems end to end Systems and user-... 
    Senior
    Full time
    Contract work
    H1b
    Work at office
    Visa sponsorship

    Cephas Consultancy Services Private Limited

    San Francisco, CA
    9 days ago
  • $236.3k - $277.7k

     ...Are you ready to make an impact?   Senior Applied AI Engineer/Architect  West Monroe is seeking a Senior Applied AI Engineer/Architect to lead the design and delivery of enterprise AI solutions that solve complex business challenges. This role serves as the technical... 
    Senior
    Local area
    Immediate start
    Flexible hours

    West Monroe

    San Francisco, CA
    3 days ago
  •  ...Applied AI Engineer AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billion+ end-user experiences. The Voice AI space... 
    Relocation

    WeHireYou

    San Francisco, CA
    3 days ago
  •  ...developing grid infrastructure, trading power in real time, using AI across the business, and installing distributed energy in...  ...building a cutting-edge AI team, and this role is for an engineer who wants to apply AI to real problems in energy. As an Applied AI Engineer,... 
    Work at office

    Fuse Energy LLC

    San Francisco, CA
    2 days ago
  •  ...renewable projects in limbo. We are eliminating this friction with AI-native workflows that help developers deploy assets and capital...  ...information in messy sources like scanned leases, permits, and engineering schematics. You will integrate rigorous validation and... 
    Remote work
    Flexible hours

    Vor Systems, Inc.

    San Francisco, CA
    5 days ago
  •  ...We're seeking an Applied AI Engineer to build and maintain production-grade AI agent infrastructure at an early-stage company. This role focuses on developing reliable agent systems that execute tasks across multiple iterations, retain long-term context, recover from... 

    Accrescent Group

    San Francisco, CA
    5 days ago
  • $100k - $175k

     ...AI is rapidly transforming the world. As generative AI reshapes industries, teams need...  ...in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering...  ...The Role We are looking for an AI Applied Engineer focused on developer growth.... 
    Work experience placement
    Work at office
    Remote work
    Work from home
    Shift work
    Afternoon shift

    Arize AI

    San Francisco, CA
    4 days ago
  •  ...SaaS). We combine cutting edge data science, machine learning, AI, and deep clinical expertise to introduce a patient‑centric...  ...medication adherence, and optimize interventions at scale. As a Senior AI Engineer, you will play a key role in designing, building, and deploying... 
    Senior

    latitude

    San Francisco, CA
    16 hours ago
  •  ...We’re looking for a Senior AI engineer to build the core intelligence behind AI teammates for finance. You’ll develop systems that go beyond...  ...doesn’t just assist, but delivers outcomes. The work is applied, the systems are complex, and the bar for reliability is high... 
    Senior

    Numos AI

    San Francisco, CA
    4 days ago
  • $251k - $278k

    About the TeamOpenAI’s Applied AI Engineering team helps organizations turn frontier AI capabilities into safe, reliable, and high-impact production systems. We work with customer executives, product and engineeriIng teams, security leaders, and transformation teams to... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  • $251k - $278k

    About the TeamAcross industries, OpenAI’s Applied AI Engineering (AIE) team helps organizations turn frontier AI into safe, reliable production systems that deliver meaningful business outcomes. We work directly with customers’ engineering, product, security, and transformation... 
    Work at office
    Local area
    Remote work
    Relocation package
    Flexible hours
    3 days per week

    OpenAI

    San Francisco, CA
    3 days ago
  • $211k - $278k

    About the teamThe Applied AI Engineering team is responsible for ensuring the safe and effective deployment of Generative AI applications for developers and startups. We act as a trusted advisor and thought partner for our customers, working to build an effective backlog... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  • Job Summary As a Sr. Business Systems Analyst on the STAR (Statistics and Reserves) Central Business Administration Function (CBAF) team, you will play an integral role in supporting the STAR suite of applications. You will be responsible for satisfying our clients’...
    Senior
    Shift work
    Weekend work

    Compunnel

    San Francisco, CA
    3 days ago
  • $152k - $271k

     ...work.Document Intelligence is the horizontal engine that turns that raw material — any file a...  ...maintenance knowledge, and into the AI-native entities and answers built on top of...  ...Intelligence.Minimum Requirements:Strong applied GenAI craft - prompt engineering, structured... 

    MaintainX

    San Francisco, CA
    10 hours ago
  • We are looking for an Applied AI Training Engineer to join a Contract opportunity in San Francisco, California. This role focuses on shaping high-quality data and evaluation assets that strengthen how large language models learn specialized enterprise software concepts... 
    Contract work

    Robert Half

    San Francisco, CA
    2 days ago
  •  ...Head of Applied AI Engineering About the Company Profitable AI platform turning healthcare data into measurable enterprise action Industry...  ...will also partner directly with strategic customers and senior stakeholders, translating business needs into technical plans... 

    Confidential

    San Francisco, CA
    1 day ago
  • $180k - $275k

     ...About the job Senior AI Engineer Senior AI Engineer Company: Confidential - consumer and business banking Location: San Francisco...  ...-based agentic financial assistant that helps consumers apply for loans, manage payments and navigate financial products in... 
    Senior
    Full time
    Work at office
    Visa sponsorship

    Transparent Search Group

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Applied AI Engineer. Be the first to apply!