Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied AI Engineer

Judgment Labs

The Role:

We are looking for Applied AI Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback.

Your research will not live on a whiteboard. You'll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems.

What You'll Do:
  • Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals
  • Design and implement post-training and optimization workflows to improve agents, both internally and for customers
  • Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows
  • Build internal tools and infrastructure that support rapid experimentation, analysis, and training
  • Work closely with product to integrate agents into customer-facing workflows
  • Collaborate with external companies and research partners on frontier AI research
What We're Looking For

Every hire clears three bars, no exceptions:
  • Agency. You are intellectually curious, self-directed, and stay up to date with the latest research, blogs, trends, and ideas.
  • Depth of thought. You can reason clearly about abstract systems, and ideally have experience working on agents, RL, or the infrastructure that supports them.
  • Ownership. You own outcomes, not just tasks. You use freedom to experiment responsibly, make business-driven decisions, and focus first on work that moves the company forward.
More specifically, you should bring strength in at least one of the following areas:
  • Data quality, evaluation, benchmarking, and hands-on work with messy production data
  • Agent systems built or evaluated in real-world or production settings
  • Reinforcement learning, post-training, agents, or machine learning fundamentals
  • Infrastructure and systems work across training, data pipelines, evaluation, or model serving
  • Translating research into product while balancing customer constraints, technical tradeoffs, and business impact
  • Turning ambiguous problems into clear, well-designed plans
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Applied AI Engineer in San Francisco, CA vacancy
  • MaintainX is the world's leading AI-powered maintenance and asset management platform,...  ...work.Document Intelligence is the horizontal engine that turns that raw material — any file a...  ...Intelligence.Minimum Requirements:Strong applied GenAI craft - prompt engineering, structured... 
    Suggested
    Immediate start

    MaintainX

    San Francisco, CA
    2 days ago
  • $198k - $280k

    About the teamThe Applied AI Engineering team is responsible for ensuring the safe and effective deployment of Generative AI applications for developers and startups. We act as a trusted advisor and thought partner for our customers, working to build an effective backlog... 
    Suggested
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  • $197.4k - $266.6k

     ...Forbes Best Startup Employers 2022 List.AI is transforming customer support and, with...  ...product teams to identify opportunities for applying generative AI to solve user needs and...  ...data structures, and principles of software engineering.Nice to Have:Knowledge in specialized... 
    Suggested
    Work at office
    Immediate start
    Remote work
    Work from home
    Monday to Friday

    FrontApp

    San Francisco, CA
    2 days ago
  • $197k - $278k

    About the teamThe Applied AI Engineer - Digital Natives team is responsible for ensuring the safe and effective deployment of Generative AI applications for developers and enterprises. We act as a trusted advisor and thought partner for our customers, working to build an... 
    Suggested
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  • $211k - $235k

    About AlembicAlembic is an applied science company building GPU-resident distributed data systems that deliver 10-100x performance...  ...impossible.The RoleWe're hiring a Senior Software Engineer onto our Applied AI team to build and extend the backend systems that power our... 
    Suggested
    Work at office

    Alembic

    San Francisco, CA
    1 day ago
  • $250k - $300k

     ...intelligence. As the only vertically integrated AI infrastructure company built from the...  ...models in use today.The work is applied, not academic. The optimizations you build...  ...you will also work directly with customer engineering teams to tailor deployments to their needs... 
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • $228.6k - $342.8k

     ...We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights...  ...it understands what it finds.We are hiring a Senior Staff Applied AI Engineer to own context retrieval for Databricks agents across SaaS... 
    Work at office
    Local area
    Immediate start
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  •  ...We’re inventing the future of B2B SaaS with AI agents. We’re betting on language models and we’re betting on scale. You’ll test...  ...Seniority level: Entry level Employment type: Full‑time Job function: Engineering and Information Technology Industries: Software Development... 
    Full time

    SafetyKit

    San Francisco, CA
    1 day ago
  • $139k - $257.55k

     ...team is exploring the next generation of AI-native creative systems that redefine how...  ...workflows.We are looking for forward-thinking engineers who are excited to explore ambiguous...  ...systems that intelligently retrieve and apply brand assets, reusable creative components... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    3 days ago
  •  ...Alpharun is an applied AI company that helps leading enterprises hire and train their frontline teams. Our platform fully automates candidate...  ...to build high‑performing teams at scale. As an Applied AI Engineer, you'll join an extremely talented and hard‑working... 
    Work at office

    Alpharun

    San Francisco, CA
    21 hours ago
  • $166.9k - $225.9k

     ...Job Summary Drata is seeking a Senior Applied Research Engineer to drive the quality and effectiveness of our AI systems through rigorous experimentation, evaluation, and applied research. This research‑focused role emphasizes experimentation and rigor over production... 
    Flexible hours

    Drata

    San Francisco, CA
    21 hours ago
  • $225k - $320k

     ...society’s challenges with unprecedented speed and accuracy. Our AI-enabled platform turns siloed and disconnected data into...  ...RolePeregrine builds an end-to-end intelligence platform. As the Applied AI Engineering Lead, you will own how artificial intelligence is applied,... 
    Local area

    Peregrine Technologies

    San Francisco, CA
    4 days ago
  •  ...About CodeRabbit CodeRabbit is the leading AI code review platform, trusted by more than 17,000 customers and 150,000...  ...the problem we exist to solve. Role Overview As an Applied Gen AI Engineer at CodeRabbit, you'll play a central role in designing, building... 

    CodeRabbit

    San Francisco, CA
    21 hours ago
  •  ...Applied AI Engineer Console is building the AI agents that power autonomous enterprises. We use AI to autonomously resolve IT, HR, Legal, Finance, Security, and Ops tasks the moment they come in from Slack or Teams. We're building toward a future where enterprise operations... 
    Work at office

    Console

    San Francisco, CA
    3 days ago
  • $150k - $170k

     ..., and London. For more information, please visit Role Overview CHAOS is seeking a highly motivated, mission-oriented Applied AI Engineer to help develop, integrate, and deploy AI/ML-powered capabilities across our product lines. In this role, you will work closely... 
    Work experience placement
    Casual work
    Work at office
    Relocation package
    2 days per week

    CHAOS Industries

    San Francisco, CA
    21 hours ago
  • A technology company in San Francisco seeks a Forward Deployed Engineer to lead AI-driven enterprise solutions. Responsibilities include developing production-ready systems and collaborating with research teams to meet customer needs. Ideal candidates will have a strong... 

    Jobleads-US

    San Francisco, CA
    21 hours ago
  •  ...ApS. -- # About Sphinx Sphinx builds AI analysts that operate inside browsers and...  ...customer base. # About Aurora Aurora helps top engineers discover opportunities at some of the...  ...described as a **Senior Full-Stack / Applied AI Engineer** with strong ownership. It is... 
    Full time
    Worldwide

    Aurora Jobs ApS

    San Francisco, CA
    a month ago
  • About the teamThe Applied AI Engineering team is responsible for helping developers and enterprises safely and effectively deploy OpenAI technologies in production. We act as trusted technical advisors and thought partners for customers, working side by side with their... 
    Relocation package

    OpenAI

    San Francisco, CA
    5 days ago
  •  ...Job Description Job Description Job Description Applied AI Engineer, Work From Home   We are looking for an Applied AI Engineer to design, build, and optimize AI-powered features that sit directly inside our product workflows.  The Applied AI Engineer role... 
    Remote work
    Work from home

    Parallel Partners

    San Francisco, CA
    2 days ago
  •  ...Responsibilities Design and ship customer-facing AI experiences end to end, including agent orchestration, tool use, interfaces...  ...Define technical direction and improve AI product quality and engineering practices. Own complex AI products from early experimentation... 
    Full time

    Mintlify

    San Francisco, CA
    10 days ago
  •  ...About Becoming Becoming is building Developmental Intelligence: AI for predicting how organisms change over time. Most...  ...ultimately predictable systems. The Role We are seeking an Applied AI Engineer to help build the software, infrastructure, and data systems... 

    Becoming

    San Francisco, CA
    2 days ago
  •  ...strong in-person culture. About the role Slash is building an AI-native financial platform, and we're forming Slash AI Labs, a...  ...’ll do Ship full-stack AI features end to end, from prompt engineering and agent orchestration to React UI and API integration... 
    Full time
    Work at office

    Slash Financial

    San Francisco, CA
    17 days ago
  • $200k - $250k

     ...Description Job Description About the Role Roger is an AI platform that frees home health clinicians from paperwork so...  ...continuously improve in accuracy. We are now looking for a Senior Applied AI Engineer to build the intelligence layer at the core of Roger:... 
    Remote work
    Work from home

    Roger Healthcare

    San Francisco, CA
    2 days ago
  •  ...to move to the US. About Clera : Clera is a fast-growing AI start-up reimagining how top talent finds their dream jobs. We’re...  ...- and opportunity. We are looking for an exceptional founding engineer. You will work directly with our CTO & Co-Founder Daniel and... 
    Visa sponsorship

    Clera

    San Francisco, CA
    2 days ago
  • $280k - $320k

     ...create reliable, interpretable, and steerable AI systems. We want AI to be safe and...  ...growing group of committed researchers, engineers, policy experts, and business leaders working...  .... About the Role We're looking for an Applied AI Engineer to join our Beneficial Deployments... 
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    3 days ago
  •  ...About the Company We deploy AI that operates computers the way humans do: navigating browsers, processing documents, working...  ...people were the product. About the Role As an Applied AI Engineer, you'll work on everything from browser agent reliability to... 
    Full time
    Relocation

    Product Pulse

    San Francisco, CA
    13 days ago
  • About Retell Ai Retell AI is using first-principles thinking to reimagine the call center with cutting-edge voice AI. Thousands...  ...every month—and we're just getting started. We're hiring an Applied AI Engineer to work directly with enterprise customers to design, build,... 
    Full time
    H1b

    Retell

    San Francisco, CA
    4 days ago
  • Jack & Jill in San Francisco is seeking a Senior Applied AI Engineer to build and deploy production-grade AI systems that automate complex clinical workflows and improve patient care delivery. You will design LLM agents, implement RAG systems, and create robust evaluation... 

    Jack & Jill

    San Francisco, CA
    3 days ago
  • $190k - $250k

    Job Title Senior Applied AI Engineer Salary $190k-$250k Equity Company Description Well-funded healthtech AI startup Job Description Build and deploy production-grade AI systems that automate complex clinical workflows and improve patient care delivery. You will design... 

    Jack & Jill

    San Francisco, CA
    3 days ago
  • $120k - $160k

    Simbe is building the AI powered operating system for physical retail. Our autonomous robots and multimodal computer vision platform...  ...team productivity. Simbe is looking for a Customer Facing Applied AI Engineer to help turn our computer vision and data platform into... 

    Simbe Robotics Inc

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied AI Engineer. Be the first to apply!