Applied AI Engineer
Judgment Labs
The Role: We are looking for Applied AI Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback. Your research will not live on a whiteboard. You'll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems. What You'll Do:
- Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals
- Design and implement post-training and optimization workflows to improve agents, both internally and for customers
- Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows
- Build internal tools and infrastructure that support rapid experimentation, analysis, and training
- Work closely with product to integrate agents into customer-facing workflows
- Collaborate with external companies and research partners on frontier AI research
- Agency. You are intellectually curious, self-directed, and stay up to date with the latest research, blogs, trends, and ideas.
- Depth of thought. You can reason clearly about abstract systems, and ideally have experience working on agents, RL, or the infrastructure that supports them.
- Ownership. You own outcomes, not just tasks. You use freedom to experiment responsibly, make business-driven decisions, and focus first on work that moves the company forward.
- Data quality, evaluation, benchmarking, and hands-on work with messy production data
- Agent systems built or evaluated in real-world or production settings
- Reinforcement learning, post-training, agents, or machine learning fundamentals
- Infrastructure and systems work across training, data pipelines, evaluation, or model serving
- Translating research into product while balancing customer constraints, technical tradeoffs, and business impact
- Turning ambiguous problems into clear, well-designed plans
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Applied AI Engineer in San Francisco, CA vacancy
- MaintainX is the world's leading AI-powered maintenance and asset management platform,... ...work.Document Intelligence is the horizontal engine that turns that raw material — any file a... ...Intelligence.Minimum Requirements:Strong applied GenAI craft - prompt engineering, structured...SuggestedImmediate start
$198k - $280k
About the teamThe Applied AI Engineering team is responsible for ensuring the safe and effective deployment of Generative AI applications for developers and startups. We act as a trusted advisor and thought partner for our customers, working to build an effective backlog...SuggestedWork at officeLocal areaRelocation packageFlexible hours$197.4k - $266.6k
...Forbes Best Startup Employers 2022 List.AI is transforming customer support and, with... ...product teams to identify opportunities for applying generative AI to solve user needs and... ...data structures, and principles of software engineering.Nice to Have:Knowledge in specialized...SuggestedWork at officeImmediate startRemote workWork from homeMonday to Friday$197k - $278k
About the teamThe Applied AI Engineer - Digital Natives team is responsible for ensuring the safe and effective deployment of Generative AI applications for developers and enterprises. We act as a trusted advisor and thought partner for our customers, working to build an...SuggestedWork at officeLocal areaRelocation packageFlexible hours$211k - $235k
About AlembicAlembic is an applied science company building GPU-resident distributed data systems that deliver 10-100x performance... ...impossible.The RoleWe're hiring a Senior Software Engineer onto our Applied AI team to build and extend the backend systems that power our...SuggestedWork at office$250k - $300k
...intelligence. As the only vertically integrated AI infrastructure company built from the... ...models in use today.The work is applied, not academic. The optimizations you build... ...you will also work directly with customer engineering teams to tailor deployments to their needs...Temporary work$228.6k - $342.8k
...We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights... ...it understands what it finds.We are hiring a Senior Staff Applied AI Engineer to own context retrieval for Databricks agents across SaaS...Work at officeLocal areaImmediate startWorldwide- ...We’re inventing the future of B2B SaaS with AI agents. We’re betting on language models and we’re betting on scale. You’ll test... ...Seniority level: Entry level Employment type: Full‑time Job function: Engineering and Information Technology Industries: Software Development...Full time
$139k - $257.55k
...team is exploring the next generation of AI-native creative systems that redefine how... ...workflows.We are looking for forward-thinking engineers who are excited to explore ambiguous... ...systems that intelligently retrieve and apply brand assets, reusable creative components...Full timeTemporary workLocal areaWorldwide- ...Alpharun is an applied AI company that helps leading enterprises hire and train their frontline teams. Our platform fully automates candidate... ...to build high‑performing teams at scale. As an Applied AI Engineer, you'll join an extremely talented and hard‑working...Work at office
$166.9k - $225.9k
...Job Summary Drata is seeking a Senior Applied Research Engineer to drive the quality and effectiveness of our AI systems through rigorous experimentation, evaluation, and applied research. This research‑focused role emphasizes experimentation and rigor over production...Flexible hours$225k - $320k
...society’s challenges with unprecedented speed and accuracy. Our AI-enabled platform turns siloed and disconnected data into... ...RolePeregrine builds an end-to-end intelligence platform. As the Applied AI Engineering Lead, you will own how artificial intelligence is applied,...Local area- ...About CodeRabbit CodeRabbit is the leading AI code review platform, trusted by more than 17,000 customers and 150,000... ...the problem we exist to solve. Role Overview As an Applied Gen AI Engineer at CodeRabbit, you'll play a central role in designing, building...
- ...Applied AI Engineer Console is building the AI agents that power autonomous enterprises. We use AI to autonomously resolve IT, HR, Legal, Finance, Security, and Ops tasks the moment they come in from Slack or Teams. We're building toward a future where enterprise operations...Work at office
$150k - $170k
..., and London. For more information, please visit Role Overview CHAOS is seeking a highly motivated, mission-oriented Applied AI Engineer to help develop, integrate, and deploy AI/ML-powered capabilities across our product lines. In this role, you will work closely...Work experience placementCasual workWork at officeRelocation package2 days per week- A technology company in San Francisco seeks a Forward Deployed Engineer to lead AI-driven enterprise solutions. Responsibilities include developing production-ready systems and collaborating with research teams to meet customer needs. Ideal candidates will have a strong...
- ...ApS. -- # About Sphinx Sphinx builds AI analysts that operate inside browsers and... ...customer base. # About Aurora Aurora helps top engineers discover opportunities at some of the... ...described as a **Senior Full-Stack / Applied AI Engineer** with strong ownership. It is...Full timeWorldwide
- About the teamThe Applied AI Engineering team is responsible for helping developers and enterprises safely and effectively deploy OpenAI technologies in production. We act as trusted technical advisors and thought partners for customers, working side by side with their...Relocation package
- ...Job Description Job Description Job Description Applied AI Engineer, Work From Home We are looking for an Applied AI Engineer to design, build, and optimize AI-powered features that sit directly inside our product workflows. The Applied AI Engineer role...Remote workWork from home
- ...Responsibilities Design and ship customer-facing AI experiences end to end, including agent orchestration, tool use, interfaces... ...Define technical direction and improve AI product quality and engineering practices. Own complex AI products from early experimentation...Full time
- ...About Becoming Becoming is building Developmental Intelligence: AI for predicting how organisms change over time. Most... ...ultimately predictable systems. The Role We are seeking an Applied AI Engineer to help build the software, infrastructure, and data systems...
- ...strong in-person culture. About the role Slash is building an AI-native financial platform, and we're forming Slash AI Labs, a... ...’ll do Ship full-stack AI features end to end, from prompt engineering and agent orchestration to React UI and API integration...Full timeWork at office
$200k - $250k
...Description Job Description About the Role Roger is an AI platform that frees home health clinicians from paperwork so... ...continuously improve in accuracy. We are now looking for a Senior Applied AI Engineer to build the intelligence layer at the core of Roger:...Remote workWork from home- ...to move to the US. About Clera : Clera is a fast-growing AI start-up reimagining how top talent finds their dream jobs. We’re... ...- and opportunity. We are looking for an exceptional founding engineer. You will work directly with our CTO & Co-Founder Daniel and...Visa sponsorship
$280k - $320k
...create reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...growing group of committed researchers, engineers, policy experts, and business leaders working... .... About the Role We're looking for an Applied AI Engineer to join our Beneficial Deployments...Work at officeVisa sponsorshipFlexible hoursShift work- ...About the Company We deploy AI that operates computers the way humans do: navigating browsers, processing documents, working... ...people were the product. About the Role As an Applied AI Engineer, you'll work on everything from browser agent reliability to...Full timeRelocation
- About Retell Ai Retell AI is using first-principles thinking to reimagine the call center with cutting-edge voice AI. Thousands... ...every month—and we're just getting started. We're hiring an Applied AI Engineer to work directly with enterprise customers to design, build,...Full timeH1b
- Jack & Jill in San Francisco is seeking a Senior Applied AI Engineer to build and deploy production-grade AI systems that automate complex clinical workflows and improve patient care delivery. You will design LLM agents, implement RAG systems, and create robust evaluation...
$190k - $250k
Job Title Senior Applied AI Engineer Salary $190k-$250k Equity Company Description Well-funded healthtech AI startup Job Description Build and deploy production-grade AI systems that automate complex clinical workflows and improve patient care delivery. You will design...$120k - $160k
Simbe is building the AI powered operating system for physical retail. Our autonomous robots and multimodal computer vision platform... ...team productivity. Simbe is looking for a Customer Facing Applied AI Engineer to help turn our computer vision and data platform into...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Applied AI Engineer. Be the first to apply!
Related searches
- field applications engineer San Francisco, CA
- application security engineer San Francisco, CA
- cnc applications engineer San Francisco, CA
- application support engineer San Francisco, CA
- senior application security engineer San Francisco, CA
- technical application engineer San Francisco, CA
- application operations engineer San Francisco, CA
- senior application support engineer San Francisco, CA
- project application engineer San Francisco, CA
- hydraulic application engineer San Francisco, CA


