AI Engineer (Applied LLM Systems)
Discernis
About Discernis
Discernis builds AI driven document intelligence for high stakes legal work. Because our customers handle privileged and regulated matters that most cloud AI cannot touch, we run on premises and in customer controlled environments as well as in the cloud. That makes security, reliability, and reproducibility core product features, not afterthoughts. We work with AmLaw firms and enterprise legal teams where accuracy, explainability, and data control are non negotiable.
The Role
You will lead the design and evolution of the AI systems at the core of our product. Day to day, that means inventing new AI powered workflows that help legal teams understand massive document sets, then making them faster and more reliable, and building the evaluations that tell us we are getting it right. You will reach for whatever technique fits the problem, prompt engineering, agentic orchestration, retrieval, or post-training, and because our customers often cannot send data to external providers, much of this runs on models we host and improve ourselves.
What You Will Do
- Design and build new AI powered workflows that solve real problems for legal teams, using whatever gets the best result: agentic and multi step orchestration, prompt engineering, retrieval, and post-training
- Improve the quality, reliability, latency, and cost of existing workflows using that same full toolkit
- Own and develop our evaluation and benchmarking frameworks so we can measure and improve quality, catch regressions, and know we are moving in the right direction
- Design agentic patterns and structured outputs robust enough for complex legal and investigative use cases
- Own self hosted model serving and inference optimization across customer deployments
- Post-train and adapt models where that is the right lever, including fine tuning, preference optimization, and domain adaptation
What You Bring
- Experience building production LLM or ML powered features end to end, with the judgment to know which technique fits which problem
- Hands on experience with agentic or multi step LLM orchestration and tool use
- Breadth across the modern LLM toolkit: prompt engineering and retrieval, and ideally post-training methods such as fine tuning, DPO, or RLHF
- Experience designing and running evaluations for LLM systems
- Hands on experience with self hosted model serving such as vLLM, TGI, or similar
- Strong Python skills and comfort with concurrent or distributed processing
- Bonus: embedding and vector search pipelines, or retrieval augmented generation at scale
- Bonus: background in legal tech, document intelligence, or information retrieval
Tech Environment
Python, self hosted inference (vLLM), LLM orchestration and agent frameworks, evaluation tooling
Apply Here:
$170k - $230k
...Job Description Job Description Description: Applied AI Engineer | Production AI & LLM Systems | $170K-$230K + Equity Full-Time | Hybrid - Approximately 3 Days/Week In Office | New York, NY Dana Gudermuth Senior Recruiter | Heartline Staffing Call or Text...SuggestedPermanent employmentFull timeWork at officeRelocation package3 days per week- Entendre is looking for a Member of Technical Staff - Applied AI based in New York to design and ship user-facing products that merge cutting-edge AI capabilities with dependable workflows. You will work across the stack to deliver solutions that are robust and intuitive...Suggested
$159.2k - $301.6k
The Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build the next generation of AI-enabled product... ...at the intersection of large-scale systems engineering, applied AI, and production software architecture. You will design and...SuggestedFull timeTemporary workLocal areaRemote workWorldwide$229.9k - $262.4k
AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader... ...to continuing to build world-class applied science and engineering teams to deliver...SuggestedFull timePart timeLocal area- ...Plot is seeking an experienced AI product engineer to build agentic, reasoning-driven systems that power consumer intelligence and marketing automation. You will... ...teams to prototype, test, and scale AI capabilities, applying state-of-the-art methods while maintaining a...Suggested
$195k - $225k
...SummaryWe are pioneering a new AI development team... ...deeply technical AI Engineer to be a foundational member... ...and build agentic systems that translate complex... ...feedbackChampion a culture of applied innovation, balancing... ...building LLM-powered applications that...Full time$197.3k - $245.6k
...degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a... ...the development of AI systems with trade-offs among cost,... ...and ML technologies such as LLM inference, similarity search... ..., or Golang ~ Experience applying advanced techniques to optimize...Full time$197.3k - $245.6k
...degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a... ...experience leading AI system development with tradeoffs... ...and ML technologies such as LLM inference, similarity search... ...Golang. We value experience applying modern optimization...Full time$175k - $250k
Applied AI EngineerAbout MillenniumMillennium is a global, diversified... ...and advanced proprietary systems are core to the health and growth... ...process automation: reverse-engineer manual, undocumented workflows... ...on.Substantial hands-on LLM and agentic experience: tool...Work at officeFlexible hours$10k
...the same.If you want to build systems that directly shape how... ...place to do it.About the RoleThe Applied AI team at Ramp is at the forefront... ...seeking strong full-stack engineers who are proficient in web frameworks... ...and build infrastructure for LLM inference. If you're...Full timeWork at officeHome officeFlexible hours$10k
...the same.If you want to build systems that directly shape how... ...Intelligence team, part of Ramp's Applied AI org, powers the agentic analysis... ...frontend-leaning role for an engineer who obsesses over interaction... ...center of real production LLM systems rather than being bolted...Full timeWork at officeHome officeFlexible hours$180k - $220k
...Applied AI Engineer New York City | 4–5 days in office $180,000–$220,000 base + bonus + equity... ...A AI company building agentic AI systems that automate complex, mission-critical... ...Responsibilities Build and ship multi-agent and LLM-powered workflows used in production...Work at office$229.9k - $262.4k
AI Engineer 5 (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning) At Capital One, we are... ...responsible and reliable AI systems, changing banking for good. For years... ...to continuing to build world-class applied science and engineering teams to deliver...Full timePart timeLocal area$229.9k - $262.4k
AI Engineer 5 ((AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an... ...continuing to build world-class applied science and engineering teams...Full timePart timeLocal area- ...early-stage, venture-backed AI startup building the collaboration... .... The company is developing systems that allow agents to maintain... ...today. They’re hiring 1–2 Applied AI Engineers to take significant... ...production, not just integrating an LLM into an existing product....
$220k - $300k
...Senior Applied AI Engineer $220,000 - $300,000 Base Salary + Equity A high-growth, venture-backed... ...edge of LLMs, AI agents, retrieval systems, recommendation engines, and applied... ...machine learning, agent frameworks, and LLM technologies Highlights Production...Full time- ...Markets - GenAI / Agentic Systems, Infosys ConsultingThe... ...Consultant with AI experience to design, build... ...techniques, with experience in LLM application development... ...prompt engineering, evaluation frameworks,... ...sponsorship are welcome to apply. Infosys is unable to provide...Full timeTemporary workWork experience placement
$113.1k - $232.3k
Position Summary Lead Applied AI Engineer II - ServiceNow Role Overview: As a ServiceNow Lead... ...with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open... ...may include ServiceNow Certified System Administrator, Certified Application Developer...Work at officeLocal areaVisa sponsorshipFlexible hours3 days per week$200k - $250k
...Applied AI Engineer, Agents & Evaluation Compensation: $200k–$250k base + equity Location... ...now building a new generation of agentic systems on top of that foundation. They’re... ...criteria. Build golden datasets, LLM-as-judge systems, rule-based graders, regression...Full timeFor contractors- ...Applied AI Engineer New York, NY - hybrid 12 months+ Overview What You'll Do • Design... ...of shared GenAI capabilities across systems and workflows. What You'll Bring... ...Proven experience designing and operating LLM-based systems using patterns such as RAG...
- ...Applied AI Engineer Must have: • 5+ years of strong front-to-back engineering experience, focusing... ...reliability measurement in production systems. • Designing and operating GenAI... ...and operating production grade GenAI / LLM platforms, applying patterns such as RAG...
$200k - $250k
...the United States to help them hire. Applied AI Engineer Location New York, NY... ...and incorporating them into production systems. Engineers have significant ownership over... ...agentic workflows, MCP-connected systems, LLM applications, financial data pipelines,...H1bWork at officeRemote workVisa sponsorship- ...that deliver healthcare. Our AI sensing platform enables... ...position We're looking for an Applied AI Engineer to take our growing... ...deployments, and some of the systems you'll touch are on a SaMD pathway... ...pipelines (STT, TTS, streaming LLM) Production RAG systems beyond...
$250k - $300k
...Senior Applied AI Engineer We're looking for a Senior Applied AI Engineer to build the intelligence... ...disagree with each other. We need systems that can understand all of it, connect... ...work. The challenge isn't getting an LLM to produce an answer. It's building a system...Work at officeLocal area$225k - $275k
...Applied AI Engineer, Product and Delivery | Hybrid Portland, ME or Remote (East Coast / Chicago)... ..., simulating its people, processes and systems to produce an actionable roadmap for AI... ...can build against Design and build LLM-powered prototypes to test whether an idea...Remote work- ...About Qualitate Qualitate is building the AI-native primary intelligence platform for enterprises... ...firms. The Role We're looking for a Senior Applied AI Engineer to help build the LLM and retrieval systems at the core of our AI Moderator - the engine that...Full timeFlexible hours
$229.9k - $262.4k
...are creating responsible and reliable AI systems, changing banking for good. For years... ...to continuing to build world-class applied science and engineering teams to deliver our industry leading... ...Invent and introduce state-of-the-art LLM optimization techniques to improve the...Full timePart timeLocal area$160k - $350k
...its numbers at the speed of AI. Who We Are Rillet's... ...software. Who We Need As an Applied AI Engineer on Rillet's AI & ML team, you... ...and ship production AI systems that transform how finance and... ...on experience with production LLM applications: agentic systems...Work at officeRelocationFlexible hours1 day per week$150k - $300k
...The Role As an Applied AI Engineer, you'll bring the frontier of AI research and engineering to... ...performance, and implement advanced retrieval systems to make the most of AI for finance... ...Experiment with the latest LLM orchestration patterns and context management...Work at office- ...Applied AI Engineer Our client is seeking an Applied AI Engineer with 10+ years of experience... ...evolve reusable GenAI workflows and agentic systems deployed across multiple Lending... ...~ Strong proficiency with LangChain, LLM platforms, and RAG (Retrieval-Augmented...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer (Applied LLM Systems). Be the first to apply!
- senior ai engineer New York, NY
- ai developer New York, NY
- ai engineer New York, NY
- ai ml engineer New York, NY
- ai engineer remote New York, NY
- machine learning ai engineer New York, NY
- ai prompt engineer New York, NY
- ai research engineer New York, NY
- senior linux systems engineer New York, NY
- system engineer contract New York, NY





