Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer (Applied LLM Systems)

Full-time

Discernis

About Discernis

Discernis builds AI driven document intelligence for high stakes legal work. Because our customers handle privileged and regulated matters that most cloud AI cannot touch, we run on premises and in customer controlled environments as well as in the cloud. That makes security, reliability, and reproducibility core product features, not afterthoughts. We work with AmLaw firms and enterprise legal teams where accuracy, explainability, and data control are non negotiable.

The Role

You will lead the design and evolution of the AI systems at the core of our product. Day to day, that means inventing new AI powered workflows that help legal teams understand massive document sets, then making them faster and more reliable, and building the evaluations that tell us we are getting it right. You will reach for whatever technique fits the problem, prompt engineering, agentic orchestration, retrieval, or post-training, and because our customers often cannot send data to external providers, much of this runs on models we host and improve ourselves.

What You Will Do

  • Design and build new AI powered workflows that solve real problems for legal teams, using whatever gets the best result: agentic and multi step orchestration, prompt engineering, retrieval, and post-training
  • Improve the quality, reliability, latency, and cost of existing workflows using that same full toolkit
  • Own and develop our evaluation and benchmarking frameworks so we can measure and improve quality, catch regressions, and know we are moving in the right direction
  • Design agentic patterns and structured outputs robust enough for complex legal and investigative use cases
  • Own self hosted model serving and inference optimization across customer deployments
  • Post-train and adapt models where that is the right lever, including fine tuning, preference optimization, and domain adaptation

What You Bring

  • Experience building production LLM or ML powered features end to end, with the judgment to know which technique fits which problem
  • Hands on experience with agentic or multi step LLM orchestration and tool use
  • Breadth across the modern LLM toolkit: prompt engineering and retrieval, and ideally post-training methods such as fine tuning, DPO, or RLHF
  • Experience designing and running evaluations for LLM systems
  • Hands on experience with self hosted model serving such as vLLM, TGI, or similar
  • Strong Python skills and comfort with concurrent or distributed processing
  • Bonus: embedding and vector search pipelines, or retrieval augmented generation at scale
  • Bonus: background in legal tech, document intelligence, or information retrieval

Tech Environment

Python, self hosted inference (vLLM), LLM orchestration and agent frameworks, evaluation tooling

Apply Here:

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Engineer (Applied LLM Systems) in New York, NY vacancy
  • $170k - $230k

     ...Job Description Job Description Description: Applied AI Engineer | Production AI & LLM Systems | $170K-$230K + Equity Full-Time | Hybrid - Approximately 3 Days/Week In Office | New York, NY Dana Gudermuth Senior Recruiter | Heartline Staffing Call or Text... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Relocation package
    3 days per week

    Purple Cow Recruiting

    New York, NY
    14 days ago
  • Entendre is looking for a Member of Technical Staff - Applied AI based in New York to design and ship user-facing products that merge cutting-edge AI capabilities with dependable workflows. You will work across the stack to deliver solutions that are robust and intuitive... 
    Suggested

    Entendre

    New York, NY
    3 days ago
  • $159.2k - $301.6k

    The Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build the next generation of AI-enabled product...  ...at the intersection of large-scale systems engineering, applied AI, and production software architecture. You will design and... 
    Suggested
    Full time
    Temporary work
    Local area
    Remote work
    Worldwide

    Adobe Systems

    New York, NY
    21 hours ago
  • $229.9k - $262.4k

    AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader...  ...to continuing to build world-class applied science and engineering teams to deliver... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  •  ...Plot is seeking an experienced AI product engineer to build agentic, reasoning-driven systems that power consumer intelligence and marketing automation. You will...  ...teams to prototype, test, and scale AI capabilities, applying state-of-the-art methods while maintaining a... 
    Suggested

    Jobleads-US

    New York, NY
    3 days ago
  • $195k - $225k

     ...SummaryWe are pioneering a new AI development team...  ...deeply technical AI Engineer to be a foundational member...  ...and build agentic systems that translate complex...  ...feedbackChampion a culture of applied innovation, balancing...  ...building LLM-powered applications that... 
    Full time

    Horizon Media

    New York, NY
    1 day ago
  • $197.3k - $245.6k

     ...degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a...  ...the development of AI systems with trade-offs among cost,...  ...and ML technologies such as LLM inference, similarity search...  ..., or Golang ~ Experience applying advanced techniques to optimize... 
    Full time

    Capital One

    New York, NY
    9 days ago
  • $197.3k - $245.6k

     ...degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a...  ...experience leading AI system development with tradeoffs...  ...and ML technologies such as LLM inference, similarity search...  ...Golang. We value experience applying modern optimization... 
    Full time

    Capital One

    New York, NY
    9 days ago
  • $175k - $250k

    Applied AI EngineerAbout MillenniumMillennium is a global, diversified...  ...and advanced proprietary systems are core to the health and growth...  ...process automation: reverse-engineer manual, undocumented workflows...  ...on.Substantial hands-on LLM and agentic experience: tool... 
    Work at office
    Flexible hours

    Millennium Management

    New York, NY
    21 hours ago
  • $10k

     ...the same.If you want to build systems that directly shape how...  ...place to do it.About the RoleThe Applied AI team at Ramp is at the forefront...  ...seeking strong full-stack engineers who are proficient in web frameworks...  ...and build infrastructure for LLM inference. If you're... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    4 days ago
  • $10k

     ...the same.If you want to build systems that directly shape how...  ...Intelligence team, part of Ramp's Applied AI org, powers the agentic analysis...  ...frontend-leaning role for an engineer who obsesses over interaction...  ...center of real production LLM systems rather than being bolted... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    4 days ago
  • $180k - $220k

     ...Applied AI Engineer New York City | 4–5 days in office $180,000–$220,000 base + bonus + equity...  ...A AI company building agentic AI systems that automate complex, mission-critical...  ...Responsibilities Build and ship multi-agent and LLM-powered workflows used in production... 
    Work at office

    OJ Digital

    New York, NY
    4 days ago
  • $229.9k - $262.4k

    AI Engineer 5 (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning) At Capital One, we are...  ...responsible and reliable AI systems, changing banking for good. For years...  ...to continuing to build world-class applied science and engineering teams to deliver... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    AI Engineer 5 ((AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an...  ...continuing to build world-class applied science and engineering teams... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  •  ...early-stage, venture-backed AI startup building the collaboration...  .... The company is developing systems that allow agents to maintain...  ...today. They’re hiring 1–2 Applied AI Engineers to take significant...  ...production, not just integrating an LLM into an existing product.... 

    Day One Partners

    New York, NY
    19 hours ago
  • $220k - $300k

     ...Senior Applied AI Engineer $220,000 - $300,000 Base Salary + Equity A high-growth, venture-backed...  ...edge of LLMs, AI agents, retrieval systems, recommendation engines, and applied...  ...machine learning, agent frameworks, and LLM technologies Highlights Production... 
    Full time

    Storm2

    New York, NY
    15 hours ago
  •  ...Markets - GenAI / Agentic Systems, Infosys ConsultingThe...  ...Consultant with AI experience to design, build...  ...techniques, with experience in LLM application development...  ...prompt engineering, evaluation frameworks,...  ...sponsorship are welcome to apply. Infosys is unable to provide... 
    Full time
    Temporary work
    Work experience placement

    Infosys Technologies

    New York, NY
    3 days ago
  • $113.1k - $232.3k

    Position Summary Lead Applied AI Engineer II - ServiceNow Role Overview: As a ServiceNow Lead...  ...with hands-on GenAI experience across LLM integration (OpenAI, Anthropic, or open...  ...may include ServiceNow Certified System Administrator, Certified Application Developer... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    New York, NY
    2 days ago
  • $200k - $250k

     ...Applied AI Engineer, Agents & Evaluation Compensation: $200k–$250k base + equity Location...  ...now building a new generation of agentic systems on top of that foundation. They’re...  ...criteria. Build golden datasets, LLM-as-judge systems, rule-based graders, regression... 
    Full time
    For contractors

    People In AI

    New York, NY
    1 day ago
  •  ...Applied AI Engineer New York, NY - hybrid 12 months+ Overview What You'll Do • Design...  ...of shared GenAI capabilities across systems and workflows. What You'll Bring...  ...Proven experience designing and operating LLM-based systems using patterns such as RAG... 

    Veterans Sourcing Group, LLC

    New York, NY
    3 days ago
  •  ...Applied AI Engineer Must have: • 5+ years of strong front-to-back engineering experience, focusing...  ...reliability measurement in production systems. • Designing and operating GenAI...  ...and operating production grade GenAI / LLM platforms, applying patterns such as RAG... 

    Saxon Global

    New York, NY
    2 days ago
  • $200k - $250k

     ...the United States to help them hire. Applied AI Engineer Location New York, NY...  ...and incorporating them into production systems. Engineers have significant ownership over...  ...agentic workflows, MCP-connected systems, LLM applications, financial data pipelines,... 
    H1b
    Work at office
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    New York, NY
    3 days ago
  •  ...that deliver healthcare. Our AI sensing platform enables...  ...position We're looking for an Applied AI Engineer to take our growing...  ...deployments, and some of the systems you'll touch are on a SaMD pathway...  ...pipelines (STT, TTS, streaming LLM) Production RAG systems beyond... 

    Norbert Health

    New York, NY
    4 days ago
  • $250k - $300k

     ...Senior Applied AI Engineer We're looking for a Senior Applied AI Engineer to build the intelligence...  ...disagree with each other. We need systems that can understand all of it, connect...  ...work. The challenge isn't getting an LLM to produce an answer. It's building a system... 
    Work at office
    Local area

    Elayne

    New York, NY
    3 hours ago
  • $225k - $275k

     ...Applied AI Engineer, Product and Delivery | Hybrid Portland, ME or Remote (East Coast / Chicago)...  ..., simulating its people, processes and systems to produce an actionable roadmap for AI...  ...can build against Design and build LLM-powered prototypes to test whether an idea... 
    Remote work

    Harnham

    New York, NY
    3 days ago
  •  ...About Qualitate Qualitate is building the AI-native primary intelligence platform for enterprises...  ...firms. The Role We're looking for a Senior Applied AI Engineer to help build the LLM and retrieval systems at the core of our AI Moderator - the engine that... 
    Full time
    Flexible hours

    Qualitate

    New York, NY
    2 days ago
  • $229.9k - $262.4k

     ...are creating responsible and reliable AI systems, changing banking for good. For years...  ...to continuing to build world-class applied science and engineering teams to deliver our industry leading...  ...Invent and introduce state-of-the-art LLM optimization techniques to improve the... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $160k - $350k

     ...its numbers at the speed of AI. Who We Are Rillet's...  ...software. Who We Need As an Applied AI Engineer on Rillet's AI & ML team, you...  ...and ship production AI systems that transform how finance and...  ...on experience with production LLM applications: agentic systems... 
    Work at office
    Relocation
    Flexible hours
    1 day per week

    Rillet

    New York, NY
    1 day ago
  • $150k - $300k

     ...The Role As an Applied AI Engineer, you'll bring the frontier of AI research and engineering to...  ...performance, and implement advanced retrieval systems to make the most of AI for finance...  ...Experiment with the latest LLM orchestration patterns and context management... 
    Work at office

    Rowspace

    New York, NY
    1 day ago
  •  ...Applied AI Engineer Our client is seeking an Applied AI Engineer with 10+ years of experience...  ...evolve reusable GenAI workflows and agentic systems deployed across multiple Lending...  ...~ Strong proficiency with LangChain, LLM platforms, and RAG (Retrieval-Augmented... 

    TheStaffed

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer (Applied LLM Systems). Be the first to apply!