Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - AI Platform New York City | Private Credit

$150k - $200k

J Harlan Group, LLC

Job Description

Job Description

Software Engineer – AI Platform New York City | Private Credit Build Production AI That Investment Professionals Rely on Every Day

Our client is one of the leading private credit investment firms in the United States , managing more than $9 billion in assets and providing bespoke financing solutions to middle-market companies navigating growth, acquisitions, operational transformation, and complex financial situations.

The firm has built a production AI platform that is transforming how investment professionals research, analyze, and evaluate investment opportunities. The platform powers AI-generated investment memoranda, due diligence questionnaire (DDQ) automation, and intelligent retrieval across highly complex financial and legal documents.

Our client is seeking an exceptional Software Engineer to help expand this platform and build the next generation of AI-enabled investment workflows.

  • This is not an AI research role.
  • This is not a machine learning model training role.
  • This is not a prompt engineering or proof-of-concept position.

Instead, this is an opportunity to build production AI systems that become part of the daily workflow of investment professionals making real investment decisions.

As one of a small number of engineers supporting this platform, you'll have significant ownership, influence technical direction, and see your work move quickly from concept to production.

Working alongside the platform's lead engineer, you'll partner directly with investment professionals, investor relations, and operations teams to design, build, deploy, and continuously improve AI-powered applications that deliver measurable business impact.

If you're passionate about solving challenging engineering problems, shipping production software, and leveraging cutting-edge AI technologies to solve real-world business problems, this is an exceptional opportunity.

What You'll Build

You'll help design, build, and evolve production AI systems, including:

  • AI-powered investment memorandum generation
  • Due diligence questionnaire (DDQ) automation
  • Retrieval-Augmented Generation (RAG) across complex legal and financial documents
  • AI agents, reusable skills, and workflow automation
  • Source attribution and provenance tracking
  • AI review workflows that improve the accuracy, transparency, and trustworthiness of AI-generated content

Everything you build will be deployed into production and used by investment professionals, not developed as a proof of concept or demo.

Representative Projects

Examples of the engineering challenges you'll tackle include:

  • Trace every statement in an AI-generated investment memorandum back to the exact page and source document used to support it.
  • Improve retrieval across hundreds of pages of credit agreements, financial statements, and legal documentation while preserving complex tables and formatting.
  • Design review workflows that identify and prevent hallucinated financial information before it reaches investment professionals.
  • Build reusable AI agents and workflows that automate repetitive research and due diligence processes.
  • Develop internal AI tools that reduce hours of manual investment analysis into minutes while maintaining transparency, traceability, and accuracy.
  • Partner directly with business users to transform manual workflows into scalable AI-powered solutions.
  • Continuously improve platform performance, reliability, and user experience as new AI capabilities emerge.

Key Responsibilities

  • Design, develop, deploy, and support production AI applications that support the investment lifecycle.
  • Build and enhance AI agents, reusable skills, subagents, and workflow automation.
  • Develop provenance tracking, citation, and review capabilities that improve confidence in AI-generated output.
  • Build scalable retrieval pipelines utilizing vector search and modern RAG architectures.
  • Collaborate closely with investment, investor relations, and operations professionals to understand business workflows and deliver practical AI solutions.
  • Own projects from architecture and design through implementation, deployment, testing, monitoring, and ongoing production support.
  • Participate in architectural discussions and help shape the future direction of the firm's AI platform.

Qualifications

The ideal candidate will possess:

  • 3–5 years of professional software engineering experience.
  • Strong programming experience in one or more of the following:
    • Python
    • TypeScript / JavaScript
    • Go
    • Rust
  • Experience building production AI applications using technologies such as:
    • AI Agents
    • Retrieval-Augmented Generation (RAG)
    • Vector Search
    • Prompt & Context Engineering
    • Evaluation Frameworks (Evals)
  • Daily experience using AI-assisted development tools such as:
    • Claude Code
    • Cursor
    • Codex
    • GitHub Copilot
    • or similar AI-native development environments
  • Demonstrated success independently designing, building, deploying, and supporting production software.
  • A builder's mindset with a passion for solving difficult technical problems and delivering high-quality software.
  • Strong verbal and written communication skills with the ability to work directly with senior business stakeholders.
  • Excellent analytical, organizational, and problem-solving skills.

Preferred Experience

Experience in one or more of the following areas is highly desirable:

  • Document-intensive or highly regulated industries
  • Financial Services
  • Private Credit
  • Banking or Capital Markets
  • Asset Management
  • Investment Banking
  • Vector databases (Qdrant, Pinecone, Weaviate, or similar)
  • PDF and document parsing
  • Anthropic or OpenAI APIs
  • Agent SDKs
  • Model Context Protocol (MCP)
  • Programmatic document generation (DOCX/PPTX)
  • Open-source software development

Engineering Culture

The engineering organization is intentionally small, collaborative, and highly empowered.

Engineers are trusted to:

  • Own problems from design through production.
  • Work directly with investment professionals and business stakeholders.
  • Influence technical architecture and platform direction.
  • Continuously improve products and engineering practices.
  • Move quickly while maintaining high engineering standards.

The culture values:

  • Shipping reliable production software
  • Strong software engineering fundamentals
  • Thoughtful code reviews
  • Practical AI solutions over hype
  • Ownership, accountability, and initiative
  • Curiosity, experimentation, and continuous learning

Why This Opportunity Stands Out

This role offers the opportunity to:

  • Help shape how AI is transforming investment decision-making at one of the industry's leading private credit investment firms.
  • Build AI systems that directly support real investment decisions.
  • Solve technically challenging problems involving large-scale financial and legal documents.
  • Influence the architecture and evolution of a rapidly expanding AI platform.
  • Collaborate directly with experienced investment professionals to solve meaningful business problems.
  • Join a small engineering team where individual contributions have immediate visibility and impact.
  • Work with cutting-edge AI technologies while building production systems—not prototypes.
  • Develop solutions that fundamentally change how investment professionals research, analyze, and evaluate investment opportunities.

Compensation

Base Salary: $150,000 – $200,000

In addition to a highly competitive base salary, our client offers a comprehensive total compensation package that includes:

  • Performance-based discretionary bonus
  • Comprehensive medical, dental, and vision benefits
  • Retirement savings plan
  • Paid time off
  • Additional employee wellness and benefit programs

Compensation will be commensurate with experience, technical expertise, and overall qualifications.

Location: New York City

Applicants must be legally authorized to work in the United States on a full-time basis. Sponsorship or transfer of employment visas are not available for this position.

Interested?

If you're excited or know someone who would be an outstanding fit - building production AI systems that solve complex, real-world problems- and want to work at the intersection of software engineering, artificial intelligence, and private credit- we'd welcome the opportunity to have a confidential conversation. Please contact Jerry Goldberg | View email address on ziprecruiter.com | View phone number on ziprecruiter.com

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - AI Platform New York City | Private Credit in New York, NY vacancy
  • $180k - $220k

     ...Mission Aktos is an AI-driven Vertical Software startup looking for a Staff Full Stack Engineer (70/30 Backend...  ...debts and improve their credit scores— granting...  ...AI-powered software platform that caters to Collectors...  ...with office in New York City Salary Range: $18... 
    Software
    Full time
    Work at office
    Local area

    Aktos

    New York, NY
    1 day ago
  • $237k - $340k

     ...year USD About Radical AI Radical AI is a...  ...semiconductors, and space to engineer around material shortcomings, Radical invents new materials for specific...  ...looking for a Head of Software Engineering to build...  ...willing to relocate to — New York City; this role requires... 
    Software
    Immediate start
    Relocation

    Nodi

    New York, NY
    4 days ago
  •  ...Job Title: Java FSD Developer with AI. Location: New York City, NY (Hybrid). Expr level 10+ years....  ...capabilities using modern frameworks, cloud platforms, and Large Language Models (LLMs)....  ...document summarization, recommendation engines, and workflow automation Design... 
    Suggested
    Contract work

    Jobleads-US

    New York, NY
    6 days ago
  • $2,200 per week

     ...Full‑time Employee Location: On‑site, New York City, NY Duration: 10 weeks (June 8th, 2...  ...to mobile, cloud computing, business software, healthcare, and cleantech. Work...  ...into leading roles in venture capital and private equity, launched their own funds, or started... 
    Software
    Private
    Bi-weekly pay
    Full time
    Temporary work
    Summer work
    Internship
    Work at office
    Relocation
    Monday to Friday

    VC Stack

    New York, NY
    1 day ago
  • $140k - $200k

     ...office. These include frontend and backend engineers, AI research scientists, and others from...  ...Overview The responsibilities of our Platform team include building and maintaining all...  ...to, payments, analytics, subscriptions, new products, text to speech, and external APIs... 
    Software
    Remote job
    Full time
    Work at office

    Speechify

    New York, NY
    1 day ago
  • $135k - $180k

     ...seamless, end-to-end platform to improve patient experiences...  ...is headquartered in New York City and has been...  ...Accounting, IT, and Data Engineering teams to modernize how...  ...automation. Experience with AI / ML use cases in...  ...compensation, credit card, or banking details... 
    Ongoing contract
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work

    Dassault Systèmes

    New York, NY
    1 day ago
  •  ...Data Centers based out of our New York office.  CreditSights...  ...unbiased research on global credit markets, empowering clients to...  ...the digital infrastructure, software, and networking equipment segments...  ...companies, hedge funds, private equity investors and corporations... 
    Software
    Private
    Temporary work
    Work at office
    Immediate start
    Flexible hours
    3 days per week

    Fitch Group

    New York, NY
    27 days ago
  • $265k - $285k

     ...headquartered with offices in New York, London, Stockholm and other...  ...Architecture, Cyber Security, Data & AI, Infrastructure, Product...  ..., computer science, computer engineering, electrical engineering,...  ...infrastructure as a service (IaaS), platform as a service (PaaS), SOA,... 
    Temporary work
    Work at office
    Work visa

    Sirius Group

    New York, NY
    2 days ago
  •  ...Senior AI Agents Developer -  New York City Salary Details: $500,000 - $1,000,000...  ...market leadership. As a privately funded and highly capitalized...  ...strategy. Our expanding AI Engineering team, working directly...  ...benchmark external AI models, platforms, and services Work... 
    Full time
    Contract work
    New York, NY
    13 days ago
  • Sr Site Reliability Engineer (Linux, UNIX, Reliability...  ...C++, Java, DevOps) in New York City C, C++, DevOps...  ...Deployment and Runtime Platform is responsible for corporate...  ...including: - Private and public Cloud computing...  ...planning. • Develop software and systems architectural... 
    Software
    Private
    Permanent employment
    Full time
    Remote work

    DBA Web Technologies

    New York, NY
    more than 2 months ago
  • $450 per month

     ...territory. We are looking for a Territory Sales Manager located in New York City, NY.  What you'll do: Responsible for driving revenue...  ...skills Proficiency in Microsoft Office and CRM software such as Salesforce.com Ability to manage multiple projects... 
    Software
    Remote job
    Full time
    Live in
    Work at office
    Flexible hours
    Night shift

    Standard Process Inc.

    New York, NY
    1 day ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer, Gen AI Platform Overview:...  ..., and support AI software components including...  ...courage to share new ideas even when...  ..., or equivalent private cloud) ~ Experience...  ...New York, NY: $250,800 - $...  ...1-4920; New York City's Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    1 day ago
  • $150k

     ...Description: iT Manager New York New York $ Up to:...  ...technical issues (hardware, software, connectivity) Manage...  ...preferably within financial services (private equity, hedge fund,...  ...the firm's offices in New York City, Santa Monica, and Palm Beach... 
    Software
    Private
    Work at office
    Remote work
    Relocation

    ESR Healthcare

    New York, NY
    1 day ago
  • $147k - $185k

     ...Global FinancialsNew York City Area - USAWhy...  ...strives to make a new world happen. WWT'...  ...to help public and private sector organizations...  ...scale intelligent AI, digital,...  ...-art hardware and software—WWT enables clients...  ..., PMO Manager and Engineering Manager) to ensure... 
    Software
    Private
    Full time
    Contract work
    Flexible hours
    Shift work

    World Wide Technology

    New York, NY
    6 days ago
  •  ...are partnering with an early-stage, cutting-edge AI startup in New York City to hire a Full Stack AI Engineer with strong zero-to-one product-building experience...  ...Qualifications ~4 or more years of professional software engineering experience ~ Proven experience building... 
    Software
    Work at office
    Local area
    Remote work
    Relocation

    Gallin Associates

    New York, NY
    a month ago
  • $130.9k - $251.9k

     ...Location: United States, New York, New YorkSalary:...  .... We drive AI transformation by...  ...Innovation Hub Solution Engineer forApp Innovation...  ...Hub in New York City, you’ll leverage your...  ...on the latest AI platform and technology...  ...on experience with software architecture and development... 
    Software
    Ongoing contract
    Local area

    Microsoft

    New York, NY
    5 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI)...  ..., and support AI software components including...  ...courage to share new ideas even when...  ...Azure, or equivalent private cloud) ~...  ...Engineer New York, NY: $250,800 – $...  ...1-4920; New York City?s Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer ( MLX, Gen AI Platform Services, Agentic AI) Overview...  ..., and support AI software components...  ...courage to share new ideas even when they...  ...Azure, or equivalent private cloud). ~...  ...Engineer New York, NY: $215,200 - $...  ...1-4920; New York City’s Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    18 hours ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure...  ..., and support AI software components...  ...courage to share new ideas even when they...  ...Azure, or equivalent private cloud) Experience...  ...AI Engineer New York, NY: $250,800 - $...  ...1-4920; New York City’s Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    18 hours ago
  • $197.3k - $225.1k

     ...Lead AI/ML Engineer (Platform, kubeflow) Overview At Capital...  ..., and support AI software components...  ...courage to share new ideas even when they...  ...Azure, or equivalent private cloud) Experience...  ...AI Engineer New York, NY: $215,200 - $...  ...1-4920; New York City’s Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $110k - $140k

     ...Asset Manager | New York City | Mixed Use Portfolio | Fully Remote Please read the information in this job post thoroughly to understand...  ...with financial reports in Yardi/MRI or other real estate software Self-starting and diligent individual with a successful track... 
    Software
    For contractors
    Local area
    Immediate start
    Remote work
    Work from home

    Advice Personnel

    New York, NY
    2 days ago
  • $110k - $120k

     ...BCG Platinion | AI Tech Consultant, Enterprise Solutions...  ...(Internship) - New York, United States of America...  ...into leading-edge tech platforms, at scale. What You'...  ...across IT, enterprise software, and data/AI - including...  ...include New York City, Dallas, Boston, Chicago... 
    Software
    Full time
    Summer work
    Internship
    Work at office
    Local area

    Boston Consulting Group

    New York, NY
    2 days ago
  •  ...we expand our platform, we are building a Data + AI team to unlock...  ...join a small, private, high-impact company...  ...and Principal Engineers who thrive in...  ...standards for a new core capability...  ...level: 8+ years in software/data...  ...structure.Based in New York City, available to... 
    Software
    Private
    Temporary work
    Work from home
    Worldwide
    Home office
    3 days per week

    Appgate

    New York, NY
    1 day ago
  • $220k - $290k

     ...Senior Enterprise Sales Engineer - New YorkHarness is the AI Software Delivery Platform company, led by technologist and entrepreneur...  ..., IVP, Unusual Ventures, Citi Ventures, and more. As AI accelerates...  ...commuting distance to the New York officeWhat You Will Have at... 
    Software
    Local area
    Immediate start
    Flexible hours
    Shift work

    Harness

    New York, NY
    3 days ago
  • $240k - $260k

     ...the largest global platform for the LGBTQ+ business...  ...Director, Private Markets Technology (Private Credit & Global Real Estate...  ...managers and senior engineers while partnering closely...  ...platforms, and AI-driven capabilities...  ...for this position in New York City is $240,000 - $260,... 
    Private
    Full time
    Part time
    Work at office
    Flexible hours

    Invesco

    New York, NY
    1 day ago
  • $85k - $95k

     ...communities. Learn more at yai.org/careers. Locations (New York City) ~ Positions available throughout New York City, including...  ...ability to use or to quickly learn to use applicable equipment, software and/or electronic programs, specifically the electronic medical... 
    Software
    Temporary work
    Work at office
    Local area
    Flexible hours

    YAI

    New York, NY
    a month ago
  • $115k - $130k

     ...Advisory & Restructuring, Debt Private Placements and Fund Placement...  ...Analyst to join our team in New York. The candidate will be...  ...spanning many verticals including Software, Internet, and Hardware. You...  ...For job postings in New York City, Oppenheimer is required by law... 
    Software
    Private

    Oppenheimer & Co. Inc.

    New York, NY
    18 days ago
  • $54.5k - $103.75k

     ...Executive Salesforce is the #1 AI CRM, where humans with...  ...either the full Salesforce platform or specializing in a specific...  ...set of existing customers and new logo accounts. Develop a...  .... In California and New York, and select cities in the metropolitan areas of... 

    Salesforce

    New York, NY
    2 days ago
  •  ...As a Senior DevOps Engineer at Regard, you’ll scale and secure the...  ...infrastructure behind our healthcare AI platform. You’ll design, build, and...  ...Evaluate and implement new tools, sharing best practices...  ...sponsorship, and are within the New York City, Los Angeles, or San... 
    Work at office
    Local area
    Home office
    Visa sponsorship
    2 days per week

    Regard

    New York, NY
    more than 2 months ago
  • $182.75k - $215k

     ...Carta is the connected platform and AI-native ecosystem for private capital. Built to...  ...together the software, services, and legal...  ...private equity, private credit) to how we position...  .... Marketing is the engine for growth at Carta...  ...San Francisco, CA; New York, NY $173,613 - $20... 
    Software
    Private
    Full time

    Carta, Inc.

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - AI Platform New York City | Private Credit. Be the first to apply!