Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - AI Platform New York City | Private Credit

$150k - $200k

J Harlan Group, LLC

Job Description

Job Description

Software Engineer – AI Platform New York City | Private Credit Build Production AI That Investment Professionals Rely on Every Day

Our client is one of the leading private credit investment firms in the United States , managing more than $9 billion in assets and providing bespoke financing solutions to middle-market companies navigating growth, acquisitions, operational transformation, and complex financial situations.

The firm has built a production AI platform that is transforming how investment professionals research, analyze, and evaluate investment opportunities. The platform powers AI-generated investment memoranda, due diligence questionnaire (DDQ) automation, and intelligent retrieval across highly complex financial and legal documents.

Our client is seeking an exceptional Software Engineer to help expand this platform and build the next generation of AI-enabled investment workflows.

  • This is not an AI research role.
  • This is not a machine learning model training role.
  • This is not a prompt engineering or proof-of-concept position.

Instead, this is an opportunity to build production AI systems that become part of the daily workflow of investment professionals making real investment decisions.

As one of a small number of engineers supporting this platform, you'll have significant ownership, influence technical direction, and see your work move quickly from concept to production.

Working alongside the platform's lead engineer, you'll partner directly with investment professionals, investor relations, and operations teams to design, build, deploy, and continuously improve AI-powered applications that deliver measurable business impact.

If you're passionate about solving challenging engineering problems, shipping production software, and leveraging cutting-edge AI technologies to solve real-world business problems, this is an exceptional opportunity.

What You'll Build

You'll help design, build, and evolve production AI systems, including:

  • AI-powered investment memorandum generation
  • Due diligence questionnaire (DDQ) automation
  • Retrieval-Augmented Generation (RAG) across complex legal and financial documents
  • AI agents, reusable skills, and workflow automation
  • Source attribution and provenance tracking
  • AI review workflows that improve the accuracy, transparency, and trustworthiness of AI-generated content

Everything you build will be deployed into production and used by investment professionals, not developed as a proof of concept or demo.

Representative Projects

Examples of the engineering challenges you'll tackle include:

  • Trace every statement in an AI-generated investment memorandum back to the exact page and source document used to support it.
  • Improve retrieval across hundreds of pages of credit agreements, financial statements, and legal documentation while preserving complex tables and formatting.
  • Design review workflows that identify and prevent hallucinated financial information before it reaches investment professionals.
  • Build reusable AI agents and workflows that automate repetitive research and due diligence processes.
  • Develop internal AI tools that reduce hours of manual investment analysis into minutes while maintaining transparency, traceability, and accuracy.
  • Partner directly with business users to transform manual workflows into scalable AI-powered solutions.
  • Continuously improve platform performance, reliability, and user experience as new AI capabilities emerge.

Key Responsibilities

  • Design, develop, deploy, and support production AI applications that support the investment lifecycle.
  • Build and enhance AI agents, reusable skills, subagents, and workflow automation.
  • Develop provenance tracking, citation, and review capabilities that improve confidence in AI-generated output.
  • Build scalable retrieval pipelines utilizing vector search and modern RAG architectures.
  • Collaborate closely with investment, investor relations, and operations professionals to understand business workflows and deliver practical AI solutions.
  • Own projects from architecture and design through implementation, deployment, testing, monitoring, and ongoing production support.
  • Participate in architectural discussions and help shape the future direction of the firm's AI platform.

Qualifications

The ideal candidate will possess:

  • 3–5 years of professional software engineering experience.
  • Strong programming experience in one or more of the following:
    • Python
    • TypeScript / JavaScript
    • Go
    • Rust
  • Experience building production AI applications using technologies such as:
    • AI Agents
    • Retrieval-Augmented Generation (RAG)
    • Vector Search
    • Prompt & Context Engineering
    • Evaluation Frameworks (Evals)
  • Daily experience using AI-assisted development tools such as:
    • Claude Code
    • Cursor
    • Codex
    • GitHub Copilot
    • or similar AI-native development environments
  • Demonstrated success independently designing, building, deploying, and supporting production software.
  • A builder's mindset with a passion for solving difficult technical problems and delivering high-quality software.
  • Strong verbal and written communication skills with the ability to work directly with senior business stakeholders.
  • Excellent analytical, organizational, and problem-solving skills.

Preferred Experience

Experience in one or more of the following areas is highly desirable:

  • Document-intensive or highly regulated industries
  • Financial Services
  • Private Credit
  • Banking or Capital Markets
  • Asset Management
  • Investment Banking
  • Vector databases (Qdrant, Pinecone, Weaviate, or similar)
  • PDF and document parsing
  • Anthropic or OpenAI APIs
  • Agent SDKs
  • Model Context Protocol (MCP)
  • Programmatic document generation (DOCX/PPTX)
  • Open-source software development

Engineering Culture

The engineering organization is intentionally small, collaborative, and highly empowered.

Engineers are trusted to:

  • Own problems from design through production.
  • Work directly with investment professionals and business stakeholders.
  • Influence technical architecture and platform direction.
  • Continuously improve products and engineering practices.
  • Move quickly while maintaining high engineering standards.

The culture values:

  • Shipping reliable production software
  • Strong software engineering fundamentals
  • Thoughtful code reviews
  • Practical AI solutions over hype
  • Ownership, accountability, and initiative
  • Curiosity, experimentation, and continuous learning

Why This Opportunity Stands Out

This role offers the opportunity to:

  • Help shape how AI is transforming investment decision-making at one of the industry's leading private credit investment firms.
  • Build AI systems that directly support real investment decisions.
  • Solve technically challenging problems involving large-scale financial and legal documents.
  • Influence the architecture and evolution of a rapidly expanding AI platform.
  • Collaborate directly with experienced investment professionals to solve meaningful business problems.
  • Join a small engineering team where individual contributions have immediate visibility and impact.
  • Work with cutting-edge AI technologies while building production systems—not prototypes.
  • Develop solutions that fundamentally change how investment professionals research, analyze, and evaluate investment opportunities.

Compensation

Base Salary: $150,000 – $200,000

In addition to a highly competitive base salary, our client offers a comprehensive total compensation package that includes:

  • Performance-based discretionary bonus
  • Comprehensive medical, dental, and vision benefits
  • Retirement savings plan
  • Paid time off
  • Additional employee wellness and benefit programs

Compensation will be commensurate with experience, technical expertise, and overall qualifications.

Location: New York City

Applicants must be legally authorized to work in the United States on a full-time basis. Sponsorship or transfer of employment visas are not available for this position.

Interested?

If you're excited or know someone who would be an outstanding fit - building production AI systems that solve complex, real-world problems- and want to work at the intersection of software engineering, artificial intelligence, and private credit- we'd welcome the opportunity to have a confidential conversation. Please contact Jerry Goldberg | View email address on us.fitly.work | View phone number on us.fitly.work

Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - AI Platform New York City | Private Credit in New York, NY vacancy
  • $150k

     ...world-class software, purpose-built...  ...venture capital, private equity and private credit. Trusted by 6...  ..., Carta’s platform of software...  ...that - it’s a new category of software...  ...blockers. AI & Automation...  ...where prompt engineering and workflow...  ...k OTE in New York City, NY (... 
    Software
    Private
    Hourly pay
    Full time
    Contract work
    Work at office

    Carta, Inc.

    New York, NY
    3 days ago
  •  ...Senior Platform Automation Engineer New York City, NY or Plano, TX (Hybrid) Phone + Video Job Description...  ...infrastructure management into an AI-driven development lifecycle. This...  ...developer platforms that support modern software development and deployment.... 
    Software

    Verito Solutions Inc

    New York, NY
    2 days ago
  • $229.9k - $286.2k

     ...in Computer Science, AI, Electrical Engineering, Computer...  ...solutions on cloud platforms such as AWS, Google...  ...Azure, or comparable private cloud environments...  ...training and inference software to improve hardware...  ...including Cambridge, New York, San Francisco, and... 
    Software
    Private
    Full time

    Capital One

    New York, NY
    2 days ago
  • $250k

     ...through world‑class software, purpose‑built...  ...capital, private equity and private credit. Trusted by 65,0...  ...countries, Carta’s platform of software and...  ...just that - it’s a new category of software...  ...for the largest AI‑native law firm...  ...10/hour) in New York City Disclosures We... 
    Software
    Private
    Full time
    Temporary work
    Work at office

    Carta, Inc.

    New York, NY
    3 days ago
  • $180k - $220k

     ...Mission Aktos is an AI-driven Vertical Software startup looking for a Staff Full Stack Engineer (70/30 Backend...  ...debts and improve their credit scores— granting...  ...AI-powered software platform that caters to Collectors...  ...with office in New York City Salary Range: $18... 
    Software
    Full time
    Work at office
    Local area

    Aktos

    New York, NY
    1 day ago
  • $135k - $180k

     ...seamless, end-to-end platform to improve patient experiences...  ...is headquartered in New York City and has been...  ...Accounting, IT, and Data Engineering teams to modernize how...  ...automation. Experience with AI / ML use cases in...  ...compensation, credit card, or banking details... 
    Ongoing contract
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work

    Dassault Systèmes

    New York, NY
    more than 2 months ago
  • $237k - $340k

     ...year USD About Radical AI Radical AI is a...  ...semiconductors, and space to engineer around material shortcomings, Radical invents new materials for specific...  ...looking for a Head of Software Engineering to build...  ...willing to relocate to — New York City; this role requires... 
    Software
    Immediate start
    Relocation

    Jobleads-US

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...DescriptionSenior Lead AI Engineer\n \n \n...  ...AI models and platforms empower teams...  ...and support AI software components including...  ...to share new ideas even when...  ...or equivalent private cloud) \n \n...  ...Engineer\n \n New York, NY: $250,800 -...  ...4920; New York City’s Fair Chance... 
    Software
    Private
    Full time
    Part time
    Local area

    Energy Jobline ZR

    New York, NY
    4 days ago
  • $139k - $188k

    New York City, United States At Anaplan, we are a team of innovators...  ...through our leading AI-infused scenario planning and analysis platform so our customers can...  ...Winning Culture is the engine that drives our teams...  ...role (SaaS/enterprise software preferred). Deep knowledge... 
    Software

    Scmdojo

    New York, NY
    4 days ago
  • $147k - $185k

     ...Global FinancialsNew York City Area - USAWhy...  ...strives to make a new world happen. WWT'...  ...to help public and private sector organizations...  ...scale intelligent AI, digital,...  ...-art hardware and software—WWT enables clients...  ..., PMO Manager and Engineering Manager) to ensure... 
    Software
    Private
    Full time
    Contract work
    Flexible hours
    Shift work

    World Wide Technology

    New York, NY
    a month ago
  • $130.9k - $251.9k

     ...Location: United States, New York, New YorkSalary:...  .... We drive AI transformation by...  ...Innovation Hub Solution Engineer forApp Innovation...  ...Hub in New York City, you’ll leverage your...  ...on the latest AI platform and technology...  ...on experience with software architecture and development... 
    Software
    Ongoing contract
    Local area

    Microsoft

    New York, NY
    4 days ago
  •  ...Fitch Group delivers vital credit and risk insights,...  ...headquarters in London and New York, Fitch Group is owned...  ...Data Office, Chief Software Office, Chief Technology...  ...edge technologies like AI and cloud solutions, we...  ...reusable frameworks and platform for accelerated AI adoption... 
    Software
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch Group

    New York, NY
    5 days ago
  • $110k - $120k

     ...BCG Platinion | AI Tech Consultant, Enterprise Solutions...  ...(Internship) - New York, United States of America...  ...into leading-edge tech platforms, at scale. What You'...  ...across IT, enterprise software, and data/AI - including...  ...offer include New York City, Dallas, Boston,... 
    Software
    Full time
    Summer work
    Internship
    Work at office
    Local area

    Boston Consulting Group

    New York, NY
    18 days ago
  • Sr Site Reliability Engineer (Linux, UNIX, Reliability...  ...C++, Java, DevOps) in New York City C, C++, DevOps...  ...Deployment and Runtime Platform is responsible for corporate...  ...including: - Private and public Cloud computing...  ...planning. • Develop software and systems architectural... 
    Software
    Private
    Permanent employment
    Full time
    Remote work

    DBA Web Technologies

    New York, NY
    more than 2 months ago
  •  ...Data Centers based out of our New York office.  CreditSights...  ...unbiased research on global credit markets, empowering clients to...  ...the digital infrastructure, software, and networking equipment segments...  ...companies, hedge funds, private equity investors and corporations... 
    Software
    Private
    Temporary work
    Work at office
    Immediate start
    Flexible hours
    3 days per week

    Fitch Group

    New York, NY
    a month ago
  •  ...Senior AI Agents Developer -  New York City Salary Details: $500,000 - $1,000,000...  ...market leadership. As a privately funded and highly capitalized...  ...strategy. Our expanding AI Engineering team, working directly...  ...benchmark external AI models, platforms, and services Work... 
    Full time
    Contract work
    New York, NY
    21 days ago
  • $450 per month

     ...territory. We are looking for a Territory Sales Manager located in New York City, NY.  What you'll do: Responsible for driving revenue...  ...skills Proficiency in Microsoft Office and CRM software such as Salesforce.com Ability to manage multiple projects... 
    Software
    Remote job
    Full time
    Live in
    Work at office
    Flexible hours
    Night shift

    Standard Process Inc.

    New York, NY
    1 day ago
  • NYB - Sr. Java Developer Location: New York City, NY (Hybrid) Duration: 9 Months Rates / Credit Trading Platform Development MUST HAVE SKILLS: Java, Kafka or Solace, Sybase or Oracle API development with vendor platforms (ION or Bloomberg or Murex or Client or TransFICC... 

    Staffing the Universe

    New York, NY
    6 days ago
  • $145k - $165k

     ...partnerships, as well as our private network, which we use...  ...are seeking a Senior Software Engineer – Integration to join a new Bruin Platform Modernization team in...  ...experience. You will use AI-assisted engineering...  ...NYC, #NewYorkCity, New York City, NewYorkCity, Senior Software... 
    Software
    Private
    Contract work

    MetTel

    New York, NY
    18 days ago
  • $87k - $188k

     ...Litigation Support Discovery Attorney | City of New York C Organising Institution / Firm City of...  .... Whether you aim to move into private practice, corporate compliance, or senior...  ...Familiarity with litigation support review software is also highly preferred. Q: Does this... 
    Software
    Private practice
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    City of New York (Law Department)

    New York, NY
    5 days ago
  • Air Techniques is seeking a Territory Manager to cover New York City and Long Island. This role requires strong dental sales experience...  ...Bachelor's degree in a relevant field, and proficiency in business software like MS Office and CRM systems. #J-18808-Ljbffr Air... 
    Software

    Air Techniques

    New York, NY
    3 days ago
  • $200k - $300k

     ...Engineering Manager, Platform Doctronic gives people free, private access to AI health guidance and affordable visits with human physicians...  ...test, deploy, and operate software. Guide key technical...  ...And Benefits New York City and San Francisco base salary... 
    Software
    Private

    Doctronic

    New York, NY
    7 hours ago
  • $25 per hour

     ...mixed-use real estate. Based in New York City, we own, develop and operate...  .... Our dynamic services platform spans development, construction...  ...operations. We partner with private owners and institutional...  ...Microsoft Office and Yardi software. Work authorization (required... 
    Software
    Private
    Hourly pay
    Work at office

    Rose Associates Inc.

    New York, NY
    24 days ago
  • $197.3k - $225.1k

     ...Overview Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services) At...  ...and support AI software components including...  ...to share new ideas even when...  ..., or equivalent private cloud) ~ Experience...  ...Engineer New York, NY: $215,200 -...  ...-4920; New York City’s Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $200k - $250k

     ...other investment platforms, SFM thrives on...  ...including public and private equity and credit, fixed income,...  ...in New York City with offices in...  ...systems while guiding engineering teams on implementation...  ...governance of AI/LLM initiatives,...  ...~12+ years of software engineering experience... 
    Software
    Private
    Permanent employment
    Work at office

    Soros Fund Management

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    Sr. Lead AI Engineer (GenAI Platform) Overview: At Capital One...  ..., and support AI software components...  ...courage to share new ideas even when they...  ...Azure, or equivalent private cloud) ~...  ...Engineer New York, NY: $250,800 - $...  ...1-4920; New York City’s Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $265k - $285k

     ...headquartered with offices in New York, London, Stockholm and other...  ...Architecture, Cyber Security, Data & AI, Infrastructure, Product...  ..., computer science, computer engineering, electrical engineering,...  ...infrastructure as a service (IaaS), platform as a service (PaaS), SOA,... 
    Temporary work
    Work at office
    Work visa

    Jobleads-US

    New York, NY
    5 days ago
  • $240k - $280k

     ...About Norm Ai Norm Ai, the...  ...pioneered Legal Engineering, the process that...  ...of no-code software tools. Norm Ai...  ...institutions across private funds, private...  ...legal intelligence platform that powers...  ...maximum target for new hire salary for...  ...move to New York City, designed to... 
    Software
    Private
    Work at office
    Relocation
    3 days per week

    Norm AI, Inc

    New York, NY
    4 days ago
  • $190k - $230k

    New YorkLab49 - Software Engineering /Full-time /On-siteLab49 is an award-winning specialist...  ...with one or more cloud platforms with a working understanding...  ...S9427A when hiring in New York.  Our total rewards...  ...artificial intelligence (AI) tools to support parts of... 
    Software
    Full time
    Temporary work
    Immediate start

    ION Group

    New York, NY
    a month ago
  • $244.7k - $279.2k

     ...in Computer Science, AI, Electrical Engineering, Computer Engineering...  ...AI solutions on cloud platforms such as AWS, Google...  ...Cloud, Azure, or similar private cloud environments....  ...and inference software for better hardware utilization...  ...the ability to apply new methods thoughtfully... 
    Software
    Private
    Full time
    Remote work

    Capital One

    New York, NY
    20 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - AI Platform New York City | Private Credit. Be the first to apply!