Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - AI Platform New York City | Private Credit

$150k - $200k

J Harlan Group, LLC

Job Description

Job Description

Software Engineer – AI Platform New York City | Private Credit Build Production AI That Investment Professionals Rely on Every Day

Our client is one of the leading private credit investment firms in the United States , managing more than $9 billion in assets and providing bespoke financing solutions to middle-market companies navigating growth, acquisitions, operational transformation, and complex financial situations.

The firm has built a production AI platform that is transforming how investment professionals research, analyze, and evaluate investment opportunities. The platform powers AI-generated investment memoranda, due diligence questionnaire (DDQ) automation, and intelligent retrieval across highly complex financial and legal documents.

Our client is seeking an exceptional Software Engineer to help expand this platform and build the next generation of AI-enabled investment workflows.

  • This is not an AI research role.
  • This is not a machine learning model training role.
  • This is not a prompt engineering or proof-of-concept position.

Instead, this is an opportunity to build production AI systems that become part of the daily workflow of investment professionals making real investment decisions.

As one of a small number of engineers supporting this platform, you'll have significant ownership, influence technical direction, and see your work move quickly from concept to production.

Working alongside the platform's lead engineer, you'll partner directly with investment professionals, investor relations, and operations teams to design, build, deploy, and continuously improve AI-powered applications that deliver measurable business impact.

If you're passionate about solving challenging engineering problems, shipping production software, and leveraging cutting-edge AI technologies to solve real-world business problems, this is an exceptional opportunity.

What You'll Build

You'll help design, build, and evolve production AI systems, including:

  • AI-powered investment memorandum generation
  • Due diligence questionnaire (DDQ) automation
  • Retrieval-Augmented Generation (RAG) across complex legal and financial documents
  • AI agents, reusable skills, and workflow automation
  • Source attribution and provenance tracking
  • AI review workflows that improve the accuracy, transparency, and trustworthiness of AI-generated content

Everything you build will be deployed into production and used by investment professionals, not developed as a proof of concept or demo.

Representative Projects

Examples of the engineering challenges you'll tackle include:

  • Trace every statement in an AI-generated investment memorandum back to the exact page and source document used to support it.
  • Improve retrieval across hundreds of pages of credit agreements, financial statements, and legal documentation while preserving complex tables and formatting.
  • Design review workflows that identify and prevent hallucinated financial information before it reaches investment professionals.
  • Build reusable AI agents and workflows that automate repetitive research and due diligence processes.
  • Develop internal AI tools that reduce hours of manual investment analysis into minutes while maintaining transparency, traceability, and accuracy.
  • Partner directly with business users to transform manual workflows into scalable AI-powered solutions.
  • Continuously improve platform performance, reliability, and user experience as new AI capabilities emerge.

Key Responsibilities

  • Design, develop, deploy, and support production AI applications that support the investment lifecycle.
  • Build and enhance AI agents, reusable skills, subagents, and workflow automation.
  • Develop provenance tracking, citation, and review capabilities that improve confidence in AI-generated output.
  • Build scalable retrieval pipelines utilizing vector search and modern RAG architectures.
  • Collaborate closely with investment, investor relations, and operations professionals to understand business workflows and deliver practical AI solutions.
  • Own projects from architecture and design through implementation, deployment, testing, monitoring, and ongoing production support.
  • Participate in architectural discussions and help shape the future direction of the firm's AI platform.

Qualifications

The ideal candidate will possess:

  • 3–5 years of professional software engineering experience.
  • Strong programming experience in one or more of the following:
    • Python
    • TypeScript / JavaScript
    • Go
    • Rust
  • Experience building production AI applications using technologies such as:
    • AI Agents
    • Retrieval-Augmented Generation (RAG)
    • Vector Search
    • Prompt & Context Engineering
    • Evaluation Frameworks (Evals)
  • Daily experience using AI-assisted development tools such as:
    • Claude Code
    • Cursor
    • Codex
    • GitHub Copilot
    • or similar AI-native development environments
  • Demonstrated success independently designing, building, deploying, and supporting production software.
  • A builder's mindset with a passion for solving difficult technical problems and delivering high-quality software.
  • Strong verbal and written communication skills with the ability to work directly with senior business stakeholders.
  • Excellent analytical, organizational, and problem-solving skills.

Preferred Experience

Experience in one or more of the following areas is highly desirable:

  • Document-intensive or highly regulated industries
  • Financial Services
  • Private Credit
  • Banking or Capital Markets
  • Asset Management
  • Investment Banking
  • Vector databases (Qdrant, Pinecone, Weaviate, or similar)
  • PDF and document parsing
  • Anthropic or OpenAI APIs
  • Agent SDKs
  • Model Context Protocol (MCP)
  • Programmatic document generation (DOCX/PPTX)
  • Open-source software development

Engineering Culture

The engineering organization is intentionally small, collaborative, and highly empowered.

Engineers are trusted to:

  • Own problems from design through production.
  • Work directly with investment professionals and business stakeholders.
  • Influence technical architecture and platform direction.
  • Continuously improve products and engineering practices.
  • Move quickly while maintaining high engineering standards.

The culture values:

  • Shipping reliable production software
  • Strong software engineering fundamentals
  • Thoughtful code reviews
  • Practical AI solutions over hype
  • Ownership, accountability, and initiative
  • Curiosity, experimentation, and continuous learning

Why This Opportunity Stands Out

This role offers the opportunity to:

  • Help shape how AI is transforming investment decision-making at one of the industry's leading private credit investment firms.
  • Build AI systems that directly support real investment decisions.
  • Solve technically challenging problems involving large-scale financial and legal documents.
  • Influence the architecture and evolution of a rapidly expanding AI platform.
  • Collaborate directly with experienced investment professionals to solve meaningful business problems.
  • Join a small engineering team where individual contributions have immediate visibility and impact.
  • Work with cutting-edge AI technologies while building production systems—not prototypes.
  • Develop solutions that fundamentally change how investment professionals research, analyze, and evaluate investment opportunities.

Compensation

Base Salary: $150,000 – $200,000

In addition to a highly competitive base salary, our client offers a comprehensive total compensation package that includes:

  • Performance-based discretionary bonus
  • Comprehensive medical, dental, and vision benefits
  • Retirement savings plan
  • Paid time off
  • Additional employee wellness and benefit programs

Compensation will be commensurate with experience, technical expertise, and overall qualifications.

Location: New York City

Applicants must be legally authorized to work in the United States on a full-time basis. Sponsorship or transfer of employment visas are not available for this position.

Interested?

If you're excited or know someone who would be an outstanding fit - building production AI systems that solve complex, real-world problems- and want to work at the intersection of software engineering, artificial intelligence, and private credit- we'd welcome the opportunity to have a confidential conversation. Please contact Jerry Goldberg | View email address on ziprecruiter.com | View phone number on ziprecruiter.com

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - AI Platform New York City | Private Credit in New York, NY vacancy
  • $180k - $220k

     ...Mission Aktos is an AI-driven Vertical Software startup looking for a Staff Full Stack Engineer (70/30 Backend...  ...debts and improve their credit scores— granting...  ...AI-powered software platform that caters to Collectors...  ...with office in New York City Salary Range: $18... 
    Software
    Full time
    Work at office
    Local area

    Aktos

    New York, NY
    12 hours ago
  • $110k - $120k

    ## Community Manager - New York CityApplylocations: City Office New York, New York, NYtime...  ...global real estate platform offering expertise in property...  ...Disabilities Act, Fair Credit Reporting Act, and other laws...  ...using property management software (preferably Entrata, Yardi... 
    Software
    Full time
    For contractors
    Work at office
    Local area
    Immediate start

    Greystar

    New York, NY
    2 days ago
  • $170k - $185k

     ...Morgan, Capital One Ventures, Citi Ventures, ServiceNow,...  ...the industry’s leading AI-powered software delivery platform, enabling teams worldwide...  ...code is only 30–40% of the engineering lifecycle — the rest...  ...commuting distance to the New York office What You Will Have... 
    Software
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Menlo Ventures

    New York, NY
    2 days ago
  • $135k - $180k

     ...seamless, end-to-end platform to improve patient experiences...  ...is headquartered in New York City and has been...  ...Accounting, IT, and Data Engineering teams to modernize how...  ...automation. Experience with AI / ML use cases in...  ...compensation, credit card, or banking details... 
    Suggested
    Ongoing contract
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work

    Dassault Systèmes

    New York, NY
    12 hours ago
  • Sr Site Reliability Engineer (Linux, UNIX, Reliability...  ...C++, Java, DevOps) in New York City C, C++, DevOps...  ...Deployment and Runtime Platform is responsible for corporate...  ...including: - Private and public Cloud computing...  ...planning. • Develop software and systems architectural... 
    Software
    Private
    Permanent employment
    Full time
    Remote work

    DBA Web Technologies

    New York, NY
    more than 2 months ago
  •  ...technical issues (hardware, software, connectivity) Manage onboarding...  ...) Evaluate and recommend new technologies to improve...  ...preferably within financial services (private equity, hedge fund,...  ...across the firm's offices in New York City, Santa Monica, and Palm Beach... 
    Software
    Private
    Work at office
    Remote work
    Relocation

    ESR Healthcare

    New York, NY
    2 days ago
  • $197.3k - $225.1k

     ...description": "Lead AI Engineer ( MLX, Gen AI Platform Services, Agentic...  ..., and support AI software components...  ...courage to share new ideas even when they...  ...Azure, or equivalent private cloud) ~...  ...Engineer New York, NY: $215,200 - $...  ...1-4920; New York City's Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    12 hours ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer, Gen AI Platform Overview:...  ..., and support AI software components including...  ...courage to share new ideas even when...  ..., or equivalent private cloud) ~ Experience...  ...New York, NY: $250,800 - $...  ...1-4920; New York City's Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    12 hours ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure...  ..., and support AI software components...  ...courage to share new ideas even when they...  ...Azure, or equivalent private cloud) ~...  ...Engineer New York, NY: $250,800 - $...  ...1-4920; New York City's Fair Chance Act... 
    Software
    Private
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    12 hours ago
  •  ...must be within a commutable distance to New York City (10271) This job is onsite in New...  ...Server, Azure, and the ESRI ArcGIS platform. This is an onsite position in New York...  ...Science, GIS, Information Systems, Software Engineering, or a related field. ~8+ years of full... 
    Software
    Contract work

    Booker DiMaio, LLC

    New York, NY
    3 days ago
  • $190k - $220k

     ...Parental Leave We want our new parents to get the time...  ...patients. Our Investors Point72 Private Investments led our most...  ...building the future of AI that makes a difference...  ...Current Openings Senior Software Engineer - Data Platform New York City Employment Type Full time... 
    Software
    Private
    Full time
    Work at office

    Adonis Technology, Inc.

    New York, NY
    1 day ago
  •  ...As a Senior DevOps Engineer at Regard, you’ll scale and secure the...  ...infrastructure behind our healthcare AI platform. You’ll design, build, and...  ...Evaluate and implement new tools, sharing best practices...  ...sponsorship, and are within the New York City, Los Angeles, or San... 
    Work at office
    Local area
    Home office
    Visa sponsorship
    2 days per week

    Regard

    New York, NY
    more than 2 months ago
  • $83.22k - $97.9k

     ...Office Administrator, New York City Casey Family Programs, an Equal Opportunity Employer, is...  ...employee expenses, payment authorizations, credit cards, etc.), contract administration,...  ...are needed. A broad knowledge of computer software is required. Advanced skills in the... 
    Software
    Full time
    Contract work
    Work experience placement
    Work at office
    Local area
    Monday to Friday

    Casey Family Programs

    New York, NY
    12 hours ago
  • $54.5k - $103.75k

     ...Salesforce Salesforce is the #1 AI CRM, where humans with...  ...either the full Salesforce platform or specializing in a...  ...set of existing customers and new logo accounts. Develop a...  ...locations. In California and New York, and select cities in the metropolitan areas of... 

    Salesforce

    New York, NY
    2 days ago
  • $100k - $115k

     ...mixed-use real estate. Based in New York City, we own, develop and operate...  .... Our dynamic services platform spans development, construction...  ...operations. We partner with private owners and institutional...  ...computers and property management software, to include Microsoft Office... 
    Software
    Private
    For contractors
    Work at office
    Local area

    Rose Associates

    New York, NY
    2 days ago
  • $31.25 - $33.65 per hour

     ...real estate. Based in New York City, we own, develop and operate...  ...Our dynamic services platform spans development,...  .... We partner with private owners and institutional...  ...comprehensive background and credit checks according to...  ...property management software, to include Microsoft... 
    Software
    Private
    Hourly pay
    Work at office
    Local area
    Weekend work

    Rose Associates

    New York, NY
    4 days ago
  • $180k

     ...Forward Deployed Engineer -  NYC...  ...and ships the AI workflow that changes...  ...is yours. The credit and the consequences...  ...-old claims platform for a national...  ...engineers. - Private equity: an...  ...shipping production software end to end,...  ...: you track new models, tools,... 
    Software
    Private
    Permanent employment
    Full time
    Work at office
    Local area
    Relocation
    Day shift
    New York, NY
    5 days ago
  • $100k - $120k

     ...mixed-use real estate. Based in New York City, we own, develop and operate...  .... Our dynamic services platform spans development, construction...  ...operations. We partner with private owners and institutional...  ...provide ongoing support for new software and technology to streamline... 
    Software
    Private
    Work at office

    Rose Associates

    New York, NY
    2 days ago
  • $165k - $225k

     ...You! Santander offers private bankers the strength of...  ...to a powerful global platform, strong local-market connectivity...  ...across investments, credit, wealth planning,...  ...relationships, acquiring new clients, and delivering...  ...this position in New York City is $165,000-$225,000. Actual... 
    Private
    Hourly pay
    Full time
    Contract work
    Local area
    Shift work

    Santander US

    New York, NY
    3 days ago
  • $150k - $180k

    CreditSights is currently seeking a Senior Credit Analyst Technology based out of our New York or Charlotte office....  ...analysis of companies in the fintech, software, networking equipment and further...  ...companies, hedge funds, private equity investors and corporations... 
    Software
    Private
    Temporary work
    Work at office
    Immediate start
    Flexible hours
    3 days per week

    CFA Institute

    New York, NY
    2 days ago
  •  ...the departmental orientation of new hires. Plans, implements...  ...equipment. Will use Tracking Software such as Ascendco, SPM,...  ...and local laws, including the City of Los Angeles' Fair Chance Initiative...  ...Chance Ordinance, and the New York Fair Chance Act. We encourage... 
    Software
    Local area
    Remote work
    Flexible hours

    Compass Group

    New York, NY
    2 days ago
  • $140k - $160k

     ...Fitch Group delivers vital credit and risk insights,...  ...headquarters in London and New York, Fitch Group is owned...  ...Data Office, Chief Software Office, Chief Technology...  ...edge technologies like AI and cloud solutions, we...  ...adversarial testing of AI platforms and guardrails to... 
    Software
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch Group

    New York, NY
    10 days ago
  • $253.3k - $327.8k

     ...help organizations unlock the full potential of their data, from AI to multicloud. Ready to innovate and contribute to our path to...  ...cultivating and maintaining relationships with key partners in New York City . In this role, you will drive NetApp's product and service... 
    Work at office
    Local area

    NetApp

    New York, NY
    3 days ago
  • $100k - $115k

     ...mixed-use real estate. Based in New York City, we own, develop and operate...  .... Our dynamic services platform spans development, construction...  ...operations. We partner with private owners and institutional...  ...computers and property management software, to include Microsoft Office... 
    Software
    Private
    Work at office

    Rose Associates Inc.

    New York, NY
    1 day ago
  • $79.5k - $110k

     ...customers trust Medidata's seamless, end-to-end platform to improve patient experiences,...  ..., DSY.PA), Medidata is headquartered in New York City and has been recognized as a Leader by Everest...  ...applicants for monetary compensation, credit card, or banking details. Equal... 
    Hourly pay
    Ongoing contract
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours

    Medidata Solutions

    New York, NY
    3 days ago
  • $47.59 per hour

     ...income with deep expertise across public and private markets. We invest our clients' capital across a range of fixed income and credit opportunities, leveraging our decades of...  ...Assistant to join our team in New York, NY. We have opportunities to support our... 
    Private
    Hourly pay
    Immediate start
    Flexible hours

    PIMCO

    New York, NY
    2 days ago
  • $70k - $75k

     ...team’s product knowledge The Private Dining Manager is...  ...business across Eataly’s three New York City locations Lead all aspects of...  ...similar CRM/event management platforms, ensuring accurate documentation...  ...unemployment status, salary history, credit/bankruptcy history and... 
    Private
    Local area
    Flexible hours
    Afternoon shift

    Eataly North America

    New York, NY
    2 days ago
  • $31.25 - $33.65 per hour

     ...real estate. Based in New York City, we own, develop and operate...  ...Our dynamic services platform spans development,...  .... We partner with private owners and institutional...  ...comprehensive background and credit checks according to...  ...property management software, to include Microsoft... 
    Software
    Private
    Hourly pay
    Work at office
    Local area
    Weekend work

    Rose Associates

    New York, NY
    3 hours ago
  • $114.75k - $153k

     ...customers trust Medidata's seamless, end-to-end platform to improve patient experiences,...  ..., DSY.PA), Medidata is headquartered in New York City and has been recognized as a Leader by Everest...  ...applicants for monetary compensation, credit card, or banking details.   Equal... 
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Dassault Systèmes

    New York, NY
    12 hours ago
  •  ...Senior AI Agents Developer -  New York City Salary Details: $500,000 - $1,000,000...  ...market leadership. As a privately funded and highly capitalized...  ...strategy. Our expanding AI Engineering team, working directly...  ...benchmark external AI models, platforms, and services Work... 
    Permanent employment
    Full time
    Contract work
    New York, NY
    26 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - AI Platform New York City | Private Credit. Be the first to apply!