Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer - AI & LLM Integration

$75 - $85 per hour
Full-time

Intellibus

Intellibus designs and engineers technology platforms for established FinTech and financial-services firms. We build production-grade systems that help organizations solve complex business problems through software engineering, data, and emerging technologies.

We are looking for engineers who can turn AI capabilities into practical, reliable applications that deliver measurable business value.

The AI Engineer Role

Hands-on Senior AI Engineer with 12+ years of software engineering experience and strong expertise in Core Java, Spring Boot, enterprise backend development, microservices, Microsoft Azure, and Large Language Models (LLMs).

This is a senior engineering position requiring someone who has spent years designing, developing, and deploying complex enterprise applications and has subsequently gained practical experience integrating AI and LLM capabilities into production systems.

The ideal candidate is first and foremost a strong software engineer who understands enterprise application architecture, backend engineering, distributed systems, and cloud-native development, with substantial hands-on experience building AI-powered applications.

You will be responsible for designing and developing enterprise AI solutions, integrating LLMs into existing applications, building intelligent workflows, and delivering production-ready systems within complex financial-services environments.

Key Responsibilities

  1. Core Java & Enterprise Backend Engineering
  • Demonstrate advanced hands-on expertise in Core Java, including OOP, Collections, Streams API, Multithreading, Concurrency, JVM fundamentals, and performance optimization.
  • Design, develop, and maintain enterprise-grade backend applications using Java and Spring Boot.
  • Build scalable RESTful APIs, microservices, and distributed applications.
  • Implement complex business logic, enterprise integrations, asynchronous processing, and event-driven architectures.
  • Work with Spring Security, Spring Data, Hibernate, JPA, and related frameworks.
  • Apply appropriate design patterns, coding standards, and architectural principles.
  • Troubleshoot complex production issues, optimize application performance, and improve system reliability.

2. Microservices & Distributed Systems

  • Design and implement enterprise microservices architectures.
  • Develop resilient, scalable, and loosely coupled services.
  • Work with messaging and event-streaming technologies such as Apache Kafka.
  • Implement service-to-service communication, API integrations, and asynchronous workflows.
  • Understand distributed transactions, fault tolerance, circuit breakers, and high-availability architectures.
  • Work with relational and NoSQL databases and optimize data access patterns.

3. AI & Large Language Model Engineering

  • Design, build, and integrate LLM-powered applications into enterprise platforms.
  • Work hands-on with commercial and open-source LLMs, including Azure OpenAI and other model providers.
  • Develop LLM integrations using APIs, SDKs, and backend services.
  • Build AI-powered workflows, intelligent automation, and agentic applications.
  • Implement Retrieval-Augmented Generation (RAG) architectures.
  • Work with embeddings, vector databases, semantic search, and enterprise knowledge retrieval.
  • Develop prompt engineering strategies, structured outputs, function calling, and tool integrations.
  • Implement LLM orchestration, context management, conversation memory, and multi-step AI workflows.
  • Evaluate model responses for accuracy, relevance, hallucinations, and consistency.
  • Implement guardrails, validation, security controls, and responsible AI practices.
  • Optimize latency, token consumption, model performance, and inference costs.
  • Take AI applications beyond prototypes and deliver reliable, scalable production solutions.

4. Microsoft Azure & Cloud Engineering

  • Design and deploy enterprise applications and AI solutions on Microsoft Azure.
  • Work with Azure OpenAI Service, Azure AI services, Azure App Services, Azure Functions, and related cloud services.
  • Integrate AI services with enterprise applications, APIs, and data platforms.
  • Work with Azure cloud architecture, networking, security, identity, and access management.
  • Build and manage CI/CD pipelines and automated deployment workflows.
  • Apply cloud-native engineering principles, scalability, monitoring, and reliability practices.

5. Python, Data Engineering & Enterprise Platforms

  • Develop Python applications, services, and automation supporting AI workflows.
  • Work with SQL, relational databases, and structured and unstructured data.
  • Build data-processing and integration workflows supporting LLM applications.
  • Work with PostgreSQL, Oracle, MySQL, or comparable enterprise databases.
  • Experience with Microsoft Fabric, data engineering, and enterprise analytics platforms is preferred.
  • Integrate enterprise data sources with AI models and retrieval systems.

6. Engineering Quality & Production Delivery

  • Write clean, maintainable, testable, and production-quality code.
  • Conduct code reviews and mentor other engineers.
  • Develop unit, integration, and automated tests.
  • Troubleshoot complex application and infrastructure issues.
  • Implement application logging, monitoring, observability, and performance optimization.
  • Collaborate with architects, engineering leaders, and business stakeholders to deliver enterprise solutions.

Required Technical Qualifications

  • 12+ years of professional software engineering experience.
  • Strong recent hands-on development experience in enterprise software engineering.
  • Proven experience designing and delivering complex production applications.
  • Practical experience building and deploying AI/LLM-powered applications.

Core Java & Backend

  • Advanced Core Java and Spring Boot expertise.
  • Strong understanding of OOP, Collections, Streams, Multithreading, Concurrency, and JVM.
  • Extensive experience with REST APIs, microservices, Spring Framework, Hibernate, and JPA.
  • Strong understanding of enterprise application architecture and distributed systems.

AI & LLMs

  • Demonstrated hands-on experience integrating LLMs into enterprise applications.
  • Experience with Azure OpenAI or comparable LLM platforms.
  • Strong understanding of RAG, embeddings, vector databases, prompt engineering, and LLM orchestration.
  • Experience building AI agents, tool calling, and intelligent workflows is highly desirable.
  • Experience deploying and maintaining AI applications in production is strongly preferred.

Azure & Cloud

  • Strong experience with Microsoft Azure and cloud-based application development.
  • Experience integrating Azure AI services with enterprise applications.
  • Familiarity with cloud security, identity, deployment, and monitoring.

Additional Skills

  • Working knowledge of Python.
  • Strong SQL and database development experience.
  • Exposure to Microsoft Fabric and enterprise data platforms.
  • Experience with Kafka, Docker, Kubernetes, and CI/CD pipelines.

What We Are Looking For

We want engineers who:

  • Have spent 12+ years building enterprise software applications.
  • Are deeply hands-on with Java, Spring Boot, and backend engineering.
  • Understand how large-scale enterprise applications are architected and implemented.
  • Have moved beyond AI experimentation and have built actual LLM-powered applications.
  • Can independently design, code, debug, and deploy complex solutions.
  • Understand how to integrate AI capabilities into existing enterprise systems.
  • Can take ownership of technical deliverables and work effectively with senior engineering teams.

Important: Candidates whose experience is primarily prompt engineering, Python scripting, AI tool usage, academic research, or AI-generated code without strong enterprise software engineering fundamentals will not be suitable for this position.

Compensation: $75 - $85 / Hour

Our Process

  1. Initial Screening: 15-minute video call with the Recruiting Team.
  2. Assessments: One proctored GQ multiple-choice assessment and a SlideWare presentation (under 2 hours).
  3. Interview Rounds: Three 30-minute video interviews with the Technical Team, Project Lead, and Executive Team.
  4. Offer: Final decision and job offer.

If this sounds like the kind of work you want to be doing, apply now. Our team will be in touch within the hour.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - AI & LLM Integration in New York, NY vacancy
  •  ...Visionaryz is looking for a senior, hands-on architect to...  ...adopts agentic AI. Your work will cover how...  ...-driven, and messaging integration patterns across legacy,...  ...Azure and/or AWS AI/LLM or agentic solutions you...  ...clearly to executives and engineers alike ⭐ Nice to... 
    Senior

    Visionaryz Inc.

    New York, NY
    20 hours ago
  •  ...Job Description Job Title : Senior Cloud Solutions Architect – Agentic AI, Integration & Architecture Duration: 12...  ...Cloud Solutions Architect / Cloud Engineer/Application Architect with deep...  ...AWS. - Experience delivering AI/LLM or agentic solutions in an enterprise... 
    Senior
    Remote work

    SoHo Dragon

    New York, NY
    4 days ago
  • $15 - $45 per hour

     ...feeds training and evaluation of AI coding and agent products. What...  ...you will do Build and review API integrations, webhooks, data mapping and...  ...Write prompts and documentation for LLM-powered workflows What you need Professional software experience in Python, Go or JavaScript... 
    Suggested
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    14 hours ago
  •  ...Senior Cloud Solutions Architect AI & Integration Job Title: Senior Cloud Solutions Architect AI & Integration...  ...requirements. Collaborate with product, engineering, DevOps, and Cybersecurity teams....  ...experience delivering AI/LLM or agentic solutions. ~ Experience... 
    Senior
    Contract work
    Remote work

    Crossfire Consulting Corp

    New York, NY
    1 day ago
  • $170k - $200k

     ...Software Engineer (Backend / Full Stack) Early-Stage AI Startup | New York City, NY | Onsite Compensation: $170,000–$200,000 Base + Equity Company...  ...optimize system performance. Develop AI agents, LLM integrations, and automated workflows. Collaborate with... 
    Senior
    Full time
    Monday to Friday

    People In AI

    New York, NY
    10 days ago
  •  ...Senior Software Engineer | AI-First Development New York City – Financial District 4 Days/Week On-Site About eNGINE...  ...engineering best practices. AI/ML & Application Integration Integrate AI/ML capabilities and LLM-powered functionality into applications where... 
    Senior
    Relocation

    eNGINE

    New York, NY
    8 days ago
  • $193.3k - $261.5k

    Join Amazon's Data Integration organization and help shape the future of AI-driven data integration! We're seeking a talented Senior Software Engineer to join our AI and Platform Excellence (APEX) team. APEX is at the forefront of leveraging AI/ML to revolutionize data... 
    Senior
    Internship
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  •  ...Senior Software Engineer – AI | Forward Deployed Engineering Location: Hybrid, with required office attendance...  ..., and multi-step workflows that integrate with enterprise platforms and...  ...production AI/ML solutions, including LLM-powered applications. ~ Strong Python... 
    Senior
    Full time
    Contract work
    Work at office

    kadence

    New York, NY
    1 day ago
  •  ...space has always lacked: an integrated care model combining...  ...navigation, and purpose-built software. They collaborate...  ...The Role We are hiring senior- and staff-level product engineers who want to deploy high-...  ...is leveraging applied AI and LLM agents at the architectural... 
    Senior
    Immediate start
    Shift work

    Dynamics Solutions, LLC.

    New York, NY
    5 days ago
  • $200k - $250k

     ...clinics by providing AI-powered software, payer contracting, and...  ...are technical. Every engineer on the team has experience...  ..., and ship. Role: Senior Software Engineer We're...  ...next you're building an LLM pipeline for clinical...  ...on systems where data integrity, money movement, and... 
    Senior
    Full time
    Start working today
    Work at office

    Alpaca Health

    New York, NY
    2 days ago
  •  ...About the Role We're looking for a Senior Software Engineer (AI Agents) to build the core systems behind...  ...’ll design and ship production-grade LLM systems, contribute across the stack,...  ...• Hands-on experience building or integrating LLM-powered or agent-based systems... 
    Senior

    arcadia

    New York, NY
    a month ago
  • $138k - $173k

     ...are looking for a full stack Senior Software Engineer to lead the design,...  ...client applications and backend integrations. Lead rigorous code reviews...  ...Kotlin/Android) with the help of AI tooling, so you're either...  ...coding assistants, agentic IDEs, LLM-based testing or review... 
    Senior
    Temporary work
    Local area
    Immediate start
    Worldwide

    FanDuel

    New York, NY
    3 days ago
  •  ...Senior Software Development EngineerGibson Dunn is a leading...  ...Software Development Engineer designs, architects, builds...  ...solutions and integrating cutting-edge capabilities...  ...partnership with the firm's AI Platform Engineering...  ...Evaluation & Quality: LLM evaluation tooling,... 
    Senior

    Gibson Dunn

    New York, NY
    14 hours ago
  •  ...Full Stack Software Engineer We are looking for a Full Stack Software...  ...stage engineering team building AI-powered software for the...  ...services within AWS . Develop integrations and automation workflows that...  ...tool, the team uses LLM-based development agents as a... 
    Senior
    Full time

    Next Ventures

    New York, NY
    more than 2 months ago
  •  ...in-office Level: Senior Experience: 8+ years of professional software engineering experience About the...  ...scientists, research-focused AI practitioners, or...  ...applications and integrating LLMs into production software...  ...applications using LLM APIs, Azure OpenAI,... 
    Senior
    Full time
    Work at office
    Remote work
    2 days per week

    InnoveIQ

    New York, NY
    2 days ago
  • Senior AI Platform Engineer - LLM Gateway BBVA busca un profesional senior para incorporarse a la implantación de una plataforma corporativa de LLM Gateway. La plataforma proporcionará un acceso común, seguro, gobernado y observable a modelos fundacionales para los distintos... 
    Senior

    Tecdata

    New York, NY
    4 days ago
  • H2O.ai is seeking a Senior AI Engineer to build impactful AI solutions for APAC enterprise problems. You will design and deploy end-to-end AI systems, including agentic AI, LLM-powered applications, and production ML pipelines. This hands-on role is embedded in a customer... 
    Senior
    Remote job

    h2o.ai

    New York, NY
    14 hours ago
  • $225k - $250k

     ...Overview Susquehanna is hiring a Senior Software Engineer to design and build production-grade AI agents that reduce operational...  ...safeguards to mitigate LLM failure modes (hallucination, prompt...  ...solutions. Evaluate and integrate emerging models, frameworks, and... 
    Senior
    Work experience placement

    Susquehanna International Group, LLP

    New York, NY
    14 hours ago
  • Senior LLM Engineer remote Software development Referral Bonus $150 Required Skills Machine Learning Artificial Intelligence Job Description Senior LLM...  ...focused on designing, building, and deploying Generative AI and LLM-based solutions. The role requires deep technical... 
    Senior
    Full time
    Remote work

    Executive Staff Recruiters / ESR Healthcare

    New York, NY
    4 days ago
  • $145k - $275k

     ...PLTR) builds the data and AI platforms that...  ...) and agentic autonomy software that lets users manage...  ...threat detection. Build LLM and AI-driven systems that...  ...make fast decisions. Integrate with sensors, effectors...  ...platforms. Engineer scalable, reliable and... 
    Senior
    Full time
    Visa sponsorship

    Palantir

    New York, NY
    7 days ago
  •  ...Job Details: Senior Software Engineer - Build Production-Grade AI Agents New York, NY  Own the AI agents that...  ...agent behavior Safeguards for LLM failure modes and constraints...  ...quants, and traders Evaluation and integration of new AI models and frameworks... 
    Senior

    Liberty Personnel Services, Inc.

    New York, NY
    a month ago
  • $180k - $250k

     ...Enterprise Associates (NEA), Andrew Ng’s AI Fund , and Primavera. We live in a...  ...accessible to everyone. As a Senior Software Engineer at Kira, you will own core backend systems...  ...) ~(Preferred) Experience with integrating LLM-backed services, including API usage,... 
    Senior
    Full time
    Live in
    Work at office
    Local area
    Flexible hours

    kira

    New York, NY
    3 days ago
  • $155k - $180k

     ...a highly skilled full stack software engineer to support, manage, and improve the AI-driven software the Integrity Team uses to identify conduct...  ....Experience building LLM-based applications (retrieval...  ...0-$180,000Job Posting Title:Senior ManagerEmployees currently are... 
    Odd job
    Full time
    Temporary work
    Local area
    Remote work
    1 day per week

    National Basketball Association

    New York, NY
    4 days ago
  • $120k - $300k

     ...holders. About Evertune AI: Evertune is building the...  ...’ll be joining Evertune’s software engineering team– a tight-knit, high-velocity...  ...patterns, optimizing AI integrations, and making architectural decisions...  ...third-party APIs, including LLM providers like OpenAI and... 
    Senior
    Permanent employment
    Full time
    Work at office
    Local area
    Visa sponsorship
    2 days per week
    3 days per week

    evertune

    New York, NY
    3 days ago
  • $126k - $248k

     ...As a Senior Software Engineer on the Database Integration & Observability team, you will drive core initiatives across three key areas: Ecosystem Integrations...  ...market. We have redefined the data platform for the AI era, enabling builders to create, transform, and disrupt... 
    Senior
    Full time
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    New York, NY
    9 hours ago
  • $145k - $165k

     ...broadest portfolio of technology and integrated partnerships, as well as our private network...  ...career.      We are seeking a Senior Software Engineer – Integration to join a new Bruin...  ...integration experience. You will use AI-assisted engineering tools as a core part... 
    Senior
    Contract work

    MetTel

    New York, NY
    8 hours ago
  • $156.36k - $279.96k

     ...meet you. WHAT YOU'LL DO We're looking for a Senior Software Engineer II to join the Decisioning Studio Integrations team building BrazeAI Decisioning Studio™....  ...GCP preferred) and Kubernetes ~ Experience with AI coding assistants, and the judgment to know when... 
    Senior
    Work at office
    Local area
    Flexible hours

    Braze

    New York, NY
    9 hours ago
  •  ...are looking for a highly experienced Senior Backend AI Engineer – Agentic AI to design, develop, and...  ...Distributed Systems. Agentic AI & LLM: LangGraph, LangChain, Multi-Agent...  ...Retrieval-Augmented Generation, LLM Integration, Model Gateways, Inference, Evaluation... 
    Senior
    Full time

    Neshent Technologies

    New York, NY
    7 days ago
  • $4,500 - $6,000 per month

     ...in Georgia Team: Engineering (London + Kraków,...  ...scheduling, payouts, and integrations with Airbnb,...  ...We are a small, senior engineering team, and we build with AI as a core part of...  ...problems into shipped software Mentor through...  ...agentic workflows or LLM features into a... 
    Senior
    For contractors
    Remote work

    Houst

    New York, NY
    3 days ago
  • $130k - $175k

     ...interest in Uncountable Engineering! Description...  ...of our platform into an AI-first R&D ecosystem. We...  ...Generative AI. As an LLM Applications Engineer,...  ...experimental datasets. Integration: Connect LLM capabilities...  ...Requirements ~2+ years of software development experience... 

    Uncountable Inc

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer - AI & LLM Integration. Be the first to apply!