Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer - AI & LLM Integration

$75 - $85 per hour

Intellibus

Intellibus designs and engineers technology platforms for established FinTech and financial-services firms. We build production-grade systems that help organizations solve complex business problems through software engineering, data, and emerging technologies.

We are looking for engineers who can turn AI capabilities into practical, reliable applications that deliver measurable business value.

The AI Engineer Role

Hands-on Senior AI Engineer with 12+ years of software engineering experience and strong expertise in Core Java, Spring Boot, enterprise backend development, microservices, Microsoft Azure, and Large Language Models (LLMs).

This is a senior engineering position requiring someone who has spent years designing, developing, and deploying complex enterprise applications and has subsequently gained practical experience integrating AI and LLM capabilities into production systems.

The ideal candidate is first and foremost a strong software engineer who understands enterprise application architecture, backend engineering, distributed systems, and cloud-native development, with substantial hands-on experience building AI-powered applications.

You will be responsible for designing and developing enterprise AI solutions, integrating LLMs into existing applications, building intelligent workflows, and delivering production-ready systems within complex financial-services environments.

Key Responsibilities

  1. Core Java & Enterprise Backend Engineering
  2. Demonstrate advanced hands-on expertise in Core Java, including OOP, Collections, Streams API, Multithreading, Concurrency, JVM fundamentals, and performance optimization.
  3. Design, develop, and maintain enterprise-grade backend applications using Java and Spring Boot.
  4. Build scalable RESTful APIs, microservices, and distributed applications.
  5. Implement complex business logic, enterprise integrations, asynchronous processing, and event-driven architectures.
  6. Work with Spring Security, Spring Data, Hibernate, JPA, and related frameworks.
  7. Apply appropriate design patterns, coding standards, and architectural principles.
  8. Troubleshoot complex production issues, optimize application performance, and improve system reliability.

  1. Microservices & Distributed Systems

  • Design and implement enterprise microservices architectures.
  • Develop resilient, scalable, and loosely coupled services.
  • Work with messaging and event-streaming technologies such as Apache Kafka.
  • Implement service-to-service communication, API integrations, and asynchronous workflows.
  • Understand distributed transactions, fault tolerance, circuit breakers, and high-availability architectures.
  • Work with relational and NoSQL databases and optimize data access patterns.

  1. AI & Large Language Model Engineering

  • Design, build, and integrate LLM-powered applications into enterprise platforms.
  • Work hands-on with commercial and open-source LLMs, including Azure OpenAI and other model providers.
  • Develop LLM integrations using APIs, SDKs, and backend services.
  • Build AI-powered workflows, intelligent automation, and agentic applications.
  • Implement Retrieval-Augmented Generation (RAG) architectures.
  • Work with embeddings, vector databases, semantic search, and enterprise knowledge retrieval.
  • Develop prompt engineering strategies, structured outputs, function calling, and tool integrations.
  • Implement LLM orchestration, context management, conversation memory, and multi-step AI workflows.
  • Evaluate model responses for accuracy, relevance, hallucinations, and consistency.
  • Implement guardrails, validation, security controls, and responsible AI practices.
  • Optimize latency, token consumption, model performance, and inference costs.
  • Take AI applications beyond prototypes and deliver reliable, scalable production solutions.

  1. Microsoft Azure & Cloud Engineering

  • Design and deploy enterprise applications and AI solutions on Microsoft Azure.
  • Work with Azure OpenAI Service, Azure AI services, Azure App Services, Azure Functions, and related cloud services.
  • Integrate AI services with enterprise applications, APIs, and data platforms.
  • Work with Azure cloud architecture, networking, security, identity, and access management.
  • Build and manage CI/CD pipelines and automated deployment workflows.
  • Apply cloud-native engineering principles, scalability, monitoring, and reliability practices.

  1. Python, Data Engineering & Enterprise Platforms

  • Develop Python applications, services, and automation supporting AI workflows.
  • Work with SQL, relational databases, and structured and unstructured data.
  • Build data-processing and integration workflows supporting LLM applications.
  • Work with PostgreSQL, Oracle, MySQL, or comparable enterprise databases.
  • Experience with Microsoft Fabric, data engineering, and enterprise analytics platforms is preferred.
  • Integrate enterprise data sources with AI models and retrieval systems.

  1. Engineering Quality & Production Delivery

  • Write clean, maintainable, testable, and production-quality code.
  • Conduct code reviews and mentor other engineers.
  • Develop unit, integration, and automated tests.
  • Troubleshoot complex application and infrastructure issues.
  • Implement application logging, monitoring, observability, and performance optimization.
  • Collaborate with architects, engineering leaders, and business stakeholders to deliver enterprise solutions.

Required Technical Qualifications

  • 12+ years of professional software engineering experience.
  • Strong recent hands-on development experience in enterprise software engineering.
  • Proven experience designing and delivering complex production applications.
  • Practical experience building and deploying AI/LLM-powered applications.

Core Java & Backend

  • Advanced Core Java and Spring Boot expertise.
  • Strong understanding of OOP, Collections, Streams, Multithreading, Concurrency, and JVM.
  • Extensive experience with REST APIs, microservices, Spring Framework, Hibernate, and JPA.
  • Strong understanding of enterprise application architecture and distributed systems.

AI & LLMs

  • Demonstrated hands-on experience integrating LLMs into enterprise applications.
  • Experience with Azure OpenAI or comparable LLM platforms.
  • Strong understanding of RAG, embeddings, vector databases, prompt engineering, and LLM orchestration.
  • Experience building AI agents, tool calling, and intelligent workflows is highly desirable.
  • Experience deploying and maintaining AI applications in production is strongly preferred.

Azure & Cloud

  • Strong experience with Microsoft Azure and cloud-based application development.
  • Experience integrating Azure AI services with enterprise applications.
  • Familiarity with cloud security, identity, deployment, and monitoring.

Additional Skills

  • Working knowledge of Python.
  • Strong SQL and database development experience.
  • Exposure to Microsoft Fabric and enterprise data platforms.
  • Experience with Kafka, Docker, Kubernetes, and CI/CD pipelines.

What We Are Looking For

We want engineers who:

  • Have spent 12+ years building enterprise software applications.
  • Are deeply hands-on with Java, Spring Boot, and backend engineering.
  • Understand how large-scale enterprise applications are architected and implemented.
  • Have moved beyond AI experimentation and have built actual LLM-powered applications.
  • Can independently design, code, debug, and deploy complex solutions.
  • Understand how to integrate AI capabilities into existing enterprise systems.
  • Can take ownership of technical deliverables and work effectively with senior engineering teams.

Important: Candidates whose experience is primarily prompt engineering, Python scripting, AI tool usage, academic research, or AI-generated code without strong enterprise software engineering fundamentals will not be suitable for this position.

Compensation: $75 - $85 / Hour

Our Process

  1. Initial Screening: 15-minute video call with the Recruiting Team.
  2. Assessments: One proctored GQ multiple-choice assessment and a SlideWare presentation (under 2 hours).
  3. Interview Rounds: Three 30-minute video interviews with the Technical Team, Project Lead, and Executive Team.
  4. Offer: Final decision and job offer.

If this sounds like the kind of work you want to be doing, apply now. Our team will be in touch within the hour.

Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - AI & LLM Integration in Manhattan, NY vacancy
  • $106k - $159.5k

     ...you can make your mark as a Senior Software Engineer at Marsh Agency. Marsh Agency...  ...stack capabilities for an AI-powered insurance document...  ...design, and client-side API integration. Professional experience...  ...document-processing services, and LLM-powered workflows.... 
    Senior
    Minimum wage
    Full time
    Local area
    Remote work
    Night shift

    Marsh McLennan

    Hoboken, NJ
    2 days ago
  • $145k - $160k

     ...are seeking a highly skilled Senior Salesforce Developer to design...  ...and implement robust integrations (REST/SOAP APIs, middleware)Optimize...  ...Agentforce-powered solutionsDefine AI agent architecture, behaviors...  ...degree in Computer Science, Engineering, or related field (or... 
    Senior
    Full time

    Pearson

    Hoboken, NJ
    1 day ago
  • $116.2k - $229.1k

     ...7The Work You’ll DoThe Software & ALM Senior Consultant executes hands...  ...-on delivery to build AI-enabled software and systems engineering lifecycle workflows (...  ...impact analysis.Build integrations across ALM, PLM, and CI...  ...tools via APIsPython-based LLM/RAG application work (... 
    Senior
    Local area

    Deloitte

    Jersey City, NJ
    13 hours ago
  •  ...Job Title: Senior Python Developer Location: Rutherford, NJ (3...  ...data-driven applications and AI-powered solutions, including...  ...search solutions. Build and integrate AI/ML, LLM, GenAI, and RAG-based solutions...  ...product, architecture, and engineering teams. Required Skills:... 
    Senior
    Worldwide
    3 days per week

    Dexian

    Rutherford, NJ
    4 days ago
  •  ...Senior Software Engineer Hybrid - Newark, NJ | Right to Hire About the Role Join a major financial...  ...that supports its enterprise AI governance ecosystem Design, develop...  ...automation, control validation, platform integrations, cloud-native capabilities, and data... 
    Senior
    Contract work

    JSR Tech Consulting

    Newark, NJ
    9 days ago
  •  ...industry's relationship with data, using AI agents to turn messy, unstructured...  ...continuing to scale fast. They're hiring a Senior Software Engineer to help build the product experience...  ...with or around AI/ML systems, hands-on LLM or agent experience is a bonus but not... 
    Senior
    Full time

    arcadia

    Brooklyn, NY
    1 day ago
  •  ...Our client is seeking a Senior GenAI Cloud Engineer to build and deploy enterprise-scale AI solutions that drive...  ...AI applications. • Integrate LLMs with enterprise systems...  ...through working software. • Improve the team:...  ...Bedrock or other enterprise LLM platforms. •... 
    Senior

    JSR Tech Consulting

    Newark, NJ
    10 days ago
  • $146k - $234k

     ...Expert-Level GEOINT System Integrator with hands‑on experience across the Systems Engineering and Integration...  ...Engineering (MBSE), and AI while introducing process...  ...processes and products. Mentor Senior-, Mid-, and Junior-...  ...Measured service Software as a Service (SaaS) Platform... 
    Senior
    Contract work
    Shift work

    Peraton

    Brooklyn, NY
    5 days ago
  •  ...Senior DevOps EngineerThe Office of Technology...  ...Senior DevOps Engineer to drive the modernization...  ..., and reliable software deployments.Architect...  ....Develop, integrate, and maintain pipelines...  ...deployment of cutting-edge AI models, Model...  ...advanced AI frameworks, LLM orchestration tools... 
    Senior
    Permanent employment
    Full time
    Work at office
    Shift work
    Night shift
    Weekend work
    Afternoon shift

    New York City | Jobs

    Brooklyn, NY
    4 days ago
  •  ...Verwendung von MongoDB, Golang, Angular, OpenSearch, Kafka und ggf. AI mit Schwerpunkt auf Leistung, Zuverlässigkeit und...  ...Entwicklungsmethoden. Vertrautheit mit Verfahren zur kontinuierlichen Integration und Bereitstellung (CI/CD). Was wir Dir bieten Moderne Technologien... 
    Senior
    Work at office

    cidaas by Widas ID GmbH

    Brooklyn, NY
    3 days ago
  • Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Java Developer for a contract assignment with...  ...Proficient in using AI-assisted development tools...  ...Boot components integrating with Apache Kafka and...  ...Exposure to Spring AI and LLM integration patterns (... 
    Senior
    Contract work

    Software Guidance & Assistance

    Jersey City, NJ
    21 hours ago
  • $50 - $70 per hour

    Senior AI Engineers - Agentic Development & AI-Augmented Engineering- Hoboken, NJAbout the RoleWe're looking for a Staff Software Engineer who can define and scale how our engineering organization builds...  ...that are legible and safe for LLM agents to useDefine human-in-the-... 
    Senior
    Contract work
    Local area

    HCLTech

    Hoboken, NJ
    2 days ago
  •  ...Framework and SQL Server Development. ~ Experience building, integrating, maintaining, and supporting Trading Systems. ~ Strong understanding...  ...plus. ~ Additional experience with Oracle, C++, or Python/AI is preferred. ~4 days onsite mandatory Domain:... 
    Senior
    Full time
    Contract work

    INFOTRON

    Manhattan, NY
    10 days ago
  • $175k - $215k

     .... About the Role As an AI Engineer, you'll build the intelligence...  ...language, get intelligent integration suggestions, detect data quality...  ...You'll build and iterate on LLM pipelines, RAG systems, and agentic...  ...Experience ~5+ years software engineering; 1+ years focused... 
    Senior
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    3 days ago
  • $160k - $165k

     ...Annually Description: Senior AI Tech Lead Jersey City...  ...S3, CloudWatch, prompt engineering, agent orchestration, tool integration, Vector stores,...  ...preferred. 10+ years of software engineering experience with...  ...-on experience building LLM-based applications, AI... 
    Senior
    Full time

    Judge Group, Inc.

    Bayonne, NJ
    3 days ago
  •  ...- Risk Technology - Sap Grc & Security - Senior ConsultantLocation: New York Other locations...  ...technologies), including exposure to IAM integrations (e.g., Saviynt, SailPoint, SAP IAG)...  ...ServiceNow or HP ALM Awareness of emerging SAP technologies such as BTP, SAC, AI, or RPA... 
    Senior
    Shift work

    EY

    Hoboken, NJ
    4 days ago
  •  ...the next generation of AI-powered equity...  ...Job Description Senior AI Engineer We're looking for a...  ...engineers who enjoy turning LLM and agentic AI capabilities...  ...AI capabilities get integrated into products used by...  ...building, and maintaining software systems Strong... 
    Senior
    Work at office
    Local area

    Versant Media

    Englewood Cliffs, NJ
    24 days ago
  •  ...join our talented Team.   Job Title: AI Senior Security Engineer Location(s): Jersey City, NJ, Tampa...  ...programmatic techniques to optimize LLM outputs for reliable security logic...  ...traditional signature-based defenses. Integrate large language models from providers... 
    Senior
    Work experience placement
    Local area

    Ampcus Incorporated

    Jersey City, NJ
    17 days ago
  • $167.1k - $300.9k

     ...to demonstrate the shift to AI-forward development processes...  ...with peers across Development & Engineering and Architecture teams,...  ...either an internal or external software or platform engineering role,...  ...falsification of information or lack of integrity at any point in the... 
    Senior
    Summer holiday
    Immediate start
    Flexible hours
    Shift work

    Ernst & Young

    Hoboken, NJ
    3 days ago
  • $25k

     ...Job Description Job Title : Senior Software Engineer Team : Systems...  ...platform, data systems, and the AI and automation that scale our...  ...participate in scrum and sprints, and integrate the systems our programs...  ...scale operations, such as LLM-assisted development or... 
    Senior
    Full time
    Work at office
    Immediate start
    Remote work
    Visa sponsorship
    Work visa
    Monday to Friday
    2 days per week
    3 days per week

    Braven

    Newark, NJ
    18 days ago
  •  ...and maintain web applications and interfaces, including the integration of AI models, using modern frameworks like Next.js and Prisma.System...  ...ensure seamless data flow and functionality.Visualization Engineering: Develop and maintain high-performance dashboards in Tableau... 
    Senior

    Virtusa

    Jersey City, NJ
    4 days ago
  • $136k - $253k

     ...Build and deploy production AI solutions that help tax and...  ...outcomes for their clients. As a Senior Software Engineer, you will combine Python,...  ...simpler builds and standard integrations, translating ambiguous needs...  ...and deploying AI/ML or LLM-powered applications in production... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Brooklyn, NY
    2 days ago
  • $110k - $150k

     ...excited by modern frameworks, tools and engineering practices? Do you want to build scalable...  ...and quality assurance professionals• apply software engineering practices including automated...  ...advantage• you’re curious to explore how AI can improve how we build, deliver, and optimize... 
    Senior
    Full time
    Flexible hours

    UBS

    Weehawken, NJ
    2 days ago
  •  ...Broadridge team. We are looking for a Senior Software Engineer. This is an exciting opportunity to join...  ...JavaScript) is a plus.Exposure to the AI/ML techniques & methodologies is a...  ...version control (Git) and continuous integration (CI/CD) processes.Strong problem-solving... 
    Senior
    Full time
    Local area
    Immediate start

    Broadridge

    Newark, NJ
    21 hours ago
  •  ...together.What’s the role?We are looking for a Senior Software Engineer, Machine Learning to help build and...  ...predictive and generative (open source LLM) models.You won't just be deploying...  ...00M+ users.Thoughtfully use generative AI and other productivity tools to work effi... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Etsy

    Brooklyn, NY
    4 days ago
  •  ...Senior Manager of Software Engineering When you mentor and advise multiple technical teams...  ..., building production AI agents on NEO that leverage...  ...productionize, and operate LLM-powered agents on NEO (the...  ...workflows using A2A, and integrate tools and data through MCP... 
    Senior

    JPMorgan Chase

    Jersey City, NJ
    1 day ago
  • $140k - $200k

     ..., old or new. Our engineering mission is to democratize...  ...’re looking for a Senior Platform Engineer...  ...role for a strong software generalist with...  ...use case.Bring AI into the engineering...  ...- from LLM-powered code modification...  ...builder with AI. You've integrated LLMs or agent-... 
    Senior
    Full time
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Collectors

    Jersey City, NJ
    3 days ago
  • $119.3k - $196.6k

     ...BALMAIN Beauty.DescriptionThe Senior Lead, Finance Platform Engineering provides engineering...  ...Financial Close, and Finance integrations. Partner with the...  ...OneStream integration, and AI-enabled engineering capabilities...  ...operating efficiency, software licensing optimization,... 
    Senior
    Full time
    Local area

    Estée Lauder

    Long Island City, NY
    1 day ago
  •  ...SRI Tech SolutionsRole: Senior Generative AI DeveloperLocation: Irving...  ...FastAPI for seamless integration with AI models and data...  ...professional experience in software development and system design...  ...Experience with LLM fine-tuning, prompt engineering, and model evaluation. Knowledge... 
    Senior
    Full time
    3 days per week

    SRI Tech

    Jersey City, NJ
    3 days ago
  •  ...AWS Software Development EngineerAmazon Web Services (AWS) is building...  ...of Software Development Engineer (SDE) talent for anticipated roles...  .../Machine Learning, Healthcare AI, Infrastructure Services, Firmware...  ...of Machine Learning and LLM fundamentals, including transformer... 
    Internship
    Day shift

    A W S

    Astoria, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer - AI & LLM Integration. Be the first to apply!