Senior Software Engineer - AI & LLM Integration
$75 - $85 per hourIntellibus
Intellibus designs and engineers technology platforms for established FinTech and financial-services firms. We build production-grade systems that help organizations solve complex business problems through software engineering, data, and emerging technologies.
We are looking for engineers who can turn AI capabilities into practical, reliable applications that deliver measurable business value.
The AI Engineer Role
Hands-on Senior AI Engineer with 12+ years of software engineering experience and strong expertise in Core Java, Spring Boot, enterprise backend development, microservices, Microsoft Azure, and Large Language Models (LLMs).
This is a senior engineering position requiring someone who has spent years designing, developing, and deploying complex enterprise applications and has subsequently gained practical experience integrating AI and LLM capabilities into production systems.
The ideal candidate is first and foremost a strong software engineer who understands enterprise application architecture, backend engineering, distributed systems, and cloud-native development, with substantial hands-on experience building AI-powered applications.
You will be responsible for designing and developing enterprise AI solutions, integrating LLMs into existing applications, building intelligent workflows, and delivering production-ready systems within complex financial-services environments.
Key Responsibilities
- Core Java & Enterprise Backend Engineering
- Demonstrate advanced hands-on expertise in Core Java, including OOP, Collections, Streams API, Multithreading, Concurrency, JVM fundamentals, and performance optimization.
- Design, develop, and maintain enterprise-grade backend applications using Java and Spring Boot.
- Build scalable RESTful APIs, microservices, and distributed applications.
- Implement complex business logic, enterprise integrations, asynchronous processing, and event-driven architectures.
- Work with Spring Security, Spring Data, Hibernate, JPA, and related frameworks.
- Apply appropriate design patterns, coding standards, and architectural principles.
- Troubleshoot complex production issues, optimize application performance, and improve system reliability.
- Design and implement enterprise microservices architectures.
- Develop resilient, scalable, and loosely coupled services.
- Work with messaging and event-streaming technologies such as Apache Kafka.
- Implement service-to-service communication, API integrations, and asynchronous workflows.
- Understand distributed transactions, fault tolerance, circuit breakers, and high-availability architectures.
- Work with relational and NoSQL databases and optimize data access patterns.
- Design, build, and integrate LLM-powered applications into enterprise platforms.
- Work hands-on with commercial and open-source LLMs, including Azure OpenAI and other model providers.
- Develop LLM integrations using APIs, SDKs, and backend services.
- Build AI-powered workflows, intelligent automation, and agentic applications.
- Implement Retrieval-Augmented Generation (RAG) architectures.
- Work with embeddings, vector databases, semantic search, and enterprise knowledge retrieval.
- Develop prompt engineering strategies, structured outputs, function calling, and tool integrations.
- Implement LLM orchestration, context management, conversation memory, and multi-step AI workflows.
- Evaluate model responses for accuracy, relevance, hallucinations, and consistency.
- Implement guardrails, validation, security controls, and responsible AI practices.
- Optimize latency, token consumption, model performance, and inference costs.
- Take AI applications beyond prototypes and deliver reliable, scalable production solutions.
- Design and deploy enterprise applications and AI solutions on Microsoft Azure.
- Work with Azure OpenAI Service, Azure AI services, Azure App Services, Azure Functions, and related cloud services.
- Integrate AI services with enterprise applications, APIs, and data platforms.
- Work with Azure cloud architecture, networking, security, identity, and access management.
- Build and manage CI/CD pipelines and automated deployment workflows.
- Apply cloud-native engineering principles, scalability, monitoring, and reliability practices.
- Develop Python applications, services, and automation supporting AI workflows.
- Work with SQL, relational databases, and structured and unstructured data.
- Build data-processing and integration workflows supporting LLM applications.
- Work with PostgreSQL, Oracle, MySQL, or comparable enterprise databases.
- Experience with Microsoft Fabric, data engineering, and enterprise analytics platforms is preferred.
- Integrate enterprise data sources with AI models and retrieval systems.
- Write clean, maintainable, testable, and production-quality code.
- Conduct code reviews and mentor other engineers.
- Develop unit, integration, and automated tests.
- Troubleshoot complex application and infrastructure issues.
- Implement application logging, monitoring, observability, and performance optimization.
- Collaborate with architects, engineering leaders, and business stakeholders to deliver enterprise solutions.
Required Technical Qualifications
- 12+ years of professional software engineering experience.
- Strong recent hands-on development experience in enterprise software engineering.
- Proven experience designing and delivering complex production applications.
- Practical experience building and deploying AI/LLM-powered applications.
Core Java & Backend
- Advanced Core Java and Spring Boot expertise.
- Strong understanding of OOP, Collections, Streams, Multithreading, Concurrency, and JVM.
- Extensive experience with REST APIs, microservices, Spring Framework, Hibernate, and JPA.
- Strong understanding of enterprise application architecture and distributed systems.
AI & LLMs
- Demonstrated hands-on experience integrating LLMs into enterprise applications.
- Experience with Azure OpenAI or comparable LLM platforms.
- Strong understanding of RAG, embeddings, vector databases, prompt engineering, and LLM orchestration.
- Experience building AI agents, tool calling, and intelligent workflows is highly desirable.
- Experience deploying and maintaining AI applications in production is strongly preferred.
Azure & Cloud
- Strong experience with Microsoft Azure and cloud-based application development.
- Experience integrating Azure AI services with enterprise applications.
- Familiarity with cloud security, identity, deployment, and monitoring.
Additional Skills
- Working knowledge of Python.
- Strong SQL and database development experience.
- Exposure to Microsoft Fabric and enterprise data platforms.
- Experience with Kafka, Docker, Kubernetes, and CI/CD pipelines.
What We Are Looking For
We want engineers who:
- Have spent 12+ years building enterprise software applications.
- Are deeply hands-on with Java, Spring Boot, and backend engineering.
- Understand how large-scale enterprise applications are architected and implemented.
- Have moved beyond AI experimentation and have built actual LLM-powered applications.
- Can independently design, code, debug, and deploy complex solutions.
- Understand how to integrate AI capabilities into existing enterprise systems.
- Can take ownership of technical deliverables and work effectively with senior engineering teams.
Important: Candidates whose experience is primarily prompt engineering, Python scripting, AI tool usage, academic research, or AI-generated code without strong enterprise software engineering fundamentals will not be suitable for this position.
Compensation: $75 - $85 / Hour
Our Process
- Initial Screening: 15-minute video call with the Recruiting Team.
- Assessments: One proctored GQ multiple-choice assessment and a SlideWare presentation (under 2 hours).
- Interview Rounds: Three 30-minute video interviews with the Technical Team, Project Lead, and Executive Team.
- Offer: Final decision and job offer.
If this sounds like the kind of work you want to be doing, apply now. Our team will be in touch within the hour.
$106k - $159.5k
...you can make your mark as a Senior Software Engineer at Marsh Agency. Marsh Agency... ...stack capabilities for an AI-powered insurance document... ...design, and client-side API integration. Professional experience... ...document-processing services, and LLM-powered workflows....SeniorMinimum wageFull timeLocal areaRemote workNight shift$145k - $160k
...are seeking a highly skilled Senior Salesforce Developer to design... ...and implement robust integrations (REST/SOAP APIs, middleware)Optimize... ...Agentforce-powered solutionsDefine AI agent architecture, behaviors... ...degree in Computer Science, Engineering, or related field (or...SeniorFull time$116.2k - $229.1k
...7The Work You’ll DoThe Software & ALM Senior Consultant executes hands... ...-on delivery to build AI-enabled software and systems engineering lifecycle workflows (... ...impact analysis.Build integrations across ALM, PLM, and CI... ...tools via APIsPython-based LLM/RAG application work (...SeniorLocal area- ...Job Title: Senior Python Developer Location: Rutherford, NJ (3... ...data-driven applications and AI-powered solutions, including... ...search solutions. Build and integrate AI/ML, LLM, GenAI, and RAG-based solutions... ...product, architecture, and engineering teams. Required Skills:...SeniorWorldwide3 days per week
- ...Senior Software Engineer Hybrid - Newark, NJ | Right to Hire About the Role Join a major financial... ...that supports its enterprise AI governance ecosystem Design, develop... ...automation, control validation, platform integrations, cloud-native capabilities, and data...SeniorContract work
- ...industry's relationship with data, using AI agents to turn messy, unstructured... ...continuing to scale fast. They're hiring a Senior Software Engineer to help build the product experience... ...with or around AI/ML systems, hands-on LLM or agent experience is a bonus but not...SeniorFull time
- ...Our client is seeking a Senior GenAI Cloud Engineer to build and deploy enterprise-scale AI solutions that drive... ...AI applications. • Integrate LLMs with enterprise systems... ...through working software. • Improve the team:... ...Bedrock or other enterprise LLM platforms. •...Senior
$146k - $234k
...Expert-Level GEOINT System Integrator with hands‑on experience across the Systems Engineering and Integration... ...Engineering (MBSE), and AI while introducing process... ...processes and products. Mentor Senior-, Mid-, and Junior-... ...Measured service Software as a Service (SaaS) Platform...SeniorContract workShift work- ...Senior DevOps EngineerThe Office of Technology... ...Senior DevOps Engineer to drive the modernization... ..., and reliable software deployments.Architect... ....Develop, integrate, and maintain pipelines... ...deployment of cutting-edge AI models, Model... ...advanced AI frameworks, LLM orchestration tools...SeniorPermanent employmentFull timeWork at officeShift workNight shiftWeekend workAfternoon shift
- ...Verwendung von MongoDB, Golang, Angular, OpenSearch, Kafka und ggf. AI mit Schwerpunkt auf Leistung, Zuverlässigkeit und... ...Entwicklungsmethoden. Vertrautheit mit Verfahren zur kontinuierlichen Integration und Bereitstellung (CI/CD). Was wir Dir bieten Moderne Technologien...SeniorWork at office
- Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Java Developer for a contract assignment with... ...Proficient in using AI-assisted development tools... ...Boot components integrating with Apache Kafka and... ...Exposure to Spring AI and LLM integration patterns (...SeniorContract work
$50 - $70 per hour
Senior AI Engineers - Agentic Development & AI-Augmented Engineering- Hoboken, NJAbout the RoleWe're looking for a Staff Software Engineer who can define and scale how our engineering organization builds... ...that are legible and safe for LLM agents to useDefine human-in-the-...SeniorContract workLocal area- ...Framework and SQL Server Development. ~ Experience building, integrating, maintaining, and supporting Trading Systems. ~ Strong understanding... ...plus. ~ Additional experience with Oracle, C++, or Python/AI is preferred. ~4 days onsite mandatory Domain:...SeniorFull timeContract work
$175k - $215k
.... About the Role As an AI Engineer, you'll build the intelligence... ...language, get intelligent integration suggestions, detect data quality... ...You'll build and iterate on LLM pipelines, RAG systems, and agentic... ...Experience ~5+ years software engineering; 1+ years focused...SeniorLocal area$160k - $165k
...Annually Description: Senior AI Tech Lead Jersey City... ...S3, CloudWatch, prompt engineering, agent orchestration, tool integration, Vector stores,... ...preferred. 10+ years of software engineering experience with... ...-on experience building LLM-based applications, AI...SeniorFull time- ...- Risk Technology - Sap Grc & Security - Senior ConsultantLocation: New York Other locations... ...technologies), including exposure to IAM integrations (e.g., Saviynt, SailPoint, SAP IAG)... ...ServiceNow or HP ALM Awareness of emerging SAP technologies such as BTP, SAC, AI, or RPA...SeniorShift work
- ...the next generation of AI-powered equity... ...Job Description Senior AI Engineer We're looking for a... ...engineers who enjoy turning LLM and agentic AI capabilities... ...AI capabilities get integrated into products used by... ...building, and maintaining software systems Strong...SeniorWork at officeLocal area
- ...join our talented Team. Job Title: AI Senior Security Engineer Location(s): Jersey City, NJ, Tampa... ...programmatic techniques to optimize LLM outputs for reliable security logic... ...traditional signature-based defenses. Integrate large language models from providers...SeniorWork experience placementLocal area
$167.1k - $300.9k
...to demonstrate the shift to AI-forward development processes... ...with peers across Development & Engineering and Architecture teams,... ...either an internal or external software or platform engineering role,... ...falsification of information or lack of integrity at any point in the...SeniorSummer holidayImmediate startFlexible hoursShift work$25k
...Job Description Job Title : Senior Software Engineer Team : Systems... ...platform, data systems, and the AI and automation that scale our... ...participate in scrum and sprints, and integrate the systems our programs... ...scale operations, such as LLM-assisted development or...SeniorFull timeWork at officeImmediate startRemote workVisa sponsorshipWork visaMonday to Friday2 days per week3 days per week- ...and maintain web applications and interfaces, including the integration of AI models, using modern frameworks like Next.js and Prisma.System... ...ensure seamless data flow and functionality.Visualization Engineering: Develop and maintain high-performance dashboards in Tableau...Senior
$136k - $253k
...Build and deploy production AI solutions that help tax and... ...outcomes for their clients. As a Senior Software Engineer, you will combine Python,... ...simpler builds and standard integrations, translating ambiguous needs... ...and deploying AI/ML or LLM-powered applications in production...SeniorFull timeWork at officeLocal areaFlexible hours$110k - $150k
...excited by modern frameworks, tools and engineering practices? Do you want to build scalable... ...and quality assurance professionals• apply software engineering practices including automated... ...advantage• you’re curious to explore how AI can improve how we build, deliver, and optimize...SeniorFull timeFlexible hours- ...Broadridge team. We are looking for a Senior Software Engineer. This is an exciting opportunity to join... ...JavaScript) is a plus.Exposure to the AI/ML techniques & methodologies is a... ...version control (Git) and continuous integration (CI/CD) processes.Strong problem-solving...SeniorFull timeLocal areaImmediate start
- ...together.What’s the role?We are looking for a Senior Software Engineer, Machine Learning to help build and... ...predictive and generative (open source LLM) models.You won't just be deploying... ...00M+ users.Thoughtfully use generative AI and other productivity tools to work effi...SeniorFull timeWork at officeLocal areaRemote workVisa sponsorship
- ...Senior Manager of Software Engineering When you mentor and advise multiple technical teams... ..., building production AI agents on NEO that leverage... ...productionize, and operate LLM-powered agents on NEO (the... ...workflows using A2A, and integrate tools and data through MCP...Senior
$140k - $200k
..., old or new. Our engineering mission is to democratize... ...’re looking for a Senior Platform Engineer... ...role for a strong software generalist with... ...use case.Bring AI into the engineering... ...- from LLM-powered code modification... ...builder with AI. You've integrated LLMs or agent-...SeniorFull timeRemote workWorldwideFlexible hoursShift work$119.3k - $196.6k
...BALMAIN Beauty.DescriptionThe Senior Lead, Finance Platform Engineering provides engineering... ...Financial Close, and Finance integrations. Partner with the... ...OneStream integration, and AI-enabled engineering capabilities... ...operating efficiency, software licensing optimization,...SeniorFull timeLocal area- ...SRI Tech SolutionsRole: Senior Generative AI DeveloperLocation: Irving... ...FastAPI for seamless integration with AI models and data... ...professional experience in software development and system design... ...Experience with LLM fine-tuning, prompt engineering, and model evaluation. Knowledge...SeniorFull time3 days per week
- ...AWS Software Development EngineerAmazon Web Services (AWS) is building... ...of Software Development Engineer (SDE) talent for anticipated roles... .../Machine Learning, Healthcare AI, Infrastructure Services, Firmware... ...of Machine Learning and LLM fundamentals, including transformer...InternshipDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer - AI & LLM Integration. Be the first to apply!
- information technology software engineer Manhattan, NY
- senior software engineer remote Manhattan, NY
- startup software engineer Manhattan, NY
- software developer Manhattan, NY
- cybersecurity software engineer Manhattan, NY
- software engineer Manhattan, NY
- software engineer amazon Manhattan, NY
- intel software engineer Manhattan, NY
- software developer positions Manhattan, NY
- ngo software engineer Manhattan, NY







