Senior Software Engineer - AI & LLM Integration
$75 - $85 per hourIntellibus
Intellibus designs and engineers technology platforms for established FinTech and financial-services firms. We build production-grade systems that help organizations solve complex business problems through software engineering, data, and emerging technologies.
We are looking for engineers who can turn AI capabilities into practical, reliable applications that deliver measurable business value.
The AI Engineer Role
Hands-on Senior AI Engineer with 12+ years of software engineering experience and strong expertise in Core Java, Spring Boot, enterprise backend development, microservices, Microsoft Azure, and Large Language Models (LLMs).
This is a senior engineering position requiring someone who has spent years designing, developing, and deploying complex enterprise applications and has subsequently gained practical experience integrating AI and LLM capabilities into production systems.
The ideal candidate is first and foremost a strong software engineer who understands enterprise application architecture, backend engineering, distributed systems, and cloud-native development, with substantial hands-on experience building AI-powered applications.
You will be responsible for designing and developing enterprise AI solutions, integrating LLMs into existing applications, building intelligent workflows, and delivering production-ready systems within complex financial-services environments.
Key Responsibilities
- Core Java & Enterprise Backend Engineering
- Demonstrate advanced hands-on expertise in Core Java, including OOP, Collections, Streams API, Multithreading, Concurrency, JVM fundamentals, and performance optimization.
- Design, develop, and maintain enterprise-grade backend applications using Java and Spring Boot.
- Build scalable RESTful APIs, microservices, and distributed applications.
- Implement complex business logic, enterprise integrations, asynchronous processing, and event-driven architectures.
- Work with Spring Security, Spring Data, Hibernate, JPA, and related frameworks.
- Apply appropriate design patterns, coding standards, and architectural principles.
- Troubleshoot complex production issues, optimize application performance, and improve system reliability.
2. Microservices & Distributed Systems
- Design and implement enterprise microservices architectures.
- Develop resilient, scalable, and loosely coupled services.
- Work with messaging and event-streaming technologies such as Apache Kafka.
- Implement service-to-service communication, API integrations, and asynchronous workflows.
- Understand distributed transactions, fault tolerance, circuit breakers, and high-availability architectures.
- Work with relational and NoSQL databases and optimize data access patterns.
3. AI & Large Language Model Engineering
- Design, build, and integrate LLM-powered applications into enterprise platforms.
- Work hands-on with commercial and open-source LLMs, including Azure OpenAI and other model providers.
- Develop LLM integrations using APIs, SDKs, and backend services.
- Build AI-powered workflows, intelligent automation, and agentic applications.
- Implement Retrieval-Augmented Generation (RAG) architectures.
- Work with embeddings, vector databases, semantic search, and enterprise knowledge retrieval.
- Develop prompt engineering strategies, structured outputs, function calling, and tool integrations.
- Implement LLM orchestration, context management, conversation memory, and multi-step AI workflows.
- Evaluate model responses for accuracy, relevance, hallucinations, and consistency.
- Implement guardrails, validation, security controls, and responsible AI practices.
- Optimize latency, token consumption, model performance, and inference costs.
- Take AI applications beyond prototypes and deliver reliable, scalable production solutions.
4. Microsoft Azure & Cloud Engineering
- Design and deploy enterprise applications and AI solutions on Microsoft Azure.
- Work with Azure OpenAI Service, Azure AI services, Azure App Services, Azure Functions, and related cloud services.
- Integrate AI services with enterprise applications, APIs, and data platforms.
- Work with Azure cloud architecture, networking, security, identity, and access management.
- Build and manage CI/CD pipelines and automated deployment workflows.
- Apply cloud-native engineering principles, scalability, monitoring, and reliability practices.
5. Python, Data Engineering & Enterprise Platforms
- Develop Python applications, services, and automation supporting AI workflows.
- Work with SQL, relational databases, and structured and unstructured data.
- Build data-processing and integration workflows supporting LLM applications.
- Work with PostgreSQL, Oracle, MySQL, or comparable enterprise databases.
- Experience with Microsoft Fabric, data engineering, and enterprise analytics platforms is preferred.
- Integrate enterprise data sources with AI models and retrieval systems.
6. Engineering Quality & Production Delivery
- Write clean, maintainable, testable, and production-quality code.
- Conduct code reviews and mentor other engineers.
- Develop unit, integration, and automated tests.
- Troubleshoot complex application and infrastructure issues.
- Implement application logging, monitoring, observability, and performance optimization.
- Collaborate with architects, engineering leaders, and business stakeholders to deliver enterprise solutions.
Required Technical Qualifications
- 12+ years of professional software engineering experience.
- Strong recent hands-on development experience in enterprise software engineering.
- Proven experience designing and delivering complex production applications.
- Practical experience building and deploying AI/LLM-powered applications.
Core Java & Backend
- Advanced Core Java and Spring Boot expertise.
- Strong understanding of OOP, Collections, Streams, Multithreading, Concurrency, and JVM.
- Extensive experience with REST APIs, microservices, Spring Framework, Hibernate, and JPA.
- Strong understanding of enterprise application architecture and distributed systems.
AI & LLMs
- Demonstrated hands-on experience integrating LLMs into enterprise applications.
- Experience with Azure OpenAI or comparable LLM platforms.
- Strong understanding of RAG, embeddings, vector databases, prompt engineering, and LLM orchestration.
- Experience building AI agents, tool calling, and intelligent workflows is highly desirable.
- Experience deploying and maintaining AI applications in production is strongly preferred.
Azure & Cloud
- Strong experience with Microsoft Azure and cloud-based application development.
- Experience integrating Azure AI services with enterprise applications.
- Familiarity with cloud security, identity, deployment, and monitoring.
Additional Skills
- Working knowledge of Python.
- Strong SQL and database development experience.
- Exposure to Microsoft Fabric and enterprise data platforms.
- Experience with Kafka, Docker, Kubernetes, and CI/CD pipelines.
What We Are Looking For
We want engineers who:
- Have spent 12+ years building enterprise software applications.
- Are deeply hands-on with Java, Spring Boot, and backend engineering.
- Understand how large-scale enterprise applications are architected and implemented.
- Have moved beyond AI experimentation and have built actual LLM-powered applications.
- Can independently design, code, debug, and deploy complex solutions.
- Understand how to integrate AI capabilities into existing enterprise systems.
- Can take ownership of technical deliverables and work effectively with senior engineering teams.
Important: Candidates whose experience is primarily prompt engineering, Python scripting, AI tool usage, academic research, or AI-generated code without strong enterprise software engineering fundamentals will not be suitable for this position.
Compensation: $75 - $85 / Hour
Our Process
- Initial Screening: 15-minute video call with the Recruiting Team.
- Assessments: One proctored GQ multiple-choice assessment and a SlideWare presentation (under 2 hours).
- Interview Rounds: Three 30-minute video interviews with the Technical Team, Project Lead, and Executive Team.
- Offer: Final decision and job offer.
If this sounds like the kind of work you want to be doing, apply now. Our team will be in touch within the hour.
- ...Visionaryz is looking for a senior, hands-on architect to... ...adopts agentic AI. Your work will cover how... ...-driven, and messaging integration patterns across legacy,... ...Azure and/or AWS AI/LLM or agentic solutions you... ...clearly to executives and engineers alike ⭐ Nice to...Senior
- ...Job Description Job Title : Senior Cloud Solutions Architect – Agentic AI, Integration & Architecture Duration: 12... ...Cloud Solutions Architect / Cloud Engineer/Application Architect with deep... ...AWS. - Experience delivering AI/LLM or agentic solutions in an enterprise...SeniorRemote work
$15 - $45 per hour
...feeds training and evaluation of AI coding and agent products. What... ...you will do Build and review API integrations, webhooks, data mapping and... ...Write prompts and documentation for LLM-powered workflows What you need Professional software experience in Python, Go or JavaScript...SuggestedRemote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours- ...Senior Cloud Solutions Architect AI & Integration Job Title: Senior Cloud Solutions Architect AI & Integration... ...requirements. Collaborate with product, engineering, DevOps, and Cybersecurity teams.... ...experience delivering AI/LLM or agentic solutions. ~ Experience...SeniorContract workRemote work
$170k - $200k
...Software Engineer (Backend / Full Stack) Early-Stage AI Startup | New York City, NY | Onsite Compensation: $170,000–$200,000 Base + Equity Company... ...optimize system performance. Develop AI agents, LLM integrations, and automated workflows. Collaborate with...SeniorFull timeMonday to Friday- ...Senior Software Engineer | AI-First Development New York City – Financial District 4 Days/Week On-Site About eNGINE... ...engineering best practices. AI/ML & Application Integration Integrate AI/ML capabilities and LLM-powered functionality into applications where...SeniorRelocation
$193.3k - $261.5k
Join Amazon's Data Integration organization and help shape the future of AI-driven data integration! We're seeking a talented Senior Software Engineer to join our AI and Platform Excellence (APEX) team. APEX is at the forefront of leveraging AI/ML to revolutionize data...SeniorInternshipFlexible hours- ...Senior Software Engineer – AI | Forward Deployed Engineering Location: Hybrid, with required office attendance... ..., and multi-step workflows that integrate with enterprise platforms and... ...production AI/ML solutions, including LLM-powered applications. ~ Strong Python...SeniorFull timeContract workWork at office
- ...space has always lacked: an integrated care model combining... ...navigation, and purpose-built software. They collaborate... ...The Role We are hiring senior- and staff-level product engineers who want to deploy high-... ...is leveraging applied AI and LLM agents at the architectural...SeniorImmediate startShift work
$200k - $250k
...clinics by providing AI-powered software, payer contracting, and... ...are technical. Every engineer on the team has experience... ..., and ship. Role: Senior Software Engineer We're... ...next you're building an LLM pipeline for clinical... ...on systems where data integrity, money movement, and...SeniorFull timeStart working todayWork at office- ...About the Role We're looking for a Senior Software Engineer (AI Agents) to build the core systems behind... ...’ll design and ship production-grade LLM systems, contribute across the stack,... ...• Hands-on experience building or integrating LLM-powered or agent-based systems...Senior
$138k - $173k
...are looking for a full stack Senior Software Engineer to lead the design,... ...client applications and backend integrations. Lead rigorous code reviews... ...Kotlin/Android) with the help of AI tooling, so you're either... ...coding assistants, agentic IDEs, LLM-based testing or review...SeniorTemporary workLocal areaImmediate startWorldwide- ...Senior Software Development EngineerGibson Dunn is a leading... ...Software Development Engineer designs, architects, builds... ...solutions and integrating cutting-edge capabilities... ...partnership with the firm's AI Platform Engineering... ...Evaluation & Quality: LLM evaluation tooling,...Senior
- ...Full Stack Software Engineer We are looking for a Full Stack Software... ...stage engineering team building AI-powered software for the... ...services within AWS . Develop integrations and automation workflows that... ...tool, the team uses LLM-based development agents as a...SeniorFull time
- ...in-office Level: Senior Experience: 8+ years of professional software engineering experience About the... ...scientists, research-focused AI practitioners, or... ...applications and integrating LLMs into production software... ...applications using LLM APIs, Azure OpenAI,...SeniorFull timeWork at officeRemote work2 days per week
- Senior AI Platform Engineer - LLM Gateway BBVA busca un profesional senior para incorporarse a la implantación de una plataforma corporativa de LLM Gateway. La plataforma proporcionará un acceso común, seguro, gobernado y observable a modelos fundacionales para los distintos...Senior
- H2O.ai is seeking a Senior AI Engineer to build impactful AI solutions for APAC enterprise problems. You will design and deploy end-to-end AI systems, including agentic AI, LLM-powered applications, and production ML pipelines. This hands-on role is embedded in a customer...SeniorRemote job
$225k - $250k
...Overview Susquehanna is hiring a Senior Software Engineer to design and build production-grade AI agents that reduce operational... ...safeguards to mitigate LLM failure modes (hallucination, prompt... ...solutions. Evaluate and integrate emerging models, frameworks, and...SeniorWork experience placement- Senior LLM Engineer remote Software development Referral Bonus $150 Required Skills Machine Learning Artificial Intelligence Job Description Senior LLM... ...focused on designing, building, and deploying Generative AI and LLM-based solutions. The role requires deep technical...SeniorFull timeRemote work
$145k - $275k
...PLTR) builds the data and AI platforms that... ...) and agentic autonomy software that lets users manage... ...threat detection. Build LLM and AI-driven systems that... ...make fast decisions. Integrate with sensors, effectors... ...platforms. Engineer scalable, reliable and...SeniorFull timeVisa sponsorship- ...Job Details: Senior Software Engineer - Build Production-Grade AI Agents New York, NY Own the AI agents that... ...agent behavior Safeguards for LLM failure modes and constraints... ...quants, and traders Evaluation and integration of new AI models and frameworks...Senior
$180k - $250k
...Enterprise Associates (NEA), Andrew Ng’s AI Fund , and Primavera. We live in a... ...accessible to everyone. As a Senior Software Engineer at Kira, you will own core backend systems... ...) ~(Preferred) Experience with integrating LLM-backed services, including API usage,...SeniorFull timeLive inWork at officeLocal areaFlexible hours$155k - $180k
...a highly skilled full stack software engineer to support, manage, and improve the AI-driven software the Integrity Team uses to identify conduct... ....Experience building LLM-based applications (retrieval... ...0-$180,000Job Posting Title:Senior ManagerEmployees currently are...Odd jobFull timeTemporary workLocal areaRemote work1 day per week$120k - $300k
...holders. About Evertune AI: Evertune is building the... ...’ll be joining Evertune’s software engineering team– a tight-knit, high-velocity... ...patterns, optimizing AI integrations, and making architectural decisions... ...third-party APIs, including LLM providers like OpenAI and...SeniorPermanent employmentFull timeWork at officeLocal areaVisa sponsorship2 days per week3 days per week$126k - $248k
...As a Senior Software Engineer on the Database Integration & Observability team, you will drive core initiatives across three key areas: Ecosystem Integrations... ...market. We have redefined the data platform for the AI era, enabling builders to create, transform, and disrupt...SeniorFull timeLocal areaRemote workWorldwideFlexible hours$145k - $165k
...broadest portfolio of technology and integrated partnerships, as well as our private network... ...career. We are seeking a Senior Software Engineer – Integration to join a new Bruin... ...integration experience. You will use AI-assisted engineering tools as a core part...SeniorContract work$156.36k - $279.96k
...meet you. WHAT YOU'LL DO We're looking for a Senior Software Engineer II to join the Decisioning Studio Integrations team building BrazeAI Decisioning Studio™.... ...GCP preferred) and Kubernetes ~ Experience with AI coding assistants, and the judgment to know when...SeniorWork at officeLocal areaFlexible hours- ...are looking for a highly experienced Senior Backend AI Engineer – Agentic AI to design, develop, and... ...Distributed Systems. Agentic AI & LLM: LangGraph, LangChain, Multi-Agent... ...Retrieval-Augmented Generation, LLM Integration, Model Gateways, Inference, Evaluation...SeniorFull time
$4,500 - $6,000 per month
...in Georgia Team: Engineering (London + Kraków,... ...scheduling, payouts, and integrations with Airbnb,... ...We are a small, senior engineering team, and we build with AI as a core part of... ...problems into shipped software Mentor through... ...agentic workflows or LLM features into a...SeniorFor contractorsRemote work$130k - $175k
...interest in Uncountable Engineering! Description... ...of our platform into an AI-first R&D ecosystem. We... ...Generative AI. As an LLM Applications Engineer,... ...experimental datasets. Integration: Connect LLM capabilities... ...Requirements ~2+ years of software development experience...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer - AI & LLM Integration. Be the first to apply!
- software engineer internship remote New York, NY
- software engineer remote New York, NY
- graduate software developer no experience New York, NY
- work from home software developer New York, NY
- summer intern software engineer New York, NY
- junior software developer New York, NY
- information technology software engineer New York, NY
- senior software engineer remote New York, NY
- rust software engineer New York, NY
- part time software developer New York, NY






